././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.6973155 kiwi-11.1.8/.bumpversion.cfg0000644000000000000000000000025615273675667012636 0ustar00[bumpversion] current_version = 11.1.8 commit = True tag = True [bumpversion:file:pyproject.toml] [bumpversion:file:kiwi/version.py] [bumpversion:file:doc/source/conf.py] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.6988065 kiwi-11.1.8/LICENSE0000644000000000000000000010451315273675667010534 0ustar00 GNU GENERAL PUBLIC LICENSE Version 3, 29 June 2007 Copyright (C) 2007 Free Software Foundation, Inc. Everyone is permitted to copy and distribute verbatim copies of this license document, but changing it is not allowed. Preamble The GNU General Public License is a free, copyleft license for software and other kinds of works. The licenses for most software and other practical works are designed to take away your freedom to share and change the works. By contrast, the GNU General Public License is intended to guarantee your freedom to share and change all versions of a program--to make sure it remains free software for all its users. We, the Free Software Foundation, use the GNU General Public License for most of our software; it applies also to any other work released this way by its authors. You can apply it to your programs, too. When we speak of free software, we are referring to freedom, not price. Our General Public Licenses are designed to make sure that you have the freedom to distribute copies of free software (and charge for them if you wish), that you receive source code or can get it if you want it, that you can change the software or use pieces of it in new free programs, and that you know you can do these things. To protect your rights, we need to prevent others from denying you these rights or asking you to surrender the rights. Therefore, you have certain responsibilities if you distribute copies of the software, or if you modify it: responsibilities to respect the freedom of others. For example, if you distribute copies of such a program, whether gratis or for a fee, you must pass on to the recipients the same freedoms that you received. You must make sure that they, too, receive or can get the source code. And you must show them these terms so they know their rights. Developers that use the GNU GPL protect your rights with two steps: (1) assert copyright on the software, and (2) offer you this License giving you legal permission to copy, distribute and/or modify it. For the developers' and authors' protection, the GPL clearly explains that there is no warranty for this free software. For both users' and authors' sake, the GPL requires that modified versions be marked as changed, so that their problems will not be attributed erroneously to authors of previous versions. Some devices are designed to deny users access to install or run modified versions of the software inside them, although the manufacturer can do so. This is fundamentally incompatible with the aim of protecting users' freedom to change the software. The systematic pattern of such abuse occurs in the area of products for individuals to use, which is precisely where it is most unacceptable. Therefore, we have designed this version of the GPL to prohibit the practice for those products. If such problems arise substantially in other domains, we stand ready to extend this provision to those domains in future versions of the GPL, as needed to protect the freedom of users. Finally, every program is threatened constantly by software patents. States should not allow patents to restrict development and use of software on general-purpose computers, but in those that do, we wish to avoid the special danger that patents applied to a free program could make it effectively proprietary. To prevent this, the GPL assures that patents cannot be used to render the program non-free. The precise terms and conditions for copying, distribution and modification follow. TERMS AND CONDITIONS 0. Definitions. "This License" refers to version 3 of the GNU General Public License. "Copyright" also means copyright-like laws that apply to other kinds of works, such as semiconductor masks. "The Program" refers to any copyrightable work licensed under this License. Each licensee is addressed as "you". "Licensees" and "recipients" may be individuals or organizations. To "modify" a work means to copy from or adapt all or part of the work in a fashion requiring copyright permission, other than the making of an exact copy. The resulting work is called a "modified version" of the earlier work or a work "based on" the earlier work. A "covered work" means either the unmodified Program or a work based on the Program. To "propagate" a work means to do anything with it that, without permission, would make you directly or secondarily liable for infringement under applicable copyright law, except executing it on a computer or modifying a private copy. Propagation includes copying, distribution (with or without modification), making available to the public, and in some countries other activities as well. To "convey" a work means any kind of propagation that enables other parties to make or receive copies. Mere interaction with a user through a computer network, with no transfer of a copy, is not conveying. An interactive user interface displays "Appropriate Legal Notices" to the extent that it includes a convenient and prominently visible feature that (1) displays an appropriate copyright notice, and (2) tells the user that there is no warranty for the work (except to the extent that warranties are provided), that licensees may convey the work under this License, and how to view a copy of this License. If the interface presents a list of user commands or options, such as a menu, a prominent item in the list meets this criterion. 1. Source Code. The "source code" for a work means the preferred form of the work for making modifications to it. "Object code" means any non-source form of a work. A "Standard Interface" means an interface that either is an official standard defined by a recognized standards body, or, in the case of interfaces specified for a particular programming language, one that is widely used among developers working in that language. The "System Libraries" of an executable work include anything, other than the work as a whole, that (a) is included in the normal form of packaging a Major Component, but which is not part of that Major Component, and (b) serves only to enable use of the work with that Major Component, or to implement a Standard Interface for which an implementation is available to the public in source code form. A "Major Component", in this context, means a major essential component (kernel, window system, and so on) of the specific operating system (if any) on which the executable work runs, or a compiler used to produce the work, or an object code interpreter used to run it. The "Corresponding Source" for a work in object code form means all the source code needed to generate, install, and (for an executable work) run the object code and to modify the work, including scripts to control those activities. However, it does not include the work's System Libraries, or general-purpose tools or generally available free programs which are used unmodified in performing those activities but which are not part of the work. For example, Corresponding Source includes interface definition files associated with source files for the work, and the source code for shared libraries and dynamically linked subprograms that the work is specifically designed to require, such as by intimate data communication or control flow between those subprograms and other parts of the work. The Corresponding Source need not include anything that users can regenerate automatically from other parts of the Corresponding Source. The Corresponding Source for a work in source code form is that same work. 2. Basic Permissions. All rights granted under this License are granted for the term of copyright on the Program, and are irrevocable provided the stated conditions are met. This License explicitly affirms your unlimited permission to run the unmodified Program. The output from running a covered work is covered by this License only if the output, given its content, constitutes a covered work. This License acknowledges your rights of fair use or other equivalent, as provided by copyright law. You may make, run and propagate covered works that you do not convey, without conditions so long as your license otherwise remains in force. You may convey covered works to others for the sole purpose of having them make modifications exclusively for you, or provide you with facilities for running those works, provided that you comply with the terms of this License in conveying all material for which you do not control copyright. Those thus making or running the covered works for you must do so exclusively on your behalf, under your direction and control, on terms that prohibit them from making any copies of your copyrighted material outside their relationship with you. Conveying under any other circumstances is permitted solely under the conditions stated below. Sublicensing is not allowed; section 10 makes it unnecessary. 3. Protecting Users' Legal Rights From Anti-Circumvention Law. No covered work shall be deemed part of an effective technological measure under any applicable law fulfilling obligations under article 11 of the WIPO copyright treaty adopted on 20 December 1996, or similar laws prohibiting or restricting circumvention of such measures. When you convey a covered work, you waive any legal power to forbid circumvention of technological measures to the extent such circumvention is effected by exercising rights under this License with respect to the covered work, and you disclaim any intention to limit operation or modification of the work as a means of enforcing, against the work's users, your or third parties' legal rights to forbid circumvention of technological measures. 4. Conveying Verbatim Copies. You may convey verbatim copies of the Program's source code as you receive it, in any medium, provided that you conspicuously and appropriately publish on each copy an appropriate copyright notice; keep intact all notices stating that this License and any non-permissive terms added in accord with section 7 apply to the code; keep intact all notices of the absence of any warranty; and give all recipients a copy of this License along with the Program. You may charge any price or no price for each copy that you convey, and you may offer support or warranty protection for a fee. 5. Conveying Modified Source Versions. You may convey a work based on the Program, or the modifications to produce it from the Program, in the form of source code under the terms of section 4, provided that you also meet all of these conditions: a) The work must carry prominent notices stating that you modified it, and giving a relevant date. b) The work must carry prominent notices stating that it is released under this License and any conditions added under section 7. This requirement modifies the requirement in section 4 to "keep intact all notices". c) You must license the entire work, as a whole, under this License to anyone who comes into possession of a copy. This License will therefore apply, along with any applicable section 7 additional terms, to the whole of the work, and all its parts, regardless of how they are packaged. This License gives no permission to license the work in any other way, but it does not invalidate such permission if you have separately received it. d) If the work has interactive user interfaces, each must display Appropriate Legal Notices; however, if the Program has interactive interfaces that do not display Appropriate Legal Notices, your work need not make them do so. A compilation of a covered work with other separate and independent works, which are not by their nature extensions of the covered work, and which are not combined with it such as to form a larger program, in or on a volume of a storage or distribution medium, is called an "aggregate" if the compilation and its resulting copyright are not used to limit the access or legal rights of the compilation's users beyond what the individual works permit. Inclusion of a covered work in an aggregate does not cause this License to apply to the other parts of the aggregate. 6. Conveying Non-Source Forms. You may convey a covered work in object code form under the terms of sections 4 and 5, provided that you also convey the machine-readable Corresponding Source under the terms of this License, in one of these ways: a) Convey the object code in, or embodied in, a physical product (including a physical distribution medium), accompanied by the Corresponding Source fixed on a durable physical medium customarily used for software interchange. b) Convey the object code in, or embodied in, a physical product (including a physical distribution medium), accompanied by a written offer, valid for at least three years and valid for as long as you offer spare parts or customer support for that product model, to give anyone who possesses the object code either (1) a copy of the Corresponding Source for all the software in the product that is covered by this License, on a durable physical medium customarily used for software interchange, for a price no more than your reasonable cost of physically performing this conveying of source, or (2) access to copy the Corresponding Source from a network server at no charge. c) Convey individual copies of the object code with a copy of the written offer to provide the Corresponding Source. This alternative is allowed only occasionally and noncommercially, and only if you received the object code with such an offer, in accord with subsection 6b. d) Convey the object code by offering access from a designated place (gratis or for a charge), and offer equivalent access to the Corresponding Source in the same way through the same place at no further charge. You need not require recipients to copy the Corresponding Source along with the object code. If the place to copy the object code is a network server, the Corresponding Source may be on a different server (operated by you or a third party) that supports equivalent copying facilities, provided you maintain clear directions next to the object code saying where to find the Corresponding Source. Regardless of what server hosts the Corresponding Source, you remain obligated to ensure that it is available for as long as needed to satisfy these requirements. e) Convey the object code using peer-to-peer transmission, provided you inform other peers where the object code and Corresponding Source of the work are being offered to the general public at no charge under subsection 6d. A separable portion of the object code, whose source code is excluded from the Corresponding Source as a System Library, need not be included in conveying the object code work. A "User Product" is either (1) a "consumer product", which means any tangible personal property which is normally used for personal, family, or household purposes, or (2) anything designed or sold for incorporation into a dwelling. In determining whether a product is a consumer product, doubtful cases shall be resolved in favor of coverage. For a particular product received by a particular user, "normally used" refers to a typical or common use of that class of product, regardless of the status of the particular user or of the way in which the particular user actually uses, or expects or is expected to use, the product. A product is a consumer product regardless of whether the product has substantial commercial, industrial or non-consumer uses, unless such uses represent the only significant mode of use of the product. "Installation Information" for a User Product means any methods, procedures, authorization keys, or other information required to install and execute modified versions of a covered work in that User Product from a modified version of its Corresponding Source. The information must suffice to ensure that the continued functioning of the modified object code is in no case prevented or interfered with solely because modification has been made. If you convey an object code work under this section in, or with, or specifically for use in, a User Product, and the conveying occurs as part of a transaction in which the right of possession and use of the User Product is transferred to the recipient in perpetuity or for a fixed term (regardless of how the transaction is characterized), the Corresponding Source conveyed under this section must be accompanied by the Installation Information. But this requirement does not apply if neither you nor any third party retains the ability to install modified object code on the User Product (for example, the work has been installed in ROM). The requirement to provide Installation Information does not include a requirement to continue to provide support service, warranty, or updates for a work that has been modified or installed by the recipient, or for the User Product in which it has been modified or installed. Access to a network may be denied when the modification itself materially and adversely affects the operation of the network or violates the rules and protocols for communication across the network. Corresponding Source conveyed, and Installation Information provided, in accord with this section must be in a format that is publicly documented (and with an implementation available to the public in source code form), and must require no special password or key for unpacking, reading or copying. 7. Additional Terms. "Additional permissions" are terms that supplement the terms of this License by making exceptions from one or more of its conditions. Additional permissions that are applicable to the entire Program shall be treated as though they were included in this License, to the extent that they are valid under applicable law. If additional permissions apply only to part of the Program, that part may be used separately under those permissions, but the entire Program remains governed by this License without regard to the additional permissions. When you convey a copy of a covered work, you may at your option remove any additional permissions from that copy, or from any part of it. (Additional permissions may be written to require their own removal in certain cases when you modify the work.) You may place additional permissions on material, added by you to a covered work, for which you have or can give appropriate copyright permission. Notwithstanding any other provision of this License, for material you add to a covered work, you may (if authorized by the copyright holders of that material) supplement the terms of this License with terms: a) Disclaiming warranty or limiting liability differently from the terms of sections 15 and 16 of this License; or b) Requiring preservation of specified reasonable legal notices or author attributions in that material or in the Appropriate Legal Notices displayed by works containing it; or c) Prohibiting misrepresentation of the origin of that material, or requiring that modified versions of such material be marked in reasonable ways as different from the original version; or d) Limiting the use for publicity purposes of names of licensors or authors of the material; or e) Declining to grant rights under trademark law for use of some trade names, trademarks, or service marks; or f) Requiring indemnification of licensors and authors of that material by anyone who conveys the material (or modified versions of it) with contractual assumptions of liability to the recipient, for any liability that these contractual assumptions directly impose on those licensors and authors. All other non-permissive additional terms are considered "further restrictions" within the meaning of section 10. If the Program as you received it, or any part of it, contains a notice stating that it is governed by this License along with a term that is a further restriction, you may remove that term. If a license document contains a further restriction but permits relicensing or conveying under this License, you may add to a covered work material governed by the terms of that license document, provided that the further restriction does not survive such relicensing or conveying. If you add terms to a covered work in accord with this section, you must place, in the relevant source files, a statement of the additional terms that apply to those files, or a notice indicating where to find the applicable terms. Additional terms, permissive or non-permissive, may be stated in the form of a separately written license, or stated as exceptions; the above requirements apply either way. 8. Termination. You may not propagate or modify a covered work except as expressly provided under this License. Any attempt otherwise to propagate or modify it is void, and will automatically terminate your rights under this License (including any patent licenses granted under the third paragraph of section 11). However, if you cease all violation of this License, then your license from a particular copyright holder is reinstated (a) provisionally, unless and until the copyright holder explicitly and finally terminates your license, and (b) permanently, if the copyright holder fails to notify you of the violation by some reasonable means prior to 60 days after the cessation. Moreover, your license from a particular copyright holder is reinstated permanently if the copyright holder notifies you of the violation by some reasonable means, this is the first time you have received notice of violation of this License (for any work) from that copyright holder, and you cure the violation prior to 30 days after your receipt of the notice. Termination of your rights under this section does not terminate the licenses of parties who have received copies or rights from you under this License. If your rights have been terminated and not permanently reinstated, you do not qualify to receive new licenses for the same material under section 10. 9. Acceptance Not Required for Having Copies. You are not required to accept this License in order to receive or run a copy of the Program. Ancillary propagation of a covered work occurring solely as a consequence of using peer-to-peer transmission to receive a copy likewise does not require acceptance. However, nothing other than this License grants you permission to propagate or modify any covered work. These actions infringe copyright if you do not accept this License. Therefore, by modifying or propagating a covered work, you indicate your acceptance of this License to do so. 10. Automatic Licensing of Downstream Recipients. Each time you convey a covered work, the recipient automatically receives a license from the original licensors, to run, modify and propagate that work, subject to this License. You are not responsible for enforcing compliance by third parties with this License. An "entity transaction" is a transaction transferring control of an organization, or substantially all assets of one, or subdividing an organization, or merging organizations. If propagation of a covered work results from an entity transaction, each party to that transaction who receives a copy of the work also receives whatever licenses to the work the party's predecessor in interest had or could give under the previous paragraph, plus a right to possession of the Corresponding Source of the work from the predecessor in interest, if the predecessor has it or can get it with reasonable efforts. You may not impose any further restrictions on the exercise of the rights granted or affirmed under this License. For example, you may not impose a license fee, royalty, or other charge for exercise of rights granted under this License, and you may not initiate litigation (including a cross-claim or counterclaim in a lawsuit) alleging that any patent claim is infringed by making, using, selling, offering for sale, or importing the Program or any portion of it. 11. Patents. A "contributor" is a copyright holder who authorizes use under this License of the Program or a work on which the Program is based. The work thus licensed is called the contributor's "contributor version". A contributor's "essential patent claims" are all patent claims owned or controlled by the contributor, whether already acquired or hereafter acquired, that would be infringed by some manner, permitted by this License, of making, using, or selling its contributor version, but do not include claims that would be infringed only as a consequence of further modification of the contributor version. For purposes of this definition, "control" includes the right to grant patent sublicenses in a manner consistent with the requirements of this License. Each contributor grants you a non-exclusive, worldwide, royalty-free patent license under the contributor's essential patent claims, to make, use, sell, offer for sale, import and otherwise run, modify and propagate the contents of its contributor version. In the following three paragraphs, a "patent license" is any express agreement or commitment, however denominated, not to enforce a patent (such as an express permission to practice a patent or covenant not to sue for patent infringement). To "grant" such a patent license to a party means to make such an agreement or commitment not to enforce a patent against the party. If you convey a covered work, knowingly relying on a patent license, and the Corresponding Source of the work is not available for anyone to copy, free of charge and under the terms of this License, through a publicly available network server or other readily accessible means, then you must either (1) cause the Corresponding Source to be so available, or (2) arrange to deprive yourself of the benefit of the patent license for this particular work, or (3) arrange, in a manner consistent with the requirements of this License, to extend the patent license to downstream recipients. "Knowingly relying" means you have actual knowledge that, but for the patent license, your conveying the covered work in a country, or your recipient's use of the covered work in a country, would infringe one or more identifiable patents in that country that you have reason to believe are valid. If, pursuant to or in connection with a single transaction or arrangement, you convey, or propagate by procuring conveyance of, a covered work, and grant a patent license to some of the parties receiving the covered work authorizing them to use, propagate, modify or convey a specific copy of the covered work, then the patent license you grant is automatically extended to all recipients of the covered work and works based on it. A patent license is "discriminatory" if it does not include within the scope of its coverage, prohibits the exercise of, or is conditioned on the non-exercise of one or more of the rights that are specifically granted under this License. You may not convey a covered work if you are a party to an arrangement with a third party that is in the business of distributing software, under which you make payment to the third party based on the extent of your activity of conveying the work, and under which the third party grants, to any of the parties who would receive the covered work from you, a discriminatory patent license (a) in connection with copies of the covered work conveyed by you (or copies made from those copies), or (b) primarily for and in connection with specific products or compilations that contain the covered work, unless you entered into that arrangement, or that patent license was granted, prior to 28 March 2007. Nothing in this License shall be construed as excluding or limiting any implied license or other defenses to infringement that may otherwise be available to you under applicable patent law. 12. No Surrender of Others' Freedom. If conditions are imposed on you (whether by court order, agreement or otherwise) that contradict the conditions of this License, they do not excuse you from the conditions of this License. If you cannot convey a covered work so as to satisfy simultaneously your obligations under this License and any other pertinent obligations, then as a consequence you may not convey it at all. For example, if you agree to terms that obligate you to collect a royalty for further conveying from those to whom you convey the Program, the only way you could satisfy both those terms and this License would be to refrain entirely from conveying the Program. 13. Use with the GNU Affero General Public License. Notwithstanding any other provision of this License, you have permission to link or combine any covered work with a work licensed under version 3 of the GNU Affero General Public License into a single combined work, and to convey the resulting work. The terms of this License will continue to apply to the part which is the covered work, but the special requirements of the GNU Affero General Public License, section 13, concerning interaction through a network will apply to the combination as such. 14. Revised Versions of this License. The Free Software Foundation may publish revised and/or new versions of the GNU General Public License from time to time. Such new versions will be similar in spirit to the present version, but may differ in detail to address new problems or concerns. Each version is given a distinguishing version number. If the Program specifies that a certain numbered version of the GNU General Public License "or any later version" applies to it, you have the option of following the terms and conditions either of that numbered version or of any later version published by the Free Software Foundation. If the Program does not specify a version number of the GNU General Public License, you may choose any version ever published by the Free Software Foundation. If the Program specifies that a proxy can decide which future versions of the GNU General Public License can be used, that proxy's public statement of acceptance of a version permanently authorizes you to choose that version for the Program. Later license versions may give you additional or different permissions. However, no additional obligations are imposed on any author or copyright holder as a result of your choosing to follow a later version. 15. Disclaimer of Warranty. THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR OR CORRECTION. 16. Limitation of Liability. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. 17. Interpretation of Sections 15 and 16. If the disclaimer of warranty and limitation of liability provided above cannot be given local legal effect according to their terms, reviewing courts shall apply local law that most closely approximates an absolute waiver of all civil liability in connection with the Program, unless a warranty or assumption of liability accompanies a copy of the Program in return for a fee. END OF TERMS AND CONDITIONS How to Apply These Terms to Your New Programs If you develop a new program, and you want it to be of the greatest possible use to the public, the best way to achieve this is to make it free software which everyone can redistribute and change under these terms. To do so, attach the following notices to the program. It is safest to attach them to the start of each source file to most effectively state the exclusion of warranty; and each file should have at least the "copyright" line and a pointer to where the full notice is found. Copyright (C) This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program. If not, see . Also add information on how to contact you by electronic and paper mail. If the program does terminal interaction, make it output a short notice like this when it starts in an interactive mode: Copyright (C) This program comes with ABSOLUTELY NO WARRANTY; for details type `show w'. This is free software, and you are welcome to redistribute it under certain conditions; type `show c' for details. The hypothetical commands `show w' and `show c' should show the appropriate parts of the General Public License. Of course, your program's commands might be different; for a GUI interface, you would use an "about box". You should also get your employer (if you work as a programmer) or school, if any, to sign a "copyright disclaimer" for the program, if necessary. For more information on this, and how to apply and follow the GNU GPL, see . The GNU General Public License does not permit incorporating your program into proprietary programs. If your program is a subroutine library, you may consider it more useful to permit linking proprietary applications with the library. If this is what you want to do, use the GNU Lesser General Public License instead of this License. But first, please read . ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.6988065 kiwi-11.1.8/Makefile0000644000000000000000000001370115273675667011165 0ustar00buildroot = / docdir = /usr/share/doc/packages python_version = 3 python_lookup_name = python$(python_version) python = $(shell which $(python_lookup_name)) sc_disable = SC1091,SC1090,SC2001,SC2174,SC1117,SC2048,SC2004,SC2317,SC2329 LC = LC_MESSAGES version := $(shell \ $(python) -c \ 'from kiwi.version import __version__; print(__version__)'\ ) install_dracut: for dracut in dracut/modules.d/*; do \ ${MAKE} -C $$dracut install ;\ done install_package_docs: install -d -m 755 ${buildroot}${docdir}/python-kiwi install -m 644 LICENSE \ ${buildroot}${docdir}/python-kiwi/LICENSE install -m 644 README.rst \ ${buildroot}${docdir}/python-kiwi/README install: # apart from python sources there are also # the manual pages and the completion # Note: These information will be missing when installed from pip # manual pages install -d -m 755 ${buildroot}usr/share/man/man8 for man in doc/build/man/*.8; do \ install -m 644 $$man ${buildroot}usr/share/man/man8 ;\ done # completion install -d -m 755 ${buildroot}usr/share/bash-completion/completions install -m 644 completions/bash-completion \ ${buildroot}usr/share/bash-completion/completions/kiwi-ng # kiwi default configuration install -d -m 755 ${buildroot}usr/share/kiwi install -d -m 755 ${buildroot}usr/share/kiwi/kiwi.yml.d install -d -m 755 ${buildroot}etc/kiwi.yml.d install -m 644 kiwi.yml ${buildroot}usr/share/kiwi/kiwi.yml.example # kiwi old XSL stylesheets for upgrade cp -a helper/xsl_to_v74 ${buildroot}usr/share/kiwi/ kiwi/schema/kiwi.rng: kiwi/schema/kiwi.rnc # whenever the schema is changed this target will convert # the short form of the RelaxNG schema to the format used # in code and auto generates the python data structures @type -p trang &>/dev/null || \ (echo "ERROR: trang not found in path: $(PATH)"; exit 1) trang -I rnc -O rng kiwi/schema/kiwi.rnc kiwi/schema/kiwi.rng # XML parser code is auto generated from schema using generateDS # http://pythonhosted.org/generateDS # --- # a) modify arch-name xsd:token pattern to be generic because # generateDS translates the regular expression into another # expression which is different and wrong compared to the # expression in the schema cat kiwi/schema/kiwi.rnc | sed -e \ s'@arch-name = xsd:token.*@arch-name = xsd:token {pattern = ".*"}@' >\ kiwi/schema/kiwi_modified_for_generateDS.rnc # convert schema rnc format into xsd format and call generateDS trang -I rnc -O xsd kiwi/schema/kiwi_modified_for_generateDS.rnc \ kiwi/schema/kiwi_for_generateDS.xsd generateDS.py -f --external-encoding='utf-8' --no-dates --no-warnings \ -o kiwi/xml_parse.py kiwi/schema/kiwi_for_generateDS.xsd rm kiwi/schema/kiwi_for_generateDS.xsd rm kiwi/schema/kiwi_modified_for_generateDS.rnc obs_test_status: ./.obs_test_status valid: for i in `find build-tests test kiwi -name *.xml -o -name *.kiwi`; do \ if [ ! -L $$i ];then \ xsltproc -o $$i.converted kiwi/xsl/master.xsl $$i && \ mv $$i.converted $$i ;\ fi \ done setup: poetry install --all-extras docs: setup poetry run make -C doc man html ghpages: setup poetry run sphinx-build doc/source doc/build docs_suse: setup sed -ie "s@:hidden:@@" doc/source/index.rst rm -f doc/source/index.rste poetry run make -C doc xml_suse git checkout doc/source/index.rst rm -rf doc/build/restxml mv doc/build/xml doc/build/restxml poetry run pip uninstall --yes rstxml2docbook || true poetry run pip install \ git+https://github.com/openSUSE/rstxml2docbook.git@feature/kiwi poetry run bash -c 'pushd doc && rstxml2docbook \ -v --no-split -o build/xml/book.xml build/restxml/index.xml' bash -c 'mkdir -p doc/build/images/src/png && \ cp -a doc/source/.images/* doc/build/images/src/png' cp doc/DC-kiwi doc/build/ bash -c 'pushd doc/build && daps -d DC-kiwi html' test_scripts: setup poetry run bash -c 'pushd test/scripts && sudo pytest -s -vv' check: setup # shell code checks find build-tests -name config.sh | xargs shellcheck bash -c 'shellcheck -e ${sc_disable} dracut/modules.d/*/*.sh -s bash' bash -c 'shellcheck -e ${sc_disable} kiwi/config/functions.sh -s bash' bash -c 'shellcheck -e ${sc_disable} boxes/*/*.sh -s bash' bash -c 'shellcheck -e ${sc_disable} boxes/images.sh -s bash' bash -c 'shellcheck build-tests.sh' # python flake tests poetry run flake8 --statistics -j auto --count kiwi poetry run flake8 --statistics -j auto --count test/unit poetry run flake8 --statistics -j auto --count test/scripts test: setup # python static code checks poetry run mypy kiwi # unit tests poetry run bash -c 'pushd test/unit && pytest -n auto \ --doctest-modules --no-cov-on-fail --cov=kiwi \ --cov-report=term-missing --cov-fail-under=100 \ --cov-config .coveragerc' black: setup poetry run black \ --skip-string-normalization \ --line-length 80 kiwi test/unit/ build: clean check test # build the sdist source tarball poetry build --format=sdist # provide rpm source tarball mv dist/kiwi-${version}.tar.gz dist/python-kiwi.tar.gz # update rpm changelog using reference file helper/update_changelog.py --since package/python-kiwi.changes --fix > \ dist/python-kiwi.changes helper/update_changelog.py --file package/python-kiwi.changes >> \ dist/python-kiwi.changes # update package version in spec file cat package/python-kiwi-spec-template | sed -e s'@%%VERSION@${version}@' \ > dist/python-kiwi.spec # update package version in PKGBUILD file md5sums=$$(md5sum dist/python-kiwi.tar.gz | cut -d" " -f1); \ cat package/python-kiwi-pkgbuild-template | sed \ -e s'@%%VERSION@${version}@' \ -e s"@%%MD5SUM@$${md5sums}@" > dist/PKGBUILD # provide rpm rpmlintrc cp package/python-kiwi-rpmlintrc dist # provide additional source files cp package/systemd-tmpfiles-for-suse.conf dist prepare_for_pypi: clean setup # documentation render and tests poetry run make -C doc man # sdist tarball, the actual publishing happens via the # ci-publish-to-pypi.yml github action poetry build --format=sdist clean: rm -rf dist rm -rf doc/build rm -rf doc/dist ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.6988065 kiwi-11.1.8/README.rst0000644000000000000000000000442415273675667011216 0ustar00KIWI - Next Generation ====================== .. |GitHub Action Code Style| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-code-style.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |GitHub Action Config Functions| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-config-functions.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |GitHub Action Documentation| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-documentation.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |GitHub Action Publish Pages| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-publish-pages.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |GitHub Action Publish PyPi| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-publish-to-pypi.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |GitHub Action Unit Types| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-units-types.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |Health| image:: https://app.codacy.com/project/badge/Grade/228f7e8cd15d448688a590c272ec3789 :target: https://www.codacy.com/gh/OSInside/kiwi/dashboard?utm_source=github.com&utm_medium=referral&utm_content=OSInside/kiwi&utm_campaign=Badge_Grade .. |Doc| replace:: `Documentation `__ .. |Installation| replace:: `Installation `__ .. |Contributing| replace:: `Contributing `__ .. |IntegrationTesting| replace:: `Integration Testing `__ .. |Donate| image:: https://www.paypalobjects.com/en_US/i/btn/btn_donateCC_LG.gif :target: https://www.paypal.com/donate/?hosted_button_id=CYZY57A7Q4TCC |GitHub Action Code Style| |GitHub Action Config Functions| |GitHub Action Documentation| |GitHub Action Publish Pages| |GitHub Action Publish PyPi| |GitHub Action Unit Types| |Health| **KIWI, the OS image and appliance builder.** * |Installation| * |IntegrationTesting| * |Contributing| * |Doc| KIWI has helped you in your work ? Even the smallest gift is a way to help that we don't run out of coffee :) |Donate| ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7051604 kiwi-11.1.8/build-tests.sh0000755000000000000000000001054415273675667012325 0ustar00#!/bin/bash # git clone https://github.com/OSInside/kiwi.git # Simple build test script to build the integration test # images from a given test directory. The host to run this # command requires the following tools: # # - tree # - git # - xmllint # - podman # - pip # # And requires the installation of kiwi which provides # the boxbuild command # # $ pip install --upgrade kiwi # set -e ARGUMENT_LIST=( "test-dir:" "test-name:" "box-name:" "vm" ) function usage() { echo "usage: build-tests --test-dir " echo " --test-dir " echo " Some test dir name, e.g. build-tests/x86/tumbleweed/" echo " --test-name " echo " some test name, e.g. test-image-disk" echo " --box-name " echo " name of the box to use for the build, default: universal" echo " --vm" echo " build in a virtual machine instead of a container" } if ! opts=$(getopt \ --longoptions "$(printf "%s," "${ARGUMENT_LIST[@]}")" \ --name "$(basename "$0")" \ --options "" \ -- "$@" ); then usage exit 0 fi eval set --"${opts}" while [[ $# -gt 0 ]]; do case "$1" in --test-dir) argTestDir=$2 shift 2 ;; --test-name) argTestName=$2 shift 2 ;; --box-name) argBoxName=$2 shift 2 ;; --vm) argVM=1 shift ;; *) break ;; esac done if [ ! "${argTestDir}" ];then usage exit 1 fi if [ ! -e "${argTestDir}"/.repos ];then echo "No .repos information for specified test dir" exit 1 fi boxname=universal if [ "${argBoxName}" ];then boxname="${argBoxName}" fi function create_repo_list() { local build_dir=$1 if [ -s "${build_dir}"/.repos ];then local repo_options="--ignore-repos" while read -r repo;do repo_options="${repo_options} --add-repo ${repo}" done < "${build_dir}"/.repos echo "${repo_options}" fi } function create_build_commands() { local build_dir=$1 local test_name=$2 build_commands=() for image in "${build_dir}"/*;do test -e "${image}/appliance.kiwi" || continue test -e "${image}/.skip_boxbuild_container" && continue base_image=$(basename "${image}") if [ -n "${test_name}" ] && [ ! "${test_name}" = "${base_image}" ];then continue fi build_command="kiwi-ng --debug" has_profiles=false repo_options=$(create_repo_list "${build_dir}") box_options="system boxbuild --box ${boxname}" if [ ! "${argVM}" = 1 ];then box_options="${box_options} --container" fi for profile in $( xmllint --xpath "//image/profiles/profile/@name" \ "${image}/appliance.kiwi" 2>/dev/null | cut -f2 -d\" );do has_profiles=true target_dir="build_results/${base_image}/${profile}" build_command="${build_command} --profile ${profile}" build_command="${build_command} ${box_options} kiwi" build_command="${build_command} --description $image" build_command="${build_command} ${repo_options}" build_command="${build_command} --target-dir ${target_dir}" echo "${build_command}" \ > "build_results/${base_image}-${profile}.build" build_commands+=( "${build_command}" ) build_command="kiwi-ng --debug" done if [ "${has_profiles}" = "false" ];then target_dir="build_results/${base_image}" build_command="${build_command} ${box_options} kiwi" build_command="${build_command} --description $image" build_command="${build_command} ${repo_options}" build_command="${build_command} --target-dir ${target_dir}" echo "${build_command}" \ > "build_results/${base_image}.build" build_commands+=( "${build_command}" ) fi done } # create results directory mkdir -p build_results # build command list create_build_commands "${argTestDir}" "${argTestName}" # build them in a row for build in "${build_commands[@]}";do ${build} sudo rm -rf build_results/*/*/build/ sudo rm -rf build_results/*/build/ done # show result tree test -d build_results && tree -L 3 build_results ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7331226 kiwi-11.1.8/completions/bash-completion0000644000000000000000000000051315273675667015065 0ustar00# NOTE: this file was generated from kiwi-ng --show-completion _kiwi_ng_completion() { local IFS=$' ' COMPREPLY=( $( env COMP_WORDS="${COMP_WORDS[*]}" \ COMP_CWORD=$COMP_CWORD \ _KIWI_NG_COMPLETE=complete_bash $1 ) ) return 0 } complete -o default -F _kiwi_ng_completion kiwi-ng ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.733253 kiwi-11.1.8/doc/Makefile0000644000000000000000000001765015273675667011741 0ustar00# Makefile for Sphinx documentation # # You can set these variables from the command line. SPHINXOPTS = SPHINXBUILD = sphinx-build PAPER = BUILDDIR = build # User-friendly check for sphinx-build ifeq ($(shell which $(SPHINXBUILD) >/dev/null 2>&1; echo $$?), 1) $(error The '$(SPHINXBUILD)' command was not found. Make sure you have Sphinx installed, then set the SPHINXBUILD environment variable to point to the full path of the '$(SPHINXBUILD)' executable. Alternatively you can add the directory with the executable to your PATH. If you don't have Sphinx installed, grab it from http://sphinx-doc.org/) endif # Internal variables. PAPEROPT_a4 = -D latex_paper_size=a4 PAPEROPT_letter = -D latex_paper_size=letter ALLSPHINXOPTS = -W -d $(BUILDDIR)/doctrees $(PAPEROPT_$(PAPER)) $(SPHINXOPTS) source # the i18n builder cannot share the environment and doctrees with the others I18NSPHINXOPTS = $(PAPEROPT_$(PAPER)) $(SPHINXOPTS) source .PHONY: help help: @echo "Please use \`make ' where is one of" @echo " html to make standalone HTML files" @echo " dirhtml to make HTML files named index.html in directories" @echo " singlehtml to make a single large HTML file" @echo " pickle to make pickle files" @echo " json to make JSON files" @echo " htmlhelp to make HTML files and a HTML help project" @echo " qthelp to make HTML files and a qthelp project" @echo " applehelp to make an Apple Help Book" @echo " devhelp to make HTML files and a Devhelp project" @echo " epub to make an epub" @echo " latex to make LaTeX files, you can set PAPER=a4 or PAPER=letter" @echo " latexpdf to make LaTeX files and run them through pdflatex" @echo " latexpdfja to make LaTeX files and run them through platex/dvipdfmx" @echo " text to make text files" @echo " man to make manual pages" @echo " texinfo to make Texinfo files" @echo " info to make Texinfo files and run them through makeinfo" @echo " gettext to make PO message catalogs" @echo " changes to make an overview of all changed/added/deprecated items" @echo " xml to make Docutils-native XML files" @echo " xml_suse to make DocBook 5 output for SUSE documentation" @echo " pseudoxml to make pseudoxml-XML files for display purposes" @echo " linkcheck to check all external links for integrity" @echo " doctest to run all doctests embedded in the documentation (if enabled)" @echo " coverage to run coverage check of the documentation (if enabled)" @echo " spell to run spell-checking" .PHONY: clean clean: rm -rf $(BUILDDIR)/ .PHONY: html html: $(SPHINXBUILD) -b html $(ALLSPHINXOPTS) $(BUILDDIR)/html @echo @echo "Build finished. The HTML pages are in $(BUILDDIR)/html." .PHONY: dirhtml dirhtml: $(SPHINXBUILD) -b dirhtml $(ALLSPHINXOPTS) $(BUILDDIR)/dirhtml @echo @echo "Build finished. The HTML pages are in $(BUILDDIR)/dirhtml." .PHONY: singlehtml singlehtml: $(SPHINXBUILD) -b singlehtml $(ALLSPHINXOPTS) $(BUILDDIR)/singlehtml @echo @echo "Build finished. The HTML page is in $(BUILDDIR)/singlehtml." .PHONY: pickle pickle: $(SPHINXBUILD) -b pickle $(ALLSPHINXOPTS) $(BUILDDIR)/pickle @echo @echo "Build finished; now you can process the pickle files." .PHONY: json json: $(SPHINXBUILD) -b json $(ALLSPHINXOPTS) $(BUILDDIR)/json @echo @echo "Build finished; now you can process the JSON files." .PHONY: htmlhelp htmlhelp: $(SPHINXBUILD) -b htmlhelp $(ALLSPHINXOPTS) $(BUILDDIR)/htmlhelp @echo @echo "Build finished; now you can run HTML Help Workshop with the" \ ".hhp project file in $(BUILDDIR)/htmlhelp." .PHONY: qthelp qthelp: $(SPHINXBUILD) -b qthelp $(ALLSPHINXOPTS) $(BUILDDIR)/qthelp @echo @echo "Build finished; now you can run "qcollectiongenerator" with the" \ ".qhcp project file in $(BUILDDIR)/qthelp, like this:" @echo "# qcollectiongenerator $(BUILDDIR)/qthelp/kiwi.qhcp" @echo "To view the help file:" @echo "# assistant -collectionFile $(BUILDDIR)/qthelp/kiwi.qhc" .PHONY: applehelp applehelp: $(SPHINXBUILD) -b applehelp $(ALLSPHINXOPTS) $(BUILDDIR)/applehelp @echo @echo "Build finished. The help book is in $(BUILDDIR)/applehelp." @echo "N.B. You won't be able to view it unless you put it in" \ "~/Library/Documentation/Help or install it in your application" \ "bundle." .PHONY: devhelp devhelp: $(SPHINXBUILD) -b devhelp $(ALLSPHINXOPTS) $(BUILDDIR)/devhelp @echo @echo "Build finished." @echo "To view the help file:" @echo "# mkdir -p $$HOME/.local/share/devhelp/kiwi" @echo "# ln -s $(BUILDDIR)/devhelp $$HOME/.local/share/devhelp/kiwi" @echo "# devhelp" .PHONY: epub epub: $(SPHINXBUILD) -b epub $(ALLSPHINXOPTS) $(BUILDDIR)/epub @echo @echo "Build finished. The epub file is in $(BUILDDIR)/epub." .PHONY: latex latex: $(SPHINXBUILD) -b latex $(ALLSPHINXOPTS) $(BUILDDIR)/latex @echo @echo "Build finished; the LaTeX files are in $(BUILDDIR)/latex." @echo "Run \`make' in that directory to run these through (pdf)latex" \ "(use \`make latexpdf' here to do that automatically)." .PHONY: latexpdf latexpdf: $(SPHINXBUILD) -b latex $(ALLSPHINXOPTS) $(BUILDDIR)/latex @echo "Running LaTeX files through pdflatex..." $(MAKE) -C $(BUILDDIR)/latex all-pdf @echo "pdflatex finished; the PDF files are in $(BUILDDIR)/latex." .PHONY: latexpdfja latexpdfja: $(SPHINXBUILD) -b latex $(ALLSPHINXOPTS) $(BUILDDIR)/latex @echo "Running LaTeX files through platex and dvipdfmx..." $(MAKE) -C $(BUILDDIR)/latex all-pdf-ja @echo "pdflatex finished; the PDF files are in $(BUILDDIR)/latex." .PHONY: text text: $(SPHINXBUILD) -b text $(ALLSPHINXOPTS) $(BUILDDIR)/text @echo @echo "Build finished. The text files are in $(BUILDDIR)/text." .PHONY: man man: $(SPHINXBUILD) -b man $(ALLSPHINXOPTS) $(BUILDDIR)/man @echo @echo "Build finished. The manual pages are in $(BUILDDIR)/man." .PHONY: texinfo texinfo: $(SPHINXBUILD) -b texinfo $(ALLSPHINXOPTS) $(BUILDDIR)/texinfo @echo @echo "Build finished. The Texinfo files are in $(BUILDDIR)/texinfo." @echo "Run \`make' in that directory to run these through makeinfo" \ "(use \`make info' here to do that automatically)." .PHONY: info info: $(SPHINXBUILD) -b texinfo $(ALLSPHINXOPTS) $(BUILDDIR)/texinfo @echo "Running Texinfo files through makeinfo..." make -C $(BUILDDIR)/texinfo info @echo "makeinfo finished; the Info files are in $(BUILDDIR)/texinfo." .PHONY: gettext gettext: $(SPHINXBUILD) -b gettext $(I18NSPHINXOPTS) $(BUILDDIR)/locale @echo @echo "Build finished. The message catalogs are in $(BUILDDIR)/locale." .PHONY: changes changes: $(SPHINXBUILD) -b changes $(ALLSPHINXOPTS) $(BUILDDIR)/changes @echo @echo "The overview file is in $(BUILDDIR)/changes." .PHONY: linkcheck linkcheck: $(SPHINXBUILD) -b linkcheck $(ALLSPHINXOPTS) $(BUILDDIR)/linkcheck @echo @echo "Link check complete; look for any errors in the above output " \ "or in $(BUILDDIR)/linkcheck/output.txt." .PHONY: doctest doctest: $(SPHINXBUILD) -b doctest $(ALLSPHINXOPTS) $(BUILDDIR)/doctest @echo "Testing of doctests in the sources finished, look at the " \ "results in $(BUILDDIR)/doctest/output.txt." .PHONY: coverage coverage: $(SPHINXBUILD) -b coverage $(ALLSPHINXOPTS) $(BUILDDIR)/coverage @echo "Testing of coverage in the sources finished, look at the " \ "results in $(BUILDDIR)/coverage/python.txt." .PHONY: xml xml: $(SPHINXBUILD) -b xml $(ALLSPHINXOPTS) $(BUILDDIR)/xml @echo @echo "Build finished. The XML files are in $(BUILDDIR)/xml." .PHONY: xml_suse xml_suse: $(SPHINXBUILD) -b xml -t suse $(ALLSPHINXOPTS) $(BUILDDIR)/xml @echo @echo "Build finished. The XML files are in $(BUILDDIR)/xml." .PHONY: pseudoxml pseudoxml: $(SPHINXBUILD) -b pseudoxml $(ALLSPHINXOPTS) $(BUILDDIR)/pseudoxml @echo @echo "Build finished. The pseudo-XML files are in $(BUILDDIR)/pseudoxml." .PHONY: spell spell: $(SPHINXBUILD) -b spelling $(ALLSPHINXOPTS) $(BUILDDIR)/spelling @echo @echo "Spell-checking complete. Find results in $(BUILDDIR)/spelling." ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7333384 kiwi-11.1.8/doc/source/.images/architecture.svg0000644000000000000000000000545515273675667016327 0ustar00 KIWI NG Architecture Image description config.xml or *.kiwi Repositories Packages used for the build Prepare Create a new root Prepared root tree Create One or more images disk, ISO, container ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7333865 kiwi-11.1.8/doc/source/.images/flow-diagram.png0000644000000000000000000026721315273675667016205 0ustar00PNG  IHDR BY cHRMz&u0`:pQ<bKGD pHYsodIDATxwtUoz'%{ AEQ |PiXQl(6@T:;z McaA}ݹ3ewl6@DDDDDnJ@DDDDDf(Q""""""6DDDDDDlF ،% """""b3J@DDDDDf(Q""""""6DDDDDDlF ،% """""b3J@DDDDDf(Q""""""6DDDDDDlF ،@Dj,ٶ;Bݦ!=Zֳڞ?-!7/ӭYدCￎ%=+/MMݪzc%˿1sоwPn!ޞn1%,'"ŷkU.-Ze>ypwqfҳ|+ذ-&) s`ϴ*\ >/O|J:Ad|2N=D'2gK-kWf]m[""(#~|KZ% 9y&}6;@VQMr9X.XUK_Ol'3'c,̜\ʕ.:~ $4ȱWao+x5'vvvïT ~[<^y+Jyg.SY% N1S&A .ddi%Ͻ=ddU""rQ,%<#hߠ:?| 'G_*)y]^8W}sӞ+.<2#fɇ= VMj r>e%D3#3s9t:xpվ{wkV㿱I#V R!eDDn fłh\"s ^s]__ogVq^S"9= kP$`I<[7Z@~Aɞ(_ּte :rmx:;ǁSdl~,1^[l+Y!e( Q?{nVedGpǦ NѢ/)>(MW`X0_8e=Lկ^d,圎Mٿ%˭s#e};Y<\<ۧ#bzFL,ݶgzw1JΎmI0:5ca%XW`ӝ*%XtTܜ_.ļ8C~A|KѻMC^ׅ^l=po=iy% :rGZLδjM}Z׭DD2-W(RǫH\U*,ϫq=Zl6dž]$fy1#{NDF ĥDkÅ߱) 6y{k5B0ܫUQؤ!xg\UF_Ttl6cgggtjV,۾CiW:q%йI-cǞ9IiVaQ6=ʪ|@# 9c{?.ù+((0_0֌ykсyÿT tlQ.)b䀋'tٹy3wVHh!Qn''#lIʗ1rH@n 6Gd}>σDc@D?k}<\od}'"ԫvrNx~Eݺjai :j9*L :(Φ<5y|hYĄҒ0w]? ` nԫ\O7" f{OD`ogǗk|@^{Q۳p FKօLu|T-G/WUts!=+!dS".9g><| r0{|w3wW({Yߥt:k}^:s\^xn\JfuzFHժqp- Ⱥ=G8a oߠ:1Z:ZԮD7?y{"1<ة3^~3b}w Ym;77_B- 5*ҥI틞o,3c9;:lT$tjJ&]I^rT(CD|2$;b6G;AN N\DD(ZRxU,۾uvt09M)߸=68:s*:tvyΎ; uzyKW Ͽp$7sٹV2s9PBݡ.Ƶ ]GNXfJyJLTb - H?XYjGՍ >F)H ompN0cK5A.Ddi֭.Mk#tia<>~yfçcH2Mp#5#F 7|*Ţ/0 p'gVgdq!٥I-U.X.v_%gΎLbd?rr}4jiouhBMۮU13_=nQhv*`b @/xpvzaq)i,{֥Lpg+c<_Wzu]/U(l 9i[gfFbrg='۝*|7h|f'"xyWtJ~US5Ӡjy<\ 4߈퇓E:65V?mG9+.9׾կ}|2rX}fjfg.ZԶ}vzYWg':Zas=-ڲGc9jY԰F+_XZ +iٌa5se9BjlK+P3 "!5 e|([g! 1>HDVDDn .N~Inϫ-WًE<crYU~y1LmM@Qs败Eʼܯ5׍XlfWP`6_ӱq16V/|ۍGZvwe5s:U DD─-yG[r~.CVg/0iVx9j 7}2{K>x ke0Cw4gմVETjV6'Gj֬NmߘE^mjp/]ƒɒ^*_m6ڏ^Ƅ8;:Ыu~{ФFUrXx«k]+cg6_m$)6陜MΎJ%)qyO&:17gʗJHn6y|"3Slɫ"""F ،`(Q""""""6DDDDDDlF ،% """""b3J@DDDDDf(Q""""""6DDDDDDlF ،% """""b3J@DDDDDf(Q""""""6DDDDDDlF ،% """""b3J@DDDDDf(Q""""""6XHQ1qL&*V(Wܡ\֑')0\] X{{#.>nf;E%)]ʧO([^-K%qrrh V%ǘMjj:~eDYXxcJjz:*/$"2 ٹycD*g/[6Q\^2ɩ<6IOY O@&Nu'i GG2ryΗ&ʧS]8W?2ϊnɟ2}TpEqgdijԡ5G_ibW\]]gos]W [|{}|:s6j˴iմX{TRa?ItLaQl蚎܅,_XIzR"7rW׎exgGY6UƔ񾢲\o2 Vgg'vnG9?Wtl<٧u}e:kڹ~a Q1WIRR>tO+ё` xa]%">ygK覭;9n M֥g;;GNK,&Lw'}?_$[VM([$0%||5ZJtjߪEFPraێ=hڐאFNmQ2!2:jӾMscظnJRr ~e֥UחO~v<<ӣ Ѹa]Kvv6Z7vjWO =v?CO=w0N}B]]NGas 94nPNQFf&7C*t{;;b!B9^{{wnFW=PcO!*V(ǝwřLj#3+{Chڨ߿!g?4k܀`2~vhߚltx$kTs6etjg2ѾM Wdl;q*Adа^mz\i;7fێ>vJsW׎8::y[Y9:r (_Ώ]L|l©p4G剉qúVfoN@ctjߊHqttd톭xӷw7Y| fյ#_flԴtvK([ujUdIo6o JT8ڴc^iڨaDEҦUS֫MyKٽK{jO |7W׫GfcggGv-[&g;3X~+quumfԬ^'33u[s+W|^[m\|"{u&xzŪwthmĺHMKǝILNTIi\|"$.>jѦeӫJ"ݸw7VLbRu_aйc*Z7Em͍N[Q܍6nAl|ժTcF/݄:+];5_^Dq1R2X~ wgק^v6:oߋWRJp ؼ-GOP7ݺt=QLM.:RR;#^59γ/ⵑٻɩ=mⱧ^!0(<\g^z8[v0䥑Gr({>!:&k679t8"y楑,Xѭg209v 1qܽǞF𾃀!qD(ɼ5v 8Es))i|:s6girϿFg rssm"֬ W;_~OBb2g"'''ODTt,f E+xnh<[d%`+0i3~:A{?e/ .Z+n]sI⺍xr>vxj=ܴu'DDc'ʸfϚM,Kq b,vv[AA;)i|73#fGx8|MGN`ogdž́L9$y-72bێ=r`C%xs )i|>k+'&6_xz/_!'7;׌ߖа=:6Wa҇_֎'n6RxO?>ax0`؈w xf8[`@&4^CDd 6nc9| \==AUyفDƱ!ڴjʮiՔ c^,wyX2oy|˖X퓕͗7^:мI>Gztd]Ox^l߱x\XDT )iT=3p:??W_|B9?~7mZ5/gxztځli|K0TR$(/ yEӆldır&N`Oqww#++x /*b8:9g;| jw&ӬԬ^r'J劗$&%zU-gڵkCko׺η$ ǎFRr aQT,GО }z]NMvacDnCGNӯV[w=ww#%5(x}2ؾs?ƬO'Ge?&6^}`ȓn'N>`L$S ~e_iټ=y11?j6}zu3Qn-~7>ł4/&Sv f3&~̗өyԨVSbogGJj |5ЭK{c0ƛ?SN-:֢wϮs o<99|1ko}{wu&|7~gZ:;3X|q[vp ~Jxyb6ykfF1~<T,ϩb#r>% X(Q‹ }!.ɔ@߻ѷЏ{3GTt,=NFr*4Ĥ<=;5..L;jp%,-_YbKl9N^^y|?gڷgN:O9h~u逃el_Y2>ʔ.yமqu [v?C>'OE;;~|%OGR.UxC%ȨXc⬒#9%#ݣeF 1ァsse.څSVF"J`y'GGƾ5^_2jFU-Yww7G /O1_> x3yq=~ c^ڶ1iLٵ-5"*:=tol ulS8tu&sѝ򏟿$//a>rc'BVtמٹoϷ ~E!1)^}TujUo>"+;<||Wƾ5(߬Iʖ)@̮k(ǾG.L +;; 2{^dff-U҇ȨQ2j,-Ϋ#c6w.E6 n]P34Z4k;{MhXip?3NQZevgA{Sje9a8wՙy8||JX=.YқO]rԔ4<ݍ,n$ ȥ-,#3 B3$%9޹_NXKGrr _q&`AXPrE|˖lxE?Wj KW\>>!tdIo}2')RƷlijT̎]|ZSΏ]{`ggGz.q㻹y0DnZm[55///Ig~vV~ݚVw$%Qxީ1l/]g_/ƻ`߁ԬQukQL7RRR)Q{l7Lrs PJ~/z מzYstКrsyG;gQ]7"''̬,RRӌs(sBR2Mz_.24jP#^4)iZM7IɩsYID9g 3s KWϾ#b96ͮm.E -Ͽ~1Y~,DEƾʒ/wM|8E.\/lυ+hߦ9vv+w /&}(AllpvvvN-< ݿWH}~/d/ .EFV?W1/#3|BJT(3O/ƍh|ʒE|BCJj))iWwiBb2V}!ww>ڏԴt&N?y?K"brrr)U{;;a|L4kҀ/<..+Ntҁcl۱Y?畭ӰtZ+B`P0n{sg \"5Wӯ~d'dⓙ[:װ8d'k[F 7s019|nnoӂLVV6f3_n4iX_}6#`>l0Cas=-=~Ө냇ܿ=E~%~eNηe.ڵiv2KVlKKr~ ]2d-P$#3 /m/<2,t(r3Řz_aCVv6` +v~3f<;V:5Lh{鎋3kodg?'I)ffMvsIKK` ::?G{S,ѼUl6g27?壢cŘfbfou]wvd%Dd֝ӭK{ xj&ʖ);n-lByծ_&dd瓙^1NRw-;ٱҥ,5-WG3qL5ϙlӃҥJ^4&[S? b23ww:kWaق x3{{{1{;;5M{߁899RǛcG\r*ď>>Lجq}dO &yw'}_D^uk2䣌xon.Ƌ89:ҫ=vGw rrr )]K6rdelKO!:6G/1rTcYB&y)A*9t1f^6@L~- o33^^L:..Ѱ^m/6/OJ}i|>'*ïlޝ4g|x}M>(l {KR*<6ŬVԫ3M,7ˉq?p⺝ͤ{h}zwe_[=u<6;מ`Kg?yޞ8>2{{{֯̀GcƗ?PFU'NgpwsSִj:7Sz=%/`W]VgJsLc'|ď,ljas ~lZ6os@8x99xejT1/"b9VjTLll]Ϻe2zċ5n ~elU*# ͷ'BFf&]:ecxeS X c ؙv[FVV6Q1qT,ivN..DD[1xzx]b_c2({߯ELxDnó󉊎dʧBcGrr6>=ҧWW"-[LKYY8::X{a1q`ggZ]8^c1WHrLvv6]3ݍ8To!??.>~SQ˰7ٟEnfg<=g#:[o~LEDZZδ=n|B"nndeegmyWkYD^ZfȨ+[>? wiF-LX\R33R{!yyy~bb1Vٺ.]dN^^1899Wx=Z@nAnnEa9v 7f30ohָ~/zy}!vv`i9U|mbPǽka>=2Z_*9?0&O&RJgUku͔|,\Cni.>kutt(~\c8v%]Xp9IԭUê| /"p[vvv]RyxTp_ww7cKqrr¯uE̸QÙ4K3;{;Ԫnb"7?0~CVp_>"""OHd`噌mR"rJ@rWDiռ1իV.H$pW0;9x丱5UUth+-%++'GG؉P~߲i٬-5Q:8kL\=Φ;Dc3ԡU&nؘXD.Mc@䖓Kc fK.mԫ]VѮu^JDDn}iﳌؾsY6o/5n@-hڨ>NN+r-b*?UukPW-TtLAeaL6V\_J@䶒F}ˮ=:wW'ԡUFnwWDDn$;jlNjjјvQ_q+rKQ"zmn#m|ZhB%Vi\ZLbRӃ & (9R~eiլZ4AZ8:ϯAcl-CFhռ1͚4&X QvD@ܳ/m;jlsuqQښDD&ur O^ZU䶤D2 8q*1Ӛ#""WPP#.[wcl+ 8{?x.Jyy0꛿(qXuQ)psCHwU>7[~&>s;ۥ[HHMvC#]ZXŕŴ+Y0q>J{ӹq-#z)jU❁yy :ľoߡf_[ _y|lձ8Ζy8)_o--9%]{i"S|eTDn4% "){{{jTLjP_bbٽܚ#NrD([_24m\OLm$;7y낌ǵf& Q e,.|`7mߘ'#xk֟gsܜI7NM [0|rЄZv|tiRa>YC b}jQȱsL,A8۱<|WzX_.\OY~+n)9Ύ*7jT\ܡ-NW"ozvDn9UXj..ԭ5G[9 @Zf6NF tlVdOwO~|ظ\Կ=4U oCw4:VêX4E-wKpg+1ԇ\4 SIi< XZUΗgaDs? X.| XUG3c6d)?GiN&>!Lr[5oLr)"DDpqq6B;{g__f¹p8,vv|8!'z5'"3Y&3"c[X ϭNI@| ކi`ב<O'* OEצ`c iR|Y0wWg^j9l 9QoRq^w!#SrhWWDnSJ@D*R@yw##9Y]4kR_V+u5+tvST(c}:!5;i$J,JQl"0$ekgœ|t3.j/yn 1-Oh A)gG?xst@DnFJ@Dx{vtYa+k6l՚#Wa`6V^/$]΍븷}c,*uBJ c|.GV1}%YhSwlBZ9ЏDEsqr$ϔORL`s{],_lVHeooO5hբ1m[5B9J""7fNN4ihYs$1B㇟:7XJ.4VO/( -3 L h^YW`Y~h^2Z&<3j'H(jUX,cY l$77=NL:גuv VѺeS<("77% "r\#ghҰmZ6ǻĿ\e4ca,ܲ;Эy]ҳr"]ju꧑Oq_`ü<҂}'"xK+#][PP`i3d>ZԮ̆GZ"W_ %+7Oّ%ס ?|Xq}dg L׬q}s."c戦vӆ>Hǃj`x6 }"rg֒MZ!;L H&}, ̠7ʔ.AfN.ٹWtA;׋7V+͸'),*WDnJ@DӚ#ѪN~OeK2O^dޣe[{eF IdB2sa6qwqfpv߱)]_om{:]6N7g'Nzɥlىhƨ({{L\PP# ]DD 2y#:mA>uag6_`D)H`^miߦ9KCrz&).II/"'~Y1Cպ1IefSɯEg!:) e|n\\S>a:;_?Ħ;LFF'-6L۴!*WDn=J@Dqvv=BtA;h^jmP"礤]/&.V]!L&c :mrEpڊMl?*Ys$h? Cm1S~>s,aֿ:H6mI`P0O6Siٔ5E^MBk f'k8;9QNM4{tA{9~2#O+QJ@qXL\F`P0kV+SeܶvW'2iW}g]n{CxyĻ*ؾ3OED䖢mL;e 9̈aC+[ܧu33w~1pbb-Sܧ&"rKP""t=Qyggg\]qwwWWg\]\pWg\]]pw 77W!ҩWox<&;;) L|sr!d"##<9deec2`{P0}{Yܧ&"rK,X"r[J$:&ΒTK*r/7/sED䖠DDDDDDlFEDDDDfh3XÞDI+ #u8ك=<hRʑ]焋ƼI&`~h6yؚUv =(1b[J@fLٟ2NL?g{9P'}\7y[|6$gݚ,co\nN֬^b_LŽ큗,q?a!ז2׹*ptp'罷CԭW!dddPfM6FҦ][ ظnwё-Ѧ][ dV,]NdTNN4lԀwtcGkgf.ifT^ؼq ))ɔ.S]PZUcKh٪Bٰn/.:+ȠUԭWM6ѷ__cx/YFtt4~~_?_,\LZZGa?vWёV[gR)Ytg gY{QVZCZj**VW)CĒEKa})S;]U\G:W#GYr zb?+4SX|T=:[ܺG'G7kLX"9r5+Wӵ=?+VZϗw2QFDǰfy~[6mrԩ[(w66X/"rR,v%dRW(M8Bjj*p۴fɪԭWt .8 3j y(N<Ũ#8 <̟<Żoӏ> T(`ݚDGE]q%PKNv׬g?`d ~w|Mmǜ_ 8-7 3dedr mtܶe+O x5+W3Ả؊Z@D@ x;x'xb۳b lČ/?aco.؞uk֒O0yW7ywGWtk?nz-L<@6Hr+Wd^:L8m883[{Ԭ])ӧ)/QofIǯLh O<6];Ԑ3.&ύ]cF@~~'LI&L>G''yW6C;232>e:Ψ'%%O?ϧƔ0ӏ׽<{5ի_9bc.St)23?S'7x/ r֢e2i$fLc.=|~0-3i88:htab֗ԮSwvaINJƧϙ*:tǙϬN- "rbSOݾoFV-$mvԬUm[,w{Ӈ G~~99dgf]u?~ΎlXzM8JtT?1 ]z9r3NN؟#ٻRCB;j߄qY07l@33KEÀ'+cGʡۛ~c]k\\\3]cTReҁ4|IKtho 6&{R?""y{{m'8ߞݔ*]JU*PƷѷ ",ӧyGKO4eS6l"t'''7Kܫ^ ;`?8/pN8}1% .A+XTpK1y$PNLH /S;?il6sA^u+^DFEPվ+[ޫȈH"pp|ŊֱWLNv )[ؘXJ*u2 EcggNjϾ`U&++l233b@՘W pGEFy_g72"j_zmڷeݚs__VXOɒlsQ""7% "rӫ[2ԭ[ؘX0a3.8мE3 ~gZVs~}jaJ{rx)~rRzuƽ=HIٻYٔ83 К0E*T,ڥ- "uգ %3-YF\9Fnnn2Y2nWupnTZe %83vXuwsٙȶ';L};WG?]u1ʪ+ޣU-"rS,镯P&͛˜_IOO/}ɢ4oq*WDddjעvԮSZkuXd9?/6;vR_2+9:o?O<2QhOIbc/Kٱ/xWX{xvٰv.n=$%%$5vvvmUfwnPwTRF#){].RJΪػ'GG*U dfNcG":Rf L̑G#hN&;tX=ccʄƑƧFjja2eЦ][kv "3+6˜_&G.؞?ΧzԬ]#.X"R+r|UU峙>x}׆]r1r(>cn___ޛ>ό;:ƌz{{*U `;#:izUVSn@FMϻ{^WJ*<2Q~0fg^=yq؋|ٗ|  c87Pz5^fYƄ&ư׍:u4ʴlӊ=k8|2z*` Kg}I3vX`Y7ϽSjӚξ={ꇯ/6ldӆqʔ-Cϻ{3OXuO{{{>:q KH~}۝MzI'=yΗw'kV֭< 2j(._nn]yqKWW;fjzfg^SNqJXgc=e;9OLt4Q;Sz~Ԕ'quu|E6d3g 摗o2HOx|^$c/W@t/{AAInnUWe%1 w8r޻ؘX-K2/X&""Tʗ/oL@PXJJ nn,^IFz:*`0S~>'NL˸P}ĐU_qoe\r}5Z:󐛏Z@D??ka]V\\]^sNN8duk0\qOɒEK0q+xgfehظQ˔h\UKj*T%|PRb [Hg է_/l63hRɇ')E88+/2僩ٵooށǟxÓ`̚94>iq#"rMBzEfMDFFYF1okԴ  iZ!""5J@DDn1ѻoCnbuq~n%˔^ܡ^y{xPJezOOOǵ#pZd+իWG^xƱ~7+QD&a@4ߟ:y"8oر;voǟ]YY_κ115WW(<,b2;G;j yy-kIIIz>&:-v:7`/X:v`CO\ OR[Ǐ x rEYz-<̍TQw'gP)AbuAw-Zmżc$ 9tGŅ6ТU Yd'O]:QE;z$ݻILt4+ .6eгwO|bYVm[Q^=,\Lvm9~6l/ĩXz x{оc;Myy,]ݻ{.v م;ﺓuj?<~;;;׬Ɲ= @S ewӣW XJ;7}˩'^zoNаIC:v'Od@.\BͩRU^a4+((`ݚu qFѵ Myy[ж}[8|0{`*g iѪ9>%K2jH=:߃psw#-5 7w7PB>vҸiL]{Bi3Eׯ,zMY߲?v,4kєU_k{EI&cXX8GCm.>4nڄA}88޽$:w>s""jۇ-[=hc[pn ۛժZ^3={hlNjJ*sK~/ y,4kCGu/<ӤnZڴkMxX8/?*UjX_s'!>3۷Rl֫G>̟;??_/o^:5jդrɜ?wܵ 99L4۶oO0 7䉓w6ztzg_"*2VmZǒgJf|>=ׂ{G?l&00ZrIeҬEs#hG_4ogg/4mʔ  '8ؒ$_?N@SHOO#REgob8sυXL{{{rsryW8~-Z +;?{z䉓 \Ϻ5kTU% Tb@Ev߃Hgڤ4l///V,4:LVf&u!dW dZiIFF&sza 2"}G6nȊe_?`K~zQ1#x;v2~x9x?+W{-1mTѺMk&OLmHR""WdRRSS7iLWejMDGYƎvx&N?ǟR:f~6=Sfuf͜Enn.=e}\_~6!!x*UfYۓŠg-9<ȷ"r%#U仟3M1KYjC|lJ)M;oGS?Cƹ^{qafu$'%SOP,>G''֬\M 4o 曯ٙ ];s&L@Ν8‹Ͼ⅋prrWdɗ?hgqD,\Juy,qmi۾۷nc^=b?8r/IuXp1'LywOOxrDE_tuxqK˗.gۖL1H$6o7bt~'ԩW/ujn:c!!sw]s\."lf?<)rxwTd_`]tH>|!X.c$"d2ޞB͍3{ ~S#';{_J) #LZZjظ!KV-%+RgYg,- C_em4lH>Nql۲5k@zhպ%۷lX cG1xǜ8q~w{uj@mSA;vywӦ][#n|}} uMx!...]b9|Asg#ywO HAA{~|0lvzYb؞jй܋@n]ؼa1}UTZŪDDZ@DEDD0y$?>SsA衧NǟygCVe(WQ򈏋'rUooo}/:;O<0ʕ/Gfҽ߅+oK{n"9q͚[wSZ*U`ooOTD$4str"V._ũS' =Jjjjr(QxAJuosSFΣ?bU.))*U\u_~ lkƏOzu HTd$Pre"#-D"hzf{{{*V *faؘJ,y :rH}%&&@|\<9EίI&4i䂯q\28:8Pzz.wvϿbOn4oUy[\+% "rM:+/Bՙϔ+_r*Ԫ]C!pww#Brqus'g' ?+7;W7 No9|0[eVFO> h|_o&NqѫwOTw#1!:!'']\kWeՃ﹛UO?oUzF%gg"PVM^y"\1\]\4x CT͝qed].Z&;Wv!HG/Zπ :6G,RD8;;[87+~}VU7{G"k+_:un: IIN55KDZAAF]|'=(cѷw[w!:2J+aggGŀcNáʢR|~7Qn ~ΤϽn+5&:];x^zTYkQTI"#"HNN @_t)|^X'..O 9)ȈH&Mq=IZZS&N&.6l~7 䉓~5pp'1ޒ4ݓT~0xէ}ۛOŧ_LtTM{{cPy\­Bld|,\̈Wy3TX{'h7TRRR̟;egݚddr 9S1a]z$)!i>$!ҍk)]Qr.$'fjz}ɔȍ.X"rBO9޾c{\]\gKM7i&㱫+5jdiƀ;voۯB L6ɸ哏>ᣩ^:M2Bhڼ ~K?°x<5I7m°,ӦX(r }HnK|:M&Zm&} xG|ԩ[>xk5𩁼y.Δ(Q_y._Ŋy>e:{ 3>"+g)uקdI|.2օq!!bz% "";{tcɢ< 5mLzz:ǨPBq' C^C4oX\RDfDD\]xps\ܻW3pBqwwa/^ז)^>t멩wEDD0h@qaޞVmZ2.DDn6WDDDDDlF ،% """""b3J@DDDDDf(Q""""""6DDDDDDlF ،% """""b3J@DDDDDf8w"7F;[Z@DDukUaZ@D."oq rw"""WK- """""b3J@DDDDDf(Q""""""6DDDDDDlF ،% """""b3J@DDDDDf(Q"""RH~~>d/Pn*O&=#['-pGvCb bw+*{q?ej7}; ([^ȡLyWT+Ybmq,"r]9w"""):rlzrrrhټ1j0as 'C-Cv-.al?t8wVSn-w0YY^;ڷHHLnoV`6-p7ۋ-R=;' 9I9tj //O#8r$Iɬߴ;:lf@;:lR:rhڳMq7iڍps֤j&bb(]ʇwLRڳJ9v4{ByW sĚu[8u:2KrWxyyZYi;!Q=uŹ?:")dyŷw0ٗGp*26Ŭ9$&pgF""cx~;۴T?Evv;RPPpExg}Ȕ2M~06lApr?䥑|$%Kx|k$@hXi: I0d]g)',;s>9YJll#GG)[ _|yi>NM:GIs?<=V!,-eJ$''7ߙDttU*WByƿ:ɟGFD"""7ww+gp*4]ѭ,+VgbNG2{hk:7oҀJ9p(nFq?DNmqwwсvdCE^ёr|lVLJJƼN& ..d7f֧230ݻvwwunX|`M̘2H>:ke]L)&"D 4\\e'''<=INN%%5|HIt7/+Vo'x z\ۛLRR:/oo/rs:%HNI|ԫS/xGtLE*Q;6.^}=_DbR num}%IJJ)r\wwJ.ɤ_'xkҍ2\""g)FNN.q $R+oNGZ ߯,W|dV5m[k"ag2q*, +KXDf~:,//O<=-Kyqܙ8 KTh8_x?|?#'7o{E1~3w\]Y:[>:?c9XINIe/x7|N cKϛ+"r|Տ呓G}KUTݻv` K0յ#=fFٌK\kJVv6_INI%??mZ6}$&%3eeoK.kl!?_WL`Yk ;;aom;++fʺh9(ᅓf$>!\̲ 93}}\шu~c1Q H~8:9^EJDz tixzA)(0Sί,&vvԫSgzGMݍԴts=;r&qrrd[Vt?KKw%rttmf38::{o3..Ό"~#3324kҀǰ7NjZ:<Ї^gƔԪQOMfoyG9v*>>%HKˠf*<ԫSI~ILL<3)cëo_1LkݜɟPZ%tj˛o@vvY<9cJ;v<@ԫ=wwGPIɩnј?"r3v% }~snܻʿ$--4*Ϊ\DxDeƋ=}q()d”g*ϥ$%LJprgWPP@XD>%.4.x<#+kQ`.0H$:&o/c qw1oc{vN.. }w}oҗ=T(S$>>%ۗ~FQ t<,w To\E99:r)/>{Sҥ(S$%})y Pqrrh'ԨVeO^.:ժX ^.|KX-("r)ʞ!dg\t{DDD?% ""rS_& ~C.S<IDAT'I?"rsѷE*"pDF;(.4vB4 ،Z@D.c=eADDhQܿ?-L- """""b3J@DDDDDf(Q""""""6DDDDDDlF ،% """""b3J@DDDDDf(Q""""""6DDD]WUqƊ T KF@EETPEEұcXwcppG'sν~sEDDFDDDDDDFDDDDDDƮ )hi;}ظ8|}|-WŜ=s7~@eu?vW^ 'й['jթK/a˜-KmM3;R:zDD`DDh.Oڋ2y$z=ۋKVf sInv[kܹ ve~1`غeŲ|=Ipv>7q[{"",ĔSP"N+veY0o>.N<;~wwwNg3‹,]ADD/ "x PԬUCRvΖ2eʰtX";v @۶ldefQFU۴֖۶s9bbbYh ڵٙԔV._IlmlZ*~~kSRE*U3Ν=GbcI&x~gNf굤SbyhnCנbJ?Æ Y7Zj>xu`2777N>_+?6AYj mvקjJř&MpGn5i<;i=yh$>.[h-]΂_ڋJRR23>q|ɧ|CBC)?r,$<4xFZj*ȏDRb|4#ƍۯMVf. xW?oAFzwfٴayk1K||<_}*YyEGE3__oƀ>/sN23ع}/m"d_=r .05csg捛۳[6n&1!y?ϣ~ HNJC2֯]ۯy`yxxҿ%GecFGfF&}7o3yc+_#YY/:ݞ|Kg_ʋ_$%9AL5D1BJxDO̬+4\KVfD$^wjQG͵>xkf2mtڅa $8>!0`ڴ2w9|*]S'-~|4# _%`] 4&>>Y3g\|dziׇNbˢsGjjE3a{qR8կyjիQ^=.\ء$$$o@?llr;]]]y'tko4ٱmڴޞI&-""GDDk_ky獷އm-Yd N|>ck׬Cթ[.tīD|sptȡ;sԔ[>Ŋ͏qvrΞWo~BB9{, <4 G<7P}xG aӆgΖ/gc /@XX fѦoY_s `0!ۤERR2-Zif&3?fZ4nڈt""3pq7NNiךiކq+ܭ m[svǢ?1[||}ldfL;ѵ[U(Oŋƭݥ&ϛ3L :0>ѕS|y$'%@Nv69F#vWl˯U+>FbY4hWWWL&o&Q/ҵ{W:vHlrsr@zzz632rrv`00jhlյvv0_}mkn>h:+g[E4 ]DX".0e.F^XNwء|=+Shגyb4c|YrZƯ?*V &&_p;#ޡ }נ>Žsby߲9vž {nǰa[CIO_|FLF#UU5c}۳)p# Χ7O<ݝI&1ṙ:p;=EDt "]Eaĩ捛moj|k_~c&c;:8`|{H`@23(_|F11DǐC… :OJr2F{d#[[>h$-=?¾={!#=ՠbLΜ:MFzm[QvtlՁGлoo<..`0080@1hGܭ3M7c#kG]9r0&VED4N}d&,yC&zxt)<v.^Хcbd$)))gNDX8&ReJ9vZz:9(9߲ؐMFF. Z Xb-VN GGGlRJfz:}xc211/NE,a2HKMŅgppǧ/?Mŋ8֢(UTsy∌+%Kz+|mSsi~r$ty]ʻ@DޢV;;*VgݝuFjU-z||1-Lj{'p쇴nNjJ-ޥϫgx.|ǯXR{BbEݯOaU88s`cN]\'g |y -[rAr9<(ɄoY_ڶoK_}շ-Cn{9ٌ5۽[x*" Qܳbcby7c7Ʃ'Y/w֣GqћMxqdEޑZ332yL7 wwwK(Z&OcзHMKc=p;~dc㉈<""$ıvVZ+ucu 2ﳙAغ*rܱ֗)LaFݞ|N]:w53݂,7Ύ9u$G4nڸ)=iQrśnh4nZZQFԩy=vD"EXt9T^bk+tx,Ɔ+VJڵh20fj6ʚUkiШ>%J;z,ZBM벳Xߜ9}EұK'Jx>'9t4lԀս5EyեW^߇XЩvG&|0;u 8>˖Jbhݾ KbEV._(KyӶ}[/vӯW15 Dɒ޹'ϱ7l6þ={i׾ >eJ+;xE shס%Jd綝_ y\'''RSq 0[f-^^^ԭ_c@\]]y'ٽk9_.Ͳ˩נyYFjy^߲1LYy2euۚGFz^rֆ^}z˩S|P6YGgNb[GD^glXȦ̙-v-$'uV}hڼyQbΞ9k~\|9666+_|$Cz*&L@_W[kV M&غq iiO32쟞qVfVm22R-#X֬\_a_`0\]lV'Kr UvMrٹcE}{F5xbCrrr ]prv`00jhlmmZ܃agw?Id+CiԸ(_<6Tׇ  %;;nxa TR9϶JsN:){5@D剮4|Y3>H"ӋJyGDos=g*UCyFڴu)RSRp)T I&:DvNvd'&&rIS4ə_~ˉ'xn-W TVռ,';9@&oCGPb?|=$$$0O}`mllṗDGG3x`6l >>6o+_&,4F@6 b_K-KjUZ*&Odefo^&@rru?&.6 8{,ӧ|b}oIhh(۷nmSs-6t܉̖M[$\FO8:9Y0Mo`defq Əυ  yDD;W\f*Vh192[;;lˈ^dtקpvq޳tۯ?O≎,ɘ cz7-YbrZCܝY_~]ס~[|5+|;"4ed )r*U̗~ɬ5bFcu1#\UP\9h¼`00񣉌` rstօ]s3OuV4NN8:92x`V:3iDJ,IGkSrE|˕%1!\w7bkINJwFM9C6}FO`Cס_ x;RȽ`m1// =I`ؒƎKNv&#,,dʖ/y!/FU'##_sNǖM[,\%YKfF&iixzz\sH8]ۢZbc LJ"E\ARRJ?Ch$,4tʕ/=FVEy}7|Dž /^|;ELL %oy{WͥQw^?DD:[uߨh ;lzn_NިE\Fxw'ϲwtQFݖƳpa+)U^CD@DDlU|9K9{fAs|Ch\""r)\LƫTҽ EnGGԬ]bܚ{ ֭  hڬ5iݶuRKs>rm:+DD:6"""""b5 """""b5 """""b5 """""b5 """""b5 """""b5 """""b5 """""b5 """""b5 """""b5 """""b5 """""b5 """""b5 """""b5v]ݮҨ.ADDD価a]܃"r = VŹω(((((((((((((|HXA "R֮pbŨa~Av]?LX+ظ䔂.SD(}oe6Eӆ]usGMIDhQDt"""Fh޸KקIBb$b4|мI}Fc~SV `0kA9v4+Jlݱ ʷt7 ,KТi\\8}<H \oFbM %Ӱ~ٸe'Qy89: d}$$&QJE֯KHɳ;qU+Z+pvL&#;짐 Kڀ-D^ӃR«gB֖7R1 mnپCGSַ c4oRH<|7Jȍo +s|0cuj}Ybp+LjYv#7O֖1{coKoјw|c'N٠·QryK㧥己:i;1\\Xv#^OSry:[!1;;[L&OxNҢiO>-  goWSBYL&o?c5XMcxwx9ktot ڵj-\xi}>NvvGcۖ}T*O e9|DmoںMhjٔ[瑫T#i ;h٬!h2q :rePjE9΍Hu|9LN:ǢO$;+ۼMGj B9_*U( ` *&`lݱiddff+l <"|k۱{?.]@zuHIKgeem6nc6<=#""7J= ""rޟCGN Cqws%5-!/UxeP/ {{{&|< U>[B"& { 27B$%'h3m8tރrkJII=xB366-0kTe?qB^ȯ-iQ6l45gw1Lԭt_Sb6*藉c &TEc^b%ŖDnܻN[/-- (S;۾'$L b2ATtyddd~!^qKs!22Jboog}Bb rpBJj*{2L$'Z@Vv6!*jCUzF5#33X#84ٽ?_>t[{\ \;'<=-S*O(k! /sӥ ;ỬOӵKТiZ4m@NN{WDD+8t!!|L&֬ZM 8q6ohq9|x-X"n܂_km7n?SL:q*-Z1 \HgzzJv'aޏ.]qƱ)p#^`ѶoƆ yo퇓͚-?/wwwL&~)?N&ￖ;uɢ%|HH3#""G= "ʢXbt}KW/y?2ﷹ00ej+3# hӮ V-IJJbz(A.̏6kJbe5~><ѕ%K{<Ǯ߰NNl ]ڷg/֬ZCqy,wX5)VkW˳O=A2e8u1|^%>mJ.eާqPJ%UV=s>yAA@mvz)0 ߇T8 !>.5+|e"",;{{7Jz{ӣOMF||֖[HINf떭=r .P~ߴy3˗3B =s/666+_>>mnW\[}'G xG>gFhӮ ۷`̟o{#""OCD䁵k.:@XX3Nc`O2DoNm٧ſ^z ۟:qԔ,;@re:d~'ķO5oG'g~q.'u *V }͢ +){Ǎ׳UV9u˖m>gg/NbB"UU5 p]` $8gEFF&-[2asھkODDXuƥP!& RSRr'[.];w~fU.쬬<u>kW>%9I'y##,[H,y`3L3]fkKǮyW ~UU5ڟ'ODnxd̄oɪh6[|nɂyYfO<=mLØR44i䦟@凟0Ы4fgᚏ0 o5?'s2h j?Zk`2L]_<] ǽ=y\[h$B$ )Sb6vXrs7yaaa$'%S|Y;5 y5T^'8<Ps:l`74VB)29.wRRRaa)R8sLMK#",>u,)5/󐻏z@Dgccw)oKyzc7߷ FGX-|ݵ777Uv.DCs@DDqW≎ؿ/rDDDJ= ""V#_tB"E͇y{Pv-y$"""w#+jڬ5]Kҥxg DDD`(((((((((((((t"wK z@DD5[{hd 8|_d"\ ǥP;r̝w~xO_D䁥/L&>9uc'1x ~en}{r`>6l޸˸.7g_PD \\\\c c˦-}""4}ie<-'$$_~g޾*WI ˎ)U k Ż7C@ +_ŋti""r)}iЎ-ǧ 5S'OcY|*C5wEJr2-ZV.[All˔]vx.l=شq3LяWr"/^d⸉󒚖SbqUk\@ZZgOa} _>,}1)))\^"8<.пg?4Ą$v_?{2^zp9m:O䉓;}4#ǘ>s6lbP߁ڹؘX~8|̧?b{v}ؾmii,/O|\yL</ꋯ_'""rgDD;11\I^8s =iӮ-;wOW}a-̘6Q0ydZl_+?sr8n 4bԄڒ['Mo$8=53<==/qvq!;+A?r֗0(R&MgY<OO6og_~F:ü_a2}>MFZ:^Y3:w\CVf&Oïu+>p`5cz63> @|\iն5<ׂ}zЬEs:gQj;@= "rm|Џ-eY7^vv6II3r{8l`̇l޴KLL4o&y}_胝-NN<3=|$v܉ Otf>nF yWύWN];wSO=CJuػ{uHaM>CmUZ>*ULFz9F5k?yqq8J.EKW` i~\ren:ȍQwӿ7|j7_}ÐP/NB/_<=z~`q oO3331LARۛ s 7|nnnDG]$+3 _CmꐖJ||>e}-* e^%Ks`ǧr߲>WoKއ 3_LvVޖkY|y8hWo7߳w^_fp[[""{{wȏȖM[HMIaۖt www~g&pbbc XOo̝ϻ#ޥѻo/>3bc.M8tYY=| 8hk!&HDxiioׄp͇qssɉ&=#Ԕf|4l;7]x]Omol @zF:GaOPzK;j*.^BjJ '(_<?my˕/G lg;vԔ~[_c.^H4cϮ=|ɧcԉy#F廮]}U&Hn]SQz|~󂟯y |i q1 ڴxDEF3L{w*U0fXlmoZxKro\z5^~e~w6'O"`]μ1 FEϧ{iШ!/ro,""7`| cEz\wq^Mll,eʔr1"qqq.GFoǧŤtȽlXh ƫD?c 89:xO\l,)m%%%[h4 a!+glܰ'%9%"[ͥQw^?DDkŊcs>nW +(_׻RZի#qp"yAL]ycw؟{f$''dh~}mmm(S"}@DDC^fٶu;\9|0xs]+uI5l={IOOSNDDD n+"""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""VcWj.*DDDDl-Qe=H= "WëKkuZ_ȍRXXXXXXXXXXXX<9r$wÈOH,S)}/=#/s1*qS>cܔnq&|9,t"""wZHhQ1{ԮYKy`)]d2c~?mϺ8~4hP6>eOH3|VH:PC$}> 6mEZ FıbM YYٴkJ|B=)]dF#6ԙ '&6usΩo9""ؾk=GܹSf|śO˫Fy.9rF]{_ֲt: wٹyQL%wϷƑ3_HMMc]żEKW?`ߗ2|Ĥ""w]ĩXgQڻFÊhX6/RJEfY__~( HHMKc4mT~=d}y~N[?t~oii߸*c41#BBpٙ?`Y |}23pp/K,"rWP85Pڻ63}9|$@-9~ YYYѤcŋ!;;wZ=n~\*ﶎNx/ʌqIIL.ns\0ףa:^uqf3=ՉҥJҷǓx$!1U*n}DD_"Ǽ$*RD@^mo;''а xzb4 k!<=ocbqrr"==LJy76d ~8}ÝbEo~LNQUlmm)[:u6o9Nph8SƾC,{5QѱԨ^zG@DD6x`/&%(UҋXХܗ@DDZȅÿlmm $\*"6 ωhHt^\ \u덈""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""V""""""VcWȝALL.Zg'jQN*Vd^vI[IMIXb4l܈z>ga[:DCJ)k7k,jzZt*VDj\u;wt||}|Yh {vAtjo([ޗ6rYAㆸ8;ï?2J.udU?̠n<~2ii)]VT\j.F^d_u[[FmպDDUy:x?{N8Ɋ+)_y?1 Μ9C]>!z/?BN8}5ٵ3~zFELtn\r5}Je ͏Ϝ:˞]ӧ,IZj*˗.c@/+3#Fq(zG_D~@jU>kF;d<\j_0̏gҹ[&||ysț|~G ^1X3KfqTdO|,YWұKkn_'6.ˏ;FH )rkkG)Z(!a+_W^QfțQ\9]ݝZ,c |87A9t c7/Qׇ7 ==~4ze_Ky=|4W(-%**+оK:϶-XlխKeIJL_০|rΞř[4SCX/b(_<:u֭YGLL,4n誡m@ZlԪSX&{nUF붭X2Ν9GѢEa@jJ .۽'N̒EKhظ۷^zx6ƞ{hӡ N$6-K-8^||K\LTT4>eԭ .ъ+8w&ž¿znuÚ-BD+$::eJѶ}fШi<r>u޹S'N2哩$%%3i߱~.x^"_|N$,,}5 BDz`wsxsL>6[A4ly&.Kҥ12y$6ǸI㰵#=#aC#5-ҩK'z- III 83g3iڤ[GDndϿ^7wgA*]23ptt~Τ"xw?DM}CNAw^M&o^VƧ9|TT#uLcsHd4~.Ss&_~XvyY@j?V'߷g?^%JоSիSaCD}}kaʷJ[yǏ`$&&Ѧ}np"lg~\R|oFg` IMKЁWm{歌1oҸI^FMSF5 w'-=?žt|ݏƖ}{.Mػk Lw]B  }ͽNN<9?N|\g1 =;'=v[RRyzIDX8.ior$'@xxŋ{M}X_L:k'0sm2331L`-oNzF:) ""?ӬyS<==nx_6d>xd歴,vcuܛgtWbkk#ilwnzoػ9snݻѶc;ʗ/Os~$"U_ïZjx{{>Gj=Bŋ4k.N..΄= s] OL5zlkW }زa3o {m܉`wRw^7t,;[[4lC5ܞgrs"==cn[Z1OػUvY7 O<ۖ*SO`kc }784KǶM[hնMo0(R | O<k׳|.GXL&vMٲe__;`̩3$%%{mD]b] {gAxbd5MXb}ZcRc@Μ%11ط܉e|}سrZXX##-  ۯ`omm!w]q//Z_… ܎J¥Uh4r`} ߲$a-w}{i|ff5HOOg89֗6117v)<@vlIH5]?3q̄Q=}bYp }m4RSR8qM~ }^oa˜&&:Ygq):uͽūOѩk'6oo ~#%930i$Jz{S~nnqqF#,7wCzƕ{Μ>KKsK9ei"m.ϧ4v"""t.ΗK箝8v?MlL,烂0z67+Wķ\YX;ZUUxq/z>;9сC'T^yWyWܽu!"_Y?ݧBy|2b889:1טll5h{G1b~ctT4Q/XG8;a4k˜c| o`?uloަV|>s>ʘco|0CƏk/g?Cb~NX|}сի_w{^%J\M5o\WWWVjjoW,]kC_V7ֆ*^uBnRSYoڶo{]1oժ_pQL7 Wa0n˫W.߾WD~9 "r^xqW!5eJ)M~u/xdggԳOt9""Q0OO=bnSFRr>(2nI *-h]<`@D<7u+oZ~iqP jy)<`ҲM|~wH&IY&4JDJMiQҁ,ft9"r)V1ױK˿V)@Ds'roۨCA""rErG;KD_ "4#no)"wҗ~G D>;dPDbG]%"/.@D 0w1yօ_ȄxH.ŒSڻtx[]b烷_w(MAN 2Xxm׭EOt""-mcnޑ ….3;rةشu'^ȋ} n\|EDS<0:s{o1Ky`(\g8y7aK9q,K乧:S'յ=$$&Q<ѥ-v.F_+ # F1q"/^(|xLN)om,{5eJIúE_+MYtҎŊ1L\;@v~7|MY*'VpIxdfe󯋈Myggì B||"^ŋҩ*h߰ {;ڞlc{yGOuQJEujC!~Ϝ=ωgiټŋز}7cӱm s2L ̖m{a:jyy7uھk?|}^0as~{`%|7t|j{lP0Bc $4]zr y7ȱڇ?ZARr2?V{q!2pL yk~sZwWbѓp2/!Gԙ 7[n\11X~3YY|yiݞ{ 377{fälUρL;4r\0Oz)ӿ仟%tzzv#::ӿ3yރ̜=_/L zxc'q!wFN7Ͻdw3x臜 lP~+oh4=D= ""7 uj͐еCk7O'eoںi'r'\~Wdv,{5NNXNNLs^aC0bT\сTZuͷ?.w^3s9|E0Y*FNa#&Ҭq=1;;;5MFƒ߰en~[a`g܀|שZ _U*۹uY2y;x CǦx`;=ՙ)c ;;=YvΙՏ|w< [?6è3x> }yYN ؿe;p̩#ys[8M__dPXfKo{lMotZ/Sz@DDn`OWV 42_R<ݭq֏Sjlޖ;y`gY\s!#3Km'Q}GG raz bΗQ«g  gÃxmloP*883w_[7>:2221LDNZ~URyo|ҿ\\>kq9p:dqS |ILJLF#&99Ĥz~/sqvhADDFѬ3'RץC9tdmcqvvzDD' "@1ml-KKKSgoKؿU*'`6~Wl^s>cߙ1;wiK=+FHa<͕<.@Ityf z<݅>?Ayym,zL63N`e2 ёJ2eyKH:0|yI"" oRGD~!Zlߵ e}nGOZ d -Z+zۯֿ˖\^lilmٳE׆6?~*KBy_F }s#U5KKOg8;9Q/O0lߵ_q|(̚Ġ~Ѹc-Ʌ\nq]238xq'$RyrɛXޗH*U,kq{*V(KpX5UfÖD^UD^""wP!^&.> 0w>[[46i^ $#" B-̑";'e?IJN!6.g''vjͬ~dgenkFv{{{&y˂(Uҋ2ng{,OoѽK;IVњ5b1e$TW\%{Lj2ׁ_͜swE]عo_U+ByT{ut$5- fM9NNdϞYgxi'LWw8::0ˏHLJU^Tݒ!oa`gtZwI/5}I=ڊ?Өlhf]x~[-?CJuWL&Ǽܡ, = AǍCPp(j+zm ~c$vvx A$%Pb9R :3|s#Ls8 {6c)㍇ q"1q)]<߲9yvvvNcb OosmIrqh!5-B.Μ8uw77|xڰє*wXu6(tI햓c L&RkzLv)ծN.z>N$tKūx`g'se )%Kd7]wI/K^̓]:X"+Zbw):==?̢a:@7 ̧SGiBslmm=)vvvTZ*܋@DDp*<ӽ#}_Na4ٹ{? ֦.ODDnmԭsސc06}z<ӕazР^mll4}QD^""rէU5ϝDDޥDDDDDj@DDDDDj@DDDDDj@DDDDDj@DDDDDj@DDDDDj@DDDDDj@DDDDDj@DDDDDj@DDDDDj@Ds d +Jfo(RDSy; +HUYoMDw)U`kTfA""rE[/vwܿ@DsK;|FA""rE;KD_ "N>֋Y]H#3p!w{(@sɝ@iԤAaި;I""wLLେ IwKm|";]j.*bǩzls#"wL=7s&):E\չKK2rN+"]9W[$t)r_{Pņ_f 92KJ0'Nz{7tIDnZEr`)Rw]ve]".b:x~<Ɖl}OQ)&N$f4z>ֵ)B)%\^J&d2]Vk3y*0EЮHA#ci8Bb~E`xB ꬞Pf'-K:t9rQ.hѤdӹ(}{74wh+B38MXQ "r3Pņ*vt(H2p~:Ccp7pbˈ. rG39^։9M N}7'88^ϭˑ\#p3|:{c4YDD^+:3p3Å O)l+U]0&i,DDD*b3 ښ x %6Q ya-j٤nN$KDDD䮔e9Cb {ȥK1 2> I\'IIg~j;"wTIg> [/fjU5'DDD䮰+:+p!R.6S"w%Vfda:a-W*"""Vw*1 +8P=s{hއXXMZ2D*ioV;:qmt06F&N%92ak\](Ep o:7{ϔs❇ CND LĦ,f?6Ld]l x8([ȖڗG7KQQXXXXXXXXXXX]A "".3;-Od0 )8;SBi}A'""b""r[0oc+VIҳU.gPb CA$""Vf0L.BDDnݼ/Obf].-ߚ_:wQT}ǿRHHJwi"" HQQ7IUD JWzJH#R9;3w~3&{BWh_Dx->T*Y|'ֵnWã].yV}b^nQqwab6\z[ҫE N^a?{[0e 2돍\fF;ǢM vG;[*prPGjZKd \ ښ9]h\8K *6fTq[Q ;saV>hܜSjRߗ~1`"ؚE5cߟ-Y0^ 2,\zI>%o|Lu6gRy%$%srq~w]\<|#3HX>oNVo7}Ѹ*VEyw'&7|EVxQ0 [loW/߮u`蜥Ѱ|1woMJ%2ܧ\DD|#ci9˻nw1{q?ɮf=9oNy.eIy)w;oS.""z@DDQ\g^I)uuQ7-K|)~K\bMlA_9x6Tr8ѬryGQ\x=>ȭ{ ԐAbceh6>ÉK!XYZЮf9ţL%""O Cڿɋ3+--g8t.X(M"w 4m;+'~wK`ѳ݈сb~^w7*6NCyPb}"6VVT+߸( $)9sQ'We[#<:Δ)[vDD""""""&KDDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd]SrWvsYbBL!)5ܥ<7-pɆo6JOe{ܥ ʐf"{iGMD'ř=mkAxڻy(ħ$2/|srq 0Q|ιqqBs"""KRj2ќ¶ìs-oi%;akicR"&{n>30ʿCJF^'os&""9ĤX~i iQ֭skTo/~YVcgҼE}>xKЮ66@z҈SRSʊxz5?ɂ39xG⏥ߐcFйsKiٲ;vr/ 0 IҴimJ.Gc?Hrp6QD䙧HNN&2";8b„ٸq'=kn0l;?{Pz%vֵ- 22;-=:63z |0'yPYoV5j\$i!9%$s'IHH$%5ظ8;Cxx${t`Hϛ ۼx1`+xv;v om^cƘS3=_[IgB& IA-V""""rYoفi3FCЯX,nZZ7$r0޹=6.7 ޭ7oF>pYٯcڲwoÿemcŊٵ /qER)^6KK |}2lׇ͛vZ'= 0ݸI С9ӧ/RTQmboo ԛ!C&ѪEw R2hQ ̙DD)<&IIIlذ[[\q𹭽-ͼӝݱ!11w۸>)tԒf-R ?'nڐJbbbd.%K;``Ĩwջ37b΃L-rەPk~d#ܱʂ1}O,-IDDO`<&_8~2۶寿 +^/66[`ggG޼>pMc{))ܶ7Vm4>_HK֓> lڸO.T^O\^7?_xe߽6oޅ;w`p2y0=sg/q;jKHHqy*W.)R4?D·d""/9.dxnwM֮rǏ?84w1cTّO&ڵ0rxRJ9>8C':_nj8:3bg3'r0eJ{{;xbc?nIj5 > piRRRIHHٰ~;a7nOyT &~cgs VT^ɟ|́?|!C>|,^Ebb6lmmua L !!HNNfȓKDu`1;w Sޮ] çr&TXHo㣱Ld0C>]&i֬ | ggG>9C'Ӥfg'!8q6U+E4i\;C=U_,]}$XYY1xH>+~]')))TTdOk(?4>@~c1}~ɒEx7?m!CO7nR^jiۘdOp'SG>`)4HFI:ֵ;'""CZڿs<g ܥ<87s"ϑk;..wN皚ʅ0( **Ay1bkg> Q15;j Kbbbqf~o4֭*47Qxx$!W8kVf LBB^dds"/B :g8t7~ {^ 䔍b sw~> N2,$O:7=Q,^&Mі{c~`eeeE|&=""NDDDLΎwgoٸq'ٲq1;ѥks'""Oū]ZSZy=L||/oLJe1wi"")?4"""""b2 """""b2 """""b2 """""b2 """""b2 """""b2 """""b2 """""b2 """""b2 """""b2 """""b2 """""b2 """""b2 """""b2V.@iWhAs """P< ˽e3H= "%=pܥ<iit=.EDĬ@DD`OUqws5w)""Yٝ)R(?غc/Ka=\LTXs xѸA-,--  %WaZdիAp\]s:׮m^]DBTP@RRo ]iXzq۰Aj&.]$_<ԯ] }("/BjJ*NFM&MCs nFD0`xo %%鳾HHHCXb I{.=z KW@?L?IӿbϾC;Nq.nތ`ęEz]?_-'..VCtXxĊ5_އeXg'sds8Njٟ%+>v* 4_4-""/2yu)QQ1lmضkʕ`)@rr W ltВ J\4WܧID䩠KDD䙗c6lmgZi.\&>>uk?AZZ?.XLLLqukݏ x x }¥|r{bee}vb=IAcv= onO,,,3)yjDDDy/j̻Ъ[ J(«[*n4o{;jUDqtLOWidwv"%%'+n9hX]z ՅTTMvЬQ׮Цs/\sۤa-W)oS$"0yxo@h.EDzos]Qrr Wpf-oaooG\\KBBnGng׮$%'C'ZQV xk υӦUO|+4Pxa2<VHtT4ӢE=9:rm^niP\qկqVXtUxxjժXy͛vJhР:VVf5\m_nȑDEŐ/_H*V.CÆ58r$+Wl^ꔯPҸ]bbkVo3/-p~cZΜ:4g붽.>`͚d6~[~hgDEfߧ3cǓ&|}Fre\ eİ){>tV-{~vbcXtm"$*!!ٱc?[ܹKL z _czkI\Fv}|]ڵ[bbbyA\ 8`C>ȀǑľ}GCN?k4xs  ࣱ1IL-Wj&ڷ˖-۬^e"kחЇMD^\斃Q\DD}r/ gYj >>YUz6R\16oŻoaԪ]uksp7_/`:m4M9>c$]:GJ2O<̟qgͷs&aooGrJ Nd̨^Swy֮b|;@zGc?8- 7oFwtwLd+Wn`˖̜5ڵҥk5b: wa,X#ߠ:G>`ѢtԜ_ދS 1ѱlѝ-[о}3xNa„c4w1>Bfu˫ۯ6Ge,sƄq׿ py~^K"--b=,] ޽Gj1v̧t؜C`0K>mS DŦy$iiiZvmĤIm||"NNYّ^1ζmn*W)gpPf%ϖ{h۶k7T3|+nV+^0C;'..}߱{7l}eMVtё9s=^l3=j6Iz?B||"t1^>#3;6OL ؾue3V>LZ[`PDaU+϶[ߨ,,zG lݵͭ[> OZsV;}}r'K2K/$GNt'66?lݾ0.>}Y̭umC&uu> {tx[PnUch,}[w0\]SB)֭l|n 4iZ;k]^k#v*!Wt)G\\ة[!--jz@D3z4:IWZ88ey{[DBquu:{w-g G =/sbMt˰k7?Pܴ wpR gN_ !!!`nVyxgx|go'|ԩONNt{=^'''rF JѢhڬ/ Mbb(uȟ/W|y 'o^9q,]:*qZuDH;ڼy3ܹ=HII%$*ôkLW-c 6 [6{x+++B7sE_D{.\w絫7~vQLkp>/3(ȟ? Wp9@WeX'6&ؘ8YD$+@D?v?P,[>L,QGNSϷ ƛob>bcma[;*U,[:߱dg9JxǑ#'qgݬǽQlo ׯx+++Zj9r$MN2X[[wDzlll{slm)\$C˱'7Slۺ͛vǒռuzmkkKy9]`ii]{3z\>DCU2Mա@9fE7f8OIIzlmmYމQ^usƚ~/mև[C||] ! ڿ(Wݜ_ټy7%Kw.,X8-nݧACpP(fhƙ}ٹ@=ElLOڟ@t-[5X ϰNy8?}Y:qf8BE~ ALeYj#Vmmkޣܹ$&&ammЫ8t=(܍<Ka+3onݷ>lݺ0ߙB6qtkӶ^do **>ۭ9sEIIIe]o$'%zk(@jj*]&>>>Kޕ"t.hݺ_͛wȹ:t2N0U2r/$o>_F SHLLb= >o[ի5b*!W  eD7 ErJ ׯdO=͛#**1frxiS 2q—;{TΞѣȟ?824mVFNH5er|Qm_nĖ-Ep9Fv-;׮0(vƏH)--.eǎwb8y,S?kܾ Y?Exx$'f?ȕjlԸ&m%M5{~Z̺u[aƝ|\jԨ{.7ʔ-N~9ӧΓĶm{>l:""YKD]}7jWΎoau;w*}N#[YZҲuC}ZJ,i >bɓ>րz2Z- shL7{=x8ӦUOODTV_cCl{{ͻo6^SZy?ח57q%c{9|Z[[ʫ-ҵ eg谷>m+Wn4KZmzy{г+|,y)i*)urx29njo?^,mZeܮB ~~>#5§30r4jّ&\W_g?baaANhܳ⵮mٺu w{{ŢE+m_|| @ԭGcgRbi`۽z;FAJѸXZZ0|8h^c|tԜno{WD?4M_!lB0w)8Nwܥ0Br*,@c-8wvvvzf !>K`ccc*11$bɑڽhll2ܬ/+nܸIH5<<ݳ<|9ؘX|}3$_qq?wNz1xDS6pNpUs{fzɔTΟ` _;zrRSS JDD]7%%(gw܅IKK箽CQ+#h\LB|< aeeEjj*ѱ8;;~+!ֆ[3o [sq@nr͛4יrR-ų͹wLLt >>^ =Z~'~Q<5=~emmM2]nkgK26L\x޽Jt"TPL5iVT]stٷl޴+Ԯ[RC\nt// y#3NNwWs"y(Hn3< w7;:"ΎٽO`4  yZ%<7"""r/*,2w"" RH&B0w "O{DDDz@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDD<}Hs""(ScC\n2Lfɟkhmac-YA73k}O/ҺOKfWD ""ԘO:reon֬j|k!&ߗ5*/xBYZ?VvV+"+s ""gac9v4}<8|g'G9roOV @J/׸nRr2[Krw~jdsptIIIq;pwwa8fs !!{PBVHxx$K2%2lQ;5ukW3WN㲘X6mMPp(y}S >HLJ`]$%%q)\iĦpo/ԭ_ b'PDQ*T꾵\v+bيujրE x|~9{"'jUֆzظx>NRňOH ۸GN֭f"P<8Mll/\r`wc7?'&&1h]ȱS|2+=.Q^5;B=g""X| ]ȍ;55Gˢ`bԸ?D!3_ =Ы{0ؓ菕DDFW?2i=~`q^ǍǟB߉b?7p wˁyΞDXX8CFOe/Ʊm>Yߴ_ȏw?[ȅ v:s$z=%epRQ<ui-;hѴ>jUÝ 66{؋_*M;x) QVffϥZ\̟3;[[RSSyđX'c\vkkk(U0ڶ~  -'&6%᧯{kv}ϞE옍ogMҒW;m\ PÀw٥= eMe+֬fD$vDEкS/;I2ԭYCǏ,Qg/ܷO3mpU~鮯vWx+}=p\9rs?ͅKl\kkkn3z§-j"bf ""T*Z9\ٺs/ `?i\&N٨S17 G)ߟ#GOȱkL\|<%ݍl|GRR~XZZΒ_%;ȚRFelmǾpL9߱ono~;?*Ѹ~M4pZr4|4[#C kWo4zݰ`ęjV 1xSHDDDJz~T(];{qy 9AXX87n,U0'22\9ɟϏo>E2aDDDQz% cVdfD$aaޱ:5gwʰEXxydx=]Ԯ9{3;..х k߷'G{ΙsX/̜bO^ `Dť"""OzX>g\v h/\ OOwr{{0#)) oAS8uMe54WHL+KzILL"(8/wlEEpup'.%ԬZ1#m,^QXY ,ZSN`[DDnRٺ;.uUU*5I9snO>4kk}lG$""Ժ[K\`睃ËD%X"""""b2 """""b2 """""b2 """""b2.""7 y[xw,ʈAotyJ)Hr{ysρڦtɢ.[DDbKDD207Ud*<>=kED)"""Tj,[zes+""O95*c0y1)=yyS }+T /<]<@DDjUZ1`]DD^< ""r_5V"?UʛLy(}Nb2]^xa\sLy(HԼ=j""E ""%*[YYQR9s'""l+]˗-c6s'""ɲtUK_P,T vvvTxgd +5>R,vТh@DD~VVnP(""r;GoBDD^$J%i)U刈3FDDDU*V.GDD1 ""jUgDĬ**өQ0mDs%"&" ;GAgIvl.ID6;PY>% (<bU!"OGVzYmD Syέ ATR,+y*U(IM2D&Ű*`'LD9&`jL̓;jm.s""OsLds3w)""Q.ED0\Hl^n.ED$S޷~G0w)")N>Xf>M$&&S\)srOWMڭyxwX5hϠINI1wiwuiv9@PP(+n2>IbbR/W8g|abctM./JKKcڍܽ''G^iג+TPƸ=Y~ ))UbmMkd!(T0/_nuT,ޞ?Vr= VRZ7nERR T 55_W 11EKWR\HBB"#]kؤam֫[@BqNկk -hT&Q;q*2? xBҮ%XO\ MwRJJ*}`ooO [϶{ B l]lڲ4R)կ%^`]xU+DlؼM[wceeIiX-Ѳ[ דl]/"/2]%"/( VΧ]9vD>od4h+n$.>}ұۻ,\Cq9FOW#ljeYx{m;!u._?fˌMo爉e?iܦW 1~p%GOҼ}w|5239t.GO&8*Lc~gZGpթ3iت+?a7iJ/Fg/=M_~sͪuߢ  f۽ɔϾp:F0s\:ƀ!HII5s 1tdbcppW_6YYY1'`ɲ5qΎ?xq̢Cw8}74z7]fx^#Yo =7s9~ _}3e5t}k 66>FqEx p)M\|1>Cp2.?f|~pa]z@D1x~ԫ]lߵϧeTCFO&f9R0?ew8}_ө]5**Vv88سpџ4jf]lݾ!--^}ߤ_n@zAZشm7vh{|3s`?4ү4Ccg_e|oV׻ֻm^ʔ,7fԸtc/ᒝ$^5ɌIJJb?Bjj*g}Ǽoٗ?pMV.81Y1i٬>ujUasIʖ*=psu!(*/LJB[ըZ!C{aߛYzmS +n|ߴm+?WAodW-U4ʖ{hٴ>+nd݆L0v-PVz:,_Ç#'1m°L'8=ӂ%]Y/tlzٓc߁#0wfNM Xl5OWʖ.ζ{5]Dz@D乕QwKHLt\nPH9]~1|$&&LLl#۲i%1|O\o^kKbbb 6&[wR C'+[%-!<Oٸyg9w<>+mlyk۴uڵ KՀm[60+Ybii(Y09\پs]릸svO3#HhSg~K7ѠNuztצU<|=pP:if\2yMR0 GpǮg ՠd;$-Y>6lI2ʔ,Fj2}7n݅On/Z62d@91ndz@DuAw`ƚ?\˶x)ϓJKsǷb0HHHǟs)_ RRS\||ڰ0@éѨC#qiׯV/ (T0o g9.>n%RDQ1Ovx{" 0 jר{۳ cf\ ajހ+m2~vBZZ ]&wRVUes`ڍtځ+QT1 x31 w0>/Zd;;[Ԭ€8v /[+̜=hΏ2n,|=8AҸ~MV믾̊5Gz ?~w_|B_o”Ͼḛ&>ޞX[[e ؽyf#YtM_~4k ϝĵaϗ3RZERSO+R''GVzЫe/Wg'G }ɳ:~{M1/]Ell<->ϼc|.11}w~,--R=N~e1~!J0 {0Ä˟7'N#&&\LL,tbmoG+#y(d=vv9vTV78rsAjj*Gn}z O\|!~RBB1x$ng~7P| 38SdWODdGM"$q|;w!~Avg'K O@\|<-5 %9A#&rȨhNIJ(bls.Y΃xo*"EV|4?#MߖB e1q$īo҅kTtիg/7*ҏk0t>f`{o1n,vݻv$8*GNa[*# ˭s90)})_ӽ;;ǿkA*v/˱xjo /{J/LHKKcŚ o޸.s^D5ɣ2z25u\~3>+KK&{zGoڎ{N7O1x'T>65GvF2%(V 9]i١'3p*m G.qT:F;>!-~rEYaB0w)^'!**KA/=o$\M7q`rxD$ٝHLL"11kkkΜ{NW<=iJ/Z4G JNMM܅$''ӱk-!ìaWBv|~XXZR|~fFx9 /\t혘X^y#2*Qf'#~&11g/`ogK|~FރՔ{ʙs0 5Wrr2pq6 ™+KK;vQظrqVGWODD999RXY+SuM\;qN Ss_[XXuF{z-]uGi{fdw6y7ٲ9gzaTy? ;O?Vf,*3)?VVV鑍YZRpwJ|c "PyNի]U*м}T(K\|<;vCfYz?-ߖq1ʖ.n}$U+ϒ~%b .r9&<܇/" 甕s8qv|n #84Yl2O{ʗ+i}2sh]ED~s< U*JrO}^t7gߣ\2&" 7EDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@Ds٬I3w)""Jܥ"tp 8KTH\.ED0\Ag_v]=fRDD23(y@Ds|+s""G5lRD Sy5S "z-!qFc_sƉw3H1wI""F|s&hK'LDлhJld 6}LxbK!<176|Te ҫH+s$"&"anx9=MW`{s%"/Gh?CF`kicD]FnwV6Ns(,m WZՠ{q43DDqI#(:;c٥-l 9@Pk9] !'MKul9u6-ў^EZC"򂱳xPSV`M.F{CwK, =-]<#YF4Lcp.RyA8JKgP=ܥ3FEDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@DDDDDd@䱳 )5ܥCHLIܥsHD;'k]944x9o̖"<ꌽ-/m.GDDD`yiVv (sJDO{W*Қ4u ᷦ̈́(nh<]]<@Pe q!*'Ƅ"""OdzlŨ`^YKt0wIS'҆j!'[Ba܈0wY"""r(^Y?!w廚ð1wYS'ޕyuFiΫh_?eDDD1VgKAXPw,^n.Ks ĕȑ5M?[!.Ftett8H-iz )0k|J] iiii.B^ )8O.%.9Ri[%Gl,]G=9.ED#1%hF=kwr8Vv.چKteWb2 br!qaL? K.l$*)C =-]<'k^[%;i+191dfMNRt1-K"찶"#y=(ZƾQJ7QKDDai ɪ'ϰQc++K<=ܩ\,vveI/ڵiڼ(e,Y PlV!""b.gƁE<}ϱ}~&LMp̅DzvqqO~]w~zNq1J+V@^{UDDĔ""w7WƏh|I32f2ΝKTjj*W}Dz.?3'`0Сm3:+n}._DDPg5}6{u^ԬYf!(R(];5 IL9Zü vE kRxGObggKiݢ)̘=/\1޵9]h.Yq%(`kk{}PׅKd%.[VÝ3g/pIzv⥫n,B;_׳m>X4۷|Cs4p\Q1$$w\K5uk0~ ߋk8~ FJP(1s}׷eyr@D䙗ąK4nPԴ4En/:vhE><669X[25UBb>(]7ښg+۴u7kǥt} ^pNú5hXXA-IHL3q5񱃽}T*GjZT*_n `0ㅅW׷!""(3oU$&&Qze, |}tuug'Gc'N?oz ̹t*C>^^FX8n.=~++K|=w2,@F3cx]Y[Yi.|y} \]77VVVk]8fstVVԭYvpiwM''(ZBSd%9rd7K*""1yDEǰs)6mŰ}qqqv-ydL~߼׹懅dwv=+s~TXظQp.Ș ҧǫ1iӼ6ԩY_|3&k͗2zc+~q Tx6;y/2m!Gr9v Sg~SF5W&`ggK*@&7e}N]+AJs""Sg;M0`˃ofNDB7KJJ ?-Xµa*ϧxUwߖJ"5u VVXYZRRXߺj☁|Տ ;[[ժJ[!DBpɞvvJ<.[.oҴam  Ùӯ0o^xM?dwvS|iʔ*f<.ηs_O%2n_fy6龜s*>!M^_(Shٱ'Cf>_zon/<yF(HլzgOG]<] image/svg+xml Kiwi NG Workflow Image Description (config.xml / .kiwi) Package Repositories Prepare 1. Create Target Root Directory 2. Bootstrap Target Root Directory post_bootstrap.sh 3. Install Packages 4. Apply the Overlay Tree root/ or root.tar.gz 5. Apply Archives 6. Execute config.sh config.sh 7. (Optional) Modify the Root Tree Unpacked Image Tree Create 1. Execute images.sh images.sh 2. Create the Requested Image Type type-specific scripts One or More Images Deploy / Serve ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7333865 kiwi-11.1.8/doc/source/.images/intro.png0000644000000000000000000004454115273675667014764 0ustar00PNG  IHDR R/sBITUF pHYsTT(tEXtSoftwarewww.inkscape.org<HIDATxgTGCGEQQ,`kFcoD4h^w{EX#DQivca1;^es}ٽ;3;}a޹C|,,r ?}阴G!Ԃ~ae<㸇۸kaf<eҎT.͡ g,r.йwc%:s;3#h@$U&Hr!H# G2α4 ec'1aM%8lI]y;؁xKpk@$uMHog'p:FDRæmQ2 چ[<)"l:q!{$xImcw{??1k?+60;lņ@I8896#tGxFَQqg21g,[.|$hh .za-,C'"i~>i~\>/H:Gf^6'\h&r;/ӿ҃ˑȓ=]ս\2*8גVzLӤ=W_+7WŽ87O$C"I 78 j%5'P6tos K@*50c@4mlGAs|=ؙ?(؁Ľ .ؾԆ'n'p4«~#M.t4K9b?qp6T~1P+s W|iLjSypԪZ<>DjyuԊk1.c_:f4v|.=DjO0vjL^dƳ[NishԤ[pțe, G0 Sϩ0uYv9&Eoa: ߭0}W,fb,ABwzsϘXbŘ}g ',4p ^K.?Ž(F3=I@#]v9w.\U)Vh8M%a\GXy7#Bju@، #&k~?F% s?%Uy ! )} Wpy8EKD[΄@ByC`Y|J< {vuk7F`3܎T2 !BX:HKBxS*~vay@XcSvp]_"4:j)!|i3S\n^~ =``]vX3FRd*t5Af%FZ(ڀG2'?20 awaOZ@ > B8^/ 3kq O K)nb #|N.}/p8|`Izq!<ۀ.aؑlW[ыux_@kU'chs4Tߗ<̀\G+xزk&sQ`G`q^#n Ԟ#K!lBօ3ȣe >,n!͋KM!|Aw+2\ 9n&|V/aV f5F-{*9GM)q%ϕ^:0ʳe^rGKVRꥀ\EuץٛR|{pv#gB i'=!֩ 9Yoi*ɾv~"z;؉؉ >;?ȈR@Dxux}τ6TL;0s3=oړΜHw^#RIXn'z|=B8z[tFܧtJmu/ɍ| B8KH;NĒE@>aCn'!y/a3 aYǓywko7b*d|!-ZGH?B1:tƴ ҋH@%BR@ IkLwQOzI) Ɓ]) !0/;>xqZ#B`e &.Ž) `5.:IlpO!֦S[3NSNs$ [ Ţ[>%NӽB8t`h.v#{syH^ |jݗ)F@>d|OaWG\NpkiI]EX^pN=3ɰݮI'˜R۝5R;Źp{G҅*u@cXo;KT݉+K׾iZ@ViLf@6&qs2- 6gQb8F^*\tgba;nh#CRgu_cЗm3[|8$U؊9h;Ԑp#p {"Qc8ɸVΌaY"o4g%G# F/uZuė1Is5CVN<ܖ_2!Tx޶?ˇHRnwZqWbL}ʀHjbo~(Wc֩ o.&x*VrB>L*XlyB<<\DRؤj}*{{%M~z+nӇJl7]CMo@$u `j^;=48xVDRؠ1B+t6 :އv^}TFb?rZqw"#l:7u߭m~|MĖ(I0 lx[8<3U )[90;IyCvD{8#Syc@$#tȯp"n:wȑ_h@$|-l©\hV1zpvo ;_O;%l魘lƵ81 $fW6fybJC@gg)a'ne ϝܖs Jz5I"i=i .ADvNg?6eYi߶0[p(W3qtks#Oe;ZC$fy8mDd0˷_փ 9 ,F7Xj_wHah c"Wۜ*CF;]ٛBn qHam1L|Vic I:'>>$dv8I$bCH&wPzQ'gv+:}L?[Sy]"N/!qfaVn*.geW{Iyگ? o-,Ϫ 8'4I,{,hȀHt/k82 *}! IN-<ɀH| INdnGCDR{ŸѐT^ 5u4d@$U:WBҎ J'&‡hȀHtZeB;2 *}x>c+GCDRS—hȀHtBw92 *Ν^|+GCDR3 IO3/.w,d@$U>]|q+ IN/!"i;_r4d@$U:3Bx IN /!Ž J'jf!" hȀHtuBu IN !|掆 J'<+tLd@$U2!GCDRç&>؉g_hȀH|2 L^L Oœ|!"7{; 2 $"I$I$I$ɀH $ɀH $ɀHd@$IDd@$IDd@$I2 $"I2 $"I2 $ɀH ~\]KīҌyQ}aSz;W 4]vuV oye@d@Kr^ 8 Ԙ2 2 Rc2,""5< ﳚ3ˀȀH 2 2 1 1 1 1 DDj;a6goN~l\3q%"RrNE#(}ʇL~D2 2 um(f1u?fKDdOn^Kp ȴMd^#FӀHDYpUO ɀ+}n@$*xQWwɀr5r 4 MX'W lɀȀ̼i|I+\h@$* aWw߀HDۚ:`c0Yo1C`I:o`6f0{7 \ߏ;g*8Rwes.?Âf ƭ^bvb7 ha- ze9  o{OeyU H[ ҁά'cٟZ|uyӍ'ϴtLI`9=YRY@>j) ݘ$b&9y{Yt/`"o ]Kr(x˘Gĉes٬?H[}C%JXx)<9_8S$&{3])!0I\˲ <!07a 2Jw/1]$d)nUg$fvumZ@VyeO&kySC.i-!9;ZzU:n!ΗŏC}"N<0ݕ/nҒ|L!_egٍ˦{B!t|])[z] !_3GKXL!KSưL _p)!G9»a{B;#J /p$g!_?Kptg lKXDd*?2 !!%qR`k1eBnBX,p/!yR@v$B`qBf6Y a2Љ8g- Zd6 Bٻ/n;yVeR@bUXc ^gR@ܕr{*~zF97'Znќ3"W32#Fksi<- lRA6Q H|+gSqC3:gtqQYtr`vf@tܟy3X|[1 ӭ?o4w + o]8دnė{KQgU& t*}N ;CXd[ ˥NWu/2B5W!gҩš]@g|/3&E@MsC Y/C6<|ȐbwC-{,ey59*ls%rYFN 2_y"{Hl;l_\frcϐ,NilVdrV5#@M ȤLiL@7ťg (nm3SỬQ2} a@ ke2}Fe@V3>!ГOO 鞁DN4"٘yBV/-_6dtrbY5Ԥ&˥G!;/jJ/tmr) e_~e٩ɚ!&-bB!)2d⥫BVLMjtryt29-5Qeͬ -}Uk y v*—Uڜd"!,di9tf?bY9?9(C a 0+ mgtfϯ_^ceNm@R{5=S@FY,e@jE 3 /Ԛ9b?!w^--*dԤ&ϖ^̪]!۔wei9 w]6ٷ==gVS3C)߬ Jepj#8 d3v(쎲־,]7'sV3*C>/f>˦ז¢\8X?iw> 3 ە]eRL=kgR@V eW%ee#NMv y7K@Fdt MuC6!/Nؤ|U1+ a0!ŋNs3!ņ/CR{;8o;6dCž!ЍSyWVF9fܱ؛!ٟM?ropN؆gZs&SL 0CRBΙn_) _: +CJM٥TOg5aGlRe+y"gedjrnA 2rFi鹥} =--?C*{uv~2:7 0\)svHlSr}N!KR: ]C~rqV fjR!}sQ==B+q)7dyuwߕNY0MMOt3"CUZ,3sgdo Y-t~okȎy55[(wl!.[>d\[tͼpJ4 T|o_։9븐C&rs9hT<} ߵ);f]sp:[=$rMX1q.jrw=d<_z6wK3l^mdz,U,_%wQɳ٨t3ŀ̰No|un@YHq ٪)[3KO-5<2٥ܜy35y>O795wp欺99MwUMjd<\z1)8)Jg!7rt/˽r^Nɭ H=k V:|3 Rǣ901Ae}+jg֮Tsx\ʣsa|Y7#vU靁l}} 'à%k!K'7 MZ7f;맼+\U p3F8s)آ9oulv({EGtO9$ŀ4y_8븇8ݪyQ1G7͉xlm@d@ :r<DĀH(Kp՞؀ȀȀÀȀux\΃lˀȀux<& H s45Z7D}\!`(h@d@| K2 2 D2 2 2 2 2 2 2 1 1 1     sˀȀHĀHDĀH ϻTg@ w#&1 ڕq#FP1 ڕTc Q֫nH21 ^wC7jX]1 /IWb@T+

Q#C^E#A0!0 r%s ; Dy/U}`@u~a2򩃡Y?xء0 +k'V ό]K_!)Dx+: 2 $"ɀHD2 d@d@$ID2  d@$"ɀȀH2 2 d@$"ɀHDd@d@$ɀHD2  $""ɀȀH2  d@$"IDDɀHD2  d@$ID2  d@$"ɀH2 2 d@$"ɀHDr:IDD d@$"ɀH2 2 $"ɀHD2 4m"SvDd@$U6ò9,ȀHl"οX+X!"҉%ms!"҉؇wo5 ʧ!"8w4d@$U>O,L'GCDRSq3>"82 2{!XȀHjnב԰]HȀHjd<ő԰ɸ "qnpADRçtd@X={M`Ϫ1m]Xַ\7]|/R'OWTGgw}k]B"qS#e)Yc@$BM}4Rfj_! |y7j.ǀ-2np`Qs~)TcSX9d@TOB5S2 ֕qATc<Qծ;_7j<QZ; v~UGDUiFPMp<2 ΀<A5_ȀȀHĀHD㴩< p.a rz8 ԰FvF =vN o2ʀȀH 2 2 R+""5< j?9 ԘL3ˀȀH ;,2 2 Rk8 d@ d@d@ d@d@ d@d@d@d@d@     1 2 R +~,a@$"RrnMӲ^\V4 kC.Yx*r/KɀȀo${P=(t6 D.ͫ|Y8zɀȀ 4 _ ɀӈ@/">eιyQBٍ?ʑu,=*I7( 덺e;HjRw΋B73=݊LQ٠36Fթ͖:a}sUl(]rݐSCV+sh) WkK?;,5y3 kJMzw^.{A[zIsw k-]dQv=+dߵ}-Y?ǔW|5y Ԯ\*K[a9Ml5 !rhȊ97[[C~Xg@V++~7dL}q,@6٬t" ?67*rN 2{=}$.qDY*]KɷL YR[fZv֟'Vv١9;o&gnj)diw[Yȹ=_z3 uW*0 ȝu->SmJ,P3D'ҥrogxy!+tZ۸6䛩IMQ_`<雿/zgL(?y=/]SJfk"ug xOt 0o7΢3&͐Sf.]9, Kq3WȞ)fMkrleTLtM\?¯fDd gjriṊy)5y-W<_dBE}j'ݦ 9!CFYp|$y!fw3w9fKUobxJ˜ 뎺A>J l?ӎiGs" GeyfwJn7 iCJY(S[IK}s3/|.Irv*XWKaκْiW^?dHr4Z2 /Z S35 QU$_/14 ꘳nd@d@8RU}~oY7[2 2 uoP+M9zɀX §gκْ&? /uwJ7=f{/x㟾݀ȀȀ4tC"cywXwoκْdc2_!Sx#Y:笛-7%rp<{I5ĀȀȀȀȀHĀHDĀHDĀHDDDDDDD2 D2 2 D2 2 D2 2 2 2 2 ĀȀHĀHDĀHDĀHDDDDĀɀɀȀɀȀȀȀȀȀ1nj5O/ҍob@T+ڻFP1 ڕrTcMʂĀz-r_R#.ĀWB5MS*e@ <C5 u0 DU2ͻ~D5,]WĀ 9,od@ n\pGV}G^gDNofTwXoU2 DUjˠX0 IuX8 W#b@TĀɀ!K]Vt sAPL`@TaPU6; j[j]=3aP}]AàFU*:]p {]w5GA0 r%]?Bt D  {iᩎ O'fZ""i|IoGED63,c""i8/_NDDRe}#""xt.ȀHl"X J'L-}s!"җ82 *hȀH|*^|c!"!S_o I /A Mƫ M>#!"aq.ADd@$I2 $"I2 $"I2 $I$I$I $ɀH $ɀH $IDd@$IDd@j> ۳[w@2."J|ɕ݆=q4s4r5)'i%mLrr3=[Ér7YhH E"3)&736ag9}{?׃o߻}<ߕ"ΏХۤAQ)X8c}{KC RcpqEا3NӧϔHQ)]8oMhLuEsy:ۑ :t7bc7_,0 :/oFe(X+Di=W3tE,If "bxȧuÆL%ks&wî!~r+*G-VG8_Ģpw-["N> R)HQ™lmMsE#X{;TG{ws◡xO_MMRxk4a7vt#GKE6g#|-ѯ_ET)J E1^K9ִ!=F W5cK,7Cea?}u (x+IXaEe7Y0 bbpĆaV)J E1f-b럻^qDَב# dKv}^@sqat_ЩRpk6=">)p-Z(v.Ӽp7VS*W֡S(qHX)\SQ)W8S}V'GS/6Xk$'ElivR7~q_f.U"ua (XT[~a6WBڏ垭ehiY9,23=:|}u3"̴nqyxHKKgX/ҲT@bPFzv^;f&سgs"E;?UBIENDB`././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7333865 kiwi-11.1.8/doc/source/.images/kiwi-logo.png0000644000000000000000000004165215273675667015532 0ustar00PNG  IHDRaaϣbKGD pHYs.#.#x?vtIME  IDATxܽy\}۪h @jq%EI۲lɱ=>>dIډsΜ23ؓr<ؓۉ=8lM-B-/wWuo BmS@uAxiƿgOk<!' l "@N,^OG63yǟo!S'~iZ+58 Gpbhru! -Sk!,I2+EȜsq8 Eo&>'cӓ8OXI)m14vHGi$VH!~s@Cd;dblqIq̹cǟ/WOg!>~o*ZcfsΓ XGfr2c!@ VO{HݶĢVs1Nk ~w'_&m[_&+K\n&:s,Y5X8u8Wa!Zj<>H'7 nXp! =T j%CfJ{ _~|f_~%cO1$%4V.X"(f8\oE XY#=<%5_"b6\$¤Y&F+U< 3pGO7`<r~!WwY``r.#I CbX0#w6 @JAO{J$Ykid9ɱaC_kO{ևw c+t-NrR/=~!~cS tKcsq.ap aP&t6i!¡ȭ#7sދ~H))A GɏD&4pΒCYFrkp2-5Z Zz\5/ts_zGœ35a8~ -J)/oL)t^V@H|]2uv8Vb{! AC sJR }BϧDWFqHޙdyFn /()=򵇧u@H Α[COl9-ӏϼx^(ty^SD:!C,!(*!A =Nȍq'isє!4b(̟ iL1H҄vҥݍc"]Ӝ$;~}/<8_L|fCΗ.욢cuXW0qZ)C7h=Dmʉ sZn }l*ZW텺 z@0X$k sKnmτ~GSkgfO~|Lf>0||'~6:2.l\Ͼ[+ɍ !kqJ3&1GXgQ؇J䁀v;0αnF{Rxx&^~DO?AJ@u99cm1g6} (~k#z3sxnV:DKO(P nalNbNMI )5PRB+C`XKn{ɭce-gH QDU βX[a~E-BTZIZ,$a/$ K#DAXkXkQ c@!{ZOk*Qs% $YN\R)C8lU~Ӎ=.~7?|_&ft`0>ᇯ|lqraA 2rRBBת;56Z|י]Ya6Yȍ%M-8RZ"$$BvPѴ)$+BWB)Ec,AQJzJu"=[{/G>>oִ~ \>_;< a)%DAH) (!RH_Gi9'3ֺ*/{vgr0B*u,7INhH#{U2CX5DcAu[f8d%737IGi G)(6MAHD:D_h+1Rۑg]?~`{?3=zR?L! Xu93YAJNWѪF.Rd:  ع*CB 0:A_)@+BU$D 43@IQJC̐8hk Iӊ( < (E%0$#{2fO g=rLlHM1pZ jK֖[;:2C䬬uٳcOnv" ZEB=-dR <ƇUfut_czZDaCJRЫBι"0 !$iYMzyp7ֹ<Ο}7PxpÀdt) <z8ZiUֵ9]e乥R)"InzU*t:.?W&vL?tum' Ոz3& iю hƘIuAra]2R pM4>̪S)kZy(Rh.ZȲqO+hԣ2V[ <z:Юk6SV֘?eVDYsɖ7Ơ&s9}j|ܙ\|er/p˽;9if.=R i`lb0 H9ևCܺ&pvR}ӳ5kmJ!ZEnLNy@PA8G(UJi@-h{0̿Bq#[wfp|@Hwt]~Ŗvk1K9Uh5[̟1zsuXol\$ jFx/3yqqF:ȥ9Rab@ZLlsܰiRWҞ/kD <|ϻѺDwyW–FMr֚1If(I\oaatOEhtt6 tx#ȷһ蓏MB `t=n)BQE9((FfS6Fi,aTk:#4V[̝q,{'*)Mt{&{ep$2a9s/,/rͷUB|-L4B4U")&Gv‗^|s4[ OUxJq j͘$ Ialh_ɍa@nD̈́qtGd#PM/g葩Sj3+y2%" d]Wmp5ꋅi~췺Ubbjr/&u\8wپJ2{]sIǾ6҅cysͶ=|5 W6 &3V]I̸q~XcivV4ZB`-$#ӂd=8OXo}='Ϟ}5͙"^SVi5ABV!%222w1|S_9;^4[G|C\*9j%:f~Zju~҈;{ 'nZ̞W@;nrk[)Y~ k,OhtHa (I[%ZwfYփEzЈ}>ى}ݩה-{O6eZw)WF qܦHa Bڟ>ZXZYdj&tN{G.Ø>e$SyoFkkysN'CE&,`rGҼHSgnJCf b@%`/$39i4'9Q(G~Q=O#p|꣏O<է>#Hq5%0wݼj!QqgƷ}dσ˺"4Da %3|]"4U*S4:R fT뜟5^yk/Btu۩<_%.-5&9@_Q5̭4iuiC,G)+~R"BI0LR#WHذF-.*WB ]+-߰5UZnʢ e'BJ<Px2퐥>J;3ͳ\6|$/xy+1J}%ٽG}?S4Y^?{/qqA[|29Vv% J@Hd% {aT;C7|t'f_B&.c6ߥH62l*IQ2;LnߡzBIy\zV-A6C_aN0)߾m9/q*V8Ɉo];&{җsr9^=qskE@s˅Nspc-J@hz:oVb#;rvI,LMwK]sY\`;\\NE užwk#{dyf7Y,_~ttIoh>p=J rpb̮[Gx{ع柞[5з{Ƹ}ϲ蠄 g0}Z!ZKŤ9H!z%0:Qa/}>B )$kYlxN czؖ4FC1q]UTG#Q0OzO6WI3+-N)@9'`g.Q&pe`[Ğۆ9 V(vq̧>t?؉Bkk5B/B_U y@>pkaoXZpM{x+_z nF{S _4$KhwfpU,IR ѯ3Ow/źz뛧־ o5Iz8RyPwL*asli[BqfV bs;x9mwu!}c3/ڠ.o8Z|48S3r)EO8yFㄥ4 w;GY.79zzq&96J)gw&-Z5qb# ||-|REXl]9(C~)\ Rjf6RdZě +eU_"<{e_^`mT< lCS][(GL:đ/_!'O(-5;z:ŵ !y3RcFHkJܶ>o|oSsGhwju4,x{ݫM )P<(EeJƙ^.;d!%EM"TiH!nnνl{88+~`KjwŎ} {y!Qex擧'9˩l?g7BmŎ6GWfP"7]T(,֦H((RehW=?rZ/$ +[tR$d!J~VYP+K& =>Z n&E ^ 5 " FZ Dk5i^ԁS;'Hj)ոzwg-^1u0QI~Оdph/n\WoҰ^;m 5\$]"v3JT%5g;"p⬥IYwHRCx_+ 1k G0H#1PbBxmjMOTX]EiGG*7jhO*G4F8)`m!.z;sd2C7ijS6x1y5L8/!ʕ€3T &2:%J~?.IS/4v\ 6`f6P^z,thJpL%DBx#EiQYEIXt $6첖r{,(=ŕP_с&\ofxg[ uxq~ Il9D%X)P3eїqTYN6B71Z·[f@:R)F$IN%uH-{ =s*֦lz= 8-BYLs)u!F78$^!f9Y 3yhw1BB\5!Qd\&O}t'KiyQ)n@o?{WC7si4vo|8s-vTq$BJ\E J# <!Ejb%I҂,cVڬ>]RInBvThWI!٢QQ,^T8x}&76c@>+ZC \3[z [kX3_hnly8^^yhx~bfJ@K*ר-q,7۬6:46yb>oW{R TBƇ+W"qMKrA<É Y+8o%(l[@#fIN_[ *Ce8$1|v/ ˴Pam\~d-K q+6W&Z30qm?|O#MS <4'?5p-v?ȭfQN(?  3ZKۿjZnSCYqrM_9`tD_䣄!+P.#e :WTk9RYL)o\"V }9ln3 Tˉf5r;:P{Dʃ>ɒZ/yvis[rmɛOQY%PJm>7Ïޱ:92E$YY-O0<ϵ_ǭBjWcnu5ڝ.YEfLjɧD_BHV44LW+<-F 7"jn-@pnlb)bgE*zҐ'=MvK`f_;3<5Ώ4o{G?qÓ|wg݆yr1;.^ i1Pct@8)4j1#ーwr}`6KŬ6,Xcդ'a$CkxE*qV8R!El FxebyhP]$7 24Y?9g5Fj{Iio7>8)ᅪȏ/"/y>KGxwN_:w{ZٛVPX{dtp]U?w_F'dl`j?c$YZAYYi҉8kQd!+YM µ)FXcO/6^iM=b-qශ=}ߣN?5\"2v} A0rsrYT4|7qC{+ZǎCgןЂq/yY.-qfvpoW^Ypv"/>}eF62P+UhuZZkMLn1(!Hph K]~suE#\+͓v~cyן^T(}K qvlƁbjŅY_?wϮ)rP嵓oы\|~/o7޵PGhQ<|S`D1+r ݲ9{@~ M.w5loWc^qwRPhuq1Oo玃>B f\am\}711؏E ϋځBz(0G86.$dC>Q̔zQCSMgJ3w^3vN^/O= a7*Bꢠ!M-OFJ}˩yp5jE~h{O~nϗbI1S/rĝ?ګ;A).\Ki7|dF|i(PڤI5`#Ie4䦘 Q?L|뽧*uӔ.d*?N*}g_kZِ/7_,4Z;-g>dN}yOҠ'!_n4Zcv9E 1&c[8Bn (!:TԠoh)彪ʦ}zH< N~\KsgfwQ㕣Gx~K4Ǭ94N0PVw& Vؾ࿚}}p{w]G$sT$cf3X'~֯|?*~񅲞/L0R*;mcqyi׋ zf0rofG)ދS4~Y#ŘO&a^{Sh˝3OywspAA977WS >Ymrkq_Wԅ.@d|`G__{ۿ-'''o|Y-+_S?J `'#*`\pk)^te BbeDZLZҒ/,Ӯ8 ^~k!X㰙EjRlq*d{su6me&nƼ~q=15@t4+q7uU3)wrC5r)3ywKyY?z<6U964Ӷɛ-Q Pu̡}g-7ܿhbpj=+x`2#See֞zmffHjY[Rx/-, Oe9Ξ"3)w˶1!'Ο0r͸Ixhٵ_űُN'f ƀzmb}#aTJE %yYCTsV[̬IذZ|Y̅"65F.!(%EDȍnԳtgUr1JeZ:F9qѿo}ZcN_ngbp$ ;E'n[ȏBʢYdsj9m>?ЛDtibVɛ]sYljזly%&u+q.)bv1$@P*Y9&c\LJ(+_zYJ8 W?R[ mD)zd%t VuÃy`KKJgX\sǐvsG! upkuDGK(!\eݔ'\J'w #CUigێSj[$dGusϽw%$!| I Y8;Li 6 Pϴ?!Cqfiv3. ئ=`Sl !!#iW}!i 6t3wv{ ⚦#Br¼DY (3`Sz2*1mM_(\P`!6h^(WW}UK>I珕e&c2m6!11ܦ8$6Q/4,!7 H`ɂ6, a]2#!'ٝ2ݢ=?8Q?B*1)¸BgZlJ5𫟜#Ogblaߥ^<N~1n0H,OE$$'.&0TU{ BUtGQ]hmLaFDǿ`ru6"3@zسgohJ$K|4wK~   yaZmoL؜=Fpr!Qy5:ia &Q錆YN\: QNϔ`7PH獕G,,*`2'ܗ4ӎB--/Tk.PJ1 0322`ydv2xvOʶ3*15zUnFh#vwo_m+$K Q*E,x-OPɊ4&Ԛ[is}y SZL\ VX+YI- _}g d\6l-y2 Cy䩣s?,Q8a P1' J}U*$edR۶QE % ycHA  ʷf$p eIQԪ\E ar8 8f.\]+xkO?5kL}˖-n'm$Go $E,.U.tAJò'##n^vbQnOlUMdq~y#߽HV%pJ Q_i;,` "?Rb0w5۔Fj ~/fW\ h,MS;(hw1%K XqY_-y߀t tY|Ŧ>1Ү1I*}ϸ J6fw]}^9'\*v[>Mɂ.g/h^dڃ pd{kF^pG!n^D\Z*en"D|k&7#*/൰RF1@<p6Un_]!ܫS N,zyG˒-_n[2 Sԉ+TU [\+]: 4 !avki *KT<)R; "A"-Gg;: մV Ө tGG n}g=톚"LTgͱ<ۚi J&x58!;Gf,ྖĘ")ȸ %MAޘEZ{yqƷ}Q B9ۉ?:/v٠()8+qrV(y%ط.՟@So^jW]QF|uD=YIDATբâŪ'ꑌ3ᨲ:}nK_*77`$ꝟo_]Go0)Ψrjb C#2*W̼#9Þk'$ zUn|@9aNP 8c8+ns <9T߮aSz["ʫ¨Ɇ%ߺyɥ{;UJ9ԑ%s9R~lsRJēGGsBaضm8Y8_ CJc9@d/8q(jR"ɬz 7Ȍ}C^x]V^=/ۅB!{H7>p1xXĴl Pk.۶܉w@?0{=\*RQ *8EQm۶zs^ BAc:o$7 Tlx&uVIDJ)QFesΛJ`~~EK&=+W\gϞs ͛Oԓ̲,֚ 7Nlذ[n#dv˖-~g#ئMg(PP*ą m˲֞={ 0;qZl۶mX~e[)eRuwwŋci The Author user@example.org Leap Container as VM false 1.99.1 zypper en_US us UTC To build the virtual machine image from the currently hosted Leap {exc_os_version} container at SUSE, call the following `stackbuild` command: .. code:: bash $ sudo kiwi-ng system stackbuild \ --stash leap:{exc_os_version} \ --from-registry registry.opensuse.org/opensuse \ --target-dir /tmp/myLeap \ --description container_to_VM_layer The resulting virtual machine image can be booted as follows: .. code:: bash $ qemu-kvm Leap-VM.x86_64-1.99.1.raw ././@PaxHeader0000000000000000000000000000003100000000000010207 xustar0025 mtime=1794079670.7341 kiwi-11.1.8/doc/source/build_methods/build_self_contained.rst0000644000000000000000000002057715273675667021313 0ustar00.. _self_contained: Building in a Self-Contained Environment ======================================== .. note:: **Abstract** Users building images with {kiwi} face problems if they want to build an image matching one of the following criteria: * The build should happen as a non-root user. * The build should happen on a host system distribution for which no {kiwi} packages exist. * The build happens on an incompatible host system distribution compared to the target image distribution. For example, building an apt/dpkg-based system on an rpm-based system. * Run more than one build process at the same time on the same host. * Run a build process for a different target architecture compared to the host architecture (Cross-Arch Image Build). This document describes how to perform the build process in a self-contained environment using fast-booting virtual machines to address the issues listed above. The changes on the machine to become a build host will be reduced to the requirements of the {kiwi} `boxbuild` command. Requirements ------------ The `boxbuild` command is part of {kiwi}. Add the {kiwi} repo from the Open Build Service. For details, see :ref:`installation-from-obs`. The following package pulls in the host requirements for the `boxbuild` command, like QEMU and the tools for the supported sharing backends: .. code:: bash $ sudo zypper in kiwi-systemdeps-boxbuild .. note:: The `boxbuild` command was formerly provided by the `kiwi-boxed-plugin`. The plugin is no longer needed and is replaced by the `kiwi-systemdeps-boxbuild` package. Building with the boxbuild command ---------------------------------- The {kiwi} command named `boxbuild` uses KVM as a virtualization technology and runs the {kiwi} `build` command inside a KVM-controlled virtual machine. For running the build process in a virtual machine, it's required to provide VM images that are suitable to perform this job. We call the VM images `boxes`, and they contain kiwi itself as well as all other components needed to build appliances. Those boxes are hosted in the Open Build Service and are publicly available at the `Subprojects` tab in the: `Virtualization:Appliances:SelfContained `__ project. As a user, you don't need to work with the boxes because this is all done by the `boxbuild` command and provided as a service by the {kiwi} team. The `boxbuild` command knows where to fetch the box and also cares for an update of the box when it has changed. Building an image with the `boxbuild` command is similar to building with the `build` command. One part of the `boxbuild` command is exactly the same as with the `build` command. The separation between `boxbuild` and `build` options is done using the `kiwi` subcommand. Everything after `kiwi` is passed along to the `build` command running in the box. The following example shows how to build an example from the `kiwi-descriptions` repo: .. code:: bash $ git clone https://github.com/OSInside/kiwi-descriptions.git $ kiwi-ng --profile Virtual system boxbuild --box leap kiwi \ --description kiwi-descriptions/suse/x86_64/suse-leap-15.6 \ --target-dir /tmp/myimage For compatibility with the former `kiwi-boxed-plugin`, the `--` separator is accepted as an alias for `kiwi`. For all options of the `boxbuild` command, see :ref:`kiwi_system_boxbuild`. .. note:: The provided `--description` and `--target-dir` options are set up as shared folders between the host and the box. No other data will be shared with the host. Sharing Backends ---------------- As mentioned above, the `boxbuild` call shares the two host directories provided in `--description` and `--target-dir` with the box. To do this, the following sharing backends are supported: ``--9p-sharing`` With QEMU's `9pfs`, you can create virtual filesystem devices (virtio-9p-device) and expose them to the box. For more information, see `9pfs `__. Using this sharing backend does not require any setup procedure from the user and is also the default for `boxbuild`. ``--sshfs-sharing`` SSHFS is a FUSE-based filesystem client for mounting remote directories over a Secure Shell connection (SSH). In `boxbuild`, this is used to mount directories from the host into the box. Because this runs through an SSH connection, the host must allow connections from the box. If you plan to use `sshfs`, add the following SSH public key to the :file:`~/.ssh/authorized_keys` file of the user who is expected to call `boxbuild`: .. code:: bash echo "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtiqDaYgEMkr7za7qc4iPXftgu/j3sodPOtpoG8PinwRX6/3xZteOJzCH2qCZjEgA5zsP9lxy/119cWXvdxFUvyEINjH77unzRnaHj/yTXPhHuhHgAiEubuHer2gZoOs+UH4cGJLKCrabjTjZdeK9KvL+hoAgJaWxDUvGsXYDQTBHXlKjniOL1MGbltDBHnYhu4k+PjjJ+UEBN+8+F74Y5fYgIovXXY88WQrybuEr1eAYjhvk/ln6TKw1P6uvVMuIbAGUgnZFntDCI91Qw8ps1j+lX3vNc8ZBoOwM6nHZqq4FAqbXuH+NvQFS/xDM6wwZQhAe+14dTQBA5F1mgCVf+fSbteb0/CraSGmgKIM8aPnK8rfF+BY6Jar3AJFKVRPshRzrQj6CWYu3BfmOLupCpqOK2XFyoU2lEpaZDejgPSJq/IBGZdjKplWJFF8ZRQ01a8eX8K2fjrQt/4k9c7Pjlg1aDH8Sf+5+vcehlSNs1d50wnFoaIPrgDdy04omiaJ8= kiwi@boxbuild" >> ~/.ssh/authorized_keys The public key mentioned here is associated with an SSH key pair we provide in the pre-built box images. .. warning:: If the `sshfs` backend is used without the host trusting the box, the `boxbuild` call will become interactive at the time of the sshfs mount. In this case, the user might be asked for a passphrase, or depending on the host's `sshd` setup, the request will be declined and the boxbuild will fail. ``--virtiofs-sharing`` QEMU virtio-fs shared filesystem daemon. Share a host directory tree with a box through a virtio-fs device. For more information, see `virtiofs `__. Using this sharing backend does not require any setup procedure from the user. .. warning:: virtiofs support was added but is considered experimental and not yet stable across the distributions. Feedback is welcome. Building in Container --------------------- By default, and also as the preferred method, boxbuild runs in a KVM virtual machine. However, support for building in container instances via `podman` is also implemented. The boxes are built as virtual machine images and also as OCI containers hosted on the openSUSE registry. In container mode, boxbuild pulls the requested box from the remote registry to the local registry and starts a container instance. The following example shows how to build the mentioned {kiwi} integration test image in a container: .. code:: bash $ kiwi-ng --profile Virtual system boxbuild --container --box leap kiwi \ --description kiwi-descriptions/suse/x86_64/suse-leap-15.6 \ --target-dir /tmp/myimage .. note:: The provided `--description` and `--target-dir` options are set up as shared volumes between the host and the box container. In addition, containers also share the kiwi cache from `/var/cache/kiwi` with the host for better performance. .. warning:: For building in a container, several runtime constraints exist, and the isolation model is not as strict as it is when building in a VM. Please read the following information to get clarity on the existing constraints. ``loop devices`` As kiwi requires loop devices and calls other operations that require root privileges, `podman` is started through `sudo`. As podman runs daemonless, the calling user must have the privileges to perform the needed kiwi actions. Non- privileged builds are therefore not possible in container mode with kiwi. ``linux capabilities`` Several Linux capabilities, as they can be found in https://man7.org/linux/man-pages/man7/capabilities.7.html, are set when `boxbuild` starts the container: * AUDIT_WRITE * AUDIT_CONTROL * CAP_MKNOD * CAP_SYS_ADMIN ``host device nodes`` The host device nodes from `/dev` are shared with the container instance. This is required to work with loop devices inside the container. Device isolation is therefore not possible in container mode with kiwi. The loop device handling for container-based builds restricts the number of simultaneous kiwi build processes on this host to the number of available loop device nodes exposed from the host kernel. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7333865 kiwi-11.1.8/doc/source/build_methods.rst0000644000000000000000000000216515273675667015150 0ustar00.. _build_methods: Alternative Build Methods ========================= .. note:: **Abstract** Besides building an image directly on the build host with the `kiwi-ng system build` command, {kiwi} provides alternative methods to build images. The following sections describe these methods and the use cases they address. .. toctree:: :maxdepth: 1 build_methods/build_self_contained build_methods/build_based_on_containers The `boxbuild` command runs the {kiwi} build inside of a self-contained virtual machine or container, called a box. This keeps the build host free from the build tool chain, allows building as a non-root user, and allows building images for other distributions than the one running on the build host. See :ref:`self_contained` for details. The `stash` and `stackbuild` commands store {kiwi} built root trees as OCI containers and build images on top of one or more of those containers. This allows rebuilding an image without access to the original software repositories, as well as turning existing containers into any other image type supported by {kiwi}. See :ref:`stackbuild` for details. ././@PaxHeader0000000000000000000000000000003100000000000010207 xustar0025 mtime=1794079670.7341 kiwi-11.1.8/doc/source/commands/image_info.rst0000644000000000000000000001411315273675667016220 0ustar00kiwi-ng image info ================== .. _db_image_info_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng [global options] service [] kiwi-ng image info --help kiwi-ng image info --description= [--resolve-package-list] [--list-profiles] [--print-kiwi-env] [--ignore-repos] [--add-repo=...] [--add-repo-credentials=...] [--print-xml|--print-yaml|--print-toml] .. _db_image_info_desc: DESCRIPTION ----------- Provides information about the specified image description. If no specific info option is provided, the command lists basic information about the image. This information is also available in the image XML description file. Specifying an extension option like `resolve-package-list` makes a dependency resolver run through the list of packages, providing more detailed information about the image description. .. _db_image_info_opts: OPTIONS ------- --add-repo= Adds a new repository to the existing repository setup in the XML description. This option can be specified multiple times. - **source** Source URL pointing to a package repository that must be in a format supported by the selected package manager. See the URI_TYPES section of :ref:`kiwi_system_build` for details about the supported source locators. - **type** Repository type: `rpm-md`, `apt-deb`. - **alias** An alias name for the repository. If not specified, {kiwi} generates an alias name as a result of a hex representation from uuid4. While the hex is used to uniquely identify the repository, it is not descriptive. We recommend using descriptive aliases. - **priority** A number indicating the repository priority. How the value is evaluated depends on the selected package manager. Refer to the package manager documentation for details about the supported priority ranges and their meaning. - **imageinclude** Set to either **true** or **false** to indicate if the repository is part of the system image repository setup or not. - **package_gpgcheck** Set to either **true** or **false** to indicate if the repository should validate the package signatures. - **{signing_keys}** A list of `signing_keys` enclosed in curly brackets and delimited by a semicolon. The reference to a signing key must be provided in the URI format. - **components** A component list for Debian-based repos as a space-delimited string. - **distribution** The main distribution name for Debian-based repos. - **repo_gpgcheck** Set to either **true** or **false** to indicate if the repository should validate the repository signature. - **repo_sourcetype** Specifies the source type of the repository path. Supported values are `baseurl`, `metalink`, or `mirrorlist`. With `baseurl`, the source path is interpreted as a simple URI. If `metalink` is set, the source path is resolved as a metalink URI, and if `mirrorlist` is set, the source path is resolved as a mirrorlist file. If not specified, `baseurl` is the default. --add-repo-credentials= For **uri://user:pass@location** repositories, set the user and password associated with an add-repo specification. If the provided value describes a filename in the filesystem, the first line of that file is used as credentials. --description= The description must be a directory containing a kiwi XML description and optional metadata files. --ignore-repos Ignores all repository configurations from the XML description. This option is usually used together with the `--add-repo` option. Otherwise, there are no repositories available for processing the requested image information, which could lead to an error. --list-profiles Lists profiles available for the selected/default type. NOTE: If the image description is designed in a way that there is no default build type configured and/or the main build type is also profiled, it's required to provide this information to kiwi to list further profiles for this type. For example: kiwi-ng --profile top_level_entry_profile image info ... --print-kiwi-env Prints kiwi profile environment variables. The listed variables are available in the shell environment of the kiwi hook scripts. NOTE: The kiwi profile environment grows during the build process. When used in early stages, e.g., in a `post_bootstrap.sh` script, it can happen that not all variables have a value. The setup of the kiwi profile environment in the image info output can therefore also only list the static configuration values that are known at the beginning of a build process. --resolve-package-list Solves package dependencies and returns a list of all packages, including their attributes, for example, size, shasum, and more. --print-xml Prints the image description in the XML format. The specified image description is converted to XML and sent to the XSLT stylesheet processor. The result is then validated using the RelaxNG schema and the schematron rules. The command is normally used to convert an old image description to the latest schema. --print-yaml Behaves similarly to `--print-xml`, but after validation, the result is converted to the YAML format. The command can be used for different operations: * Conversion of the specified image description from or into different formats. This requires the `anymarkup` Python module to be installed. The module is not a hard requirement and is loaded on demand. If the module is missing, requests to convert to a format other than XML will fail. * Updates an old image description to the latest schema. --print-toml Behaves like `--print-yaml`, but the validated result is converted into TOML. This also requires the `anymarkup` Python module. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/commands/image_resize.rst0000644000000000000000000000217215273675667016570 0ustar00.. _db_kiwi_image_resize: kiwi-ng image resize ==================== .. _db_kiwi_image_resize_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng [global options] service [] kiwi-ng image resize --help kiwi-ng image resize --target-dir= --size= [--root=] .. _db_kiwi_image_resize_desc: DESCRIPTION ----------- For disk-based images, this allows you to resize the image to a new disk geometry. The additional space is free and not in use by the image. The OEM boot code in {kiwi} offers a resizing procedure that can be used to make use of the additional free space. For OEM image builds, it is advisable to run the resizing operation. .. _db_kiwi_image_resize_opts: OPTIONS ------- --root= The path to the root directory. If not specified, kiwi searches for the root directory in `build/image-root` under the specified target directory. --size= The new size of the image. The value is either a size in bytes, or it can be specified with m (MB) or g (GB). Example: 20g --target-dir= The directory containing the kiwi build results. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/commands/kiwi.rst0000644000000000000000000001353015273675667015070 0ustar00kiwi-ng ======= .. _db_commands_kiwi_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng --help | --version kiwi-ng [global options] image [...] kiwi-ng [global options] result [...] kiwi-ng [global options] system [...] .. _db_commands_kiwi_desc: DESCRIPTION ----------- {kiwi} is an imaging solution that is based on an image XML description. A description can consist of a single :file:`config.xml` or :file:`.kiwi` file. It may also include additional files, such as scripts or configuration data. A collection of example image descriptions can be found in the following GitHub repository: https://github.com/OSInside/kiwi-descriptions. Most of the descriptions provide a so-called appliance image. An appliance is a small, text-based image, including a predefined remote source setup to allow the installation of missing software components. Although {kiwi} operates in two steps, the system build command combines both steps into one to make it easier to start with {kiwi}. The first step is to prepare a directory that includes the contents of a new filesystem based on one or more software package sources. The second step uses the prepared contents of the new image root tree to create an output image. {kiwi} supports the creation of the following image types: - ISO Live Systems - virtual disk for, e.g., cloud frameworks - OEM expandable disk for system deployment from ISO or the network - filesystem images for deployment in a PXE boot environment Depending on the image type, different disk formats and architectures are supported. .. _db_commands_kiwi_opts: GLOBAL OPTIONS -------------- --color-output Uses escape sequences to print different types of information in colored output. For this option to work, the underlying terminal must support those escape characters. Error messages appear in red, warning messages in yellow, and debugging information is printed in light grey. --config= Use the specified runtime configuration file. This does not replace the standard lookup: the file's settings take the highest precedence. A path that does not exist is an error. Independent of `--config`, {kiwi} always reads and merges every one of the following files that exist, with later entries overriding earlier ones: :file:`/usr/share/kiwi/kiwi.yml`, every :file:`*.yml` in :file:`/usr/share/kiwi/kiwi.yml.d/` (alphabetically), :file:`/etc/kiwi.yml`, every :file:`*.yml` in :file:`/etc/kiwi.yml.d/` (alphabetically), and :file:`~/.config/kiwi/config.yml`. Both drop-in directories are scanned whether or not the corresponding main file exists. Merging is recursive: keys inside a section are merged with the same section from earlier files, values from later files override earlier ones, and lists are combined. See :ref:`runtime_config` for further details. --debug Prints debug information on the command line. Same as: `--loglevel 10`. --debug-run-scripts-in-screen Runs scripts called by {kiwi} in a screen session. --logfile= Specifies the log file. The logfile contains detailed information about the process. The special call `--logfile stdout` sends all information to standard out instead of writing to a file. --logsocket= Sends log data to the specified Unix Domain socket in the same format as with `--logfile`. --loglevel= Specifies the logging level as a number. Further info about the available log levels can be found at: https://docs.python.org/3/library/logging.html#logging-levels. Setting a log level displays all messages at or above the specified level. .. code:: bash ---------------------------- | Level | Numeric value | ---------------------------- | CRITICAL | 50 | | ERROR | 40 | | WARNING | 30 | | INFO | 20 | | DEBUG | 10 | | NOTSET | 0 | ---------------------------- --profile= Selects a profile to use. The specified profile must be part of the XML description. The option can be specified multiple times to allow a combination of profiles. --setenv= exports an environment variable and its value into the caller's environment. This option can be specified multiple times. --shared-cache-dir= Specifies an alternative shared cache directory. The directory is shared via bind mount between the build host and image root system, and it contains information about package repositories and their cache and metadata. The default location is `/var/cache/kiwi`. --temp-dir= Specifies an alternative base temporary directory. The provided path is used as a base directory to store temporary files and directories. The default is `/var/tmp`. --target-arch= Specifies an image architecture. By default, the host architecture is used as the image architecture. If the specified architecture name does not match the host architecture (thus requesting a cross-architecture image build), you must configure the support for the image architecture and binary format on the building host. This must be done during the preparation stage, and it is beyond the scope of {kiwi}. --type= Selects an image build type. The specified build type must be configured as part of the XML description. --kiwi-file= The basename of the kiwi file that contains the main image configuration elements. If not specified, kiwi uses a file named `config.xml` or a file matching `*.kiwi`. --version Show the program version. .. _db_commands_kiwi_example: EXAMPLE ------- .. code:: bash $ git clone https://github.com/OSInside/kiwi $ sudo kiwi-ng system build \ --description kiwi/build-tests/{exc_description_disk} \ --set-repo {exc_repo_leap} \ --target-dir /tmp/myimage ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/commands/result_bundle.rst0000644000000000000000000000431315273675667016773 0ustar00kiwi-ng result bundle ===================== .. _db_kiwi_result_bundle_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng [global options] service [] kiwi-ng result bundle --help kiwi-ng result bundle --target-dir= --id= --bundle-dir= [--bundle-format=] [--zsync-source=] [--package-as-rpm] [--no-compress] .. _db_kiwi_result_bundle_desc: DESCRIPTION ----------- Creates a result bundle from the image build in the specified target directory. Each resulting image contains the specified bundle identifier as part of its filename. Uncompressed image files are also compressed as an XZ archive. An SHA checksum is generated for each resulting image. .. _db_kiwi_result_bundle_opts: OPTIONS ------- --bundle-dir= The directory containing the bundle results, compressed versions of image results, and SHA checksum files. --bundle-format= Specifies the bundle format to create the bundle. If provided, this setting will overwrite an eventually provided `bundle_format` attribute from the main image description. The format string can contain placeholders for the following elements: * %N : Image name * %P : Concatenated profile name (_) * %A : Architecture name * %I : Bundle ID * %T : Image build type name * %M : Image Major version number * %m : Image Minor version number * %p : Image Patch version number * %v : Image Version string --id= Bundle ID. It is a free-form text appended to the image version information as part of the resulting image filename. --target-dir= The directory containing the {kiwi} build results. --zsync-source= The download location of the bundle file or files. Only relevant if `zsync` is used to sync the bundle. * The zsync control file is created for the bundle files marked for compression. * All files in a bundle must be stored in the same download location. --package-as-rpm Create an RPM package containing the result files. --no-compress Do not compress the result image file(s). Note: Image files that were already produced as compressed variants stay compressed. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/commands/result_list.rst0000644000000000000000000000126715273675667016502 0ustar00kiwi-ng result list =================== .. _db_kiwi_result_list_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng [global options] service [] kiwi-ng result list --help kiwi-ng result list --target-dir= .. _db_kiwi_result_list_desc: DESCRIPTION ----------- Lists build results from a previous build or create command. During multiple image builds with the same target directory, the build result information is overwritten every time you build an image. This means that the build result list is valid for the last build only. .. _db_kiwi_result_list_opts: OPTIONS ------- --target-dir= Directory containing the {kiwi} build results. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/commands/system_boxbuild.rst0000644000000000000000000001635215273675667017346 0ustar00.. _kiwi_system_boxbuild: kiwi-ng system boxbuild ======================= .. _db_kiwi_system_boxbuild_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng [global options] service [] kiwi-ng system boxbuild --help kiwi-ng system boxbuild --box= [--box-memory=] [--box-console=] [--box-smp-cpus=] [--box-debug] [--container] [--kiwi-version=] [--shared-path=] [--no-update-check] [--no-snapshot] [--no-accel] [--9p-sharing | --virtiofs-sharing | --sshfs-sharing] [--ssh-key=] [--ssh-port=] [--x86_64 | --aarch64] [--machine=] [--cpu=] kiwi ... kiwi-ng system boxbuild --list-boxes .. _db_kiwi_system_boxbuild_desc: DESCRIPTION ----------- Build an image in a self-contained environment. The `boxbuild` command uses KVM to start a virtual machine and run the kiwi build command inside of that virtual machine. The provided `--description` and `--target-dir` options are set up as shared folders between the host and the guest. No other data will be shared with the host, which also allows for cross distribution builds. The boxbuild command provides the following additional features over the standard build command: * Build images independent of the host. * Build images as normal user not as root. * Build cross distribution images on one host. * Build in predefined build VMs called boxes which includes all components needed to build appliances. For running the build process in a virtual machine, it's required to provide VM images that are suitable to perform this job. We call the VM images `boxes`, and they contain kiwi itself as well as all other components needed to build appliances. Those boxes are hosted in the Open Build Service and are publicly available on the `Subprojects` tab at: https://build.opensuse.org/project/show/Virtualization:Appliances:SelfContained As a user, you don't need to work with the boxes because this is all done by the `boxbuild` command. It knows where to fetch the box and also cares for an update of the box when it has changed. For a detailed introduction, see :ref:`self_contained`. .. _db_kiwi_system_boxbuild_opts: OPTIONS ------- --box= Name of the virtual machine that should be used for the build process. --list-boxes Show available build boxes. --box-memory= Amount of main memory to reserve for the virtual machine. The value is passed as is to the QEMU `-m` option, so add a unit suffix, e.g. `8G`. By default, the memory setting of the selected box is used, which is 8096M for the boxes provided with {kiwi}. --box-console= Name of console in the kernel settings for the virtual machine. By default, set to hvc0. --box-smp-cpus= Number of CPUs to use in the SMP setup. By default, 4 CPUs will be used. --box-debug In debug mode, the started virtual machine will be kept open. --container Build in container instead of a VM. Options related to building in a VM will have no effect. --kiwi-version= Specify a KIWI version to use for the build. The referenced KIWI will be fetched from pip and replaces the box installed KIWI version. Note: If --no-snapshot is used in combination with this option, the change of the KIWI version will be permanently stored in the used box. --shared-path= Optional host path to share with the box. The same path as it is present on the host will also be available inside of the box during build time. --no-update-check Skip check for available box update. The option has no effect if the selected box does not yet exist on the host. --no-snapshot Run box with snapshot mode switched off. This causes the box disk file to be modified by the build process and allows to keep a persistent package cache as part of the box. The option can be used to increase the build performance due to data stored in the box which doesn't have to be reloaded from the network. On the contrary, this option invalidates the immutable box attribute and should be used with care. On update of the box, all data stored will be wiped. To prevent this, combine the option with the --no-update-check option. --no-accel Run box without hardware acceleration. By default, KVM acceleration is activated. --9p-sharing|--virtiofs-sharing|--sshfs-sharing Select sharing backend to use for sharing data between the host and the box. This can be either 9p, virtiofs or sshfs. By default, 9p is used. --ssh-key= Name of ssh key to authorize for connection. By default, 'id_rsa' is used. --ssh-port= Port number to use to forward the guest's SSH port to the host. By default, '10022' is used. --x86_64|--aarch64 Select box for the given architecture. If no architecture is selected, the host architecture is used for selecting the box. The selected box architecture also specifies the target architecture for the image build with that box. --machine= Optional machine name used by QEMU. By default, no specific value is used here and QEMU selects its default machine type. For cross arch builds or for system architectures for which QEMU defines no default like for Arm, it's required to specify a machine name. If you don't care about reproducing the idiosyncrasies of a particular bit of hardware, the best option is to use the 'virt' machine type. --cpu= Optional CPU type used by QEMU. By default, the host CPU type is used, which is only a good selection if the host and the selected box are from the same architecture. On cross arch builds, it's required to specify the CPU emulation the box should use. kiwi ... List of command parameters as supported by the kiwi-ng system build command. The information given here is passed along to the kiwi-ng system build command running in the virtual machine or container. The `--description` and `--target-dir` options are mandatory. Global options like `--type` or `--profile` must be passed as global options to the `boxbuild` call and are forwarded to the build command. See the example below how to provide options to the build command correctly. For compatibility with the former kiwi-boxed-plugin, the `--` separator is accepted as an alias for `kiwi`. .. _db_kiwi_system_boxbuild_env: ENVIRONMENT ----------- KIWI_BOXED_CACHE_DIR By default, VM disk images used as build environment are stored in the $HOME/.kiwi_boxes directory. To override this location, set the KIWI_BOXED_CACHE_DIR environment variable to a different absolute path. KIWI_BOXED_PLUGIN_CFG Path to a custom boxes configuration file. If not set, the configuration is searched in the following order: $PWD/kiwi_boxed_plugin.yml, $HOME/.config/kiwi/kiwi_boxed_plugin.yml, /etc/kiwi_boxed_plugin.yml and the default configuration provided with {kiwi}. .. _db_kiwi_system_boxbuild_example: EXAMPLE ------- .. code:: bash $ git clone https://github.com/OSInside/kiwi-descriptions $ kiwi-ng --profile Virtual system boxbuild --box leap kiwi \ --description kiwi-descriptions/suse/x86_64/suse-leap-15.6 \ --target-dir /tmp/myimage ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/commands/system_build.rst0000644000000000000000000002205415273675667016631 0ustar00.. _kiwi_system_build: kiwi-ng system build ==================== .. _db_kiwi_system_build_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng [global options] service [] kiwi-ng system build --help kiwi-ng system build --description= --target-dir= [--allow-existing-root] [--clear-cache] [--ignore-repos] [--ignore-repos-used-for-build] [--set-repo=] [--set-repo-credentials=] [--add-repo=...] [--add-repo-credentials=...] [--add-package=...] [--add-bootstrap-package=...] [--ca-cert=...] [--ca-target-distribution=] [--delete-package=...] [--set-container-derived-from=] [--set-container-tag=] [--add-container-label=...] [--set-type-attr=...] [--set-release-version=] [--signing-key=...] .. _db_kiwi_system_build_desc: DESCRIPTION ----------- Build an image in one step. The build command combines preparation and building steps, which makes it possible to create an image with a single command. The build command creates the root directory of the image under `/build/image-root` and writes a log file, `/build/image-root.log`. The resulting image files are created in the specified target directory. .. _db_kiwi_system_build_opts: OPTIONS ------- --add-bootstrap-package= Specifies a package to install as part of the early {kiwi} bootstrap phase. The option can be specified multiple times. --add-container-label= Adds a container label in the container configuration metadata. It overwrites the label with the provided key-value pair if it is already defined in the XML description. --add-package= Specifies a package to add (install). The option can be specified multiple times. --add-repo= Adds a new repository to the existing repository setup in the XML description. This option can be specified multiple times. For details about the possible option values, see the **--set-repo** information below. --add-repo-credentials= For **uri://user:pass@location** repositories, set the user and password associated with an add-repo specification. If the provided value describes a filename in the filesystem, the first line of that file is used as credentials. --allow-existing-root Uses an existing root directory from a previous build attempt. Use with caution, because this can cause an inconsistent root tree if the existing contents do not fit the previous image type setup. --clear-cache Deletes the repository cache for each of the used repositories before installing any package. This is useful when an image build validates the signature of the package from the original repository source for any build. Some package managers unconditionally trust the contents of the cache, which works for cache data dedicated to one build. In the case of {kiwi}, the cache is shared between multiple image builds on that host for performance reasons. --ca-cert= Adds a cert file to the directory storing additional local CA certificates. The import will occur immediately after the bootstrap process, where the required CA update tooling is expected to be installed. This option is useful for situations where certificates are not packaged, or the certificates are required during the build process, e.g., due to proxy servers in the build environment that need certificates in chroot. The option can be specified multiple times. --ca-target-distribution= Specifies the target distribution for the import of certificates via the `--ca-cert` option(s) and/or the provided `` from the image description. The selected distribution is used in KIWI to map the distribution-specific CA storage path and update tool for the import process. --delete-package= Specifies a package to delete. The option can be specified multiple times. --description= The path to an XML description. This is a directory containing at least one `config.xml` or `*.kiwi` XML file. --ignore-repos Ignores all repository configurations from the XML description. This option is used in combination with the `--add-repo` option. Otherwise, there are no repositories available for an image build, which leads to an error. --ignore-repos-used-for-build Works the same way as `--ignore-repos`, except that repository configuration with the `imageonly` attribute set to **true** is not ignored. --set-repo= Overwrites the first repository entry in the XML description with the provided information: - **source** Source URL pointing to a package repository that must be in a format supported by the selected package manager. See the URI_TYPES section for details about the supported source locators. - **type** Repository type: `rpm-md`, `apt-deb`. - **alias** An alias name for the repository. If not specified, {kiwi} generates an alias name as a result of a hex representation from uuid4. While the hex is used to uniquely identify the repository, it is not descriptive. We recommend using descriptive aliases. - **priority** A number indicating the repository priority. How the value is evaluated depends on the selected package manager. Refer to the package manager documentation for details about the supported priority ranges and their meaning. - **imageinclude** Set to either **true** or **false** to indicate if the repository is part of the system image repository setup or not. - **package_gpgcheck** Set to either **true** or **false** to indicate if the repository should validate the package signatures. - **{signing_keys}** A list of `signing_keys` enclosed in curly brackets and delimited by a semicolon. The reference to a signing key must be provided in the URI format. - **components** A component list for Debian-based repos as a space-delimited string. - **distribution** The main distribution name for Debian-based repos. - **repo_gpgcheck** Set to either **true** or **false** to indicate if the repository should validate the repository signature. - **repo_sourcetype** Specifies the source type of the repository path. Supported values are `baseurl`, `metalink`, or `mirrorlist`. With `baseurl`, the source path is interpreted as a simple URI. If `metalink` is set, the source path is resolved as a metalink URI, and if `mirrorlist` is set, the source path is resolved as a mirrorlist file. If not specified, `baseurl` is the default. --set-repo-credentials= For **uri://user:pass@location**-type repositories, set the user and password connected to the set-repo specification. If the provided value describes a filename in the filesystem, the first line of that file is used as credentials. --set-container-derived-from= Overwrites the source location of the base container for the selected image type. The setting applies only if the configured image type is set up with an initial `derived_from` reference. --set-container-tag= Overwrites the container tag in the container configuration. The setting is only effective if the container configuration provides the initial tag value. --set-type-attr= Overwrites/sets the attribute with the provided value in the selected build type section. Example: `--set-type-attr volid=some`. --set-release-version= Overwrites/sets the release-version element in the selected build type preferences section. --signing-key= Sets the key file to be trusted and imported into the package manager's database before performing any operation. This is useful when an image build validates repository and package signatures during build time. This option can be specified multiple times. --target-dir= The path to store the build results. .. _db_kiwi_system_build_uri: URI_TYPES --------- - **http://** | **https://** | **ftp://** A remote repository delivered via the HTTP or FTP protocol. - **obs://** An Open Buildservice repository. The source data is translated into an HTTP URL pointing to http://download.opensuse.org. - **ibs://** An internal Open Buildservice repository. The source data is translated into an HTTP URL pointing to download.suse.de. - **dir://** A local directory. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/commands/system_create.rst0000644000000000000000000000272115273675667016774 0ustar00.. _kiwi_system_create: kiwi-ng system create ===================== .. _db_kiwi_system_create_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng [global options] service [] kiwi-ng system create --help kiwi-ng system create --root= --target-dir= [--signing-key=...] .. _db_kiwi_system_create_desc: DESCRIPTION ----------- Create an image from the previously prepared image root directory. The `kiwi-ng system create` command is normally issued after the `kiwi-ng system prepare` command, and it builds the requested image type in the specified target directory. .. _db_kiwi_system_create_opts: OPTIONS ------- --root= The path to the image root directory. This directory is normally created by the `kiwi-ng system prepare` command. Keep in mind that if the specified directory is not created using the `kiwi-ng system prepare` command, {kiwi} stores image build metadata in the `image/` directory. This directory must exist for the `kiwi-ng system create` command to work correctly. --target-dir= The path to store the build results. --signing-key= A trusted key file to be imported into the package manager's database before performing any operation. This is useful if an image build validates repository and package signatures during build time. In the create step, this option only affects the boot image. This option can be specified multiple times. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/commands/system_prepare.rst0000644000000000000000000002053315273675667017170 0ustar00kiwi-ng system prepare ====================== .. _db_kiwi_system_prepare_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng [global options] service [] kiwi-ng system prepare --help kiwi-ng system prepare --description= --root= [--allow-existing-root] [--clear-cache] [--ignore-repos] [--ignore-repos-used-for-build] [--set-repo=] [--set-repo-credentials=] [--add-repo=...] [--add-repo-credentials=...] [--add-package=...] [--add-bootstrap-package=...] [--ca-cert=...] [--ca-target-distribution=] [--delete-package=...] [--set-container-derived-from=] [--set-container-tag=] [--add-container-label=...] [--set-type-attr=...] [--set-release-version=] [--signing-key=...] .. _db_kiwi_system_prepare_desc: DESCRIPTION ----------- Create a new image root directory. The prepare step sets up a new image root directory from the specified XML description. The specified directory acts as the root directory of the new image root system. You can enter the system as root via chroot using the following command: .. code:: bash $ chroot bash .. _db_kiwi_system_prepare_opts: OPTIONS ------- --add-bootstrap-package= Specify a package to install as part of the early {kiwi} bootstrap phase. The option can be specified multiple times. --add-container-label= Add a container label to the container configuration metadata. It overwrites the label with the provided key-value pair if it was already defined in the XML description. --add-package= Specify a package to add (install). The option can be specified multiple times. --add-repo= Adds a new repository to the existing repository setup in the XML description. This option can be specified multiple times. For details about the supported option values, see the **--set-repo** information below. --add-repo-credentials= For **uri://user:pass@location**-type repositories, set the user and password connected with an add-repo specification. If the provided value is a filename in the filesystem, the first line of the file is used as credentials. --allow-existing-root Allows you to re-use an existing image root directory. --clear-cache Deletes the repository cache for each of the used repositories before installing any package. This is useful if an image build validates the signature of the package from the original repository source for any build. Some package managers unconditionally trust the contents of the cache, which works for cache data dedicated to one build. In the case of {kiwi}, the cache is shared between multiple image builds on the host for performance reasons. --ca-cert= Adds a cert file to the directory storing additional local CA certificates. The import will occur immediately after the bootstrap process, where the required CA update tooling is expected to be installed. This option is useful for situations where certificates are not packaged, or the certificates are required during the build process, e.g., due to proxy servers in the build environment that need certificates in chroot. The option can be specified multiple times. --ca-target-distribution= Specifies the target distribution for the import of certificates via the `--ca-cert` option(s) and/or the provided `` from the image description. The selected distribution is used in KIWI to map the distribution-specific CA storage path and update tool for the import process. --delete-package= Specify a package to delete. The option can be specified multiple times. --description= The path to the {kiwi} XML description. The directory must contain at least a `config.xml` or `*.kiwi` XML description. --ignore-repos Ignores all repository configurations in the XML description. This option is normally used in combination with the `--add-repo` option. Otherwise, an image build operation results in an error. --ignore-repos-used-for-build Works the same way as `--ignore-repos`, but the repository configurations that have the `imageonly` attribute set to **true** are not ignored. --root= The path to the new root system. --set-repo= Overwrites the first repository entry in the XML description with the provided information: - **source** Source URL pointing to a package repository that must be in a format supported by the selected package manager. See the URI_TYPES section of :ref:`kiwi_system_build` for details about the supported source locators. - **type** Repository type: `rpm-md`, `apt-deb`. - **alias** An alias name for the repository. If not specified, {kiwi} generates an alias name based on a hex representation of uuid4. While the hex is used to uniquely identify the repository, it is not descriptive. We recommend using a descriptive and unique alias name. - **priority** A number indicating the repository priority. How the value is evaluated depends on the selected package manager. Refer to the package manager documentation for details about the supported priority ranges and their meaning. - **imageinclude** Set to either **true** or **false** to specify if the repository is part of the system image repository setup or not. - **package_gpgcheck** Set to either **true** or **false** to specify if the repository must validate the package signatures. - **{signing_keys}** A list of signing_keys enclosed in curly brackets and delimited by a semicolon. The reference to a signing key must be provided in the URI format. - **components** A component list for Debian-based repos as a space-delimited string. - **distribution** The main distribution name for Debian-based repos. - **repo_gpgcheck** Set to either **true** or **false** to specify if the repository must validate the repository signature. - **repo_sourcetype** Specifies the source type of the repository path. Supported values are `baseurl`, `metalink`, or `mirrorlist`. With `baseurl`, the source path is interpreted as a simple URI. If `metalink` is set, the source path is resolved as a metalink URI, and if `mirrorlist` is set, the source path is resolved as a mirrorlist file. If not specified, `baseurl` is the default. --set-repo-credentials= For **uri://user:pass@location**-type repositories, sets the user and password connected to the set-repo specification. If the provided value is a filename in the filesystem, the first line of that file is used as credentials. --set-container-derived-from= Overwrites the source location of the base container for the selected image type. The setting is only effective if the configured image type is set up with an initial derived_from reference. --set-container-tag= Overwrites the container tag in the container configuration. The setting applies only if the container configuration provides an initial tag value. --set-type-attr= Overwrites/sets the attribute with the provided value in the selected build type section. Example: `--set-type-attr volid=some`. --set-release-version= Overwrites/sets the release-version element in the selected build type preferences section. --signing-key= Sets the key file to be trusted and imported into the package manager database before performing any operation. This is useful if an image build validates repository and package signatures during build time. This option can be specified multiple times. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/commands/system_stackbuild.rst0000644000000000000000000000712215273675667017656 0ustar00.. _kiwi_system_stackbuild: kiwi-ng system stackbuild ========================= .. _db_kiwi_system_stackbuild_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng [global options] service [] kiwi-ng system stackbuild --help kiwi-ng system stackbuild --stash=... --description= --target-dir= [--from-registry=] [kiwi ...] kiwi-ng system stackbuild --stash=... --target-dir= [--from-registry=] [kiwi ...] .. _db_kiwi_system_stackbuild_desc: DESCRIPTION ----------- Build an image based on one or more stash containers. A stash is a {kiwi} built root tree stored as an OCI container, see :ref:`kiwi_system_stash`. Using OCI images as the portable format to store and distribute a root tree allows them to be pushed to and pulled from OCI registries. The `stackbuild` command operates in two modes: 1. Rebuild an image from a stash In this mode, `stackbuild` takes a stash, makes it available to the local registry, and builds the image using the stash rootfs and the image description stored in the stash. The given `kiwi` subcommand arguments are passed along to the `kiwi-ng system create` command. .. code:: bash $ kiwi-ng system stackbuild --stash NAME \ --target-dir /target/rebuild 2. Build an image based on a stash In this mode, `stackbuild` takes a stash, makes it available to the local registry, and uses the stash rootfs as the base for an image build of another image description. The given `kiwi` subcommand arguments are passed along to the `kiwi-ng system build` command. .. code:: bash $ kiwi-ng system stackbuild --stash NAME \ --description /some/image-description \ --target-dir /target/rebuild .. note:: The `stackbuild` command does not perform any consistency check to determine if the used stash rootfs is compatible with the provided image description. With that in mind, nothing prevents you from using a Leap stash and trying to build a Fedora image on top of it. It is the user's responsibility to combine only compatible stashes and image descriptions. For a detailed introduction, see :ref:`stackbuild`. .. _db_kiwi_system_stackbuild_opts: OPTIONS ------- --stash= Name of the stash. See `kiwi-ng system stash --list` for available stashes. Multiple stashes will be stacked together in the given order. --from-registry= Pull the given stash container name from the provided registry URI. --description= Path to the XML description. This is a directory containing at least one `config.xml` or `*.kiwi` XML file. --target-dir= Path to store the build results. kiwi ... List of command parameters as supported by the `kiwi-ng system build` command. The information given here is passed along to the `kiwi-ng system build` command if the `--description` option is set. kiwi ... List of command parameters as supported by the `kiwi-ng system create` command. The information given here is passed along to the `kiwi-ng system create` command if the `--description` option is not set. .. note:: For compatibility with the former `kiwi-stackbuild-plugin`, the `--` separator is accepted as an alias for the `kiwi` subcommand. .. _db_kiwi_system_stackbuild_example: EXAMPLE ------- .. code:: bash $ kiwi-ng system stackbuild --stash NAME --target-dir /target/rebuild \ kiwi --signing-key /path/to/key ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/commands/system_stash.rst0000644000000000000000000000265215273675667016656 0ustar00.. _kiwi_system_stash: kiwi-ng system stash ==================== .. _db_kiwi_system_stash_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng [global options] service [] kiwi-ng system stash --help kiwi-ng system stash --root= [--tag=] [--container-name=] kiwi-ng system stash --list .. _db_kiwi_system_stash_desc: DESCRIPTION ----------- Create a container from the given root directory. The command takes the contents of the given root directory at call time and creates an OCI container from it, called a stash. The stash is stored below `/var/tmp/kiwi-stash` and imported into the local container registry using `podman`. If a stash with the same container name already exists, a new layer is added to it. A stash can be used as the image root for the :ref:`kiwi_system_stackbuild` command. For a detailed introduction, see :ref:`stackbuild`. .. _db_kiwi_system_stash_opts: OPTIONS ------- --root= The path to the root directory, usually the result of a former system prepare or build call. --tag= The tag name for the container. By default, `latest` is used. --container-name= The name of the container. By default, it is set to the image name of the stash. --list List the available stashes. .. _db_kiwi_system_stash_example: EXAMPLE ------- .. code:: bash $ kiwi-ng system stash --root /tmp/mytest/build/image-root ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/commands/system_update.rst0000644000000000000000000000170315273675667017012 0ustar00kiwi-ng system update ===================== .. _db_kiwi_system_update_synopsis: SYNOPSIS -------- .. code:: bash kiwi-ng [global options] service [] kiwi-ng system update --help kiwi-ng system update --root= [--add-package=...] [--delete-package=...] .. _db_kiwi_system_update_desc: DESCRIPTION ----------- Update a previously prepared image root tree. The update command refreshes the contents of the root directory according to the repository setup of the image XML description. The update command can also be used to add or remove packages from the image root tree. .. _db_kiwi_system_update_opts: OPTIONS ------- --add-package= Specify a package to add (install). The option can be specified multiple times. --delete-package= Specify a package to delete. The option can be specified multiple times. --root= Path to the root directory of the image. ././@PaxHeader0000000000000000000000000000003100000000000010207 xustar0025 mtime=1794079670.7341 kiwi-11.1.8/doc/source/commands.rst0000644000000000000000000000077015273675667014127 0ustar00Working from the Command Line ============================= .. note:: This document provides a list of the existing {kiwi-product} commands for version |version|. .. toctree:: :maxdepth: 1 commands/kiwi commands/result_list commands/result_bundle commands/system_prepare commands/system_update commands/system_build commands/system_boxbuild commands/system_create commands/system_stackbuild commands/system_stash commands/image_resize commands/image_info ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/concept_and_workflow/customize_the_boot_process.rst0000644000000000000000000005417615273675667024211 0ustar00.. _working-with-kiwi-customizing-the-boot-process: Customizing the Boot Process ---------------------------- Most Linux systems use a special boot image to control the system boot process after BIOS or UEFI hands over control of the hardware to the operating system. This boot image is a compressed cpio initial RAM disk, and it's called the :file:`initrd`. The Linux kernel loads the :file:`initrd` into the RAM and executes :command:`init` or, if present, :command:`linuxrc`. Depending on the image type, {kiwi} creates the boot image automatically during the `create` step. To create the :file:`initrd`, {kiwi} uses a tool called `dracut`. dracut-generated initrd archives can be extended with custom modules to add functionality that is not natively provided by dracut itself. In the scope of {kiwi}, the following dracut modules are used: ``kiwi-dump`` Serves as an image installer. It provides the required implementation to install a {kiwi} image on a selectable target. This module is required if one of the attributes in the image type definition, `installiso`, `installstick`, or `installpxe`, is set to `true`. Shipped in the `dracut-kiwi-oem-dump` package. ``kiwi-dump-reboot`` Serves to boot the system into the installed image after installation is completed. Also shipped in the `dracut-kiwi-oem-dump` package, together with `kiwi-dump`. ``kiwi-live`` Boots up a {kiwi} live image. This module is required if the `iso` image type is selected. Shipped in the `dracut-kiwi-live` package. ``kiwi-verity`` Sets up dm-verity for images built with the `verity_blocks` or `embed_verity_metadata` type attributes, verifying the integrity of the root device at boot time. Shipped in the `dracut-kiwi-verity` package. ``kiwi-overlay`` Allows you to boot disk images with the attribute `overlayroot` set to `true`. A disk like that has its root partition compressed and read-only. The disk boots up using overlayfs for the root filesystem with a separate partition on the same disk for persistent data. Shipped in the `dracut-kiwi-overlay` package. ``kiwi-repart`` Resizes an OEM disk image after installation on the target disk to meet the size limits configured in the `oemconfig` section of the image description. The module takes over the tasks of repartitioning the disk, resizing RAID, LVM, LUKS, and other layers, as well as resizing the system filesystems. Shipped in the `dracut-kiwi-oem-repart` package. ``kiwi-lib`` Provides common functions used by dracut modules. Shipped in the `dracut-kiwi-lib` package, which the other modules depend on. .. note:: Using Custom Boot Image Support In addition to the standard dracut-based creation of the boot image, {kiwi} supports the use of custom boot images for the image types `oem` and `pxe`. The use of a custom boot image is enabled by setting the following attribute in the image description: .. code:: none Along with this setting, you must provide a reference to a boot image description in the `boot` attribute as follows: .. code:: none While {kiwi} supports this approach, it is recommended to use dracut instead. Keep also in mind that although {kiwi} supports the creation of custom boot images, {kiwi} does not include any official boot image descriptions. You can find an OEM boot description example at https://build.opensuse.org/package/show/Virtualization:Appliances:Images:Testing_x86:tumbleweed/custom-oem-boot-description and a PXE boot description example at https://build.opensuse.org/package/show/Virtualization:Appliances:Images:Testing_x86:tumbleweed/custom-pxe-boot-description. The custom boot image descriptions make it possible to completely customize the behavior of the initrd. This concept is mostly used in PXE environments that are usually heavily customized and require a specific boot and deployment workflow. Boot Image Hook-Scripts ....................... The dracut initrd system uses `systemd` to implement a predefined workflow of services documented in the bootup man page: http://man7.org/linux/man-pages/man7/dracut.bootup.7.html To hook in a custom boot script to this workflow, it is necessary to provide a dracut module that dracut picks when {kiwi} calls it. The module files can be provided either as a package or as part of the overlay directory in the image description. The following example shows how to include a custom hook script before the system rootfs is mounted. 1. Create a subdirectory for the dracut module: .. code:: bash $ mkdir -p root/usr/lib/dracut/modules.d/90my-module 2. Register the dracut module in the configuration file: .. code:: bash $ vi root/etc/dracut.conf.d/90-my-module.conf add_dracutmodules+=" my-module " 3. Create the hook script: .. code:: bash $ touch root/usr/lib/dracut/modules.d/90my-module/my-script.sh 4. Create a module setup file in :file:`root/usr/lib/dracut/modules.d/90my-module/module-setup.sh` containing the following: .. code:: bash #!/bin/bash # called by dracut check() { # check module integrity } # called by dracut depends() { # return list of modules depending on this one } # called by dracut installkernel() { # load required kernel modules when needed instmods _kernel_module_list_ } # called by dracut install() { declare moddir=${moddir} inst_multiple _tools_my_module_script_needs_ inst_hook pre-mount 30 "${moddir}/my-script.sh" } .. note:: Declaring Extra Tools for Hook Scripts The `install()` function called by dracut can define extra tools required by the specified hook script. The `inst_multiple` command and its parameters instruct dracut to include these extra tools and items into the initrd. The specified tools and items can be files. Normally, they are executables and libraries required by the hook script. * Each file must be included in the {kiwi} description either in a package, an archive, or in the root tree of the image description directory. * The parameters of the `inst_multiple` command are space-separated. * Each parameter can be a single executable name if it exists in the `/bin`, `/sbin`, `/usr/bin`, or `/usr/sbin` directories. * Otherwise, a full path to the file is required. This normally applies for libraries and other special files. When {kiwi} calls dracut, the :file:`90my-module` is installed into the generated initrd. At boot time, systemd calls the scripts as part of the :file:`dracut-pre-mount.service`. The dracut system offers many other possibilities to customize the initrd than shown in the example above. For more information, visit the `dracut project page `_. Boot Image Parameters ..................... A dracut-generated initrd in a {kiwi} image build process includes one or more of the {kiwi}-provided dracut modules. The following non-exhaustive list documents the most commonly used kernel boot parameters for these modules: ``rd.kiwi.term`` Exports the `TERM` variable into the initrd environment. If the default value for the terminal emulation is not correct, `rd.kiwi.term` can be used to overwrite the default. The environment is also passed to the systemd unit that calls dialog-based programs in {kiwi} dracut code, which means that the `TERM` setting applies there too. ``rd.kiwi.debug`` Activates the debug log file for the {kiwi} part of the boot process in :file:`/run/initramfs/log/boot.kiwi`. ``rd.kiwi.dialog.timeout=seconds|off`` Sets a timeout value for dialogs invoked by kiwi dracut modules. By default, the timeout is set to 60 seconds. If set to the special value `off`, the dialog will never time out. ``rd.kiwi.install.devicepersistency=by-*`` Instructs an OEM installation image to present the list of available disk devices using the device names as provided by the specified `by-*` representation. For example, `rd.kiwi.install.devicepersistency=by-path` would show the by-path device names in the list of available disks. ``rd.kiwi.install.efi_display_label=name`` Instructs an OEM installation image on EFI systems to create an EFI boot entry with the given name after the image was dumped to the target disk. Any existing EFI boot entry with the same name is removed first. The entry points to the partition labeled `EFI` on the target disk and to the first EFI binary found on it. Vendor specific loaders, e.g. `\EFI\opensuse\shim.efi`, are preferred over the removable media path `\EFI\BOOT`, and shim is preferred over any other loader. Requires `efibootmgr` to be present in the installation initrd. ``rd.kiwi.install.pxe`` Instructs an OEM installation image to look up the system image on a remote location specified in `rd.kiwi.install.image`. ``rd.kiwi.install.image=URI`` Specifies the remote location of the system image in a PXE-based OEM installation. ``rd.kiwi.install.pass.bootparam`` Instructs an OEM installation image to pass additional boot parameters to the kernel used to boot the installed image. This can be used, for example, to pass on first-boot configuration for a PXE image. Note that options starting with `rd.kiwi` are not passed to avoid side effects. ``rd.kiwi.install.partition_based`` Instructs an OEM installation image to deploy the disk image partition by partition instead of dumping the entire disk image as one blob to the target disk. In this mode {kiwi} clones the partition table and the MBR boot code of the image to the target disk, maps the partitions of the image and transfers each partition individually. Partitions containing a `btrfs` filesystem are transferred using the btrfs seed/sprout process as described in https://btrfs.readthedocs.io/en/latest/Seeding-device.html. All other partitions, e.g. the EFI partition, are copied block by block. After the transfer, the filesystem UUID of the original btrfs filesystem is restored on the target partition. The main purpose of this mode is to make the btrfs seed/sprout process available for the deployment of a system. The seed/sprout process requires the btrfs root filesystem of the disk image to be flagged as a seeding device. This flag is set by {kiwi} at build time and not by the installation system. Therefore, `rd.kiwi.install.partition_based` must be activated as part of the image description via the `kernelcmdline` attribute of the `` element. Passing the option only at boot time of the installation image is not sufficient. {kiwi} flags the root filesystem as a seeding device only for install images (`installiso`, `installstick` or `installpxe`) using the `btrfs` volume manager that set `rd.kiwi.install.partition_based` in `kernelcmdline`, for example: .. code:: xml ... The btrfs tools `btrfs` and `btrfstune` must be present in the installation initrd. If used in combination with `rd.kiwi.install.pxe`, the disk image is first fetched from the remote location into the main memory of the installation system as :file:`/image.raw`. From there the partition based deployment is performed. Make sure the system has enough main memory to store the complete uncompressed disk image. .. note:: Partition Based Mode Limitations * The result of the seed/sprout process is not bit identical with the disk image. Therefore, the verification of the installed image against the image checksum is skipped in this mode, regardless of the `oem-skip-verify` setting. * All partitions of the disk image are always deployed. This mode can't be combined with `rd.kiwi.install.retain_last` or `rd.kiwi.install.retain_past`. If one of them is set, the installation is aborted before any data is written to the target disk. * Compared to the default mode of dumping the entire disk image, the partition based deployment does not provide a significant performance gain. In combination with `rd.kiwi.install.pxe`, the deployment is even slower because of the additional transfer of the image into main memory. * Messages from the btrfs seed/sprout process are logged to :file:`/seed.log` inside the installation initrd. ``rd.kiwi.install.clone_local`` For OEM installation images in combination with `rd.kiwi.install.partition_based`. Instructs the installation to first copy the disk image from the install media into the main memory of the installation system as :file:`/image.raw` and to use this copy as the source for the partition based deployment. On this copy, the btrfs filesystems are explicitly marked as seeding devices prior to the seed/sprout process. This allows the partition based deployment from install media of images which have not been flagged as a seeding device at build time. Make sure the system has enough main memory to store the complete uncompressed disk image. This option has no effect for PXE-based installations, as these always use an in-memory copy of the disk image in partition based mode. ``rd.kiwi.install.retain_last`` Instructs an OEM installation to retain the contents of the last partition on the target disk. This setting is only useful if the last partition does not belong to the main OS, e.g., an extra data partition added via the `spare_part` attribute in the type setup of the image description. The implementation also checks if the start address of the last partition on the target disk matches the start address of the image to be deployed. Only if they match can the data on the last partition be retained. ``rd.kiwi.install.retain_past`` Instructs an OEM installation to retain the contents of the last partition on the target disk in a less strict mode than it is the case with `rd.kiwi.install.retain_last`. In the retain_past mode the partition to preserve must not be part of the initial image. It can retain the content of any last partition if its start address is past the OS image. .. note:: Retain Past Mode Limitations There are no sanity checks for the partition to retain in this mode. From an implementation perspective {kiwi} simply takes the last partition prior to the dump as reported by sfdisk and rebuilds this partition after the OS image is deployed. This can lead to a gap in the partition table between the OS end and the start of the retained partition. There is also no sanity checking when there are multiple partitions after the OS image. In this case, the last partition is retained, and all other partitions are removed. In contrast to `rd.kiwi.install.retain_last`, there is no tight coupling to the OS image partition table layout and as such `rd.kiwi.install.retain_past` should be used with caution. ``rd.kiwi.oem.luks.reencrypt`` For OEM LUKS2-encrypted disk images. If set, it re-encrypts the disk prior to an eventual resize and therefore creates a new key pool and master key. The re-encryption is advisable if the image binary is not protected. With access to the image binary, it's possible to extract the LUKS header, which then allows you to decrypt the data unless it was re-encrypted. The re-encryption process only runs if the checksum of the LUKS header still matches the one from the original disk image. Be aware that the re-encryption will ask for the passphrase if the image has been built with an initial LUKS passphrase. ``rd.kiwi.oem.luks.reencrypt_randompass`` For OEM LUKS2-encrypted disk images in combination with `rd.kiwi.oem.luks.reencrypt`. Resets the insecure built-time passphrase, set via the `luks=` attribute, with a random one-time passphrase that will be stored in memory at `/run/.kiwi_reencrypt.keyfile`. .. warning:: The passphrase will only persist as long as the system does not reboot. Using this option usually requires that the boot process implements code to set retrievable keyfile information for subsequent boot processes of this system, e.g., TPM setup or similar. ``rd.kiwi.oem.disk.consistency`` For OEM disk images providing an installation image. If set, the installation image will check against all disks that are not the selected target disk to see if there is any disk in the system that has the same PTUUID compared to the image that is about to be installed. If such a disk is found, this indicates that the same image was already installed to another storage disk on the same system, which will cause device ID inconsistencies for the entire system. In such a case, an error message is displayed, providing information about the conflicting device, and the installation will be canceled. ``rd.kiwi.oem.maxdisk=size[KMGT]`` Specifies the maximum disk size an unattended OEM installation uses for image deployment. Unattended OEM deployments default to deploying on `/dev/sda` (or more precisely, the first device that is not filtered out by `oem-device-filter`). With RAID controllers, you may have big JBOD disks along with a 480G RAID1 configured for OS deployment. With `rd.kiwi.oem.maxdisk=500G`, the deployment is performed on the RAID disk. ``rd.kiwi.oem.force_resize`` Forces the disk resize process on an OEM disk image. If set, no sanity check for unpartitioned/free space is performed, and also an eventually configured `` configuration from the image description will not be taken into account. The disk resize will be started, which includes re-partitioning as well as all steps to resize the block layers up to the filesystem holding the data. As `rd.kiwi.oem.force_resize` bypasses all sanity checks to detect if such a resize process is needed or not, it can happen that all program calls of the resize process end without any effect if the disk is already properly resized. It's also important to understand that the partition UUIDs will change on every resize, which might be an unwanted side effect of a forced resize. ``rd.kiwi.oem.installdevice`` Configures the disk device to use in an OEM installation. This overwrites or resets any other OEM device-specific settings, such as `oem-device-filter`, `oem-unattended-id`, or `rd.kiwi.oem.maxdisk`, and continues the installation on the given device. The device must exist and must be a block special. .. note:: Non-interactive mode activated by rd.kiwi.oem.installdevice When setting `rd.kiwi.oem.installdevice` explicitly through the kernel command line, {kiwi} uses the device without prompting for confirmation. ``rd.kiwi.oem.sha512`` Expect sha512 checksums and use the respective `sha512sum` tool and the `.sha512` extension for filename match and checksum calculation. By default sha256 is used. ``rd.kiwi.oem.smallest_disk`` Alters the logic that chooses the destination device during non-interactive mode deployments. The device with the smallest capacity gets selected instead of the drive with the alphabetical first device name. USB flash drives are filtered out. For big JBOD setups this parameter is an alternative to `rd.kiwi.oem.maxdisk`. ``rd.live.overlay.size`` Specifies the size for the `tmpfs` filesystem of a live ISO image that is used for the `overlayfs` mount process. If the write area of the overlayfs mount uses this `tmpfs`, any new data written during the runtime of the system is written in this space. The default value is `50%`, meaning half of the available RAM space can be used for writing new data. ``rd.live.overlay.persistent`` Instructs a live ISO image to prepare a persistent write partition. ``rd.live.encrypt`` Instructs a live ISO image to encrypt the persistent write partition. The boot process becomes interactive in this case, and the user has to specify a passphrase at boot time. ``rd.live.overlay.cowfs`` Specifies which filesystem of a live ISO image to use for storing data on the persistent write partition. ``rd.live.cowfile.mbsize`` Specifies the size of the COW file in MB. When using tools like `live-grub-stick`, the live ISO image is copied as a file on the target device, and a GRUB loopback setup is created there to boot the live system from the file. In this case, the persistent write setup that normally creates an extra write partition on the target will fail in most situations because the target has no free and unpartitioned space available. To prevent this from happening, a COW file (live_system.cow) of a partition is created alongside the live ISO image file. The default size of the COW file is 500MB. ``rd.live.cowfile.path`` Effectively used in isoscan loop-mounted live systems. For details on this type of live system, refer to :ref:`iso_as_file_to_usb_stick`. Specifies the path of the COW file below the `/run/initramfs/isoscan` loop mount point. If not specified, the cowfile is placed at `/run/initramfs/isoscan/live_system.cow`. ``rd.live.dir`` Specifies a directory that contains the live OS root directory. The default is `LiveOS`. ``rd.live.squashimg`` Specifies the name of the squashfs image file that contains the OS root. The default is `squashfs.img`. ``rd.kiwi.allow_plymouth`` By default, kiwi stops plymouth if it is present and active in the initrd. Setting `rd.kiwi.allow_plymouth` will keep plymouth active in the initrd, including all effects that might have on the available consoles. Boot Debugging '''''''''''''' If the boot process encounters a fatal error, the default behavior is to stop the boot process without any possibility to interact with the system. To prevent this, activate dracut's built-in debug mode in combination with the {kiwi} debug mode as follows: .. code:: bash rd.debug rd.kiwi.debug This must be set at the kernel command line. With these parameters activated, the system enters a limited shell environment when a fatal error occurs during boot. The shell provides a basic set of tools, and it can be used for inspection using the following command: .. code:: bash less /run/initramfs/log/boot.kiwi ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.734833 kiwi-11.1.8/doc/source/concept_and_workflow/packages.rst0000644000000000000000000002507515273675667020320 0ustar00.. _packages: Adding and Removing Packages ============================ In addition to the :ref:`repositories` setup, the package setup is required. {kiwi} allows the end user to completely customize the selection of packages via the `packages` element. .. code:: xml The `packages` element provides a collection of different child elements that instruct {kiwi} when and how to perform package installation or removal. Each `packages` element acts as a group whose behavior can be configured via the following attributes: - `type`: either `bootstrap`, `image`, `delete`, `uninstall`, `systemfiles` or one of the following build types: `docker`, `iso`, `oem`, `pxe`, `kis`, `oci`. Packages for `type="bootstrap"` are pre-installed to populate the image's root filesystem before chrooting into it. Packages in `type="image"` are installed immediately after the initial chroot into the new root filesystem. Packages in `type="delete"` and `type="uninstall"` are removed from the image. For details, see :ref:`uninstall-system-packages`. And packages that belong to a build type are only installed when that specific build type is currently processed by {kiwi}. - `profiles`: a list of profiles to which this package selection applies (see :ref:`image-profiles`). - `patternType`: selection type for patterns; supported values are: `onlyRequired`, `plusRecommended`; see: :ref:`product-and-namedCollection-element`. The following sections describe the different child elements of a `packages` group. .. _package-element: The `package` element ^^^^^^^^^^^^^^^^^^^^^ The `package` element represents a single package to be installed (or removed), whose name is specified via the mandatory `name` attribute: .. code:: xml This adds the package `udev` to the list of packages to be added to the initial filesystem. Note that the value that you pass via the `name` attribute is passed directly to the used package manager. Thus, if the package manager supports other means of how packages can be specified, you may pass them in this context too. For example, RPM-based package managers (like :command:`dnf` or :command:`zypper`) can install packages via their `Provides:`. This can be used to add a package that provides a certain capability (for example, `Provides: /usr/bin/my-binary`) via: .. code:: xml Whether this works depends on the package manager and on the environment that is being used. In the Open Build Service, certain `Provides` are either not visible or cannot be properly extracted from the {kiwi} description. Therefore, relying on `Provides` is not recommended. Packages can also be included only on specific host architectures via the `arch` attribute. {kiwi} compares the `arch` attribute's value with the host architecture that builds the image according to the output of `uname -m`. .. code:: xml This results in `grub2-x86_64-efi` and `shim` being only installed if the build host is a 64-bit x86 machine, but `grub2` will be installed independent of the architecture. .. _archive-element: The `archive` element ^^^^^^^^^^^^^^^^^^^^^ In certain situations, it is necessary to include additional packages into the image that are not available in the package manager's native format. {kiwi} supports the inclusion of regular tar archives via the `archive` element, whose `name` attribute specifies the filename of the archive ({kiwi} looks for the archive in the image description folder). .. code:: xml {kiwi} extracts the archive into the root directory of the image using `GNU tar `_. This means that only archives supported by it can be included. When multiple `archive` elements are specified, then they are applied in a top-to-bottom order. If a file is already present in the image, then the file from the archive overwrites it (same as with the image overlay). .. _uninstall-system-packages: Uninstall System Packages ^^^^^^^^^^^^^^^^^^^^^^^^^ {kiwi} supports two different methods for removing packages from the appliance: 1. Packages present as a child element of `` are gracefully uninstalled by the package manager, together with dependent packages and orphaned dependencies. 2. Packages present as a child element of `` are removed by RPM/DPKG without any dependency check, potentially breaking dependencies and compromising the underlying package database. Both types of removals take place after :file:`config.sh` is run in the :ref:`prepare step ` (see also :ref:`working-with-kiwi-user-defined-scripts`). .. warning:: An `uninstall` packages request deletes: * the listed packages * the packages dependent on the listed ones * any orphaned dependency of the listed packages Use this feature with caution, as it can cause the removal of required tools, leading to failures in later build stages. Removing packages via `type="uninstall"` can be used to completely remove a build-time tool (for example, a compiler) without having to specify all dependencies of that tool (as opposed to when using `type="delete"`). Consider the following example, where we want to compile a custom program in :file:`config.sh`. We ship its source code via an `archive` element and add the build tools (`ninja`, `meson`, and `clang`) to `` and ``: .. code:: xml The tools `meson`, `clang`, and `ninja` are then available during the :ref:`prepare step `, and they can be used in :file:`config.sh` (for further details, see :ref:`working-with-kiwi-user-defined-scripts`), for example, to build `foo_app`: .. code:: bash pushd /opt/src/foo_app mkdir build export CC=clang meson build cd build && ninja && ninja install popd The `` element ensures that the final appliance no longer contains the tools required to build `foo_app`, thus making the image smaller. There are also other use cases for `type="uninstall"`, especially for specialized appliances. For containers, you can remove the package `shadow` (it is required to set up new user accounts) or any remaining partitioning tools (`parted` or `fdisk`). All networking tools can be safely uninstalled in images for embedded devices without a network connection. .. _product-and-namedCollection-element: The `product` and `namedCollection` element ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ {kiwi} supports the inclusion of openSUSE products or of named collections (*patterns* in SUSE-based distributions or *groups* for RedHat-based distributions). These can be added via the `product` and `namedCollection` child elements, which both take the mandatory `name` attribute and the optional `arch` attribute. `product` and `namedCollection` can be used to shorten the list of packages that need to be added to the image description. A named pattern, specified with the `namedCollection` element, is a representation of a predefined list of packages. Specifying a pattern installs all packages listed in the named pattern. Support for patterns is distribution-specific and available in SLES, openSUSE, CentOS, RHEL, and Fedora. The optional `patternType` attribute on the packages element allows you to control the installation of dependent packages. You may assign one of the following values to the `patternType` attribute: - `onlyRequired`: Incorporates only patterns and packages that the specified patterns and packages require. This is a "hard dependency" only resolution. - `plusRecommended`: Incorporates patterns and packages that are required and recommended by the specified patterns and packages. The `ignore` element ^^^^^^^^^^^^^^^^^^^^ Packages can be explicitly marked to be ignored for installation inside a `packages` collection. This can be used to exclude certain packages from being installed when using patterns with `patternType="plusRecommended"`, as shown in the following example: .. code:: xml Packages can be marked as ignored during the installation by adding an `ignore` child element with the mandatory `name` attribute set to the name of the package. Optionally, you can specify the architecture via `arch`, similarly to :ref:`package-element`. .. warning:: Adding `ignore` elements as children of a `` or a `` element has no effect! The packages will still be deleted. ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.734833 kiwi-11.1.8/doc/source/concept_and_workflow/profiles.rst0000644000000000000000000000466115273675667020363 0ustar00.. _image-profiles: Image Profiles ============== A *profile* is a namespace for additional settings that can be applied by {kiwi} in addition to the default settings (or other profiles), making it possible to build multiple appliances with the same build type but with different configurations. The use of profiles is advisable to distinguish image builds of the same type but with different settings. In the following example, two virtual machine images of the `oem` type are configured: one for QEMU (using the `qcow2` format) and one for VMWare (using the `vmdk` format). .. code:: xml 15.0 zypper Each profile is declared via the element `profile` that must be a child of `profiles`, and it must contain the `name` and `description` attributes. The `description` is only present for documentation purposes; `name`, on the other hand, is used to instruct {kiwi} which profile to build via the command line. Additionally, you can provide the boolean attribute `import`, which defines whether this profile should be used by default when {kiwi} is invoked via the command line. A profile inherits the default settings that do not belong to any profile. It applies only to elements that contain the profile in their `profiles` attribute. The attribute `profiles` expects a comma-separated list of profiles for which the settings of this element apply. Profiles can furthermore inherit settings from another profile via the `requires` sub-element: .. code:: xml In the above example, the profile `QEMU` inherits the settings from `VM`. For further details on the usage of *profiles*, see :ref:`building-build-with-profiles`. ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.734833 kiwi-11.1.8/doc/source/concept_and_workflow/repository_setup.rst0000644000000000000000000001222415273675667022171 0ustar00.. _repositories: Setting up Repositories ======================= The repository selection is a crucial part of an appliance. {kiwi} allows the end user to customize the selection of repositories and packages via the `repository` element. Adding repositories ------------------- {kiwi} installs packages into an appliance from the repositories defined in the image description. This means that at least one repository **must** be defined. Otherwise, {kiwi} cannot fetch any packages. A repository is added to the description via the `repository` element, which is a child of the top-level `image` element: .. code:: xml The above example specifies two repositories: 1. The repository belonging to the {kiwi} project: *{exc_kiwi_repo}* at the Open Build Service (OBS). 2. The RPM repository belonging to the OS project: *{exc_repo_obs}* at the Open Build Service (OBS). The translated HTTP URL is also included in the final appliance. The `repository` element accepts one `source` child element that contains the URL of the repository in a correct format, along with the following optional attributes: - `imageinclude`: Specifies whether the repository should be added to the resulting image. The default is false. - `imageonly`: A repository with `imageonly="true"` is not available during the image build but is present in the resulting appliance. The default is false. - `priority`: An integer value for all packages in this repository. If the same package is available in more than one repository, the priority decides which one is used. How the value is evaluated depends on the package manager: zypper and dnf prefer the repository with the *lower* value, while apt prefers the repository with the *higher* value and follows the `Pin-Priority` semantics of `apt_preferences(5)`. - `alias`: Name to use for the repository. It appears as the repository's name in the image, visible via `zypper repos` or `dnf repolist`. If `alias` is not specified, {kiwi} generates an alias name using a hex representation from uuid4. - `repository_gpgcheck`: Specifies whether or not this specific repository values the result of the repository signature validation. The default value is `false`. - `package_gpgcheck`: Specifies whether or not this specific repository values the result of the package signature validation for each package taken from this repository. The default value is `false`. - `components`: Distribution components used for `deb` repositories. The default is `main`. - `distribution`: Distribution name information, used for `deb` repositories. - `profiles`: List of profiles to which this repository applies. - `customize`: A script to run custom modifications to the repo file or files. Repo files allow for several customization options, but not all of them are supported to be set by kiwi through the current repository schema. As the used options do not follow any standard, and they are not compatible between package managers and distributions, the only way to handle this is through a script hook that is invoked with the repo file as a parameter for each file created by {kiwi}. An example for a script call to add the `module_hotfixes` option for a `dnf`-compatible repository configuration could look as follows: .. code:: bash repo_file=$1 echo 'module_hotfixes = 1' >> ${repo_file} .. note:: If the script is provided as a relative path, it is expected to be found in the image description directory. .. _supported-repository-paths: Supported repository paths ^^^^^^^^^^^^^^^^^^^^^^^^^^ The actual location of a repository is specified in the `source` child element of `repository` via its only attribute, `path`. {kiwi} supports the following path types: - `http://URL` or `https://URL` or `ftp://URL`: a URL to the repository available via HTTP(S) or FTP. - `obs://$PROJECT/$REPOSITORY`: checks whether the repository `$REPOSITORY` of the project `$PROJECT` is available on the Open Build Service (OBS). By default, {kiwi} looks for projects on `build.opensuse.org `_, but this can be overridden using the runtime configuration file (see :ref:`runtime_config`). Note that it is not possible to add repositories using the `obs://` path from **different** OBS instances (use direct URLs to the :file:`.repo` file instead in this case). - `obsrepositories:/`: a special path only available for builds using the Open Build Service. The repositories configured for the OBS project where the {kiwi} image resides are made available inside the appliance. This allows you to configure the repositories of your image from OBS itself, without modifying the image description. - `dir:///path/to/directory` or `file:///path/to/file`: an absolute path to a local directory or file available on the host building the appliance. ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.734833 kiwi-11.1.8/doc/source/concept_and_workflow/runtime_configuration.rst0000644000000000000000000001064315273675667023147 0ustar00.. _runtime_config: The Runtime Configuration File ------------------------------ {kiwi} supports an additional configuration file for runtime-specific settings that do not belong in the image description but which are persistent and are unsuitable for command-line parameters. The runtime configuration file must adhere to the `YAML `_ format. {kiwi} reads **every** one of the following locations that exists and merges them, with later entries overriding earlier ones: 1. :file:`/usr/share/kiwi/kiwi.yml` (vendor) 2. every :file:`*.yml` in :file:`/usr/share/kiwi/kiwi.yml.d/`, alphabetically 3. :file:`/etc/kiwi.yml` (administrator) 4. every :file:`*.yml` in :file:`/etc/kiwi.yml.d/`, alphabetically 5. :file:`~/.config/kiwi/config.yml` 6. the file passed via the global `--config` option `--config` does not replace the standard lookup, it is merged last and has the highest precedence. Both drop-in directories are always scanned, whether or not the corresponding main file exists. A system with no :file:`/etc/kiwi.yml` still loads :file:`/etc/kiwi.yml.d/*.yml`. This allows for modular configuration management, where different aspects of the configuration can be separated into different files. .. note:: Sections are merged key by key. A later file only needs to contain the keys it wants to change; all other keys of the same section from earlier files are kept. Lists, such as the `disable` list in the `runtime_checks` section, are combined from all files with duplicates removed. For example, if :file:`/usr/share/kiwi/kiwi.yml` contains .. code:: yaml bundle: compress: true shasum_size: "512" and :file:`/etc/kiwi.yml.d/10-local.yml` contains .. code:: yaml bundle: shasum_size: "256" then the effective `shasum_size` is ``"256"`` and `compress` stays ``true``. A default runtime config file in :file:`/usr/share/kiwi/kiwi.yml.example` is provided with the `python3-kiwi` main package. The file contains the available settings as comments, including a short description of each setting. .. _runtime_config_sparse_sync: The sparse data sync ^^^^^^^^^^^^^^^^^^^^ The `sparse` setting of the `sync` section asks the sync step that installs the image payload to turn sequences of null bytes in the source into holes on the target. It is off by default. Its effect depends on the presence of null runs in the source material and the target filesystem. The setting applies to every data sync {kiwi} performs, not only to the one that installs the payload. One typical system setup with many null runs is a Linux distribution compiled for a larger page size (e.g., for ARM 64K Kernels). This leads to many zero tails between elf binary segments. Filesystems differ in what is needed to make the holes stick. On a filesystem that performs speculative preallocation, syncing sparsely is not enough on its own, because the skipped range is eaten by speculative preallocation and is recorded as an allocated-but-unwritten extent. Such an extent reads as zero and is reported as a hole, yet it still occupies space. {kiwi} therefore lets a filesystem implementation declare the mount options it needs to prevent this, and applies them to the install time mount only, so that they do not become mount options of the running system. Of the filesystems {kiwi} supports, only `xfs` needs this. `ext4` and `btrfs` keep the holes without help. An encrypted image keeps the gain inside the filesystem, but by default not in the image file. The sync sees the null runs in the source and writes the payload sparsely either way, so the filesystem in the image accounts less and the running system has that space available. The image file does not become smaller by itself, because {kiwi} overwrites the whole device with random data before the filesystem is created, which allocates every block of the image whatever the data sync does. With ``luks_randomize="false"`` the image file accounts less as well. It is the randomization that limits the gain. However, if the sparseness savings allow for it, you can always make the overall image smaller in the build recipe. A compressing read-only filesystem, such as `squashfs` or `erofs`, typically gains nothing in addition, because the compression already removes the null runs. Sparse allocation can sometimes lead to additional fragmentation in the target filesystem and underlying image file. Do not blindly enable it, but check if your use case gains. ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.734833 kiwi-11.1.8/doc/source/concept_and_workflow/shell_scripts.rst0000644000000000000000000003563215273675667021420 0ustar00.. _working-with-kiwi-user-defined-scripts: User-Defined Scripts ==================== .. note:: **Abstract** This chapter describes the purpose of the user-defined scripts :file:`config.sh`, :file:`images.sh`, :file:`pre_disk_sync.sh`, and :file:`disk.sh`. These scripts can be used to further customize an image in ways that are not possible via the image description alone. {kiwi} supports the following optional scripts that it runs in a root environment (chroot) containing an appliance: post_bootstrap.sh Runs at the end of the `bootstrap` phase as part of the :ref:`prepare step `. The script can be used to configure the package manager with additional settings that apply in the following chroot-based installation step, which completes the installation. The script can also be used for other tasks. config.sh Runs at the end of the :ref:`prepare step ` and after users have been set and the *overlay tree directory* has been applied. It is usually used to apply a permanent and final change of data in the root tree, such as modifying a package-specific config file. config-overlay.sh Available only if `delta_root="true"` is set on a `docker` or `oci` build type that also uses `derived_from`. In this case, the script runs at the end of the :ref:`prepare step ` prior to the `umount` of the overlay root tree. It runs after `config.sh` (if specified), and it is the last entry point to change the delta root tree. config-host-overlay.sh Available only if `delta_root="true"` is set on a `docker` or `oci` build type that also uses `derived_from`. In this case, the script runs at the end of the :ref:`prepare step ` prior to the `umount` of the overlay root tree. The script is called **NOT CHROOTED** from the host with the image root directory as its working directory. It runs after `config.sh` and `config-overlay.sh` (if any or both are specified), and it is the last entry point to change the delta root tree. images.sh Executed at the beginning of the :ref:`image creation process `. It runs in the same image root tree created by the prepare step, but it is invoked whenever an image needs to be created from that root tree. It is normally used to apply image-type-specific changes to the root tree, such as a modification to a config file that must be done when building a live ISO but not when building a virtual disk image. pre_disk_sync.sh Executed for the disk image type `oem` only, and it runs right before the synchronization of the root tree into the disk image loop file. The :file:`pre_disk_sync.sh` can be used to change the content of the root tree as a last action before the sync to the disk image is performed. This is useful, for example, for deleting components from the system that were needed earlier or cannot be modified afterward when syncing into a read-only filesystem. disk.sh Executed for the disk image type `oem` only, and it runs after the synchronization of the root tree to the disk image loop file. The `chroot` environment for this script call is the virtual disk itself and not the root tree. The script :file:`disk.sh` is normally used to apply changes to parts of the system that are not an element of the file-based root tree, such as the partition table, the contents of the final initrd, the bootloader, filesystem attributes, etc. Two further hooks have variable file names. Their paths come from the `editbootconfig` and `editbootinstall` attributes of the `type` element, and both are called **NOT CHROOTED** from the host with the image root directory as the working directory: editbootconfig Called after the bootloader configuration has been written into the system image and before the root tree is synced into the disk. Two arguments are passed: the boot filesystem name and the boot partition number. This hook is also invoked for the live ISO build type. editbootinstall Called as the very last step of the disk build, after the bootloader has been installed. Two arguments are passed: the disk image file name and the device node of the boot partition. Only invoked for the `oem` disk build type. {kiwi} executes scripts via the operating system if their executable bit is set (in that case, a shebang is mandatory); otherwise, they are invoked via the Bash shell. Scripts that are called **NOT CHROOTED** are always invoked via the Bash shell. If a script exits with a non-zero exit code, {kiwi} reports the failure and aborts the image creation. Developing/Debugging Scripts ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Creating a custom script may require some experimenting and testing. To help developers with this task, {kiwi} calls scripts associated with a `screen` session. The connection to `screen` is only done if {kiwi} is called with the `--debug-run-scripts-in-screen` option. In this mode, a script can be started using the following template: .. code:: bash # The magic bits are still not set echo "break" /bin/bash Calling the script executes a `screen` session, which gives you access to the break-in shell. You can then implement the desired script code in this environment. Once the shell is closed, the {kiwi} process continues. In addition to providing a fully featured terminal throughout the execution of the script code, you also have control of the session during the process of the image creation. Listing the active sessions for script execution can be done as follows: .. code:: bash $ sudo screen -list There is a screen on: 19699.pts-4.asterix (Attached) 1 Socket in /run/screens/S-root. .. note:: As shown above, the screen session for executing the script code provides extended control, which can be considered a security risk. Because of that, {kiwi} only runs scripts through `screen` when explicitly enabled via the `--debug-run-scripts-in-screen` switch. In production, all scripts must run natively and must not require a terminal to operate correctly. Script Template for config.sh / images.sh ----------------------------------------- {kiwi} provides a collection of methods and variables that offer custom actions. For details, see :ref:`image-customization-methods`. The following template shows how to import this information into a script: .. code:: bash #====================================== # Include functions #-------------------------------------- test -f /.kconfig && . /.kconfig ... .. warning:: Modifications of the unpacked root tree Keep in mind that there is only one unpacked root tree the script operates in. This means that all changes are permanent and are not automatically restored. .. _image-customization-methods: Functions and Variables Provided by {kiwi} ------------------------------------------- {kiwi} creates the :file:`.kconfig` file to be sourced by shell scripts. :file:`.kconfig` contains several helper functions that can be used to simplify image configuration. Functions ^^^^^^^^^ The :file:`.kconfig` file provides a common set of functions. Functions specific to SUSE Linux Enterprise and openSUSE start with `suse`; functions applicable to all Linux distributions start with `base`. The following list describes the functions provided by :file:`.kconfig` that are supported for use in image scripts. Additional functions are defined in :file:`.kconfig`, these are {kiwi} internals and may change without notice. baseSetRunlevel {value} Set the default run level. baseStripAndKeep {list of info-files to keep} A helper function for the `baseStrip*` functions that reads a list of files to check from stdin for removing params: files that should be kept. baseStripLocales {list of locales} Removes all locales except for the ones given as the parameter. baseStripTranslations {list of translations} Removes all translations except those given as the parameter. baseStripUnusedLibs Removes libraries that are not directly linked against applications in the bin directories. baseUpdateSysConfig {filename} {variable} {value} Updates the contents of a sysconfig variable. baseSystemdServiceInstalled {service} Prints the path of the first found systemd unit or mount with the name passed as the first parameter. baseSysVServiceInstalled {service} Prints the name `${service}` if a SysV init service with the same name is found; otherwise, it prints nothing. baseSystemdCall {service_name} {args} Calls `systemctl ${args} ${service_name}` if a systemd unit, a systemd mount, or a SysV init service with the `${service_name}` exists. baseInsertService {servicename} Activates the specified service via :command:`systemctl`. baseRemoveService {servicename} Deactivates the specified service via :command:`systemctl`. baseService {servicename} {on|off} Activates or deactivates a service via :command:`systemctl`. The function requires the service name and the value `on` or `off` as parameters. The following example enables the sshd service on boot: .. code:: bash baseService sshd on suseInsertService {servicename} Calls `baseInsertService`. It exists only for compatibility reasons. suseRemoveService {servicename} Calls `baseRemoveService`. It exists only for compatibility reasons. suseService {servicename} {on|off} Calls `baseService`. It exists only for compatibility reasons. suseSetupProduct Creates the :file:`/etc/products.d/baseproduct` link pointing to the product referenced either by :file:`/etc/SuSE-brand` or :file:`/etc/os-release` or the latest `.prod` file available in :file:`/etc/products.d`. baseVagrantSetup Configures the image to work as a vagrant box by performing the following changes: - add the `vagrant` user to :file:`/etc/sudoers` or :file:`/etc/sudoers.d/vagrant`. - insert the insecure vagrant ssh key, apply recommended ssh settings, and start the ssh daemon. - create the default shared folder :file:`/vagrant`. Debug {message} A helper function to print the supplied message if the variable DEBUG is set to 1 (disabled by default). Echo {echo commandline} A helper function to print a message to the controlling terminal. Rm {list of files} A helper function to delete files and log the deletion. Profile Environment Variables ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ kiwi exports its environment file for each shell script call. The environment contains the variables listed below, among others. The full list can be obtained by running: .. code:: shell-session $ kiwi-ng image info --description= --print-kiwi-env $kiwi_compressed A value of the `compressed` attribute set in the `type` element in :file:`config.xml`. $kiwi_delete A list of all packages which are children of the `packages` element with `type="delete"` in :file:`config.xml`. $kiwi_drivers A comma-separated list of driver entries as listed in the `drivers` section of :file:`config.xml`. $kiwi_iname The name of the image as listed in :file:`config.xml`. $kiwi_iversion The image version as a string. $kiwi_keytable The contents of the keytable setup as specified in :file:`config.xml`. $kiwi_language The contents of the locale setup as specified in :file:`config.xml`. $kiwi_profiles A comma-separated list of profiles used to build this image. $kiwi_timezone The contents of the timezone setup as specified in :file:`config.xml`. $kiwi_type The image type as extracted from the `type` element in :file:`config.xml`. Configuration Tips ------------------ #. **Locale configuration:** To set the locale, {kiwi} relies on `systemd-firstboot`, which writes the locale configuration file, :file:`/etc/locale.conf`. The values for the locale settings are taken from the description XML file in the `` element under ``. Keep in mind that if the build distribution does not use `/etc/locale.conf`, `systemd-firstboot` does not have any effect on the locale settings. For example, in the SLE12 distribution, `systemd-firstboot` is only effective when locales in :file:`/etc/sysconfig/language` are not set or when the file does not exist at all. For compatibility reasons, the file :file:`/etc/sysconfig/language` in SLE12 has precedence over :file:`/etc/locale.conf`, and management tools can still use `sysconfig` files for locale settings. In any case, it is possible to configure the locale setting inside the :file:`config.sh` script in {kiwi} in a distribution-specific way or by adding any additional configuration file as part of the overlay root tree. #. **Stateless systemd UUIDs:** Machine ID files (:file:`/etc/machine-id`, :file:`/var/lib/dbus/machine-id`) may be created and set during the image package installation, depending on the distribution. Those UUIDs must be unique and must be set only once in each deployment. If :file:`/etc/machine-id` does not exist or contains the string `uninitialized` (systemd v249 and later), this triggers a firstboot action in systemd, and the services are run with `ConditionFirstBoot=yes`. Unless the file already contains a valid machine ID, systemd generates a machine ID and writes it into the file, creating it if necessary. See the `machine-id man page `_ for more details. Depending on whether the firstboot action should be triggered or not, :file:`/etc/machine-id` can be created, removed, or set to `uninitialized` by :file:`config.sh`. To prevent images from including a generated machine ID, {kiwi} clears :file:`/etc/machine-id` if it exists and does not contain the string `uninitialized`. This only applies to images based on a dracut initrd. .. note:: `rw` is necessary if :file:`/etc/machine-id` does not exist. For systemd to be able to write :file:`/etc/machine-id` on boot, either the file must exist (so that a bind mount can be created) or :file:`/etc` must be writable. By default, the root filesystem is mounted read-only by dracut/systemd, so a missing :file:`/etc/machine-id` will lead to an error on boot. To force the initial mount to be read-write, add the `rw` option to the kernel command line. .. note:: Avoid inconsistent :file:`/var/lib/dbus/machine-id`. :file:`/etc/machine-id` and :file:`/var/lib/dbus/machine-id` **must** contain the same unique ID. On modern systems, :file:`/var/lib/dbus/machine-id` is already a symlink to :file:`/etc/machine-id`. However, on older systems, there might be two different files. This is the case for SLE-12-based images. If you are targeting older operating systems, it is recommended to add the symlink creation into :file:`config.sh`: .. code:: bash #====================================== # Make machine-id consistent with dbus #-------------------------------------- if [ -e /var/lib/dbus/machine-id ]; then rm /var/lib/dbus/machine-id fi ln -s /etc/machine-id /var/lib/dbus/machine-id ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.734833 kiwi-11.1.8/doc/source/concept_and_workflow/systemdeps.rst0000644000000000000000000001104015273675667020725 0ustar00.. _systemdeps: Host Requirements To Build Images --------------------------------- Building OS images requires several tools and subsystems to be present on the {kiwi} host. For example, to build a virtual disk image, tools for partition table setup or tools to create filesystems must be available on the host that builds the image. The number of required components depends on the selected image type and the features used with the image. It's unreasonable to expect {kiwi} users to know which exact components are needed to build the image. A mechanism called `kiwi-systemdeps` is designed to handle the host requirements. `kiwi-systemdeps` consists of a collection of sub-packages provided with the `python-kiwi` main package. Each individual package requires a number of tools and subsystem packages that belong to the package category. There are the following systemdeps packages: `kiwi-systemdeps-core`: * Supports building the simple root archive `tbz` image type. * Installs the package managers that are supported by the target distribution, as well as the `tar` archiving tool. `kiwi-systemdeps-containers`: * Supports building `OCI` image types used with `docker` and `podman`. * Installs the distribution-specific toolchain to build OCI- compliant container images. `kiwi-systemdeps-containers-wsl`: * Supports building `appx` and `wsl` image types. The `wsl` type is the successor to the former `appx` type. * Installs the distribution-specific toolchain to build WSL-compliant container images on Windows systems. `kiwi-systemdeps-iso-media`: * Supports building `iso` image types and `oem` install media. * Installs all tools required to build ISO filesystems. * Depends on the `-core`, `-filesystems`, and `-bootloaders` kiwi-systemdeps packages. `kiwi-systemdeps-bootloaders`: * Supports building bootable `oem` and `iso` image types. * Installs all bootloader tools depending on the host architecture to allow setup and install of the bootloader. The pulled-in components are required for any image that is able to boot through some BIOS or firmware. * Depends on the `-core` kiwi-systemdeps packages. `kiwi-systemdeps-filesystems`: * Supports building `fs-type`, `oem`, `pxe`, `kis`, and live `iso` image types. * Installs all tools to create filesystems supported by {kiwi}. The pulled-in components are needed for any image type that needs to create a filesystem. This excludes the archive-based image types like `docker`, `appx`, or `tbz`. The package also installs tools one level below the actual filesystem creation toolkit. These are components to manage loop devices, as well as partition table setup and subsystem support, like LVM and LUKS. * Depends on the `-core` kiwi-systemdeps packages. `kiwi-systemdeps-disk-images`: * Supports building the `oem` image type. * Installs all tools to create virtual disks. Virtual disks in {kiwi} are created using the QEMU toolchain. * Depends on the `-filesystems`, `-bootloaders` and `-iso-media` kiwi-systemdeps packages. `kiwi-systemdeps-image-validation`: * Installs the `jing` tool to validate the image description. This is useful for detailed error reports from {kiwi} if an image description validation error occurs. In addition, the `anymarkup` Python module is installed if the option to install recommended packages is set. With `anymarkup` available, {kiwi} can also handle image descriptions in a format other than the XML markup (for example, YAML). `kiwi-systemdeps-boxbuild`: * Supports building images in a self-contained virtual machine or container via the `kiwi-ng system boxbuild` command. * Installs the QEMU/KVM toolchain required to run the build box. `kiwi-systemdeps-stackbuild`: * Supports storing image root trees as containers and building images based on containers via the `kiwi-ng system stash` and `kiwi-ng system stackbuild` commands. * Installs `podman` and `rsync`. * Depends on the `-containers` kiwi-systemdeps package. Depending on the image type, the `kiwi-systemdeps` packages can help to quickly set up the host system for building images. In case the host must support everything, there is also the main `kiwi-systemdeps` package that has all other existing `systemdeps` packages, except for `-boxbuild` and `-stackbuild`, as its dependency. .. note:: Pulling in all `kiwi-systemdeps` packages can result in a large number of packages installed on the host because the required packages themselves have other dependencies (for example, java for jing). ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.734833 kiwi-11.1.8/doc/source/concept_and_workflow/users.rst0000644000000000000000000000344615273675667017701 0ustar00.. _adding-users: Adding Users ============ User accounts can be added or modified via the `users` element that supports a list of multiple `user` child elements: .. code:: xml Each `user` element represents a specific user to be added or modified. The following attributes are mandatory: - `name`: the UNIX username. - `password`: The password for the user account. It can be provided either in clear-text form (`pwdformat="plain"`) or in encrypted form (`pwdformat="encrypted"`). Using plain passwords is not advisable, as anyone with access to the image description can see the password. It is recommended to generate a hash of your password using `openssl` as follows: .. code:: bash $ openssl passwd -1 -salt 'xyz' YOUR_PASSWORD Additionally, the following optional attributes can be specified: - `home`: The path to the user's home directory. - `groups`: A comma-separated list of UNIX groups. The first element of the list is used as the user's primary group. The remaining elements are appended to the user's supplementary groups. When no groups are assigned, the system's default primary group will be used. - `id`: The numeric user ID of the account. - `realname`: The full name of the user. - `shell`: The login shell of the user. - `pwdformat`: The format in which `password` is provided, either `plain` or `encrypted` (the latter is the default). ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7342527 kiwi-11.1.8/doc/source/concept_and_workflow.rst0000644000000000000000000002341615273675667016537 0ustar00Concept and Workflow ==================== .. note:: **Abstract** The following sections describe the concept and general workflow of building appliances with {kiwi} |version|. .. toctree:: :maxdepth: 1 concept_and_workflow/systemdeps.rst concept_and_workflow/repository_setup concept_and_workflow/packages concept_and_workflow/profiles concept_and_workflow/users concept_and_workflow/shell_scripts concept_and_workflow/runtime_configuration concept_and_workflow/customize_the_boot_process {kiwi} builds so-called *system images* (a fully installed and optionally configured system in a single file) of a Linux distribution in two steps (for further details, see :ref:`working-with-kiwi-image-building-process`): 1. *Prepare operation*: generate an *unpacked image tree* of your image. The unpacked tree is a directory containing the future filesystem of your image, generated from your image description. 2. *Create operation*: the unpacked tree generated in step 1 is packaged into the format required for the final usage (e.g., a `qcow2` disk image to launch the image with QEMU). {kiwi} executes these steps using the following components, which it expects to find in the *description directory*: :ref:`image-description`: The :file:`config.xml` file contains the image description, which is a collection of general settings of the final image, like the image layout, installed packages, present users, etc. .. note:: The filename :file:`config.xml` is not mandatory; the image description file can also have an arbitrary name plus the :file:`*.kiwi` extension. {kiwi} first looks for a :file:`config.xml` file. If it cannot be found, it picks the first :file:`*.kiwi` file. When using a file with the :file:`.kiwi` extension, multiple markup options are supported, including `XML`, `YAML`, and `TOML`. :ref:`working-with-kiwi-user-defined-scripts`: If present, custom configuration shell scripts run at different stages of the build process. They can be used to fine-tune the image in ways that are not possible via the settings provided in :file:`config.xml`. Overlay tree directory: The *overlay tree* is a folder (called :file:`root`) or a tarball (called :file:`root.tar.gz`) that contains files and directories that will be copied into the *unpacked image tree* during the *Prepare operation*. The copying is executed after all the packages included in :file:`config.xml` have been installed. Any files that are already present will be overwritten. CD root user data: For live ISO images and install ISO images, an optional archive is supported. This is a tar archive matching the name :file:`config-cdroot.tar[.compression_postfix]`. If present, the archive will be unpacked as user data on the ISO image. For example, this is used to add license files or user documentation. The documentation can then be read directly from the CD/DVD without booting from the media. .. _working-with-kiwi-image-building-process: Image Building Process ~~~~~~~~~~~~~~~~~~~~~~ .. figure:: .images/flow-diagram.png :align: center :alt: {kiwi} Build Process Flow Diagram {kiwi} Build Process Flow Diagram {kiwi} creates images in a two-step process: The first step, the *prepare* operation, generates a so-called *unpacked image tree* (directory) using the information provided in the :file:`config.xml` configuration file (see :ref:`image-description`). The second step, the *create* operation, creates the *packed image* or *image* in the specified format based on the unpacked image tree and the information provided in the :file:`config.xml` configuration file. .. _prepare-step: The Prepare Step ^^^^^^^^^^^^^^^^ As the first step, {kiwi} creates an *unpackaged image tree*, also called a "root tree". This directory will be the installation target for software packages to be installed during the image creation process. For the package installation, {kiwi} relies on the package manager specified in the `packagemanager` element in :file:`config.xml`. {kiwi} supports the following package managers: `apk`, `apt`, `dnf4` (default), `dnf5`, `microdnf`, `pacman`, and `zypper`. The prepare step consists of the following substeps: #. **Create Target Root Directory** By default, {kiwi} aborts with an error if the target root tree already exists to avoid accidental deletion of an existing unpacked image. The option `--allow-existing-root` can be used to work based on an existing root tree. #. **Bootstrap Target Root Directory** First, {kiwi} configures the package manager to use the repositories specified in the configuration file, via the command line, or both. After the repository setup, the packages specified in the `bootstrap` section of the image description are installed into the target root tree using the package manager of the build host (not chrooted). This establishes the initial environment to support the completion of the process in a chroot setting. At the end of the `bootstrap` phase, the script :file:`post_bootstrap.sh` is executed, if present. .. note:: The essential bootstrap packages are usually `filesystem` and `glibc-locale` to specify as part of the bootstrap. The dependency chain of these two packages is usually sufficient to populate the bootstrap environment with all required software to support the installation of packages into the new root tree. #. **Install Packages** After the `bootstrap` phase, all other `` sections are used to complete the installation as a chroot operation. {kiwi} uses the package manager as installed in the `bootstrap` phase and installs all other packages as configured. .. note:: The installation of software packages through the selected package manager may install unwanted packages. Removing these packages can be accomplished by marking them for deletion in the image description; see :ref:`uninstall-system-packages`. #. **Apply Archives** All archives specified in the `archive` element of the :file:`config.xml` file are applied in the specified order (top to bottom) after the package installation is complete (see :ref:`archive-element`). Files and directories are extracted relative to the top level of the new root tree. It is possible to overwrite files already existing in the target root tree. #. **Apply the Overlay Tree** Next, {kiwi} applies all files and directories present in the overlay directory named :file:`root` or in the compressed overlay, :file:`root.tar.gz`, to the target root tree. Files already present in the target root directory are overwritten. This allows you to overwrite any file that was installed by one of the packages or archives during the installation phase. #. **Execute the user-defined script** :file:`config.sh`. At the end of the preparation stage, the script :file:`config.sh` is executed (if present). It is run in the top-level directory of the target root tree. The script's primary function is to complete the system configuration. For more details about custom scripts, see :ref:`working-with-kiwi-user-defined-scripts`. #. **Modify the Root Tree** The unpacked image tree is now finished and can be converted into the final image in the *create step*. It is possible to make manual modifications to the unpacked tree before it is converted into the final image. Since the unpacked image tree is just a directory, it can be modified using the standard tools. Optionally, it is also possible to 'change root (`chroot`)' into it, for instance, to invoke the package manager. Besides the standard filesystem layout, the unpacked image tree contains an additional directory named :file:`/image` that is not present in a regular system. It contains information {kiwi} requires during the create step, including a copy of the :file:`config.xml` file. By default, {kiwi} will not stop after the *prepare step* and will proceed directly with the *create step*. Therefore, to perform manual modifications, proceed as follows: .. code:: shell-session $ kiwi-ng system prepare $ARGS $ # make your changes $ kiwi-ng system create $ARGS .. warning:: Modifications of the unpacked root tree When performing manual modifications of the unpacked image tree, be aware that these changes might be lost when calling the prepare step again. Therefore, avoid making changes that should be persistent across multiple runs of the `prepare` step. The recommended way to apply persistent changes to the unpacked image directory is to change the original image description and re-run the `prepare` step. .. _create-step: The Create Step ^^^^^^^^^^^^^^^ {kiwi} creates the final image during the *create step*: it converts the unpacked root tree into one or multiple output files appropriate for the respective build type. It is possible to create multiple images from the same unpacked root tree, for example, a self-installing OEM image and a virtual machine image from the same image description. The only prerequisite is that both image types are specified in :file:`config.xml`. During the *create step*, the following operations are performed by {kiwi}: #. **Execute the User-defined Script** :file:`images.sh`. At the beginning of the image creation process, the script named :file:`images.sh` is executed (if present). For more details about custom scripts, see :ref:`working-with-kiwi-user-defined-scripts`. #. **Create the Requested Image Type** {kiwi} converts the unpacked root into an output format appropriate for the requested build type. During this process further image type specific user defined scripts may be executed (see :ref:`working-with-kiwi-user-defined-scripts`). ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.734833 kiwi-11.1.8/doc/source/conf.py0000644000000000000000000002335215273675667013074 0ustar00#!/usr/bin/env python3 # -*- coding: utf-8 -*- # # KIWI NG documentation build configuration file # from datetime import datetime import sys from os.path import abspath, dirname, join, normpath import shlex from sphinx.transforms import SphinxTransform # If extensions (or modules to document with autodoc) are in another directory, # add these directories to sys.path here. If the directory is relative to the # documentation root, use os.path.abspath to make it absolute, like shown here. _path = normpath(join(dirname(__file__), "../..")) sys.path.insert(0, _path) # -- General configuration ------------------------------------------------ # If your documentation needs a minimal Sphinx version, state it here. #needs_sphinx = '1.0' # Add any Sphinx extension module names here, as strings. They can be # extensions coming with Sphinx (named 'sphinx.ext.*') or your custom # ones. extensions = [ 'sphinx.ext.autodoc', 'sphinx.ext.autosummary', 'sphinx.ext.extlinks', 'sphinx.ext.todo', 'sphinx.ext.ifconfig', 'sphinx.ext.viewcode', # 'sphinxcontrib.spelling', 'sphinx_rtd_theme' ] def prologReplace(app, docname, source): result = source[0] for key in app.config.prolog_replacements: result = result.replace(key, app.config.prolog_replacements[key]) source[0] = result class AddRootRole(SphinxTransform): # Runs after the document is parsed and the source path is set default_priority = 500 def apply(self): master_doc = self.config.master_doc # Get the current document name relative to the source directory # e.g., 'index', 'folder/subpage', etc. docname = self.env.docname # Only apply the attribute if this is the main entry point if docname == master_doc: self.document['role'] = 'main' def setup(app): app.add_config_value('prolog_replacements', {}, True) app.add_transform(AddRootRole) app.connect('source-read', prologReplace) prolog_replacements = { '{exc_image_base_name}': 'kiwi-test-image-some', '{exc_image_base_name_pxe}': 'kiwi-test-image-pxe', '{exc_image_base_name_kis}': 'kiwi-test-image-kis', '{exc_image_base_name_vagrant}': 'kiwi-test-image-vagrant', '{exc_image_base_name_disk}': 'kiwi-test-image-disk', '{exc_image_base_name_disk_simple}': 'kiwi-test-image-disk-simple', '{exc_image_base_name_live}': 'kiwi-test-image-live', '{exc_image_base_name_docker}': 'kiwi-test-image-docker', '{exc_image_base_name_enclave}': 'kiwi-test-image-nitro-enclave', '{exc_netboot}': 'netboot/suse-tumbleweed', '{exc_description_pxe}': 'x86/tumbleweed/test-image-pxe', '{exc_description_kis}': 'x86/tumbleweed/test-image-kis', '{exc_description_vagrant}': 'x86/leap/test-image-vagrant', '{exc_description_disk}': 'x86/leap/test-image-disk', '{exc_description_disk_simple}': 'x86/leap/test-image-disk-simple', '{exc_description_live}': 'x86/leap/test-image-live', '{exc_description_wsl}': 'x86/tumbleweed/test-image-wsl', '{exc_description_docker}': 'x86/leap/test-image-docker', '{exc_description_enclave}': 'x86/rawhide/test-image-nitro-enclave', '{exc_os_version}': '16.0', '{exc_image_version}': '1.15.3', '{exc_image_version_pxe}': '1.42.1', '{exc_image_version_kis}': '1.42.1', '{exc_image_version_enclave}': '1.1.1', '{exc_repo_leap}': 'https://download.opensuse.org/distribution/leap/16.0/repo/oss', '{exc_repo_tumbleweed}': 'https://download.opensuse.org/tumbleweed/repo/oss', '{exc_repo_rawhide}': 'https://mirrors.fedoraproject.org/metalink?repo=rawhide&arch=x86_64', '{exc_kiwi_repo}': 'obs://Virtualization:Appliances:Builder/openSUSE_Leap_16.0', '{exc_repo_obs}': 'obs://openSUSE:Leap:16.0/standard', '{schema_version}': '8.5', '{kiwi}': 'KIWI NG', '{kiwi-product}': 'KIWI Next Generation (KIWI NG)', '{kiwi-legacy}': 'KIWI Legacy' } latex_documents = [ ('index', 'kiwi.tex', 'KIWI NG Documentation', 'Marcus Schäfer', 'manual') ] latex_elements = { 'papersize': 'a4paper', 'pointsize':'12pt', 'classoptions': ',openany', 'babel': '\\usepackage[english]{babel}', 'preamble': r''' \makeatletter \fancypagestyle{normal}{ \fancyhf{} \fancyfoot[LE,RO]{{\py@HeaderFamily\thepage}} \fancyfoot[LO]{{\py@HeaderFamily\nouppercase{\rightmark}}} \fancyfoot[RE]{{\py@HeaderFamily\nouppercase{\leftmark}}} \fancyhead[LE,RO]{{\py@HeaderFamily \@title, \py@release}} \renewcommand{\headrulewidth}{0.4pt} \renewcommand{\footrulewidth}{0.4pt} } \makeatother ''' } # Add any paths that contain templates here, relative to this directory. templates_path = ['.templates'] # The suffix(es) of source filenames. # You can specify multiple suffix as a list of string: # source_suffix = ['.rst', '.md'] source_suffix = '.rst' # The encoding of source files. source_encoding = 'utf-8-sig' # The master toctree document. master_doc = 'index' default_role="py:obj" # General information about the project. project = 'KIWI NG' author = 'Marcus Schäfer' copyright = f'2020-{datetime.now().year}, {author}' # The version info for the project you're documenting, acts as replacement for # |version| and |release|, also used in various other places throughout the # built documents. # # The short X.Y version. version = '11.1.8' # The full version, including alpha/beta/rc tags. release = version # The language for content autogenerated by Sphinx. Refer to documentation # for a list of supported languages. # # This is also used if you do content translation via gettext catalogs. # Usually you set "language" from the command line for these cases. language = 'en' # List of patterns, relative to source directory, that match files and # directories to ignore when looking for source files. exclude_patterns = [] # If true, '()' will be appended to :func: etc. cross-reference text. #add_function_parentheses = True # If true, the current module name will be prepended to all description # unit titles (such as .. function::). #add_module_names = True # If true, sectionauthor and moduleauthor directives will be shown in the # output. They are ignored by default. #show_authors = False # The name of the Pygments (syntax highlighting) style to use. pygments_style = 'sphinx' # A list of ignored prefixes for module index sorting. #modindex_common_prefix = [] # If true, keep warnings as "system message" paragraphs in the built documents. #keep_warnings = False # If true, `todo` and `todoList` produce output, else they produce nothing. todo_include_todos = True autosummary_generate = True #spelling_lang = 'en_US' #spelling_show_suggestions = True #spelling_word_list_filename = ['spelling_wordlist.txt'] # -- Options for HTML output ---------------------------------------------- #html_short_title = '%s-%s' % (project, version) #html_last_updated_fmt = '%b %d, %Y' #html_split_index = True html_logo = '.images/kiwi-logo.png' html_sidebars = { '**': [ 'localtoc.html', 'relations.html', 'about.html', 'searchbox.html', ] } html_theme = "sphinx_rtd_theme" html_theme_options = { 'collapse_navigation': False, 'sticky_navigation': True, 'navigation_depth': 3, 'includehidden': True, 'titles_only': False } # -- Options for manual page output --------------------------------------- # The man page toctree documents. kiwi_doc = 'commands/kiwi' result_list_doc = 'commands/result_list' result_bundle_doc = 'commands/result_bundle' system_prepare_doc = 'commands/system_prepare' system_update_doc = 'commands/system_update' system_build_doc = 'commands/system_build' system_boxbuild_doc = 'commands/system_boxbuild' system_create_doc = 'commands/system_create' system_stackbuild_doc = 'commands/system_stackbuild' system_stash_doc = 'commands/system_stash' image_resize_doc = 'commands/image_resize' image_info_doc = 'commands/image_info' # One entry per manual page. List of tuples # (source start file, name, description, authors, manual section). man_pages = [ ( kiwi_doc, 'kiwi', 'Creating Operating System Images', [author], 8 ), ( result_list_doc, 'kiwi::result::list', 'List build results', [author], 8 ), ( result_bundle_doc, 'kiwi::result::bundle', 'Bundle build results', [author], 8 ), ( system_prepare_doc, 'kiwi::system::prepare', 'Prepare image root system', [author], 8 ), ( system_create_doc, 'kiwi::system::create', 'Create image from prepared root system', [author], 8 ), ( system_update_doc, 'kiwi::system::update', 'Update/Upgrade image root system', [author], 8 ), ( system_build_doc, 'kiwi::system::build', 'Build image in combined prepare and create step', [author], 8 ), ( system_boxbuild_doc, 'kiwi::system::boxbuild', 'Build image in a self contained VM or container', [author], 8 ), ( system_stackbuild_doc, 'kiwi::system::stackbuild', 'Build image based on stash containers', [author], 8 ), ( system_stash_doc, 'kiwi::system::stash', 'Create a stash container from an image root directory', [author], 8 ), ( image_resize_doc, 'kiwi::image::resize', 'Resize disk images to new geometry', [author], 8 ), ( image_info_doc, 'kiwi::image::info', 'Provide detailed information about an image description', [author], 8 ) ] # If true, show URL addresses after external links. #man_show_urls = False ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.734833 kiwi-11.1.8/doc/source/contributing/kiwi_from_python.rst0000644000000000000000000000377715273675667020436 0ustar00Using {kiwi} in a Python Project ================================= .. note:: **Abstract** {kiwi} is provided as a Python module under the **kiwi** namespace. It is available for the Python 3 version. The following description applies to {kiwi} version |version|. {kiwi} can also function as a module for other Python projects. The following example demonstrates how to read an existing image description, add a new repository definition, and export the modified description on stdout: .. code:: python import sys import logging from kiwi.xml_description import XMLDescription from kiwi.xml_state import XMLState description = XMLDescription('path/to/kiwi/XML/config.xml') xml_data = description.load() xml_state = XMLState( xml_data=xml_data, profiles=[], build_type='iso' ) xml_state.add_repository( repo_source='http://repo', repo_type='rpm-md', repo_alias='myrepo', repo_prio=99 ) xml_data.export( outfile=sys.stdout, level=0 ) Each class in the example is responsible for a single task, so they can be reused in other use cases. Therefore, it is possible to use {kiwi} beyond the main image building scope, for example, to manage the setup of loop devices, filesystems, partitions, etc. This means {kiwi} offers a way to describe a system, but you can choose whether you want to use the {kiwi} description format or not. The following example shows how to use {kiwi} to create a simple filesystem image that contains your host's `tmp` directory. .. code:: python import logging from kiwi.storage.loop_device import LoopDevice from kiwi.filesystem import FileSystem with LoopDevice( filename='my_tmp.ext4', filesize_mbytes=100 ) as loop_provider: loop_provider.create() with FileSystem.new( 'ext4', loop_provider, '/tmp/' ) as filesystem: filesystem.create_on_device( label='TMP' ) filesystem.sync_data() ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.735329 kiwi-11.1.8/doc/source/contributing/kiwi_plugin_architecture.rst0000644000000000000000000001131115273675667022111 0ustar00Plugin Architecture =================== Each command provided by {kiwi} is written as a task plugin under the **kiwi.tasks** namespace. As a developer, you can extend the {kiwi} system command space with custom task plugins, following the conventions below. Naming conventions ------------------ Task plugin file name The file name of a task plugin must follow the pattern :file:`system_.py`. This allows you to invoke the task with :command:`kiwi-ng system ...` Task plugin option handling {kiwi} uses the typer module to handle options. Each task plugin must use typer to allow option handling. The typer definition must be provided in a file named :file:`cli.py` and must live in the toplevel of the plugin python namespace. The :file:`cli.py` file must provide a dictionary named `typers` that maps the command name to its `typer.Typer` instance. Task plugin class The implementation of the plugin must be a class that matches the naming convention ``SystemTask``. The class must inherit from the ``CliTask`` base class. On the plugin startup, {kiwi} expects an implementation of the `process` method. Task plugin entry point Registration of the plugin must be done in :file:`pyproject.toml` using the `tool.poetry.plugins` concept. The entry point group must be `kiwi.tasks`, and the name of the toplevel plugin python namespace must contain the `_plugin` substring. Otherwise, {kiwi} does not load the :file:`cli.py` of the plugin. The namespaces `kiwi_boxed_plugin` and `kiwi_stackbuild_plugin` are ignored because their commands are now part of {kiwi} itself. .. code:: [tool.poetry] name = "kiwi__plugin" packages = [ { include = "kiwi__plugin"}, ] [tool.poetry.plugins] [tool.poetry.plugins."kiwi.tasks"] system_ = "kiwi__plugin.tasks.system_" Example plugin -------------- .. note:: The following example assumes an existing Python project which was set up using poetry and pyproject.toml. 1. Assuming the project namespace is **kiwi_relax_plugin**, create the task plugin directory :file:`kiwi_relax_plugin/tasks`. 2. Create the entry point in :file:`pyproject.toml`. Assuming we want to create the system command **justdoit**, this is the following entry point definition in :file:`pyproject.toml`: .. code:: toml [tool.poetry] name = "kiwi_relax_plugin" packages = [ { include = "kiwi_relax_plugin"}, ] [tool.poetry.plugins] [tool.poetry.plugins."kiwi.tasks"] system_justdoit = "kiwi_relax_plugin.tasks.system_justdoit" 3. Create the typer cli interface in the file :file:`kiwi_relax_plugin/cli.py` with the following content: .. code:: python import typer from typing import Annotated # typers variable must be provided for kiwi plugins typers = { 'justdoit': typer.Typer(add_completion=False) } system = typers['justdoit'] @system.callback( help='What is it good for', invoke_without_command=True, subcommand_metavar='' ) def justdoit( ctx: typer.Context, now: Annotated[bool, typer.Option(help='For --now option')] = False ): Cli=ctx.obj Cli.subcommand_args['justdoit'] = { '--now': now, 'help': False } Cli.global_args['command'] = 'justdoit' Cli.global_args['system'] = True Cli.cli_ok = True 4. Create the plugin code in the file :file:`kiwi_relax_plugin/tasks/system_justdoit.py` with the following content: .. code:: python # These imports requires kiwi to be part of your environment # It can be either installed from pip into a virtual development # environment or from the distribution package manager. from kiwi.tasks.base import CliTask from kiwi.help import Help class SystemJustdoitTask(CliTask): def process(self): self.manual = Help() if self.command_args.get('help') is True: # The following will invoke man to show the man page # for the requested command. Thus, for the call to # succeed, a man page needs to be written and # installed by the plugin. return self.manual.show('kiwi::relax::justdoit') if self.command_args.get('--now'): print( 'https://genius.com/Frankie-goes-to-hollywood-relax-lyrics' ) 5. Test the plugin .. code:: bash $ poetry run kiwi-ng system justdoit --now ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.735329 kiwi-11.1.8/doc/source/contributing/schema_extensions.rst0000644000000000000000000001041015273675667020544 0ustar00Extending {kiwi} with Custom Operations ======================================== .. note:: **Abstract** Extension plugins in {kiwi} offer a mechanism for adding information outside the standard {kiwi} schema. This document describes how to create an extension plugin for the {kiwi} schema as well as how to add and validate additional information in the {kiwi} image description. The described schema extension can be used in an additional {kiwi} task plugin to provide a new subcommand for {kiwi}. At the present moment, there is no other plugin interface except for providing additional {kiwi} commands. Depending on the demand for custom plugins, the interface to hook into code in other parts of the {kiwi} processing needs to be extended. This description applies to version |version|. The Section ----------------------- The main {kiwi} schema supports an extension section that allows you to specify any XML structure and attributes, as long as they are attached to a namespace. This means that any custom XML structure can be implemented similar to the example below: .. code:: xml ... * Any top-level namespace must be unique. * Multiple different top-level namespaces are allowed, for example, `my_plugin_a`, `my_plugin_b`. RELAX NG Schema for the Extension --------------------------------- If an extension section is found, {kiwi} looks up its namespace and uses the main XML catalog for the schema file to validate the extension data. The schema file must be a RELAX NG schema in the `.rng` format. We recommend saving the schema as :file:`/usr/share/xml/kiwi/my_plugin.rng`. For the example above, the RELAX NG Schema in the compact format, :file:`my_plugin.rnc`, looks as follows: .. there is no rnc syntax highlighting, try cpp .. code:: cpp namespace my_plugin = "http://www.my_plugin.com" start = k.my_feature div { k.my_feature.attlist = empty k.my_feature = element my_plugin:my_feature { k.my_feature.attlist & k.title } } div { k.title.name.attribute = attribute name { text } k.title.attlist = k.title.name.attribute k.title = element my_plugin:title { k.title.attlist } } To convert this schema to the `.rng` format, just call: .. code:: bash $ trang -I rnc -O rng my_plugin.rnc /usr/share/xml/kiwi/my_plugin.rng Extension schema in XML catalog ------------------------------- As mentioned above, the mapping from the extension namespace to the correct RELAX NG schema file is handled by an XML catalog file. The XML catalog for the example is as follows: .. code:: xml For resolving the catalog, {kiwi} uses the `xmlcatalog` command and the main XML catalog from the system, :file:`/etc/xml/catalog`. .. note:: How the main catalog is informed about the existence of the {kiwi} extension catalog file depends on the distribution and its version. Refer to the distribution documentation for information on adding XML catalogs. If the following command provides the information for the correct RELAX NG schema file, you are ready for a first test: .. code:: bash $ xmlcatalog /etc/xml/catalog http://www.my_plugin.com Using the extension ------------------- To test the extension, insert the example extension into one of your image description's :file:`config.xml` file. The following example reads the name attribute from the title section of the `my_feature` root element and prints it: .. code:: python import logging from kiwi.xml_description import XMLDescription description = XMLDescription('path/to/kiwi/XML/config.xml') description.load() my_plugin = description.get_extension_xml_data('my_plugin') print(my_plugin.getroot()[0].get('name')) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.735329 kiwi-11.1.8/doc/source/contributing/scripts_testing.rst0000644000000000000000000000541515273675667020262 0ustar00Write Integration Tests for the Scripts --------------------------------------- {kiwi} comes with a set of helper functions that can be used in :file:`config.sh` (see also: :ref:`working-with-kiwi-user-defined-scripts`). These functions utilize containers to run the individual tasks and verify the final result. Ensure that you have either :command:`podman` or :command:`docker` installed and configured on your system. Podman is used by default. You can select :command:`docker` instead by setting the environment variable ``CONTAINER_RUNTIME`` to ``docker``. Then, you can run the integration tests via the `test_scripts` Makefile target: .. code:: shell-session $ make test_scripts The tests are written using the `pytest-container `__ plugin. If applicable, use the utility functions and fixtures of the plugin. For example, the `auto_container` and `auto_container_per_test` fixtures in conjunction with `testinfra `__. Test setup ~~~~~~~~~~ The script tests can be run inside different containers specified in :file:`test/scripts/conftest.py`. This file contains the `CONTAINERS` list with all currently present images. These images are pulled and built as needed, and the :file:`functions.sh` is copied into `/bin/`, so it is available in `PATH`. To use any of these containers, you can either define the global variable `CONTAINER_IMAGES` in a test module and use the `auto_container` fixture, or `parametrize `__ the `container` fixture indirectly: .. code:: python @pytest.mark.parametrize("container_per_test", (TUMBLEWEED, LEAP_15_5), indirect=True) def test_RmWorks(container_per_test): # create the file /root/foobar container_per_test.connection.run_expect([0], "touch /root/foobar") assert container_per_test.connection.file("/root/foobar").exists # source the functions and execute our function under test container_per_test.connection.run_expect([0], ". /bin/functions.sh && Rm /root/foobar") # verify the result assert not container_per_test.connection.file("/root/foobar").exists The example above uses the `_per_test` variant of the `container` fixture. It ensures that the container is used only in a single test function. Use this variant for tests that mutate the system under test because otherwise, it may lead to race conditions that are difficult to debug. For tests that only perform reads, you can omit the `_per_test` suffix so that the container environment can be shared with other tests. This improves execution speed but comes at the expense of safety in case of mutation. For further information, refer to `pytest-container `__. ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.734833 kiwi-11.1.8/doc/source/contributing.rst0000644000000000000000000001241215273675667015031 0ustar00Contributing ============ .. note:: **Abstract** This document describes the development process of {kiwi} and how you can be part of it. This description applies to version |version|. .. toctree:: :maxdepth: 1 contributing/kiwi_from_python contributing/kiwi_plugin_architecture contributing/scripts_testing contributing/schema_extensions.rst The core appliance builder is developed in Python and follows the test-driven development rules. If you want to implement a bigger feature, consider opening an issue on GitHub first to discuss the changes. Or, join the discussion in the `#kiwi` channel on `Matrix `_. Fork the upstream repository ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 1. On GitHub, navigate to: https://github.com/OSInside/kiwi. 2. In the top-right corner of the page, click :command:`Fork`. Create a local clone of the forked repository ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ .. code:: shell-session $ git clone https://github.com/YOUR-USERNAME/kiwi $ git remote add upstream https://github.com/OSInside/kiwi.git Install Required Operating System Packages ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ {kiwi} requires additional packages at runtime that are not provided by `pip`. Those will be pulled in by installing the following package: * kiwi-systemdeps The package is provided on the Open Build Service in the `Virtualization:Appliances:Builder `__ project. For manual inspection of the packages that are pulled in from the above `kiwi-systemdeps` package, please refer to the `package/python-kiwi-spec-template` spec file from the checked-out Git repository. Create a Python Virtual Development Environment ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ The following commands initialize and activate a development environment for Python 3: .. code:: shell-session $ poetry install --all-extras .. note:: To create the python virtual env for another version of Python, e.g. 3.11, call the following prior the poetry install :: $ poetry env use python3.11 The command above automatically creates the application script called :command:`kiwi-ng`, which allows you to run {kiwi} from the Python sources inside the virtual environment using Poetry: .. code:: shell-session $ poetry run kiwi-ng --help Running the Unit Tests ~~~~~~~~~~~~~~~~~~~~~~ Before submitting your changes via a pull request, ensure that all tests pass and that the code has the required test coverage via the command: .. code:: shell-session $ make check $ make test Coding Style ~~~~~~~~~~~~ {kiwi} follows the general PEP8 guidelines. Documentation ~~~~~~~~~~~~~ {kiwi} uses `Sphinx `_ for the user documentation and man pages. .. code:: shell-session $ make docs Bumping the Version ~~~~~~~~~~~~~~~~~~~ The {kiwi} project follows the `Semantic Versioning `_ scheme. We use the :command:`bumpversion` tool for consistent versioning. AI policy ~~~~~~~~~ {kiwi} has a policy of human-centric development. Only humans can be authors and are ultimately responsible for the quality of their contributions. That said, assisted development with "AI" tools (particularly contemporary LLM-based tools) is permitted with the restriction that such usage is clearly labeled with the `Assisted-by:` trailer in the pull request and commit message. The format of the trailer is as such: `Assisted-by: :`. Examples of such trailers: ================= ======================================= Tool Trailer ================= ======================================= Claude `Assisted-by: Claude:claude-opus-4-6` Gemini `Assisted-by: Gemini:gemini-2.5-pro` GitHub Copilot `Assisted-by: Copilot:gpt-4o` ChatGPT `Assisted-by: ChatGPT:gpt-4o` ================= ======================================= The trailers are required for the following scenarios: - AI wrote or generated code that ended up in the commit - AI substantially modified or refactored existing code - AI generated an implementation that the contributor then adapted It is **not** required for the following scenarios: - AI was used for **research only** - asking questions, understanding APIs, exploring approaches - but the human wrote all the code - AI performed purely **mechanical tasks** like formatting, running commands, or committing All submitted changes must be at least self-reviewed and all other guidelines continue to apply (follow code style, pass tests, make tests for new functionality, etc.) Intentional obfuscation of AI tooling usage is grounds for rejection and may result in being blocked from future contributions. Creating an RPM Package ~~~~~~~~~~~~~~~~~~~~~~~ We provide a template for an RPM spec file in :file:`package/python-kiwi-spec-template` alongside a `rpmlint` configuration file and an automatically updated :file:`python-kiwi.changes`. To create the necessary files to build an RPM package via `rpmbuild`, run: .. code:: shell-session $ make build The sources are collected in the :file:`dist/` directory. These can be directly built with :command:`rpmbuild`, :command:`fedpkg`, or submitted to the Open Build Service using :command:`osc`. ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.735329 kiwi-11.1.8/doc/source/example_use_cases/build_container_image.rst0000644000000000000000000001002715273675667022312 0ustar00.. _building_container_build: Build a Container Image ======================= .. sidebar:: Abstract This page explains how to build a Container Image. It covers the following topics: * a basic configuration explanation * how to build a Container Image * how to run it with a Container Runtime {kiwi} can build native container images from scratch or using existing images. {kiwi} container images are considered native because a {kiwi} tarball image can be loaded directly into container runtimes like Podman, Docker, or Containerd, including common container configurations. The container configuration metadata is supplied to {kiwi} as part of the :ref:`XML description file ` using the `` tag. The following configuration metadata can be specified. `containerconfig` attributes: * ``name``: Specifies the repository name of the container image. * ``tag``: Sets the tag of the container image. * ``additionalnames``: Additional fully qualified names for the image, given as a comma-separated list of ``repository:tag`` entries. An entry that starts with ``:`` adds another tag for the primary repository name, for example ``:latest,:stable``. This attribute is only applied to Docker archive output (`image="docker"` or an OEM `format="docker:..."`); OCI archive output ignores it. * ``maintainer``: Specifies the author of the container. Equivalent to the `MAINTAINER` directive in a :file:`Dockerfile`. * ``user``: Sets the user name or user id (UID) to be used when running `entrypoint` and `subcommand`. Equivalent to the `USER` directive of a :file:`Dockerfile`. * ``workingdir``: Sets the working directory to be used when running `cmd` and `entrypoint`. Equivalent to the `WORKDIR` directive in a :file:`Dockerfile`. `containerconfig` child tags: * ``subcommand``: Provides the default execution parameters of the container. Equivalent to the `CMD` directive in a :file:`Dockerfile`. * ``labels``: Adds custom metadata to an image using key-value pairs. Equivalent to one or more `LABEL` directives in a :file:`Dockerfile`. * ``expose``: Defines which ports can be exposed to the outside when running this container image. Equivalent to one or more `EXPOSE` directives in a :file:`Dockerfile`. * ``environment``: Sets environment variables using key-value pairs. Equivalent to one or multiple `ENV` directives in a :file:`Dockerfile`. * ``entrypoint``: Sets the binary to use for executing all commands inside the container. Equivalent to the `ENTRYPOINT` directive of a :file:`Dockerfile`. * ``volumes``: Creates mountpoints with the given name and marks them to hold external volumes from the host or from other containers. Equivalent to one or more `VOLUME` directives in a :file:`Dockerfile`. * ``stopsignal``: The `stopsignal` element sets the system call signal that will be sent to the container to exit. This signal can be a signal name in the format `SIG[NAME]`, for instance, `SIGKILL`, or an unsigned number that matches a position in the kernel's syscall table, for instance, 9. The default is `SIGTERM` if not defined. Other :file:`Dockerfile` directives such as `RUN`, `COPY`, or `ADD`, can be mapped to {kiwi} using the :ref:`config.sh ` script file to run Bash commands, or the :ref:`overlay tree ` to include additional files. The following example illustrates how to build a container image based on openSUSE Leap: 1. Install `umoci` and `skopeo` tools. .. code:: bash $ zypper in umoci skopeo #. Build an image with {kiwi}: .. code:: bash $ sudo kiwi-ng system build \ --description kiwi/build-tests/{exc_description_docker} \ --set-repo {exc_repo_leap} \ --target-dir /tmp/myimage #. Test the container image. First, load the new image into your container runtime: .. code:: bash $ podman load -i {exc_image_base_name_docker}.x86_64-{exc_image_version}.docker.tar.xz Then, run the image: .. code:: bash $ podman run --rm -it buildsystem /bin/bash ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/build_enclave.rst0000644000000000000000000000650315273675667020607 0ustar00.. _eif: Build an AWS Nitro Enclave ============================== .. sidebar:: Abstract This page explains how to build AWS Nitro Enclaves. It covers the following topics: * how to build an AWS Nitro Enclave * how to test the enclave via QEMU AWS Nitro Enclaves enables customers to create isolated compute environments to further protect and securely process highly sensitive data such as personally identifiable information (PII), healthcare, financial, and intellectual property data within their Amazon EC2 instances. Nitro Enclaves uses the same Nitro Hypervisor technology that provides CPU and memory isolation for EC2 instances. For further details, please visit https://aws.amazon.com/ec2/nitro/nitro-enclaves. To add an enclave build to your appliance, create a `type` element with `image` set to `enclave` in the :file:`config.xml` file, as shown below: .. code:: xml The following attributes of the `type` element are relevant: - `enclave_format`: Specifies the enclave target. As of today, only the `aws-nitro` enclave target is supported. - `kernelcmdline`: Specifies the kernel commandline suitable for the enclave. An enclave is a system that runs completely in RAM, loaded from an enclave binary format that includes the kernel, initrd, and the kernel command line suitable for the target system. With the appropriate settings specified in :file:`config.xml`, you can build an image using {kiwi}: .. code:: bash $ sudo kiwi-ng system build \ --description kiwi/build-tests/{exc_description_enclave} \ --set-repo {exc_repo_rawhide} \ --target-dir /tmp/myimage The resulting image is saved in :file:`/tmp/myimage`, and the image can be tested with QEMU: .. code:: bash $ sudo qemu-system-x86_64 \ -M nitro-enclave,vsock=c \ -m 4G \ -nographic \ -chardev socket,id=c,path=/tmp/vhost4.socket \ -kernel {exc_image_base_name_enclave}.x86_64-{exc_image_version_enclave}.eif The image is now complete and ready to use. Access to the system is possible via ssh through a vsock connection into the guest. To establish a vsock connection, it's required to forward the connection through the guest's `AF_VSOCK` socket. This can be done via a `ProxyCommand` setup of the host's ssh as follows: .. code:: bash $ vi ~/bin/vsock-ssh.sh #!/bin/bash CID=$(echo "$1" | cut -d . -f 1) socat - VSOCK-CONNECT:$CID:22 .. code:: bash $ vi ~/.ssh/config host *.vsock ProxyCommand ~/bin/vsock-ssh.sh %h After the ssh proxy setup, log in to the enclave with a custom vsock CID as follows: .. code:: bash $ ssh root@21.vsock ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/build_expandable_disk.rst0000644000000000000000000004004315273675667022304 0ustar00.. _expandable_disk: Build an Expandable Disk Image ============================== .. sidebar:: Abstract This page explains how to build an expandable disk image. It covers the following topics: * builds an expandable disk image * deploys an expandable disk image * runs the deployed system An expandable disk represents the system disk with the capability to automatically expand the disk and its filesystem to a custom disk geometry. This allows deploying the same disk image on target systems with different hardware setups. The following example shows how to build and deploy an expandable disk image based on openSUSE Leap using a QEMU virtual machine as a target system: 1. Build an image with {kiwi}: .. code:: bash $ sudo kiwi-ng --type oem system build \ --description kiwi/build-tests/{exc_description_disk} \ --set-repo {exc_repo_leap} \ --target-dir /tmp/myimage The resulting image is saved in :file:`/tmp/myimage`. * The disk image with the suffix :file:`.raw` is an expandable virtual disk. It can expand itself to a custom disk geometry. * The installation image with the suffix :file:`.install.iso` is a hybrid installation system that contains the disk image and is capable of installing this image on any target disk. .. _deployment_methods: Deployment Methods ------------------ The goal of an expandable disk image is to provide the virtual disk data for OEM vendors to support easy deployment of the system to physical storage media. Basic deployment strategies are as follows: 1. :ref:`deploy_manually` Manually deploy the disk image onto the target disk. 2. :ref:`deploy_from_iso` Boot the installation image and let {kiwi}'s installer deploy the disk image from a CD/DVD or USB stick onto the target disk. 3. :ref:`deploy_from_network` PXE boot the target system and let {kiwi}'s installer deploy the disk image from the network onto the target disk. .. _deploy_manually: Manual Deployment ----------------- The manual deployment method can be tested using virtualization software like QEMU and an additional virtual large-size target disk. To do this, follow the steps below. 1. Create a target disk: .. code:: bash $ qemu-img create target_disk 20g .. note:: Retaining the Disk Geometry If the target disk geometry is less than or equal to the geometry of the disk image itself, the disk expansion that is performed on a physical disk install during the boot workflow is skipped, and the original disk geometry stays unchanged. 2. Dump the disk image on the target disk: .. code:: bash $ dd if={exc_image_base_name_disk}.x86_64-{exc_image_version}.raw of=target_disk conv=notrunc 3. Boot the target disk: .. code:: bash $ sudo qemu -hda target_disk -m 4096 -serial stdio On the first boot of the `target_disk`, the system is expanded to the configured storage layout. By default, the system root partition and filesystem are resized to the maximum free space available. .. _deploy_from_iso: CD/DVD Deployment ----------------- The deployment from a CD/DVD via an installation image can also be tested using virtualization software such as QEMU. To do this, follow the steps below. 1. Create a target disk: Follow the steps above to create a virtual target disk. 2. Boot the installation image as a CD/DVD with the target disk attached. .. code:: bash $ sudo qemu -cdrom \ {exc_image_base_name_disk}.x86_64-{exc_image_version}.install.iso -hda target_disk \ -boot d -m 4096 -serial stdio .. note:: USB Stick Deployment Like any other ISO image built with {kiwi}, the installation image is also a hybrid image. Thus, it can also be used on a USB stick and serve as installation media, as explained in :ref:`hybrid_iso`. .. _deploy_from_network: Network Deployment ------------------ The process of deployment from the network downloads the disk image from a PXE boot server. This requires a PXE network boot server to be set up as described in :ref:`network-boot-server`. If the PXE server is running, the following steps show how to test the deployment process over the network using a QEMU virtual machine as a target system: 1. Create an installation PXE TAR archive along with your disk image by replacing the following configuration in `kiwi/build-tests/{exc_description_disk}/appliance.kiwi`: Find the line below: .. code:: xml Modify the line as follows: .. code:: xml 2. Rebuild the image, unpack the resulting :file:`{exc_image_base_name_disk}.x86_64-{exc_image_version}.install.tar` file to a temporary directory, and copy the initrd and kernel images to the PXE server. a) Unpack the installation tarball: .. code:: bash mkdir /tmp/pxe && cd /tmp/pxe tar -xf {exc_image_base_name_disk}.x86_64-{exc_image_version}.install.tar b) Copy the kernel and initrd used for PXE boot: .. code:: bash scp pxeboot.{exc_image_base_name_disk}.x86_64-{exc_image_version}.initrd PXE_SERVER_IP:/srv/tftpboot/boot/initrd scp pxeboot.{exc_image_base_name_disk}.x86_64-{exc_image_version}.kernel PXE_SERVER_IP:/srv/tftpboot/boot/linux 3. Copy the disk image, SHA256 file, system kernel, initrd, and bootoptions to the PXE boot server. Activation of the deployed system is done via `kexec` of the kernel and initrd provided here. a) Copy the system image and SHA256 checksum: .. code:: bash scp {exc_image_base_name_disk}.x86_64-{exc_image_version}.xz PXE_SERVER_IP:/srv/tftpboot/image/ scp {exc_image_base_name_disk}.x86_64-{exc_image_version}.sha256 PXE_SERVER_IP:/srv/tftpboot/image/ b) Copy the kernel, initrd, and bootoptions used for booting the system via kexec: .. code:: bash scp {exc_image_base_name_disk}.x86_64-{exc_image_version}.initrd PXE_SERVER_IP:/srv/tftpboot/image/ scp {exc_image_base_name_disk}.x86_64-{exc_image_version}.kernel PXE_SERVER_IP:/srv/tftpboot/image/ scp {exc_image_base_name_disk}.x86_64-{exc_image_version}.config.bootoptions PXE_SERVER_IP:/srv/tftpboot/image/ .. note:: The `config.bootoptions` file is used with `kexec` to boot the previously dumped image. This file specifies the root of the dumped image, and the file can include other boot options. The file provided with the {kiwi}-built image is connected to the image present in the PXE TAR archive. If other images are deployed, the file must be modified to match the correct root reference. .. note:: If the image is deployed into a ramdisk that is configured by passing `rd.kiwi.ramdisk` as part of the append setup below, it is not required to copy the above-mentioned kernel and initrd file to boot the system because for ramdisk deployments, the currently active kernel and initrd will be used, as kexec cannot be called with a system in memory. 4. Add/Update the kernel command-line parameters. Edit your PXE configuration (for example, :file:`pxelinux.cfg/default`) on the PXE server and add the following parameters to the append line similar to that shown below: .. code:: bash append initrd=boot/initrd rd.kiwi.install.pxe rd.kiwi.install.image=tftp://192.168.100.16/image/{exc_image_base_name_disk}.x86_64-{exc_image_version}.xz The location of the image is specified as a source URI that can point to any location supported by the `curl` command. {kiwi} uses `curl` to fetch the data from this URI. This means that the image, checksum file, system kernel, and initrd can be fetched from any server and do not need to be stored on the `PXE_SERVER`. By default, {kiwi} does not use specific `curl` options or flags. But it is possible to specify desired options by adding the `rd.kiwi.install.pxe.curl_options` flag to the kernel command line (`curl` options are passed as comma-separated values), for example: .. code:: bash rd.kiwi.install.pxe.curl_options=--retry,3,--retry-delay,3,--speed-limit,2048 The above instructs {kiwi} to run `curl` as follows: .. code:: bash curl --retry 3 --retry-delay 3 --speed-limit 2048 -f This can be particularly useful when the deployment infrastructure requires a specific download configuration. For example, setting more robust retries over an unstable network connection. .. note:: {kiwi} replaces commas with spaces and appends the result to the `curl` command. Keep that in mind, because command-line options that include commas break the command. .. note:: The initrd and Linux Kernel for PXE boot are always loaded via TFTP from the `PXE_SERVER`. 5. Create a target disk. Follow the steps above to create a virtual target disk. 6. Connect the client to the network and boot QEMU with the target disk attached to the virtual machine: .. code:: bash $ sudo qemu -boot n -hda target_disk -m 4096 .. note:: QEMU bridged networking To connect QEMU to the network, we recommend setting up a network bridge on the host system and connecting QEMU to it via a custom `/etc/qemu-ifup` configuration. For details, see https://en.wikibooks.org/wiki/QEMU/Networking. .. _oem_customize: OEM Customization ----------------- The deployment process of an OEM image can be customized using the `oemconfig` element. This element is a child section of the `type` element, for example: .. code:: xml 512 Below is a list of the most commonly used optional `oemconfig` element settings. oemconfig.oem-resize Determines if the disk has the capability to expand itself to a new disk geometry or not. By default, this feature is activated. The implementation of the resize capability is done in a dracut module packaged as `dracut-kiwi-oem-repart`. If `oem-resize` is set to `false`, the installation of the corresponding dracut package can be skipped as well. oemconfig.oem-boot-title By default, the string `OEM` is used as the boot manager menu entry when KIWI creates the GRUB configuration during deployment. The `oem-boot-title` element allows you to set a custom name for the grub menu entry. This value is represented by the `kiwi_oemtitle` variable in the initrd. oemconfig.oem-bootwait Determines if the system waits for user interaction before continuing the boot process after the disk image has been dumped to the designated storage device (the default value is `false`). This value is represented by the `kiwi_oembootwait` variable in the initrd. oemconfig.oem-reboot When enabled, the system is rebooted after the disk image has been deployed to the designated storage device (the default value is `false`). This value is represented by the `kiwi_oemreboot` variable in the initrd. oemconfig.oem-reboot-interactive When enabled, the system is rebooted after the disk image has been deployed to the designated storage device (the default value is `false`). Before the reboot, a message is displayed, and it must be acknowledged by the user for the system to reboot. This value is represented by the `kiwi_oemrebootinteractive` variable in the initrd. oemconfig.oem-silent-boot Determines if the system boots in silent mode after the disk image has been deployed to the designated storage device (the default value is `false`). This value is represented by the `kiwi_oemsilentboot` variable in the initrd. oemconfig.oem-shutdown Determines if the system is powered down after the disk image has been deployed to the designated storage device (the default value is `false`). This value is represented by the `kiwi_oemshutdown` variable in the initrd. oemconfig.oem-shutdown-interactive Determines if the system is powered down after the disk image has been deployed to the designated storage device (the default value is `false`). Before the shutdown, a message is displayed, and it must be acknowledged by the user for the system to power off. This value is represented by the `kiwi_oemshutdowninteractive` variable in the initrd. oemconfig.oem-swap Determines if a swap partition is created. By default, no swap partition is created. This setting is evaluated by {kiwi} at build time. oemconfig.oem-swapname Specifies the name of the swap space. By default, the name is set to `LVSwap`. The default indicates that this setting is only useful in combination with the LVM volume manager. In this case, the swapspace is configured as a volume in the volume group, and every volume requires a name. The name specified in `oemconfig.oem-swapname` here is used as the name of the swap volume. oemconfig.oem-swapsize Specifies the size of the swap partition in MB. The value is only used if `oem-swap` is set to `true`. If a swap partition is created while the size of the swap partition is not specified, KIWI uses a default size of 128 MB. This value is represented by the `kiwi_oemswapMB` variable in the initrd. oemconfig.oem-systemsize Specifies the MB size the operating system is allowed to occupy on the target disk. The size limit does not include any swap space or recovery partition considerations. In a setup *without* the `systemdisk` element, this value specifies the size of the root partition. In a setup that *includes* the `systemdisk` element when using LVM, this value specifies the size of the LVM partition that contains all specified volumes. This means that the sum of all specified volume sizes plus the sum of the specified freespace for each volume must be smaller than or equal to the size specified with the `oem-systemsize` element. This value is represented by the variable `kiwi_oemrootMB` in the initrd. The specified value can be dynamically overwritten via the `rd.kiwi.install.systemsize` kernel boot option. If `rd.kiwi.install.systemsize` is set to `all`, this will unset the size limit, and the maximum possible size will apply. oemconfig.oem-unattended The installation of the image to the target system occurs automatically without requiring user interaction. If multiple possible target devices are discovered, the image is deployed to the first device. This value is represented by the `kiwi_oemunattended` variable in the initrd. oemconfig.oem-unattended-id Selects a target disk device for the installation according to the specified device ID. The device ID corresponds to the name of the device for the configured `devicepersistency`. By default, it is the `by-uuid` device name. If no representation exists, for example, for ramdisk devices, the UNIX device node can be used to select one. The given name must be present in the device list detected by KIWI. oemconfig.oem-skip-verify Disables the checksum verification process after installing the image on the target disk. The verification process computes the checksum of the image installed on the target. This value is then compared to the initrd-embedded checksum generated at the build time of the image. Depending on the size of the image and machine power, computing the checksum may take time. .. _installmedia_customize: Installation Media Customization -------------------------------- The installation media created for OEM network or CD/DVD deployments can be customized with the `installmedia` section. It is a child section of the `type` element, for example: .. code:: xml The `installmedia` is only available for OEM image types that include the request to create an installation media. The `initrd` child element of `installmedia` lists dracut modules. The element's `action` attribute determines whether the dracut module is omitted (`action="omit"`) or added (`action="add"`). Use `action="set"` to use only the listed modules and nothing else (that is, none of the dracut modules included by default). ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/build_in_buildservice.rst0000644000000000000000000003061515273675667022341 0ustar00Building in the Open Build Service ================================== .. note:: **Abstract** This document gives a brief overview of how to build images with {kiwi} in version |version| inside of the Open Build Service. A tutorial on the Open Build Service itself can be found here: https://en.opensuse.org/openSUSE:Build_Service_Tutorial The next-generation {kiwi} is fully integrated with the Open Build Service. To start, it's best to check out one of the integration test image build projects from the base Testing project `Virtualization:Appliances:Images:Testing_$ARCH:$DISTRO` at: https://build.opensuse.org For example, the test images for SUSE on x86 can be found `here `__. Advantages of using the Open Build Service (OBS) ------------------------------------------------ The Open Build Service offers multiple advantages over running {kiwi} locally: * OBS will host the latest successful build for you without you having to set up a server yourself. * As {kiwi} is fully integrated into OBS, OBS will automatically rebuild your images if one of the included packages, one of its dependencies, or {kiwi} itself is updated. * The builds will no longer have to be executed on your own machine but will run on OBS, thereby saving you resources. Nevertheless, if a build fails, you will get a notification via email (if enabled in your user's preferences). Differences Between Building Locally and on OBS ----------------------------------------------- Note that there are a number of differences when building images with {kiwi} using the Open Build Service. Your image that built locally just fine might not build without modifications. The notable differences to running {kiwi} locally include: * OBS will pick the {kiwi} package from the repositories configured in your project, which will most likely not be the same version that you are running locally. This is especially relevant when building images for older versions, like SUSE Linux Enterprise. Therefore, include the custom appliances repository as described in the following section: :ref:`obs-recommended-settings`. * When {kiwi} runs on OBS, OBS will extract the list of packages from :file:`config.xml` and use it to create a build root. In contrast to a local build (where your distribution's package manager will resolve the dependencies and install the packages), OBS will **not** build your image if there are multiple packages that could be chosen to satisfy the dependencies of your packages [#f1]_. This shows errors like this: .. code:: bash unresolvable: have choice for SOMEPACKAGE: SOMEPACKAGE_1 SOMEPACKAGE_2 This can be solved by explicitly specifying one of the two packages in the project configuration via the following setting: .. code:: bash Prefer: SOMEPACKAGE_1 Place the above line into the project configuration, which can be accessed either via the web interface (click on the tab ``Project Config`` on your project's main page) or via ``osc meta -e prjconf``. .. warning:: We strongly encourage you to remove your repositories from :file:`config.xml` and move them to the repository configuration in your project's settings. This usually prevents the issue of having the choice for multiple package versions and results in a much smoother experience when using OBS. * By default, OBS builds only a single build type and the default profile. If your appliance uses multiple build types, put each build type into a profile, as OBS cannot handle multiple build types. There are two options to build multiple profiles on OBS: 1. Add the `OBS-Profiles` XML comment between the XML declaration (``) and the opening `` element: .. code:: xml 2. Use the `multibuild `_ feature. The first option is simpler to use but has the disadvantage that your appliances are built sequentially. The `multibuild` feature allows you to build each profile as a single package, thereby enabling parallel execution, but it requires an additional :file:`_multibuild` file. For the above example, :file:`config.xml` would have to be adapted as follows: .. code:: xml The file :file:`_multibuild` would have the following contents: .. code:: xml foo_profile bar_profile * Subfolders in OBS projects are ignored by default by :command:`osc` and must be explicitly added via `osc add $FOLDER` [#f2]_. Bear that in mind when adding the overlay files inside the :file:`root/` directory to your project. * OBS ignores file permissions. Therefore, :file:`config.sh` and :file:`images.sh` will **always** be executed through BASH (see also: :ref:`working-with-kiwi-user-defined-scripts`). .. _obs-recommended-settings: Recommendations --------------- Working with OBS ^^^^^^^^^^^^^^^^ Although OBS is an online service, it is not necessary to test every change by uploading it. OBS will use the same process as `osc build` does, so if your image builds locally via `osc build`, it should also build online on OBS. Repository Configuration ^^^^^^^^^^^^^^^^^^^^^^^^ When setting up the project, enable the `images` repository: the `images` repository's checkbox can be found at the bottom of the selection screen that appears when clicking `Add from a Distribution` in the `Repositories` tab. Or, specify it manually in the project configuration (it can be accessed via `osc meta -e prj`): .. code:: xml x86_64 Furthermore, OBS requires additional repositories from which it obtains your dependent packages. These repositories can be provided in two ways: #. Add the repositories to the project configuration on OBS and omit them from :file:`config.xml`. Provide only the following repository inside the image description: .. code:: xml This instructs OBS to inject the repositories from your project into your appliance. Additional repositories can be added by invoking `osc meta -e prj` and adding a line of the following form as a child of ``: .. code:: xml The order in which you add repositories matters: if a package is present in multiple repositories, then it is taken from the **first** repository. The **last** repository is subject to path expansion: its repository paths are included as well. Don't forget to add the repository from the `Virtualization:Appliances:Builder` project, providing the latest stable version of {kiwi} (which you are very likely using for your local builds). The following example repository configuration [#f3]_ adds the repositories from the `Virtualization:Appliances:Builder` project and those from the latest snapshot of openSUSE Tumbleweed: .. code:: xml Tumbleweed JeOS images Host JeOS images for Tumbleweed x86_64 The above can be simplified further using the path expansion of the last repository to: .. code:: xml Tumbleweed JeOS images Host JeOS images for Tumbleweed x86_64 Now, `Virtualization:Appliances:Builder` is the last repository whose repositories are included into the search path. As `openSUSE:Factory/snapshot` is among these, it can be omitted from the repository list. #. Keep the repositories in your :file:`config.xml` configuration file. If you have installed the latest stable {kiwi} as described in :ref:`kiwi-installation`, then you should add the following repository to your project's configuration (accessible via :command:`osc meta -e prj`), so that OBS will pick the latest stable {kiwi} version too: .. code:: xml x86_64 Replace `$DISTRO` with the appropriate name for the distribution that you are currently building and optionally adjust the architecture. We recommend using the first method, as it integrates better into OBS. Note that your image description will then no longer build outside of OBS, though. If building locally is required, use the second method. .. warning:: Adding the repositories to the project's configuration makes it impossible to build images for different distributions from the same project. Since the repositories are added for every package in your project, all your image builds will share the same repositories, thereby resulting in conflicts for different distributions. We recommend creating a separate project for each distribution. If that is impossible, you can keep all your repositories (including `Virtualization:Appliances:Builder`) in :file:`config.xml`. That, however, usually requires a large number of workarounds via `Prefer:` settings in the project configuration and is thus **not** recommended. Project Configuration ^^^^^^^^^^^^^^^^^^^^^ The Open Build Service will, by default, create the same output file as {kiwi} when run locally but with a custom filename ending (that is, unfortunately, unpredictable). This has the consequence that the download URL of your image will change with every rebuild (and thus break automated scripts). OBS can create symbolic links with static names to the latest build by adding the following line to the project configuration: .. code:: bash Repotype: staticlinks If you build Vagrant images (see :ref:`setup_vagrant`), add the repository-type `vagrant`. OBS creates a `boxes/` subdirectory in your download repositories, which contains JSON files for Vagrant [#f4]_. If you have added your repositories to :file:`config.xml`, you will probably see errors of the following type: .. code:: bash unresolvable: have choice for SOMEPACKAGE: SOMEPACKAGE_1 SOMEPACKAGE_2 Instead of starting from scratch and manually adding `Prefer:` statements to the project configuration, we recommend copying the current project configuration of the testing project `Virtualization:Appliances:Images:Testing_$ARCH:$DISTRO` into your own project. It provides a good starting point and can be adapted to your OBS project. .. [#f1] This is a design decision made by OBS: as its purpose is to build packages in a reproducible fashion, it cannot make a decision which package to choose from multiple available ones. A package manager built for end users, on the other hand, **must** make a choice, as it would be otherwise hardly usable. .. [#f2] `osc` compresses added folders into a `cpio `_ archive and decompresses it before running your builds. The only downside of this is that the contents of your overlay are not conveniently visible via the web interface. .. [#f3] Taken from the project `Virtualization:Appliances:Images:openSUSE-Tumbleweed `_. .. [#f4] Vagrant uses these JSON files for automatic updates of your Vagrant boxes. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/build_kis.rst0000644000000000000000000001006115273675667017752 0ustar00.. _kis: Build KIS Image (Kernel, Initrd, System) ======================================== .. sidebar:: Abstract This page explains how to build an image that consists of three components: the kernel, an initrd, and an optional root filesystem image. In {kiwi} terminology, this type of image is called KIS. A KIS image is a collection of image components that are not associated with a dedicated use case. This means that as far as {kiwi} is concerned, it is not known in which environment these components are expected to be used. The predecessor of this image type was called `pxe` under the assumption that the components will be used in a PXE boot environment. However, this assumption is not always true, and the image components may be used in different ways. Because there are so many possible deployment strategies for a `kernel` plus `initrd` and an optional `system root filesystem`, {kiwi} provides this as the universal `KIS` type. The former `pxe` image type still exists, but it is expected to be used only in combination with the legacy `netboot` infrastructure, as described in :ref:`build_legacy_pxe`. To add a KIS build to an appliance, create a `type` element with `image` set to `kis` in :file:`config.xml`, as shown below: .. code:: xml With this image type setup, {kiwi} builds a kernel and initrd not associated with any system root filesystem. Normally, such an image is only useful with certain custom dracut extensions as part of the image description. The following attributes of the `type` element are often used when building KIS images: - `archive`: By default the output files of a KIS image will be stored in a tarball archive. If you want to store the output files individually instead, set this attribute to `false`. - `compressed`: Specifies whether the root filesystem image should be xz-compressed. If set to `true`, the tar archive that contains the output files is not compressed again; otherwise, the tar archive is xz-compressed. If the `archive` attribute is set to `false`, only the compression of the root filesystem image applies. - `filesystem`: Specifies the root filesystem and triggers the build of an additional filesystem image of that filesystem. The generated kernel command-line options file (append file) will then also include a `root=` parameter that references this filesystem image's UUID. Whether the information from the append file should be used or not is optional. - `kernelcmdline`: Specifies kernel command-line options that are part of the generated kernel command-line options file (append file). By default, the append file contains no information other than the reference to the root UUID if the `filesystem` attribute is used. All other attributes of the `type` element that apply to an optional root filesystem image remain in effect in the system image of a KIS image as well. With the appropriate settings present in :file:`config.xml`, you can use {kiwi} to build the image: .. code:: bash $ sudo kiwi-ng --type kis system build \ --description kiwi/build-tests/{exc_description_kis} \ --set-repo {exc_repo_tumbleweed} \ --target-dir /tmp/myimage The resulting image components are saved in :file:`/tmp/myimage`. Outside of a deployment infrastructure, the example KIS image can be tested with QEMU as follows: .. code:: bash $ sudo qemu \ -kernel /tmp/myimage/*.kernel \ -initrd /tmp/myimage/*.initrd \ -append "$(cat /tmp/myimage/*.append) rw" \ -drive file=/tmp/myimage/{exc_image_base_name_kis}.x86_64-{exc_image_version_kis},if=virtio,driver=raw \ -serial stdio .. note:: Testing the components of a KIS image normally requires a deployment infrastructure and a deployment process encoded in the initrd. An example of a deployment infrastructure using PXE is provided by {kiwi} with the `netboot` infrastructure. However, that netboot infrastructure is no longer developed and is only kept for compatibility reasons. For details, see :ref:`build_legacy_pxe`. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/build_live_iso.rst0000644000000000000000000001460315273675667021003 0ustar00.. _hybrid_iso: Build an ISO Hybrid Live Image ============================== .. sidebar:: Abstract This page explains how to build a live image. It covers the following topics: * how to build an ISO image * how to run the image with QEMU A Live ISO image is a system on removable media, for example, a CD/DVD or a USB stick. Booting a Live ISO image does not interfere with other system storage components, making it a useful portable system for demonstration, testing, and debugging. To add a Live ISO build to your appliance, create a `type` element with `image` set to `iso` in the :file:`config.xml` file, as shown below: .. code:: xml The following attributes of the `type` element are relevant when building Live ISO images: - `flags`: Specifies the dracut module to use. If set to `overlay`, the kiwi-live dracut module supplied by {kiwi} is used for booting. If set to `dmsquash`, the dracut-supplied `dmsquash-live` module is used for booting. Both modules support a different set of live features. For details, see :ref:`live_features`. - `filesystem`: Specifies the root filesystem for the live system. If set to `squashfs`, the root filesystem is written into a squashfs image. This option is not compatible with device-mapper-specific features of the `dmsquash-live` dracut module. In that case, use `overlayfs`. If set to a value different from `squashfs` or `erofs`, the root filesystem is written into a filesystem image of the specified type, and the filesystem image is written into a squashfs image for compression. The default value of this option is `ext4`. - `hybridpersistent`: Accepts `true` or `false`; if set to `true`, the resulting image is created with a COW file to keep data persistent over a reboot. - `hybridpersistent_filesystem`: The filesystem used for the COW file. Valid values are `ext4` or `xfs`, with `ext4` being the default. With the appropriate settings specified in :file:`config.xml`, you can build an image using {kiwi}: .. code:: bash $ sudo kiwi-ng system build \ --description kiwi/build-tests/{exc_description_live} \ --set-repo {exc_repo_leap} \ --target-dir /tmp/myimage The resulting image is saved in :file:`/tmp/myimage`, and the image can be tested with QEMU: .. code:: bash $ sudo qemu -cdrom \ {exc_image_base_name_live}.x86_64-{exc_image_version}.iso \ -m 4096 -serial stdio The image is now complete and ready to use. See :ref:`iso_to_usb_stick` and :ref:`iso_as_file_to_usb_stick` for further information concerning deployment. .. _live_features: `overlay` or `dmsquash` ---------------------------------- Whether you choose the `overlay` or `dmsquash` dracut module depends on the features you intend to use. The `overlay` module supports only `overlayfs`-based overlays but with automatic creation of a writable layer for persistence. The `dmsquash` module supports `overlayfs` as well as device-mapper-based overlays. The following list describes important Live ISO features and their support status in the `overlay` and `dmsquash` modules. ISO scan Usable in the same way with both dracut modules. This feature allows you to boot the Live ISO as a file from a grub loopback-configured bootloader. The `live-grub-stick` tool is one example that uses this feature. For details on how to set up ISO scan with the `overlay` module, see :ref:`iso_as_file_to_usb_stick`. ISO in RAM completely Usable with the `dmsquash` module through `rd.live.ram`. The `overlay` module does not support this mode, while {kiwi} supports RAM-only systems as OEM deployment into RAM from an install ISO media. For details on how to set up RAM-only deployments in {kiwi}, see :ref:`ramdisk_deployment`. Overlay based on overlayfs Usable with both dracut modules. The read-only root filesystem is overlaid with a read-write filesystem using the kernel's `overlayfs` filesystem. Overlay based on device-mapper snapshots Usable with the `dmsquash` module. A squashfs-compressed read-only root is overlaid with a read-write filesystem using a device-mapper snapshot. Media Checksum Verification Boot the Live ISO only for ISO checksum verification. This is possible with both modules, but the `overlay` module uses the `checkmedia` tool, whereas the upstream `dmsquash` module uses `checkisomd5`. The verification process is triggered by passing the kernel option `mediacheck` for the `overlay` module and `rd.live.check` for the `dmsquash` module. Live ISO through PXE boot Boot the Live image via the network. This is possible with both modules, but it uses different technologies. The `overlay` module supports network boot by fetching the ISO image via `ftp`, `http`, `https`, or `dolly` from `root=live:`, as well as via the AoE (ATA over Ethernet) protocol. For details, see :ref:`network_live_boot`. The `dmsquash` module supports network boot by fetching the ISO image into memory from `root=live:` using the `livenet` module. Persistent Data Keep new data persistent on a writable storage device. This can be done with both modules but in different ways. The `overlay` module activates persistency with the kernel boot parameter `rd.live.overlay.persistent`. If the persistent setup cannot be created, the fallback to the non-persistent mode applies automatically. The `overlay` module autodetects if it is used on a disk or ISO scan loop booted from a file. If booted as a disk, persistency is set up on a new partition of that disk. If loop-booted from a file, persistency is set up on a new COW file. The COW file/partition setup can be influenced by the kernel boot parameters: `rd.live.overlay.cowfs` and `rd.live.cowfile.mbsize`. The `dmsquash` module configures persistency through the `rd.live.overlay` option exclusively and does not support the automatic creation of a write partition in disk mode. .. admonition:: dmsquash documentation Documentation for the upstream `dmsquash` module can be found `here `_. Options to set up `dmsquash` are marked with `rd.live`. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/build_simple_disk.rst0000644000000000000000000002745715273675667021510 0ustar00.. _simple_disk: Build a Virtual Disk Image ========================== .. sidebar:: Abstract This page explains how to build a simple disk image. It covers the following topics: - defines a simple disk image in the image description - builds a simple disk image - runs it with QEMU A simple virtual disk image is a compressed system disk with additional metadata useful for cloud frameworks like Amazon EC2, Google Compute Engine, or Microsoft Azure. It is used as the native disk of a system, and it does not require an additional installation workflow or a complex first-boot setup procedure. To enable {kiwi} to build a simple disk image, add a `type` element with `image="oem"` in :file:`config.xml`, where the `oem-resize` option is disabled. An example configuration for a 42-GB large VMDK image with 512 MB of RAM, an IDE controller, and a bridged network interface is shown below: .. code:: xml 42 false The following attributes of the `type` element deserve attention when building simple disk images: - `format`: Specifies the format of the virtual disk. Possible values are `gce`, `ova`, `qcow2`, `vagrant`, `vmdk`, `vdi`, `vhd`, `vhdx`, and `vhd-fixed`. In addition, a disk can be wrapped into a container by prefixing the format with `oci:` or `docker:`, for example `format="oci:qcow2"`. The permitted sub-formats are `gce`, `ova`, `qcow2`, `vmdk`, `vdi`, `vhd`, `vhdx`, `vhd-fixed` and `raw`. Note that `vagrant` cannot be used as a sub-format. - `formatoptions`: Specifies additional format options passed to :command:`qemu-img`. `formatoptions` is a comma-separated list of format-specific options in a `name=value` format, as expected by :command:`qemu-img`. {kiwi} forwards the settings from the attribute as a parameter to the `-o` option in the :command:`qemu-img` call. The `bootloader`, `size`, and `machine` child elements of `type` can be used to customize the virtual machine image. These elements are described in the following sections: :ref:`disk-bootloader`, :ref:`disk-the-size-element`, and :ref:`disk-the-machine-element`. Once your image description is finished, you can build the image using the following {kiwi} command: .. code:: bash $ sudo kiwi-ng system build \ --description kiwi/build-tests/{exc_description_disk_simple} \ --set-repo {exc_repo_leap} \ --target-dir /tmp/myimage The resulting :file:`.raw` image is stored in :file:`/tmp/myimage`. You can test the image using QEMU: .. code:: bash $ sudo qemu \ -drive file={exc_image_base_name_disk_simple}.x86_64-{exc_image_version}.raw,format=raw,if=virtio \ -m 4096 For further information on how to configure the image to work within a cloud framework, see: * :ref:`setup_for_ec2` * :ref:`setup_for_azure` * :ref:`setup_for_gce` For information on how to set up a Vagrant system, see :ref:`setup_vagrant`. .. _disk-bootloader: Setting up the Bootloader in the Image -------------------------------------- .. code:: xml The `bootloader` element defines which bootloader to use in the image, and the element offers several options for customizing its configuration. For details, see :ref:`preferences-type-bootloader`. .. _disk-the-size-element: Modifying the Size of the Image ------------------------------- The `size` child element of `type` specifies the size of the resulting disk image. The following example shows an image description where 20 GB are added to the virtual machine image, of which 5 GB are left unpartitioned: .. code:: xml 20 false The following optional attributes can be used to further customize the image size: - `unit`: Defines the unit used for the provided numerical value. Possible values are `M` for megabytes and `G` for gigabytes. The default unit is megabytes. - `additive`: A boolean value that determines whether the provided value is added to the current image size (`additive="true"`) or whether it is the total size (`additive="false"`). The default value is `false`. - `unpartitioned`: Specifies the image space in the image that is not partitioned. The attribute uses either the same unit as defined in the attribute `unit` or the default value. .. _disk-the-machine-element: Customizing the Virtual Machine ------------------------------- The `machine` child element of `type` can be used to customize the virtual machine configuration, including the number of CPUs and the connected network interfaces. The following attributes are supported by the `machine` element: - `ovftype`: The OVF configuration type. The Open Virtualization Format is a standard for describing virtual appliances and distributing them in an archive called an Open Virtual Appliance (OVA). The standard describes the major components associated with a disk image. The exact specification depends on the product using the format. Supported value is `vmware`. - `HWversion`: The virtual machine's hardware version (`vmdk` and `ova` formats only); refer to VMware documentation for further information on the supported values. - `arch`: the VM architecture (`vmdk` format only). Valid values are `ix86` (= `i586` and `i686`) and `x86_64`. - `xen_loader`: the Xen target loader that is expected to load the guest. Valid values are `hvmloader`, `pygrub`, and `pvgrub`. - `guestOS`: The virtual guest OS' identification string for the VM (only applicable for `vmdk` and `ova` formats. Note that the name designation is different for the two formats). Note: For vmware ovftools, guestOS is a VMX GuestOS, but not a VIM GuestOS. For instance, the correct value for Ubuntu 64-bit is "ubuntu-64", but not "ubuntu64Guest". See GUEST_OS_KEY_MAP in guest_os_tables.h at https://github.com/vmware/open-vm-tools for another guestOS values. - `min_memory`: The virtual machine's minimum memory in MB (`ova` format only). - `max_memory`: The virtual machine's maximum memory in MB (`ova` format only). - `min_cpu`: The virtual machine's minimum CPU count (`ova` format only). - `max_cpu`: The virtual machine's maximum CPU count (`ova` format only). - `memory`: The virtual machine's memory in MB (all formats). - `ncpus`: The number of virtual CPUs available to the virtual machine (all formats). `machine` also supports additional child elements that are covered in the following subsections. Modifying the VM Configuration Directly ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ The `vmconfig-entry` element is used to add entries directly into the virtual machine's configuration file. This is currently only supported for the `vmdk` format, where the provided strings are directly pasted into the :file:`.vmx` file. The `vmconfig-entry` element has no attributes and can appear multiple times. The entries are added to the configuration file in the provided order. Note that {kiwi} does not check the entries for correctness. The following example adds the two entries `numvcpus = "4"` and `cpuid.coresPerSocket = "2"` into the VM configuration file: .. code:: xml numvcpus = "4" cpuid.coresPerSocket = "2" Adding Network Interfaces to the VM ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Network interfaces can be explicitly specified for the VM when required via the `vmnic` element. This makes it possible to add another bridged interface or to specify the driver to be used. Note that this element is used for the `vmdk` image format only. The following example adds a bridged network interface that uses the `e1000` driver: .. code:: xml The `vmnic` element supports the following attributes: - `interface`: **Mandatory** interface ID for the VM's network interface. - `driver`: An optional driver. - `mac`: The MAC address of the specified interface. - `mode`: The mode of the interface. Note that {kiwi} does **not** verify the values of the attributes; it only inserts them into the appropriate configuration files. Specifying Disks and Disk Controllers ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ The `vmdisk` element can be used to customize the disk and disk controller for the virtual machine. At most one `vmdisk` element may be specified per `machine` element. Note that this element is used for `vmdk` and `ova` image formats only. The following example adds a disk with the ID 0 that uses an IDE controller: .. code:: xml Each `vmdisk` element can be further customized using optional attributes: - `controller`: The disk controller used for the VM guest (`vmdk` and `ova` formats). Supported values are `ide`, `sata`, `nvme`, `scsi`, `buslogic`, `lsilogic`, `lsisas1068`, `legacyESX`, `pvscsi`, and `paravirtual`. The values `scsi`, `paravirtual`, and `pvscsi` all select the VMware paravirtual SCSI controller (`VirtualSCSI` in the OVF descriptor). Recent vCenter versions only accept this SCSI controller type for many guest operating systems. `sata` and `nvme` are supported for the `ova` format only. `lsisas1068` and `legacyESX` are supported for the `vmdk` format only. If no controller is set, the `ova` format uses an NVMe controller. - `device`: The disk device to appear in the guest (`xen` format only). - `diskmode`: The disk mode (`vmdk` format only). Valid values are `monolithicSparse`, `monolithicFlat`, `twoGbMaxExtentSparse`, `twoGbMaxExtentFlat`, and `streamOptimized` (see also https://vdc-download.vmware.com/vmwb-repository/dcr-public/6335f27c-c6e9-4804-95b0-ea9449958403/c7798a8b-4c73-41d9-84e8-db5453de7b17/doc/vddkDataStruct.5.3.html). - `disktype`: The type of the disk handled internally by the VM (`ova` format only). This attribute is currently unused. - `id`: The disk ID of the VM disk (`vmdk` format only). Adding CD/DVD Drives ^^^^^^^^^^^^^^^^^^^^ {kiwi} supports adding one IDE or SCSI CD/DVD drive to the virtual machine using the `vmdvd` element for the `vmdk` and `ova` image formats. At most one `vmdvd` element may be specified per `machine` element. The following example adds a single drive with a SCSI controller: .. code:: xml The `vmdvd` element features two **mandatory** attributes: - `id`: The CD/DVD ID of the drive. - `controller`: The CD/DVD controller used for the VM guest. Valid values are `ide` and `scsi`. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/build_with_profiles.rst0000644000000000000000000000404715273675667022051 0ustar00.. _building-build-with-profiles: Building Images with Profiles ============================= {kiwi} supports so-called *profiles* inside the XML image description. Profiles act as namespaces for additional settings to be applied on top of the defaults. For further details, see :ref:`image-profiles`. Local Builds ------------ To execute local {kiwi} builds with a specific, selected profile, add the command line flag `--profile=$PROFILE_NAME`: .. code:: shell-session $ sudo kiwi-ng --type oem --profile libvirt system build \ --description kiwi/build-tests/{exc_description_vagrant} \ --set-repo {exc_repo_leap} \ --target-dir /tmp/myimage Consult the manual page of :file:`kiwi` for further details: :ref:`db_commands_kiwi_synopsis`. Building with the Open Build Service ------------------------------------ The Open Build Service (OBS) supports profiles via the `multibuild `_ feature. To enable and use the profiles, follow these steps: #. Add the following XML comment to your :file:`config.xml`: .. code:: xml It must be added before the opening `` element and after the `` element, e.g.: .. code:: xml #. Add a file :file:`_multibuild` into your package's repository with the following contents: .. code:: xml profile_1 profile_2 Add a line ``$PROFILE`` for each profile that you want OBS to build. Note that, by default, OBS excludes the build **without** any profile enabled. Running a build of a multibuild-enabled repository via :file:`osc` can be achieved via the `-M $PROFILE` flag: .. code:: shell-session $ osc build -M $PROFILE ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/build_without_debianbootstrap.rst0000644000000000000000000001100515273675667024126 0ustar00.. _debianbootstrap_alternative: Circumvent Debian Bootstrap =========================== .. sidebar:: Abstract This page provides information on how to build Debian-based images without an extra bootstrap process. When building Debian-based images, {kiwi} uses `apt` in the bootstrap and the system phase to create the image root tree. However, `apt` does not support a native way to bootstrap an empty root tree. Therefore, the bootstrap phase uses apt only to resolve the given bootstrap packages and to download these packages from the given repositories. The list of packages is then manually extracted into the new root tree, which is not exactly the same as if `apt` would have installed them natively. For the purpose of creating an initial tree to begin with, this procedure is acceptable, though. If, for some reason, this bootstrap procedure is not applicable, {kiwi} allows for an alternative process that is based on a prebuilt bootstrap-root archive provided as a package. To make use of a `bootstrap_package`, the name of that package needs to be referenced in the {kiwi} description as follows: .. code:: xml The bootstrap process now changes in a way that the provided `bootstrap_package`, `bootstrap-root`, will be installed on the build host machine. Next, {kiwi} searches for a tar archive file, :file:`/var/lib/bootstrap/bootstrap-root.ARCH.tar.xz`, where `ARCH` is the name of the host architecture, e.g., `x86_64`. If found, the archive is unpacked and serves as the bootstrap root tree to begin with. The optionally provided additional bootstrap packages, `a` and `b` in this example, will be installed like system packages via `chroot` and `apt`. Usually, no additional bootstrap packages are needed, as they could all be handled as system packages. How to Create a bootstrap_package --------------------------------- Changing the setup in {kiwi} to use a `bootstrap_package` rather than using {kiwi}'s Debian bootstrap method to do the job comes with the task of creating that package, providing the bootstrap root tree. There is more than one way to do this. The following procedure is just one example and requires some background knowledge about the Open Build Service (`OBS `__) and its {kiwi} integration. 1. Create an OBS project and repository setup that matches your image target. 2. Create an image build package. .. code:: bash osc mkpac bootstrap-root 3. Create the following :file:`appliance.kiwi` file: .. code:: xml The Author author@example.com prebuilt bootstrap rootfs for ... 1.0.1 apt .. code:: bash osc add appliance.kiwi osc ci 4. Package the image build results into a Debian package. In step 3, the bootstrap root tarball was created but not yet packaged. A Debian package is needed so that it can be referenced with the `bootstrap_package` attribute and the repository providing it. The simplest way to package the `bootstrap-root` tarball is to create another package in OBS and use the tarball file as its source. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/build_wsl_container.rst0000644000000000000000000001321015273675667022032 0ustar00.. _building_wsl_build: Build a WSL Container Image =========================== .. sidebar:: Abstract This page explains how to build a WSL/Appx container image. WSL stands for Windows Subsystem for Linux, and it is a zip-based container format consumable by Windows 10 with WSL enabled. {kiwi} can build WSL images using the :command:`appx` utility. Make sure you have installed the package that provides the command on your build host. Once the build host has the `appx` command installed, the following image type setup is required in the XML description, :file:`config.xml`: .. code:: xml The :file:`/meta/data` path specifies a path that provides additional information required for the `WSL-DistroLauncher`. This component consists of a Windows (`exe`) executable file and an :file:`AppxManifest.xml` file that references other files, like icons and resource configurations for the startup of the container under Windows. .. note:: **/meta/data** Except for the root filesystem tarball, {kiwi} is not responsible for providing the metadata required for the `WSL-DistroLauncher`. It is expected that the given metadata path contains all the needed information. Typically, this information is delivered in a package provided by the distribution, and it is installed on the build host. Setup of the WSL-DistroLauncher ------------------------------- The contents of the :file:`AppxManifest.xml` are changed by {kiwi} if the `containerconfig` section is provided in the XML description. In the context of a WSL image, the following container configuration parameters are taken into account: .. code:: xml Container Description Text All information provided here, including the entire section, is optional. If the information is not specified, the existing :file:`AppxManifest.xml` is left untouched. created_by Specifies the name of a publisher organization. An `appx` container must be signed off with a digital signature. If the image is built in the Open Build Service (OBS), this is done automatically. Outside of OBS, you must make sure that the given publisher organization name matches the certificate used for signing. author Provides the name of the author and maintainer of this container. application_id Specifies an ID name for the container. The name must start with a letter, and only alphanumeric characters are allowed. {kiwi} does not validate the specified name string because there are no common criteria for the various container architectures. package_version Specifies the version identification for the container. {kiwi} validates it against the `Microsoft Package Version Numbering `_ rules. launcher Specifies the binary file name of the launcher :file:`.exe` file. .. warning:: {kiwi} does not check the configuration in :file:`AppxManifest.xml` for validity or completeness. The following example shows how to build a WSL image based on openSUSE Tumbleweed: 1. Include the `Virtualization/WSL` repository in the list (replace `` with the desired distribution): .. code:: bash $ zypper addrepo http://download.opensuse.org/repositories/Virtualization:/WSL/ WSL #. Install the `fb-util-for-appx` utility and the package that provides the `WSL-DistroLauncher` metadata. See the previous note on :file:`/meta/data`. .. code:: bash $ zypper in fb-util-for-appx DISTRO_APPX_METADATA_PACKAGE .. note:: When building images with the Open Build Service, make sure to add the packages from the `zypper` command above to the project configuration via `osc meta -e prjconf` along with the line `support: PACKAGE_NAME` for each package that needs to be installed on the Open Build Service worker that runs the {kiwi} build process. #. Configure the image type: Add the following type and container configuration to :file:`kiwi/build-tests/{exc_description_wsl}/appliance.kiwi`: .. code:: xml Tumbleweed Appliance text based .. warning:: If the configured metadata path does not exist, the build will fail. Furthermore, {kiwi} does not check whether the metadata is complete or is valid according to the requirements of the `WSL-DistroLauncher`. #. Build the image with {kiwi}: .. code:: bash $ sudo kiwi-ng system build \ --description kiwi/build-tests/{exc_description_wsl} \ --set-repo {exc_repo_tumbleweed} \ --target-dir /tmp/myimage Testing the WSL image --------------------- For testing the image, you need a Windows 10 system. Before you proceed, enable the optional feature named :file:`Microsoft-Windows-Subsystem-Linux`. For further details on how to set up the Windows machine, see `Windows Subsystem for Linux `__. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/clone_partitions.rst0000644000000000000000000001367015273675667021372 0ustar00.. _clone_partitions: Partition Clones ================ .. sidebar:: Abstract This page provides details about the partition clone feature and its use cases. {kiwi} allows you to create block-level clones of certain partitions used in the image. Clones can be created from the `root`, `boot`, and any other partition listed in the `` element. A partition clone is a simple byte dump from one block storage device to another. However, this would cause conflicts during boot of the system because all unique identifiers, like the UUID of a filesystem, will no longer be unique. The clone feature of {kiwi} takes care of this part and re-creates the relevant unique identifiers per cloned partition. {kiwi} allows this also for complex partitions like LVM, LUKS, or RAID. The partition clone(s) will always appear first in the partition table, followed by the origin partition. The origin partition is the one whose identifier will be referenced and used by the system. By default, no cloned partition will be mounted or used by the system at boot time. Let's take a look at the following example: .. code:: xml 2048 false 100 With the above setup, {kiwi} will create a disk image that contains the following partition table: .. code:: Number Start (sector) End (sector) Size Code Name 1 2048 6143 2.0 MiB EF02 p.legacy 2 6144 47103 20.0 MiB EF00 p.UEFI 3 47104 661503 300.0 MiB 8300 p.lxbootclone1 4 661504 1275903 300.0 MiB 8300 p.lxboot 5 1275904 1296383 10.0 MiB 8300 p.lxhomeclone1 6 1296384 1316863 10.0 MiB 8300 p.lxhomeclone2 7 1316864 1337343 10.0 MiB 8300 p.lxhome 8 1337344 3864575 2 GiB 8300 p.lxrootclone1 9 3864576 6287326 2 GiB 8300 p.lxroot When booting the system, only the origin partitions `p.lxboot`, `p.lxroot`, and `p.lxhome` will be mounted and visible in, e.g., :file:`/etc/fstab`, the bootloader, or the initrd. Thus, partition clones are present as a data source but are not relevant for the operating system from a functional perspective. As shown in the above example, there is one clone request for root and boot and two clone requests for the home partition. {kiwi} does not sanity- check the provided number of clones (e.g., whether your partition table can hold that many partitions). .. warning:: There is a limit to how many partitions a partition table can hold. This also limits how many clones can be created. It's important when using the `root_clone` attribute to specify a size for the part of the system that represents the root partition. As of today, {kiwi} does not automatically divide the root partition into two identical pieces. To create a clone of the partition, a size specification is required. In the above example, the size for root is provided via the `oem-systemsize` element. Using a root clone and fixed size values has the following consequences: 1. The resize capability must be disabled. This is done via the `oem-resize` element. The reason is that only the last partition in the partition table can be resized without destroying data. If there is a clone of the root partition, it should never be resized because then the two partitions will be different in size and no longer be clones of each other. 2. There can be unpartitioned space left. In the above example, the overall disk size is set to 100G. The sum of all partition sizes will be smaller than this value, and there is no resize available anymore. Depending on the overall size setup for the disk, this will leave unpartitioned space free on the disk. Use Case -------- Potential use cases for which a clone of one or more partitions is useful include, among others: Factory Resets: Creating an image with the option to roll back to the state of the system at deployment time can be very helpful for disaster recovery. System Updates with Rollbacks e.g A/B: Creating an image that holds extra space allowing to roll back modified data can make a system more robust. For example, in a simple A/B update concept, partition A would be updated but would flip to B if A is considered broken after applying the update. .. note:: Most probably, any use case based on partition clones requires additional software to manage them. {kiwi} provides the option to create the clone layout, but it does not provide the software to implement the actual use case for which the partition clones are needed. Developers writing applications based on a clone layout created with {kiwi} can leverage the metadata file :file:`/config.partids`. This file is created at build time and contains the mapping between the partition `name` and the actual partition number in the partition table. For partition clones, the following naming convention applies: .. code:: kiwi_(name)PartClone(id)="(partition_number)" The `(name)` is either taken from the `name` attribute of the `` element, or it is a fixed name assigned by {kiwi}. There are the following reserved partition names for which cloning is supported: * root * readonly * boot For the mentioned example, this will result in the following :file:`/config.partids`: .. code:: kiwi_BiosGrub="1" kiwi_EfiPart="2" kiwi_bootPartClone1="3" kiwi_BootPart="4" kiwi_homePartClone1="5" kiwi_homePartClone2="6" kiwi_HomePart="7" kiwi_rootPartClone1="8" kiwi_RootPart="9" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/custom_fstab_extension.rst0000644000000000000000000000543515273675667022603 0ustar00.. _custom_fstab_extension: Add or Update the Fstab File ============================ .. sidebar:: Abstract This page provides further information for customizing the `/etc/fstab` file which controls the mounting of filesystems at boot time. In {kiwi}, all major filesystems that were created at image build time are handled by {kiwi} itself and setup in `/etc/fstab`. Thus there is usually no need to add entries or change the ones added by {kiwi}. However depending on where the image is deployed later it might be required to pre-populate fstab entries that are unknown at the time the image is built. Possible use cases are for example: * Adding NFS locations that should be mounted at boot time. Using autofs would be an alternative to avoid additional entries to fstab. The information about the NFS location will make this image specific to the target network. This will be independent of the mount method, either fstab or the automount map has to provide it. * Adding or changing entries in a read-only root system which becomes effective on first boot but can't be added at that time because of the read-only characteristics. .. note:: Modifications to the fstab file are a critical change. If done wrongly the risk exists that the system will not boot. In addition this type of modification makes the image specific to its target and creates a dependency to the target hardware, network, etc... Thus this feature should be used with care. The optimal way to provide custom fstab information is through a package. If this can't be done the files can also be provided via the overlay file tree of the image description. {kiwi} supports three ways to modify the contents of the `/etc/fstab` file: Providing an `/etc/fstab.append` file If that file exists in the image root tree, {kiwi} will take its contents and append it to the existing `/etc/fstab` file. The provided `/etc/fstab.append` file will be deleted after successful modification. Providing an `/etc/fstab.patch` file The `/etc/fstab.patch` represents a patch file that will be applied to `/etc/fstab` using the `patch` program. This method also allows to change the existing contents of `/etc/fstab`. On success `/etc/fstab.patch` will be deleted. Providing an `/etc/fstab.script` file The `/etc/fstab.script` represents an executable which is called as chrooted process. This method is the most flexible one and allows to apply any change. On success `/etc/fstab.script` will be deleted. .. note:: All three variants to handle the fstab file can be used together. Appending happens first, patching afterwards and the script call is last. When using the script call, there is no validation that checks if the script actually handles fstab or any other file in the image rootfs. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/custom_partitions.rst0000644000000000000000000001457315273675667021607 0ustar00.. _custom_partitions: Custom Disk Partitions ====================== .. sidebar:: Abstract This page provides details about the opportunities and limitations of customizing the partition table in addition to the volume management settings from :ref:`custom_volumes`. {kiwi} has its own partitioning schema, which is defined according to several different user configurations: boot firmware, boot partition, expandable layouts, etc. Those supported features have an impact on the partitioning schema. MBR or GUID partition tables are not flexible, have limitations, and are tied to some specific disk geometry. Because of that, the preferred alternative to disk layouts based on traditional partition tables is using flexible approaches like logical volumes. However, under certain conditions, additional entries to the low-level partition table are needed. For this purpose, the `` section exists and allows you to add custom entries, as shown in the following example: .. code:: xml Each `` entry puts a partition of the configured size in the low-level partition table, creates a filesystem on it, and includes it in the system's fstab file. If parts of the root filesystem are moved into their own partition, as in the above example, this partition will also contain the data that gets installed during the image creation process to that area. The following attributes must/can be set to configure a partition entry: name="identifier" Mandatory name of the partition as handled by {kiwi}. .. note:: The following reserved names cannot be used because they are already represented by existing attributes: `root`, `readonly`, `boot`, `prep`, `spare`, `swap`, `efi_csm`, and `efi`. partition_name="name" Optional name of the partition as it appears when listing the table contents with tools like `gdisk`. If no name is set, {kiwi} constructs a name of the form `p.lx(identifier_from_name_attr)`. partition_type="type_identifier" Optional partition type identifier as handled by {kiwi}. Allowed values are `t.linux` and `t.raid`. If not specified, `t.linux` is the default. size="size_string" Mandatory size of the partition. A size string can end with `M` or `G` to indicate a megabyte or gigabyte value. Without a unit specification, megabyte is used. mountpoint="path" Optional mountpoint to mount the partition in the system. filesystem="btrfs|ext2|ext3|ext4|squashfs|xfs|fat32|fat16" Optional filesystem configuration to create one of the supported filesystems on the partition. label="string" Optional filesystem label if a filesystem is provided. If no label is specified, the `name` identifier in uppercase letters is set as the filesystem label. clone="number" Optional setting to indicate that this partition should be cloned `number` of times. A clone partition is content-wise an exact byte-for-byte copy of the origin. However, to avoid conflicts at boot time, the UUID of any cloned partition will be made unique. In the sequence of partitions, the clone(s) will always be created first, followed by the partition considered the origin. The origin partition is the one that will be referenced and used by the system. part_id="number" Specify the partition number for this partition. This is the number used for the partition in the partition table. The value impacts the name of the Unix device node associated with the partition. This means if the disk name is, e.g., `/dev/sda` and `part_id="42"` is set, the Unix node for this partition will be `/dev/sda42`. Please note that the number has no impact on the geometry or order of partitions as they are created. The partitions in the `` section are still created in the order in which they are listed. Please also note, if custom partition IDs are used, it is strongly recommended that they be used across all partitions created by kiwi. The reason for this is that kiwi uses an incremental counter that, by default, matches the number of the partition in the table. If custom partition IDs are not used for all partitions, this results in a mix of numbers, which works but is not obviously visible when reading the image description. Because of that, also see the information about the `` attributes `eficsmpart_id`, `efipart_id`, `rootpart_id`, and `bootpart_id`. Despite the customization options of the partition table shown above, there are the following limitations: 1. By default, the root partition is always the last one. Disk images built with {kiwi} are designed to be expandable. For this feature to work, the partition containing the system's rootfs must always be the last one. If this is unwanted for some reason, {kiwi} offers an opportunity for one extra/spare partition with the option to also be placed at the end of the table. For details, look up `spare_part` in :ref:`image-description-elements`. 2. By default, there are no gaps in the partition table. The way partitions are configured is done such that there are no gaps in the table of the image. However, leaving some space free at the **end** of the partition geometry is possible in the following ways: * **Deploy with unpartitioned free space.** To leave space unpartitioned on the first boot of a disk image, it is possible to configure an `` that is smaller than the disk the image gets deployed to. Details about this setting can be found in :ref:`image-description-elements`. * **Build with unpartitioned free space.** To leave space unpartitioned at build time of the image, it is possible to disable `` and configure an `` which is smaller than the kiwi-calculated disk size or the fixed setting for the disk size via the `` element. * **Build with unpartitioned free space.** Setting some unpartitioned free space on the disk can be done using the `unpartitioned` attribute of the `size` element in the type's section. For details, see :ref:`disk-the-size-element`. * **Resize built image adding unpartitioned free space.** A built image can be resized by using the `kiwi-ng image resize` command and setting a new extended size for the disk. See {kiwi} commands docs :ref:`here `. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/custom_volumes.rst0000644000000000000000000001003215273675667021067 0ustar00.. _custom_volumes: Custom Disk Volumes =================== .. sidebar:: Abstract This chapter provides high-level explanations on how to handle volume or subvolume definitions for disk images using {kiwi}. {kiwi} supports defining custom volumes by using the logical volume manager (LVM) for the Linux kernel or by setting volumes at the filesystem level when the filesystem supports it (e.g., btrfs). Volumes are defined in the {kiwi} description file, :file:`config.xml`, using `systemdisk`. This element is a child of the `type` element, which in turn is a child of `preferences`. Volumes themselves are added via (multiple) `volume` child elements of the `systemdisk` element: .. code:: xml Additional non-root volumes are created for each `volume` element. Volume details can be defined by setting the following `volume` attributes: - `name`: Required attribute representing the volume's name. Additionally, this attribute is interpreted as the mountpoint if the `mountpoint` attribute is not used. - `mountpoint`: Optional attribute that specifies the mountpoint of this volume. - `size`: Optional attribute to set the size of the volume. If no suffix (`M` or `G`) is used, then the value is considered to be in megabytes. .. note:: Special name for the root volume You can use the `@root` name to refer to the volume mounted at `/` in case some specific size attributes for the root volume have to be defined. For instance: .. code:: xml In addition to the custom size of the root volume, it's also possible to set up the name of the root volume as follows: .. code:: xml If no name for the root volume is specified, the default name, **LVRoot**, applies. - `freespace`: Optional attribute defining the additional free space added to the volume. If no suffix (`M` or `G`) is used, the value is considered to be in megabytes. - `label`: Optional attribute to set the filesystem label of the volume. - `copy_on_write`: Optional attribute to set the filesystem copy-on-write attribute for this volume. - `quota`: Optional attribute for the `btrfs` filesystem only. Allows you to specify a quota size for the generated volume. - `parent`: Optional attribute for the `btrfs` volume manager only. The name or path of the parent subvolume this volume should be nested in. If not set, the volume is created below the default volume. - `filesystem_check`: Optional attribute to indicate that this filesystem should perform the validation to become filesystem-checked. The actual constraints of whether the check is performed or not depends on systemd and filesystem-specific components. If not set or set to `false`, no system component will be triggered to run an eventual filesystem check, which results in this filesystem never being checked. The latter is the default. - `arch`: Optional attribute to create the volume only if it matches the specified host architecture. Multiple architecture names can be specified as a comma-separated list. .. warning:: The size attributes for filesystem volumes, as for btrfs, are ignored and have no effect. The `systemdisk` element additionally supports the following optional attributes: - `name`: The volume group name, by default, `systemVG` is used. This setting is only relevant for LVM volumes. - `preferlvm`: A boolean value instructing {kiwi} to prefer LVM even if the used filesystem has its own volume management system. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/disk_ramdisk_deployment.rst0000644000000000000000000000777415273675667022732 0ustar00.. _ramdisk_deployment: Deploy and Run a System in a Ramdisk ==================================== .. sidebar:: Abstract This page provides further information for handling oem images built with {kiwi} and references the following articles: * :ref:`expandable_disk` If a machine should run the OS completely in memory without the need for any persistent storage, the approach to deploy the image into a ramdisk serves this purpose. .. note:: brd support For this functionality to work, brd (Block Ramdisk Driver) must be supported. If brd is available as a kernel module (as opposed to being compiled in the kernel), you must include the driver into the initrd. To do this, create (or edit) the `config.sh` file and add the following command to it: .. code:: bash echo 'add_drivers+=" brd "' > /etc/dracut.conf.d/10-brd.conf {kiwi} allows you to create a bootable ISO image that deploys the image into a ramdisk and activates that image with the following oem type definition: .. code:: xml true true /dev/ram1 false false 2048000 The type specification above builds an installation ISO image that deploys the System Image into the specified ramdisk device (`/dev/ram1`). The setup of the ISO image boots with a short boot timeout of 1 second and just runs through the process without asking any questions. In a ramdisk deployment, the optional target verification, swap space, and multipath targets are out of scope and therefore disabled. The configured size of the ramdisk via `oem-ramdisk-size` specifies the kB size of the OS disk, and it must be at least of the size of the System Image. The disk size can be configured dynamically with the following value in the kernelcmdline attribute: * ramdisk_size=kbyte-value An image built with the above setup can be tested in QEMU as follows: .. code:: bash $ sudo qemu -cdrom \ {exc_image_base_name}.x86_64-{exc_image_version}.install.iso \ -serial stdio .. note:: Enough Main Memory The machine, no matter if it's a virtual machine like QEMU or a real machine, must provide enough RAM to hold the image in the ramdisk as well as have enough RAM available to operate the OS and its applications. The {kiwi} build image with the extension .raw provides the System Image that gets deployed into the RAM space. Subtract the size of the System Image from the RAM space the machine offers and make sure the result is still big enough for the use case of the appliance. In the case of a virtual machine, attach enough main memory to fit this calculation. In the case of QEMU, this can be done with the `-m` option. Like all other oem {kiwi} images, the ramdisk setup also supports all the deployment methods as explained in :ref:`deployment_methods`. This means it's also possible to dump the ISO image on a USB stick, let the system boot from it, and unplug the stick from the machine because the system was deployed into RAM. .. note:: Limitations Of Ramdisk Deployments Only standard images that can be booted by a simple root mount and root switch can be used. Usually, {kiwi} calls kexec after deployment such that the correct dracut initrd created for the image will boot the image. In the case of a RAM-only system, kexec does not work because it would lose the ramdisk contents. Thus, the dracut initrd driving the deployment is also the environment to boot the system. There are cases where this environment is not suitable to boot the system. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/disk_setup_for_azure.rst0000644000000000000000000000342415273675667022240 0ustar00.. _setup_for_azure: Image Description for Microsoft Azure ===================================== .. sidebar:: Abstract This page provides further information for handling Azure disk images built with {kiwi} and references the following articles: * :ref:`simple_disk` A virtual disk image that is able to boot in the Microsoft Azure cloud framework has to comply with the following constraints: * Hyper-V tools must be installed. * The Microsoft Azure Agent must be installed. * The disk size must be set to 30G. * Kernel parameters must allow for a serial console. To meet these requirements, update the {kiwi} image description as follows: 1. Software packages Make sure to add the following packages to the package list: .. note:: Package names used in the following list match the package names of the SUSE distribution and might be different on other distributions. .. code:: xml 2. Image Type definition Update the oem image type setup as follows: .. code:: xml 30720 false An image built with the above setup can be uploaded into the Microsoft Azure cloud and registered as an image. For further information on how to upload to Azure, see: `azurectl `_. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/disk_setup_for_ec2.rst0000644000000000000000000000675515273675667021575 0ustar00.. _setup_for_ec2: Image Description for Amazon EC2 ================================ .. sidebar:: Abstract This page provides further information for handling Amazon EC2 images built with {kiwi} and references the following articles: * :ref:`simple_disk` A virtual disk image that is able to boot in the Amazon EC2 cloud framework has to comply with the following constraints: * Xen tools and libraries must be installed. * The cloud-init package must be installed. * A cloud-init configuration for Amazon must be provided. * Grub bootloader modules for Xen must be installed. * AWS tools must be installed. * The disk size must be set to 10G. * Kernel parameters must allow for a Xen console. To meet these requirements, add or update the {kiwi} image description as follows: 1. Software packages Make sure to add the following packages to the package list: .. note:: Package names used in the following list match the package names of the SUSE distribution and might be different on other distributions. .. code:: xml 2. Image Type definition Update the oem image type setup as follows: .. code:: xml 10240 false 3. Cloud-Init setup Cloud-init is a service that runs at boot time and allows you to customize the system by activating one or more cloud-init modules. For Amazon EC2, the following configuration file, :file:`/etc/cloud/cloud.cfg`, needs to be provided as part of the overlay files in your {kiwi} image description: .. code:: yaml users: - default disable_root: true preserve_hostname: false syslog_fix_perms: root:root datasource_list: [ NoCloud, Ec2, None ] cloud_init_modules: - migrator - bootcmd - write-files - growpart - resizefs - set_hostname - update_hostname - update_etc_hosts - ca-certs - rsyslog - users-groups - ssh cloud_config_modules: - mounts - ssh-import-id - locale - set-passwords - package-update-upgrade-install - timezone cloud_final_modules: - scripts-per-once - scripts-per-boot - scripts-per-instance - scripts-user - ssh-authkey-fingerprints - keys-to-console - phone-home - final-message - power-state-change system_info: default_user: name: ec2-user gecos: "cloud-init created default user" lock_passwd: True sudo: ["ALL=(ALL) NOPASSWD:ALL"] shell: /bin/bash paths: cloud_dir: /var/lib/cloud/ templates_dir: /etc/cloud/templates/ ssh_svcname: sshd An image built with the above setup can be uploaded into the Amazon EC2 cloud and registered as an image. For further information on how to upload to EC2, see: `ec2uploadimg `_. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/disk_setup_for_google.rst0000644000000000000000000000435715273675667022374 0ustar00.. _setup_for_gce: Image Description for Google Compute Engine =========================================== .. sidebar:: Abstract This page provides further information for handling GCE images built with {kiwi} and references the following articles: * :ref:`simple_disk` A virtual disk image that is able to boot in the Google Compute Engine cloud framework has to comply with the following constraints: * {kiwi} type must be an expandable disk. * Google Compute Engine init must be installed. * Disk size must be set to 10G. * Kernel parameters must allow for a serial console. To meet these requirements, update the {kiwi} image description as follows: 1. Software packages Make sure to add the following packages to the package list: .. note:: Package names used in the following list match the package names of the SUSE distribution and might be different on other distributions. .. code:: xml 2. Image Type definition To allow the image to be expanded to the configured disk geometry of the instance started by Google Compute Engine, it is suggested to let {kiwi}'s OEM boot code take over that task. It would also be possible to try cloud-init's resize module, but we found conflicts when two cloud-init systems, `google-compute-engine-init` and `cloud-init`, were used together. Thus, for now, we stick with {kiwi}'s boot code, which can resize the disk from within the initrd before the system is activated through systemd. Update the oem image type setup to be changed into an expandable type as follows: .. code:: xml 10240 true false An image built with the above setup can be uploaded into the Google Compute Engine cloud and registered as an image. For further information on how to upload to Google, see: `google-cloud-sdk` on software.opensuse.org. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/disk_setup_for_luks.rst0000644000000000000000000000433115273675667022066 0ustar00.. _setup_for_luks: Image Description for an Encrypted Disk ======================================= .. sidebar:: Abstract This page provides further information for handling disk images with an encrypted root filesystem. The information here is based on the following article: * :ref:`simple_disk` A virtual disk image can be partially or fully encrypted using the LUKS extension supported by {kiwi}. A fully encrypted image also includes the data in `/boot` to be encrypted. Such an image requests the passphrase for the master key to be entered at the bootloader stage. A partially encrypted image keeps `/boot` unencrypted and on an extra boot partition. Such an image requests the passphrase for the master key later in the boot process when the root partition is accessed by the systemd mount service. In any case, the master passphrase is requested only once. Update the {kiwi} image description as follows: 1. Software packages Make sure to add the following package to the package list: .. note:: Package names used in the following list match the package names of the SUSE distribution and might be different on other distributions. .. code:: xml 2. Image Type definition Update the oem image type setup as follows: Full disk encryption, including `/boot`: .. code:: xml false Encrypted root partition with an unencrypted extra `/boot` partition: .. code:: xml false .. note:: The value for the `luks` attribute sets the master passphrase for the LUKS keyring. Therefore, the XML description becomes security-critical and should only be readable by trustworthy people. Alternatively, the credentials information can be stored in a key file and referenced as: .. code:: xml ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/disk_setup_for_vagrant.rst0000644000000000000000000002105215273675667022551 0ustar00.. _setup_vagrant: Image Description for Vagrant ============================= .. sidebar:: Abstract This page provides further information for handling Vagrant-controlled disk images built with {kiwi} and references the following article: * :ref:`simple_disk` `Vagrant `_ is a framework to implement consistent processing/testing work environments based on Virtualization technologies. To run a system, Vagrant needs so-called **boxes**. A box is a TAR archive containing a virtual disk image and some metadata. To build Vagrant boxes, you can use `Packer `_, which is provided by Hashicorp itself. Packer is based on the official installation media (DVDs) as shipped by the distribution vendor. The {kiwi} way of building images might be helpful if such a media does not exist or does not suit your needs. For example, if the distribution is still under development or you want to use a collection of your own repositories. Note that in contrast to Packer, {kiwi} only supports the libvirt and VirtualBox providers. Other providers require a different box layout that is currently not supported by {kiwi}. In addition, you can use the {kiwi} image description as a source for the `Open Build Service `_, which allows building and maintaining boxes. Vagrant expects boxes to be set up in a specific way (for details refer to the `Vagrant box documentation `_). Applied to the referenced {kiwi} image description from :ref:`simple_disk`, the following steps are required: 1. Update the image type setup. .. code:: xml 42 false This modifies the type to build a Vagrant box for the libvirt provider, including a pre-defined disk size. The disk size is optional but recommended to provide some free space on disk. For the VirtualBox provider, the additional attribute `virtualbox_guest_additions_present` can be set to `true` when the VirtualBox guest additions are installed in the {kiwi} image: .. code:: xml 42 false The resulting Vagrant box then uses the `vboxsf` module for the synchronized folder instead of `rsync`, which is used by default. 2. Add mandatory packages. .. code:: xml 3. Add additional packages. If you have set the attribute `virtualbox_guest_additions_present` to `true`, add the VirtualBox guest additions. For openSUSE, the following packages are required: .. code:: xml Otherwise, you must add `rsync`: .. code:: xml Note that {kiwi} cannot verify whether these packages are installed. If they are missing, the resulting Vagrant box will be broken. 4. Add Vagrant user. .. code:: xml This adds the **vagrant** user to the system and applies the name of the user as the password for login. 5. Configure SSH, the default shared folder, and sudo permissions. Vagrant expects that it can log in as the user `vagrant` using an insecure public key [#f1]_. Furthermore, Vagrant also usually uses :file:`/vagrant` as the default shared folder and assumes that the `vagrant` user can invoke commands via `sudo` without having to enter a password. This can be achieved using the function `baseVagrantSetup` in :file:`config.sh`: .. code:: bash baseVagrantSetup 6. Additional customizations: In addition to `baseVagrantSetup`, you might want to also ensure the following: - If you have installed the VirtualBox guest additions into your box, then also load the `vboxsf` kernel module. - When building boxes for libvirt, ensure that the default wired networking interface is called `eth0` and uses DHCP. This is necessary since libvirt uses `dnsmasq` to issue IPs to the VMs. This step can be omitted for VirtualBox boxes. An image built with the above setup creates a Vagrant box file with the extension :file:`.vagrant.libvirt.box` or :file:`.vagrant.virtualbox.box`. Add the box file to Vagrant with the command: .. code:: bash vagrant box add my-box image-file.vagrant.libvirt.box .. note:: Using the box with the libvirt provider requires, alongside a correct Vagrant installation: - the plugin `vagrant-libvirt` to be installed - a running libvirtd daemon Once added to Vagrant, boot the box and log in with the following sequence of `vagrant` commands: .. code:: bash vagrant init my-box vagrant up --provider libvirt vagrant ssh Customizing the embedded Vagrantfile ------------------------------------ .. warning:: This is an advanced topic and not required for most users. Vagrant ships with an embedded :file:`Vagrantfile` that carries settings specific to this box, for instance, the synchronization mechanism for the shared folder. {kiwi} generates such a file automatically for you, and it should be sufficient for most use cases. If a box requires different settings in the embedded :file:`Vagrantfile`, then the user can provide {kiwi} with a path to an alternative via the attribute `embedded_vagrantfile` of the `vagrantconfig` element: it specifies a relative path to the :file:`Vagrantfile` that will be included in the finished box. In the following example snippet from :file:`config.xml`, we add a custom :file:`MyVagrantfile` into the box (the file should be in the image description directory next to :file:`config.sh`): .. code:: xml 42 false The option to provide a custom :file:`Vagrantfile` can be combined with the usage of *profiles* (see :ref:`image-profiles`), so that certain builds can use the automatically generated :file:`Vagrantfile` (in the following example, that is the VirtualBox build) and others get a customized one (the libvirt profile in the following example): .. code:: xml 42 false 42 false .. [#f1] The insecure key is removed from the box when it is first booted via Vagrant. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/integration_testing.rst0000644000000000000000000000507515273675667022076 0ustar00Building Build Tests ==================== {kiwi} provides a collection of integration test images for different architectures and distributions. The test descriptions cover a number of appliance features that can be built with {kiwi}. The test descriptions are stored in a directory structure of the following layout: `build-tests/ARCH/DISTRIBUTION/test-image-NAME`. To build integration test image(s), the script `build-tests.sh` exists. The implementation of `build-tests.sh` calls kiwi's `boxbuild` command, by default in container mode, which allows calling the script on any host system that allows you to run container instances via `podman`. The `--vm` option of `build-tests.sh` runs the build in a virtual machine instead. .. warning:: **Architectures** Cross-architecture image building is possible and also supported via boxbuild, but the performance impact is big, even in containers using qemu-binfmt, and even bigger in full qemu arch emulation. This would slow down building the integration tests a lot, and therefore, `build-tests.sh` requires the host architecture to match the image target architecture. Prior to calling `build-tests.sh`, the following requirements must be met: ``Tools`` Install the packages providing the following tools: * tree * git * xmllint * podman * pip ``Source Checkout`` Check out the kiwi git repo, which provides the test descriptions as well as the `build-tests.sh` script. .. code:: bash $ git clone https://github.com/OSInside/kiwi.git ``kiwi`` Install {kiwi}. It provides the boxbuild command used by `build-tests.sh`. If there are no {kiwi} packages for your host, install {kiwi} from pip: .. code:: bash $ pip install --upgrade kiwi .. warning:: Make sure to be able to execute `kiwi-ng`. When installed from pip as a user, `kiwi-ng` is placed in `~/.local/bin`. Update your path via `export PATH=~/.local/bin:$PATH` if needed. Building a specific integration test can be done as follows: .. code:: bash $ cd kiwi $ ./build-tests.sh \ --test-dir build-tests/x86/tumbleweed/ \ --test-name test-image-disk Building all integration tests for a specific arch and distribution can be done as follows: .. code:: bash $ cd kiwi $ ./build-tests.sh \ --test-dir build-tests/x86/tumbleweed/ .. note:: Building all integration tests can take some time and depends on the number of tests provided as well as on the build power of the host system. In general, the tests can also run in parallel or be distributed to multiple hosts. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/iso_to_usb_stick_deployment.rst0000644000000000000000000000271315273675667023614 0ustar00.. _iso_to_usb_stick: Deploy ISO Image on a USB Stick ================================ .. sidebar:: Abstract This page provides further information for handling ISO images built with {kiwi} and references the following articles: * :ref:`hybrid_iso` In {kiwi}, all generated ISO images are created to be hybrid. This means, the image can be used as a CD/DVD or as a disk. This works because the ISO image also has a partition table embedded. With more and more computers delivered without a CD/DVD drive, this becomes important. The very same ISO image can be copied onto a USB stick and used as a bootable disk. The following procedure shows how to do this: 1. Plug in a USB stick. Once plugged in, check which Unix device name the stick was assigned to. The following command provides an overview of all Linux storage devices: .. code:: bash $ lsblk 2. Dump the ISO image on the USB stick: .. warning:: Make sure the selected device really points to your stick because the following operation cannot be revoked and will destroy all data on the selected device. .. code:: bash $ dd if={exc_image_base_name_live}.x86_64-{exc_image_version}.iso of=/dev/ 3. Boot from your USB Stick. Activate booting from USB in your BIOS/UEFI. As many firmwares have different procedures on how to do it, look into your user manual. Many firmwares offer a boot menu that can be activated at boot time. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/iso_to_usb_stick_file_based_deployment.rst0000644000000000000000000000520515273675667025750 0ustar00.. _iso_as_file_to_usb_stick: Deploy ISO Image as a File on a FAT32 Formatted USB Stick ========================================================= .. sidebar:: Abstract This page provides further information for handling ISO images built with {kiwi} and references the following articles: * :ref:`hybrid_iso` In {kiwi}, all generated ISO images are created to be hybrid. This means, the image can be used as a CD/DVD or as a disk. The deployment of such an image onto a disk like a USB stick normally destroys all existing data on this device. Most USB sticks are pre-formatted with a FAT32 Windows filesystem, and to keep the existing data on the stick untouched, a different deployment needs to be used. The following deployment process copies the ISO image as an additional file to the USB stick and makes the USB stick bootable. The ability to boot from the stick is configured through a Grub2 feature that allows you to loopback mount an ISO file and boot the kernel and initrd directly from the ISO file. The initrd loaded in this process must also be able to loopback mount the ISO file to access the root filesystem and boot the live system. The dracut initrd system used by {kiwi} provides this feature upstream, called "iso-scan". Therefore, all {kiwi}-generated live ISO images support this deployment mode. For copying the ISO file to the USB stick and the setup of the Grub2 bootloader to make use of the "iso-scan" feature, an extra tool named `live-grub-stick` exists. The following procedure shows how to set up the USB stick with `live-grub-stick`: 1. Install the `live-grub-stick` package from software.opensuse.org. 2. Plug in a USB stick. Once plugged in, check which Unix device name the FAT32 partition was assigned to. The following command provides an overview of all storage devices and their filesystems: .. code:: bash $ sudo lsblk --fs 3. Call the `live-grub-stick` command as follows: Assuming "/dev/sdz1" was the FAT32 partition selected from the output of the `lsblk` command: .. code:: bash $ sudo live-grub-stick {exc_image_base_name_live}.x86_64-{exc_image_version}.iso /dev/sdz1 4. Boot from your USB Stick. Activate booting from USB in your BIOS/UEFI. As many firmwares have different procedures on how to do it, look into your user manual. EFI booting from an ISO image is not supported at the moment. For EFI booting, use the --isohybrid option with live-grub-stick; however, note that all the data on the stick will be lost. Many firmwares offer a boot menu that can be activated at boot time. Usually, this can be reached by pressing the :kbd:`Esc` or :kbd:`F12` keys. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/iso_to_usb_stick_grub2_boot_from_iso.rst0000644000000000000000000001337215273675667025400 0ustar00.. _grub_boot_from_iso: Booting Live ISO Images from Grub2 ==================================== .. sidebar:: Abstract This page provides further information for handling ISO images built with {kiwi} and references the following articles: * :ref:`hybrid_iso` In {kiwi}, all generated ISO images are created to be hybrid. This means, the image can be used as a CD/DVD or as a disk. This works because the ISO image also has a partition table embedded. With more and more computers delivered without a CD/DVD drive, this becomes important. Writing this image to a USB stick will permanently erase all existing data on the device. Additionally, the stick will no longer be usable for general data storage. Most USB sticks are pre-formatted with a FAT32 or exFAT Windows filesystem, and to keep the existing data untouched, a different deployment needs to be used. Fortunately, Grub2 supports booting directly from ISO files. It does not matter whether it is installed on your computer's hard drive or on a USB stick. The following deployment process copies the ISO image as an additional file to the USB stick or hard drive. The ability to boot from the disk is configured through a Grub2 feature that allows you to loopback mount an ISO file and boot the kernel and initrd directly from the ISO file. The initrd loaded in this process must also be able to loopback mount the ISO file to access the root filesystem and boot the live system. FAT32 is widely supported on USB sticks. For hard drives, any filesystem supported by grub is also appropriate. The dracut initrd system used by {kiwi} provides this feature upstream, called "iso-scan/filename". Therefore, all {kiwi}-generated live ISO images support this deployment mode. The following procedure expects an existing Grub2 installation on your hard drive or USB stick. 1. Copy the ISO image to a folder of your choice on your hard drive. For example, create a folder called "iso" in the root of your hard drive and copy the ISO image there: .. code:: bash sudo mkdir /iso sudo cp some-kiwi-live.iso /iso/ 2. Look up the root filesystem UUID of your current operating system. Get this information by running the command: .. code:: bash findmnt -n -o UUID / 3. Add the following submenu setup to the :file:`grub.cfg` file: .. note:: Verify that the path to the ISO image is correct. Set your own menu name. The drive identification for Grub2 can be checked at boot time by pressing the 'c' key and typing 'ls'. The following example assumes a live ISO image for the x86_64 architecture. Adjust the paths to kernel and initrd if you have a different architecture. .. code:: bash menuentry "Boot from Live ISO" { load_video set gfxpayload=keep insmod gzio insmod part_gpt insmod iso9660 insmod btrfs insmod ext2 insmod xfs insmod lvm insmod loopback search --no-floppy --fs-uuid --set=root UUID_FROM_STEP_2 set isofile="/iso/some-kiwi-live.iso" set kernel="(loop)/boot/x86_64/loader/linux" set initrd="(loop)/boot/x86_64/loader/initrd" set options="rd.live.image root=live:CDLABEL=CDROM" loopback loop $isofile linux $kernel iso-scan/filename=$isofile $options initrd $initrd } 4. Restart your computer and select the added menu entry. .. note:: For USB sticks, the procedure is identical. You would install Grub2 on the USB drive and follow the steps above. However, it is uncommon to have Grub2 already installed on a USB stick. To simplify the setup, there are good helper tools such as `MultiOS-USB`. Booting Install ISO Images from Grub2 ------------------------------------- The install ISO image created for an OEM disk image via the `installiso="true"` attribute supports the "iso-scan/filename" feature as well. The procedure is the same as for live ISO images, only the boot options differ. The following example assumes the default install ISO volume ID `INSTALL`: .. code:: bash menuentry "Install from ISO" { load_video set gfxpayload=keep insmod gzio insmod part_gpt insmod iso9660 insmod btrfs insmod ext2 insmod xfs insmod lvm insmod loopback search --no-floppy --fs-uuid --set=root UUID_FROM_STEP_2 set isofile="/iso/some-kiwi.install.iso" set kernel="(loop)/boot/x86_64/loader/linux" set initrd="(loop)/boot/x86_64/loader/initrd" set options="cdinst=1 root=install:CDLABEL=INSTALL" loopback loop $isofile linux $kernel iso-scan/filename=$isofile $options initrd $initrd } Alternatively, the grub configuration of the ISO image itself can be used through the `loopback.cfg` file provided on all {kiwi} ISO images. The ISO path must be passed via the `iso_path` variable. Depending on the distribution, the grub directory on the ISO image is named `grub2` or `grub`: .. code:: bash menuentry "Install from ISO" { insmod loopback search --no-floppy --fs-uuid --set=root UUID_FROM_STEP_2 set iso_path="/iso/some-kiwi.install.iso" export iso_path loopback loop $iso_path configfile (loop)/boot/grub2/loopback.cfg } .. note:: ISO File on the Install Target Disk If the disk selected as installation target holds the ISO file, the installation would overwrite the ISO file while reading from it. In this case {kiwi} copies the ISO file into main memory and releases the disk before the image is dumped. Make sure the system has enough main memory to store the ISO file plus an additional 512 MB. If there is not enough memory available, the installation stops before the target disk is modified. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/legacy_netboot_root_filesystem.rst0000644000000000000000000003236415273675667024324 0ustar00.. _build_legacy_pxe: Build PXE Root Filesystem Image for the legacy netboot infrastructure ====================================================================== .. _PXE: https://en.wikipedia.org/wiki/Preboot_Execution_Environment .. _TFTP: https://en.wikipedia.org/wiki/Trivial_File_Transfer_Protocol .. _NBD: https://en.wikipedia.org/wiki/Network_block_device .. _AoE: https://en.wikipedia.org/wiki/ATA_over_Ethernet .. sidebar:: Abstract This page explains how to build a filesystem image for use with {kiwi}'s PXE boot infrastructure. It contains: * how to build a PXE filesystem image * how to set up the PXE filesystem image on the PXE server * how to run it with QEMU `PXE`_ is a network boot protocol that is shipped with most BIOS implementations. The protocol sends a DHCP request to get an IP address. When an IP address is assigned, it uses the `TFTP`_ protocol to download a Kernel and boot instructions. Contrary to other images built with {kiwi}, a PXE image consists of separate boot, kernel, and root filesystem images, since these images need to be made available in different locations on the PXE boot server. A root filesystem image that can be deployed via {kiwi}'s PXE netboot infrastructure represents the system's rootfs in a Linux filesystem. A user could loop mount the image and access the contents of the root filesystem. The image does not contain any information about the system disk, its partitions, or the bootloader setup. All of this information is provided by a client configuration file on the PXE server, which controls how the root filesystem image should be deployed. Many different deployment strategies are possible, e.g., root over `NBD`_ (network block device), `AoE`_ (ATA over Ethernet), or NFS for diskless and diskful clients. This particular example shows how to build an overlayfs-based union system based on openSUSE Leap for a diskless client that receives the squashfs- compressed root filesystem image in a ramdisk overlayed via overlayfs and writes new data into another ramdisk on the same system. As a diskless client, a QEMU virtual machine is used. .. compound:: **Things to know before** * To use the image, all image parts need to be copied to the PXE boot server. If you have not set up such a server, refer to :ref:`network-boot-server` for instructions. * The following example assumes you will create the PXE image on the PXE boot server itself (if not, use `scp` to copy the files to the remote host). * To let QEMU connect to the network, we recommend setting up a network bridge on the host system and letting QEMU connect to it via a custom :file:`/etc/qemu-ifup`. For details, see https://en.wikibooks.org/wiki/QEMU/Networking * The PXE root filesystem image approach is considered a legacy setup. The required netboot initrd code will be maintained outside of the {kiwi} appliance builder code base. If possible, we recommend switching to the OEM disk image deployment via PXE. 1. Build the image with {kiwi}: .. code:: bash $ sudo kiwi-ng --profile Flat system build \ --description kiwi/build-tests/{exc_description_pxe} \ --set-repo {exc_repo_tumbleweed} \ --target-dir /tmp/mypxe-result 2. Change into the build directory: .. code:: bash $ cd /tmp/mypxe-result 3. Copy the initrd and the kernel to :file:`/srv/tftpboot/boot`: .. code:: bash $ cp *.initrd /srv/tftpboot/boot/initrd $ cp *.kernel /srv/tftpboot/boot/linux 4. Copy the system image and its SHA256 sum to :file:`/srv/tftpboot/image`: .. code:: bash $ cp {exc_image_base_name_pxe}.x86_64-{exc_image_version_pxe} /srv/tftpboot/image $ cp {exc_image_base_name_pxe}.x86_64-{exc_image_version_pxe}.sha256 /srv/tftpboot/image 5. Adjust the PXE configuration file. The configuration file controls which kernel and initrd is loaded and which kernel parameters are set. A template has been installed at :file:`/srv/tftpboot/pxelinux.cfg/default` from the ``kiwi-pxeboot`` package. The minimal configuration required to boot the example image looks like the following: .. code:: bash DEFAULT KIWI-Boot LABEL KIWI-Boot kernel boot/linux append initrd=boot/initrd IPAPPEND 2 6. Create the image client configuration file: .. code:: bash $ vi /srv/tftpboot/KIWI/config.default IMAGE=/dev/ram1;{exc_image_base_name_pxe}.x86_64;{exc_image_version_pxe};192.168.100.2;4096 UNIONFS_CONFIG=/dev/ram2,/dev/ram1,overlay All PXE boot-based deployment methods are controlled by a client configuration file. The above configuration tells the client where to find the image and how to activate it. In this case, the image will be deployed into a ramdisk (`ram1`) and overlay mounted such that all write operations will land in another ramdisk (`ram2`). {kiwi} supports a variety of different deployment strategies based on the rootfs image created beforehand. For details, refer to :ref:`pxe_legacy_client_config`. 7. Connect the client to the network and boot. This can also be done in a virtualized environment using QEMU as follows: .. code:: bash $ sudo qemu -boot n -m 4096 .. _pxe_legacy_client_config: PXE Client Setup Configuration ------------------------------ All PXE boot-based deployment methods are controlled by configuration files located in :file:`/srv/tftpboot/KIWI` on the PXE server. Such a configuration file can either be client-specific (config.MAC_ADDRESS, for example config.00.AB.F3.11.73.C8), or generic (config.default). In an environment with heterogeneous clients, this allows for a default configuration suitable for the majority of clients, configurations suitable for a group of clients (for example, machines with similar or identical hardware), and individual configurations for selected machines. The configuration file contains data about the image and about configuration, synchronization, and partition parameters. The configuration file has the following general format: .. code:: bash IMAGE="device;name;version;srvip;bsize;compressed,...," DISK="device" PART="size;id;Mount,...,size;id;Mount" RAID="raid-level;device1;device2;..." AOEROOT=ro-device[,rw-device] NBDROOT="ip-address;export-name;device;swap-export-name;swap-device;write-export-name;write-device" NFSROOT="ip-address;path" UNIONFS_CONFIG="rw-partition,compressed-partition,overlay" CONF="src;dest;srvip;bsize;[hash],...,src;dest;srvip;bsize;[hash]" KIWI_BOOT_TIMEOUT="seconds" KIWI_KERNEL_OPTIONS="opt1 opt2 ..." REBOOT_IMAGE=1 RELOAD_CONFIG=1 RELOAD_IMAGE=1 .. note:: Quoting the Values The configuration file is sourced by Bash, so the same quoting rules as for Bash apply. Not all configuration options need to be specified. It depends on the setup of the client which configuration values are required. The following is a collection of client setup examples that cover all supported PXE client configurations. Setup Client with Remote Root ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ To serve the image from a remote location and redirect all write operations to a tmpfs, the following setup is required: .. code:: bash # When using AoE, see vblade toolchain for image export AOEROOT=/dev/etherd/e0.1 UNIONFS_CONFIG=tmpfs,aoe,overlay # When using NFS, see exports manual page for image export NFSROOT="192.168.100.2;/srv/tftpboot/image/root" UNIONFS_CONFIG=tmpfs,nfs,overlay # When using NBD, see nbd-server manual page for image export NBDROOT=192.168.100.2;root_export;/dev/nbd0 UNIONFS_CONFIG=tmpfs,nbd,overlay The above setup shows the most common use case where the image built with {kiwi} is populated over the network using either AoE, NBD, or NFS in combination with overlayfs, which redirects all write operations to be local to the client. In any case, a setup of either AoE, NBD, or NFS on the image server is required beforehand. Setup Client with System on Local Disk ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ To deploy the image on a local disk, the following setup is required: .. note:: In the referenced `{exc_description_pxe}` XML description, the `pxe` type must be changed as follows, and the image needs to be rebuilt: .. code:: xml .. code:: bash IMAGE="/dev/sda2;{exc_image_base_name_pxe}.x86_64;{exc_image_version_pxe};192.168.100.2;4096" DISK="/dev/sda" PART="5;S;X,X;L;/" The setup above will create a partition table on `sda` with a 5MB swap partition (no mountpoint), and the rest of the disk will be a Linux(L) partition with `/` as its mountpoint. The (`X`) in the `PART` setup specifies a placeholder to indicate the default behavior. Setup Client with System on Local MD RAID Disk ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ To deploy the image on a local disk with a prior software RAID configuration, the following setup is required: .. note:: In the referenced `{exc_description_pxe}` XML description, the `pxe` type must be changed as follows, and the image needs to be rebuilt: .. code:: xml .. code:: bash RAID="1;/dev/sda;/dev/sdb" IMAGE="/dev/md1;{exc_image_base_name_pxe}.x86_64;{exc_image_version_pxe};192.168.100.2;4096" PART="5;S;x,x;L;/" The first parameter of the RAID line is the RAID level. So far, only raid1 (mirroring) is supported. The second and third parameters specify the raid disk devices that make up the array. If a `RAID` line is present, all partitions in `PART` will be created as RAID partitions. The first RAID is named `md0`, the second one `md1`, and so on. It is required to specify the correct RAID partition in the `IMAGE` line according to the `PART` setup. In this case, `md0` is reserved for the SWAP space, and `md1` is reserved for the system. Setup Loading of Custom Configuration File(s) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ To load, for example, a custom :file:`/etc/hosts` file on the client, the following setup is required: .. code:: bash CONF="hosts;/etc/hosts;192.168.1.2;4096;ffffffff" On boot of the client, {kiwi}'s boot code will fetch the :file:`hosts` file from the root of the server (192.168.1.2) with 4k blocksize and deploy it as :file:`/etc/hosts` on the client. The protocol is tftp by default but can be changed via the `kiwiservertype` kernel command-line option. For details, see :ref:`custom-download-server`. Setup Client to Force Reload Image ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ To force the reload of the system image even if the image on the disk is up-to-date, the following setup is required: .. code:: bash RELOAD_IMAGE=1 The option only applies to configurations with a `DISK`/`PART` setup. Setup Client to Force Reload Configuration Files ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ To force the reload of all configuration files specified in CONF, the following setup is required: .. code:: bash RELOAD_CONFIG=1 By default, only configuration files that have changed according to their checksum value will be reloaded. With the above setup, all files will be reloaded from the PXE server. The option only applies to configurations with a `DISK`/`PART` setup. Setup Client for Reboot After Deployment ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ To reboot the system after the initial deployment process is done, the following setup is required: .. code:: bash REBOOT_IMAGE=1 Setup custom kernel boot options ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ To deactivate the kernel mode setting on the local boot of the client, the following setup is required: .. code:: bash KIWI_KERNEL_OPTIONS="nomodeset" .. note:: This does not influence the kernel options passed to the client if it boots from the network. To set up those, the PXE configuration on the PXE server needs to be changed. Setup a Custom Boot Timeout ~~~~~~~~~~~~~~~~~~~~~~~~~~~ To set up a 10-second custom timeout for the local boot of the client, the following setup is required. .. code:: bash KIWI_BOOT_TIMEOUT="10" .. note:: This does not influence the boot timeout if the client boots from the network. .. _custom-download-server: Setup a Different Download Protocol and Server ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ By default, all downloads controlled by the {kiwi} linuxrc code are performed by an atftp call using the TFTP protocol. With PXE, the download protocol is fixed, and thus you cannot change the way the kernel and the boot image (:file:`initrd`) are downloaded. As soon as Linux takes over, the download protocols http, https, and ftp are also supported. {kiwi} uses the `curl` program to support the additional protocols. To select one of the additional download protocols, the following kernel parameters need to be specified: .. code:: bash kiwiserver=192.168.1.1 kiwiservertype=ftp To set up these parameters, edit the file :file:`/srv/tftpboot/pxelinux.cfg/default` on your PXE boot server and change the append line accordingly. .. note:: Once configured, all downloads except for kernel and initrd are now controlled by the given server and protocol. You need to make sure that this server provides the same directory and file structure as initially provided by the `kiwi-pxeboot` package. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/network_live_iso_boot.rst0000644000000000000000000001261415273675667022420 0ustar00.. _network_live_boot: Booting a Live ISO Image from Network ===================================== .. sidebar:: Abstract This page provides further information for handling ISO images built with {kiwi} and references the following articles: * :ref:`hybrid_iso` In {kiwi}, live ISO images can be configured to boot via the PXE boot protocol. This functionality requires a network boot server setup on the system. Details on how to set up such a server can be found in :ref:`network-boot-server`. After the live ISO is built as shown in :ref:`hybrid_iso`, the following configuration steps are required to boot from the network: 1. Extract initrd/kernel from Live ISO The PXE boot process loads the configured kernel and initrd from the PXE server. For this reason, these two files must be extracted from the live ISO image and copied to the PXE server as follows: .. code:: bash $ mount {exc_image_base_name_live}.x86_64-{exc_image_version}.iso /mnt $ cp /mnt/boot/x86_64/loader/initrd /srv/tftpboot/boot/initrd $ cp /mnt/boot/x86_64/loader/linux /srv/tftpboot/boot/linux $ umount /mnt .. note:: This step must be repeated with any new build of the live ISO image. 2. Export Live ISO to the Network Access to the live ISO file must be provided by either `ftp`, `http`, `https`, or `dolly`. The simplest method is to set up an FTP server, e.g., `vsftpd`, and copy the live ISO file to the data directory: .. code:: bash $ mkdir -p /srv/ftp/image $ cp {exc_image_base_name_live}.x86_64-{exc_image_version}.iso /srv/ftp/image .. note:: Check if the image can be downloaded via: `wget ftp://IP/image/{exc_image_base_name_live}.x86_64-{exc_image_version}.iso` before the next step. 3. Set up live ISO boot entry in PXE configuration .. note:: The following step assumes that the `pxelinux.0` loader has been configured on the boot server to boot up network clients. Edit the file :file:`/srv/tftpboot/pxelinux.cfg/default` and create a boot entry of the form: .. code:: bash LABEL Live-Boot kernel boot/linux append initrd=boot/initrd ip=dhcp root=live:ftp://IP/image/{exc_image_base_name_live}.x86_64-{exc_image_version}.iso * The `ip=` parameter controls how the dracut network module sets up the network. Several options exist to control how the network interface should be set up. Please consult the dracut manual for further information. * The boot parameter `root=live:PROTOCOL://IP/PATH...` specifies the remote endpoint and protocol to find the live ISO file. So far, `ftp`, `http`, `https`, and `dolly` are supported. 4. Boot from the Network Within the network that has access to the PXE server and the IP in the `root=` option, any network client can now boot the live system. A test based on QEMU can be done as follows: .. code:: bash $ qemu -boot n Available Remote Boot Options ----------------------------- The following kernel boot options are available to control the behavior of the remote boot process. rd.kiwi.live.curl_options= Options passed along to the curl call rd.kiwi.live.dolly_options= Options passed along to the dolly call rd.kiwi.live.system= Block device to use for the system. By default, this is set to `/dev/ram0`. ramdisk_size=kbytes Size of the ramdisk in kilobytes; the value is passed to the kernel `brd` module as `rd_size`. By default, this is set to 2097152, which is 2 GiB. rd.kiwi.live.reset Force reset of the live system. This option only makes sense if the live system device (rd.kiwi.live.system) points to a persistent storage device. In this case, {kiwi} loads the system only once and does not overwrite it unless a reset is requested. Persistent Live System ---------------------- The remote boot process of a live ISO image places the ISO file into a ramdisk by default. This means all data lives in memory and is not persistent. To boot the live system from a remote location and keep it on persistent storage, it's required to pass the `rd.kiwi.live.system` boot option with the device name pointing to that persistent storage. .. warning:: All data on the device given via `rd.kiwi.live.system` will be wiped. A test based on QEMU can be done as follows: Edit the file :file:`/srv/tftpboot/pxelinux.cfg/default` and create a boot entry of the form: .. code:: bash LABEL Live-Boot kernel boot/linux append initrd=boot/initrd ip=dhcp root=live:ftp://IP/image/{exc_image_base_name_live}.x86_64-{exc_image_version}.iso ramdisk_size=3545728 rd.kiwi.live.system=/dev/sda rd.live.overlay.persistent rd.live.overlay.cowfs=xfs * The `rd.live.overlay.persistent` and `rd.live.overlay.cowfs=xfs` options are standard {kiwi} live ISO options to control if and how a persistent write partition should be created. The options only take effect when booting into a persistent storage device. Next, create a persistent storage disk of 3G and attach it to the QEMU instance. .. code:: bash $ qemu-img create mydisk.raw 3G $ qemu -boot n -hda mydisk.raw The live system will be deployed once to the locally attached disk and will boot from it. Any subsequent boot process will not modify the local disk unless `rd.kiwi.live.reset` is passed on the kernel command line. If deployed, there is no need for the network anymore, and the system could also boot standalone. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/network_overlay_boot.rst0000644000000000000000000001206115273675667022264 0ustar00.. _network_overlay_boot: Booting a Root Filesystem from Network ====================================== .. sidebar:: Abstract This page provides further information for handling KIS images built with {kiwi} and references the following article: * :ref:`kis` In {kiwi}, the `kiwi-overlay` dracut module can be used to boot from a remote exported root filesystem. The exported device is visible as a block device on the network client. {kiwi} supports the two export backends, `NBD` (Network Block Device) and `AoE` (ATA over Ethernet), for this purpose. A system that is booted in this mode will read the contents of the root filesystem from a remote location and target any write action into RAM by default. The kernel cmdline option `rd.root.overlay.write` can be used to specify an alternative device to use for writing. The two layers (read and write) are combined using the `overlayfs` filesystem. For remote boot of a network client, the PXE boot protocol is used. This functionality requires a network boot server setup on the system. Details on how to set up such a server can be found in :ref:`network-boot-server`. Before the KIS image can be built, the following configuration step is required: * Create dracut configuration to include the `kiwi-overlay` module .. code:: bash $ cd kiwi/build-tests/{exc_description_kis} $ mkdir -p root/etc/dracut.conf.d $ cd root/etc/dracut.conf.d $ echo 'add_dracutmodules+=" kiwi-overlay "' > overlay.conf Now, the KIS image can be built as shown in :ref:`kis`. After the build, the following configuration steps are required to boot from the network: 1. Copy the initrd/kernel from the KIS build to the PXE server The PXE boot process loads the configured kernel and initrd from the PXE server. For this reason, the following files must be copied to the PXE server as follows: .. code:: bash $ cp *.initrd /srv/tftpboot/boot/initrd $ cp *.kernel /srv/tftpboot/boot/linux 2. Export Root FileSystem to the Network Access to the root filesystem is implemented using either the AoE or the NBD protocol. This requires the export of the root filesystem image as a remote block device: Export via AoE: Install the `vblade` package on the system that is expected to export the root filesystem. .. note:: Not all versions of AoE are compatible with any kernel. This means the kernel on the system exporting the root filesystem image must provide a compatible aoe kernel module compared to the kernel used inside of the root filesystem image. Once done, export the filesystem from the KIS build above as follows: .. code:: bash $ vbladed 0 1 IFACE {exc_image_base_name_kis}.x86_64-{exc_image_version_kis} The above command exports the given filesystem image file as a block storage device to the network of the given `IFACE`. On any machine except the one exporting the file, it will appear as :file:`/dev/etherd/e0.1` once the `aoe` kernel module has been loaded. The two numbers, 0 and 1 in the above example, classify a major and minor number that is used in the device node name on the reading side, in this case, :file:`e0.1`. .. note:: Only machines in the same network of the given `IFACE` can see the exported block device. Export via NBD: Install the `nbd` package on the system that is expected to export the root filesystem. Once done, export the filesystem from the KIS build above as follows: .. code:: bash $ losetup /dev/loop0 {exc_image_base_name_kis}.x86_64-{exc_image_version_kis} $ vi /etc/nbd-server/config [generic] user = root group = root [export] exportname = /dev/loop0 $ nbd-server 3. Setup boot entry in the PXE configuration .. note:: The following step assumes that the `pxelinux.0` loader has been configured on the boot server to boot up network clients. Edit the file :file:`/srv/tftpboot/pxelinux.cfg/default` and create a boot entry of the form: Using NBD: .. code:: bash LABEL Overlay-Boot kernel boot/linux append initrd=boot/initrd root=overlay:nbd=server-ip:export The boot parameter `root=overlay:nbd=server-ip:export` specifies the NBD server's IP address and the name of the export as used in :file:`/etc/nbd-server/config`. Using AoE: .. code:: bash LABEL Overlay-Boot kernel boot/linux append initrd=boot/initrd root=overlay:aoe=AOEDEVICE The boot parameter `root=overlay:aoe=AOEDEVICE` specifies the AoE device name below :file:`/dev/etherd` as it was exported by the `vbladed` command, for example, `e0.1`. 4. Boot from the Network Within the network that has access to the PXE server and the exported root filesystem image, any network client can now boot the system. A test based on QEMU can be done as follows: .. code:: bash $ sudo qemu -boot n ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/setup_network_bootserver.rst0000644000000000000000000000771315273675667023202 0ustar00.. _network-boot-server: Setting Up a Network Boot Server ================================ .. sidebar:: Abstract This page provides general information on how to set up a network boot server that provides all services needed for the PXE boot protocol. To be able to deploy a system through the PXE boot protocol, you need to set up a network boot server providing the services DHCP and TFTP. With `dnsmasq`, a utility exists that allows you to set up all needed services at once: Installing and Configuring DHCP and TFTP with dnsmasq ----------------------------------------------------- The following instructions can only serve as an example. Depending on your network structure, the IP addresses, ranges, and domain settings need to be adapted to allow the DHCP server to work within your network. If you already have a DHCP server running in your network, make sure that the `filename` and `next-server` directives are correctly set on this server. The following steps describe how to set up dnsmasq to work as DHCP and TFTP server. 1. Install the `dnsmasq` package. 2. Create the file :file:`/etc/dnsmasq.conf` and insert the following content: .. code:: bash # Do not function as a DNS server. port=0 # Log information about DHCP transactions. log-dhcp # Set the root directory for files available via TFTP, # usually "/srv/tftpboot": tftp-root=TFTP_ROOT_DIR enable-tftp dhcp-range=BOOT_SERVER_IP,proxy In the next step, it's required to decide on the boot method. There is the PXE loader provided via `pxelinux.0` from the `syslinux` package, and there is the GRUB loader provided via the `grub` package. .. note:: Placeholders Replace all placeholders (written in uppercase) with data fitting your network setup. 2.1. Insert the following content to use `pxelinux.0`: .. code:: bash # The boot filename, server name, and server IP address dhcp-boot=pxelinux.0,,BOOT_SERVER_IP # Disable re-use of the DHCP servername and filename fields as extra # option space. This is to avoid confusing some old or broken # DHCP clients. dhcp-no-override # PXE menu. The first part is the text displayed to the user. # The second is the timeout, in seconds. pxe-prompt="Booting FOG Client", 1 # The known types are x86PC, PC98, IA64_EFI, Alpha, Arc_x86, # Intel_Lean_Client, IA32_EFI, BC_EFI, Xscale_EFI and X86-64_EFI # This option is first and will be the default if there is no input # from the user. pxe-service=X86PC, "Boot to FOG", pxelinux.0 pxe-service=X86-64_EFI, "Boot to FOG UEFI", ipxe pxe-service=BC_EFI, "Boot to FOG UEFI PXE-BC", ipxe .. note:: On boot of a network client with that configuration, the default `pxelinux.0` config file is expected at :file:`TFTP_ROOT_DIR/pxelinux.cfg/default` 2.2. Insert the following content to use GRUB: .. code:: bash # The boot filename, server name, and server IP address dhcp-boot=boot/grub2/i386-pc/core.0,,BOOT_SERVER_IP When using GRUB, the referenced `dhcp-boot` GRUB module must be generated. To do this, change the directory to :file:`TFTP_ROOT_DIR` and create the :file:`setvars.conf` file with the following content: .. code:: bash set root=(tftp) set net_default_server=BOOT_SERVER_IP set prefix=boot/grub2 Now, call the following commands to create the GRUB module: .. code:: bash $ grub2-mknetdir --net-directory=TFTP_ROOT_DIR --subdir=boot/grub2 $ grub2-mkimage -O i386-pc-pxe \ --output boot/grub2/i386-pc/core.0 \ --prefix=/boot/grub2 \ -c setvars.conf \ pxe tftp .. note:: On boot of a network client with that configuration, the GRUB config file is expected at :file:`TFTP_ROOT_DIR/boot/grub2/grub.cfg` 3. Run the dnsmasq server by calling: .. code:: bash systemctl start dnsmasq ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/example_use_cases/use_suse_media.rst0000644000000000000000000000404515273675667021004 0ustar00.. _suse_media: Using SUSE Product ISO To Build =============================== .. sidebar:: Abstract This page provides information on how to use the SUSE media ISO with {kiwi}. When building an image with {kiwi}, the image description usually points to a number of public/private package source repositories from which the new image root tree will be created. Alternatively, the vendor-provided product ISO image(s) can be used. The contents of the ISO (DVD) media also provide package source repositories but are organized in a vendor-specific structure. As a user, it's important to know about this structure so that the {kiwi} image description can consume it. To use a SUSE product media, the following steps are required: 1. Mount the ISO media from the file or DVD drive: .. code:: bash $ sudo mount Product_ISO_file.iso|DVD_drive /media/suse 2. Look up all `Product` and `Module` directories: Below `/media/suse`, there is a directory structure that provides package repositories in directories starting with `Product-XXX` and `Module-XXX`. It depends on the package list in the {kiwi} image description from which location a package or a dependency of the package is taken. Therefore, it is best practice to browse through all the directories and create a `` definition for each of them in the {kiwi} image description, as the following example shows: .. code:: xml Once all the individual product and module repos have been created in the {kiwi} image description, the build process can be started as usual. .. note:: Because of the manual mount process, the `/media/suse` location stays busy after {kiwi} has created the image. The cleanup of this resource is the responsibility of the user and not done by {kiwi}. ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.735329 kiwi-11.1.8/doc/source/example_use_cases.rst0000644000000000000000000000270415273675667016012 0ustar00Examples ======== .. note:: This chapter collects practical KIWI examples for image creation, deployment, and customization. All images provided for testing use the root password `linux`. .. toctree:: :maxdepth: 1 example_use_cases/build_live_iso example_use_cases/build_simple_disk example_use_cases/build_expandable_disk example_use_cases/build_container_image example_use_cases/build_wsl_container example_use_cases/build_kis example_use_cases/build_enclave example_use_cases/iso_to_usb_stick_deployment example_use_cases/iso_to_usb_stick_file_based_deployment example_use_cases/iso_to_usb_stick_grub2_boot_from_iso example_use_cases/disk_setup_for_ec2 example_use_cases/disk_setup_for_azure example_use_cases/disk_setup_for_google example_use_cases/disk_setup_for_vagrant example_use_cases/disk_setup_for_luks example_use_cases/disk_ramdisk_deployment example_use_cases/custom_partitions example_use_cases/custom_volumes example_use_cases/clone_partitions example_use_cases/setup_network_bootserver example_use_cases/legacy_netboot_root_filesystem example_use_cases/network_overlay_boot example_use_cases/network_live_iso_boot example_use_cases/custom_fstab_extension example_use_cases/build_with_profiles example_use_cases/build_in_buildservice example_use_cases/use_suse_media example_use_cases/build_without_debianbootstrap example_use_cases/integration_testing.rst ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7363155 kiwi-11.1.8/doc/source/image_description/elements.rst0000644000000000000000000031414315273675667017631 0ustar00.. _image-description-elements: Schema Reference ================ .. note:: This document is the exhaustive reference for the {kiwi} image description schema in :file:`kiwi/schema/kiwi.rnc` for version |version|. .. contents:: Schema sections :local: :depth: 2 The sections are documented in the same order as they appear below the :ref:`sec.image` root element. Use :doc:`/image_description` for the guided introduction and this page when you need the complete list of valid elements and attributes. .. _sec.image: ------- The top level of any {kiwi} image description. .. code:: xml The image definition starts with an image tag and requires the schema format at version {schema_version}. The attribute name specifies the name of the image, which is also used for the filenames created by KIWI. Because we don’t want spaces in filenames, the name attribute must not have any spaces in its name. The following optional attributes can be inserted in the image tag: displayname Allows setting up the boot menu title for the selected boot loader. So you can have *suse-SLED-foo* as the image name but a different name as the boot display name. Spaces are not allowed in the display name because it causes problems for some boot loaders, and kiwi did not take the effort to separate the ones that can display them correctly from the ones that can't. id sets an identification number that appears as file ``/etc/ImageID`` within the image. .. _sec.include: --------- Optional include of XML file content from a file. .. code:: xml with file :file:`description.xml` as follows: .. code:: xml name contact text This will replace the `include` statement with the contents of :file:`description.xml`. The validation of the result happens after the inclusion of all `include` references. The value for the `from` attribute is interpreted as a URI. As of now, only local URI types are supported, as well as the `this://` resource locator, which translates into the path to the KIWI image description. .. note:: The include information must be embedded into an `` root node. Only the inner elements of the root node will be included. The processing of XML data via XSLT always requires a root node, which is the reason why this is required to be specified for include files as well. .. note:: Nesting of include statements in other include files is not supported. This will lead to unresolved include statements in the final document and will cause the runtime checker to complain about it. .. note:: The include is implemented via an XSLT stylesheet and therefore expects an XML document. Other markup formats are not supported as an include reference. .. _sec.description: ------------- Provide an image identity. .. code:: xml name contact text The mandatory description section contains information about the creator of this image description. The attribute `type` could be either of the value `system`, which indicates this is a system image description, or a value `boot` for custom kiwi boot image descriptions. The following optional subsections can be inserted below the description tag: license Specifies the license name that applies to this image description. .. _sec.certificates: -------------- Add a cert-file to the directory storing additional local CA certificates. The import will occur immediately after the bootstrap process, where the required CA update tooling is expected to be installed. This setting is useful for situations where certificates are not packaged, or the certificates are required during the build process, e.g., due to proxy servers in the build environment that need certificates in chroot. The required `target_distribution` attribute must be set to allow kiwi a correct matching for the CA store path and the update tool with regard to the image's target distribution. The following settings apply: +--------------+-------------------------------------------+------------------------+ | Distributor | CA Store | Update Tool | +==============+===========================================+========================+ | SUSE | /etc/pki/trust/anchors | update-ca-certificates | +--------------+-------------------------------------------+------------------------+ | Red Hat | /etc/pki/ca-trust/source/anchors | update-ca-trust | +--------------+-------------------------------------------+------------------------+ | Debian Based | /usr/local/share/ca-certificates | update-ca-certificates | +--------------+-------------------------------------------+------------------------+ | Arch Linux | /etc/ca-certificates/trust-source/anchors | update-ca-trust | +--------------+-------------------------------------------+------------------------+ .. code:: xml The `certificates` element may be specified at most once and accepts the following optional attribute: profiles="profile_a,profile_b" Import the listed certificates only when one of the listed build profiles is active (see :ref:`sec.profiles`). .. _sec.preferences: ------------- Set up image type and layout. .. code:: xml 1.2.3 zypper The mandatory preferences section contains information about the supported image type(s), the used package manager, the version of this image, and further optional elements. The preferences element may be provided multiple times and accepts the following optional attributes: arch="arch_name[,arch_name]" Use this preferences section only when building on one of the listed host architectures, as reported by :command:`uname -m`. profiles="profile_a,profile_b" Use this preferences section only when one of the listed build profiles is active (see :ref:`sec.profiles`). Preferences sections without a `profiles` attribute apply in any case and are combined with the profiled ones. ~~~~~~~~~~~~~~~~~~~~~~ The mandatory image version must be a three-part version number of the format: **Major**.\ **Minor**.\ **Release**. In case of changes to the image description, the following rules should apply: * For smaller image modifications that do not add or remove any new packages, only the release number is incremented. The XML description file(``config.xml``) remains unchanged. * For image changes that involve the addition or removal of packages, the minor number is incremented, and the release number is reset. * For image changes that change the behavior or geometry of the image file, the major number is incremented. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ The mandatory `packagemanager` element specifies which package manager should be used to handle software packages. The `packagemanager` setup is connected to the distribution used to build the image. The following table shows which package manager is connected to which distributor: +--------------+-----------------+ | Distributor | Package Manager | +==============+=================+ | SUSE | zypper | +--------------+-----------------+ | Red Hat | dnf4 / dnf5 / | | | microdnf | +--------------+-----------------+ | Debian Based | apt | +--------------+-----------------+ | Arch Linux | pacman | +--------------+-----------------+ | Alpine Linux | apk | +--------------+-----------------+ In general, the specification of one preferences section is sufficient. However, it’s possible to specify multiple preferences sections and distinguish between the sections via the `profiles` attribute (see :ref:`sec.profiles`). In combination with the above, the preferences element supports the following optional elements: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ locale-filtering can be set to "true" or "false". If set to "true", it sets the `install_lang` macro for RPM-based installations to the RPM- configured locale list. This results in language-specific files being filtered out by `rpm` if they don't match the configured list. .. code:: xml true .. note:: It depends on the individual package design if the `install_lang` macro contents apply to the package or not. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Specifies whether package signatures should be checked or not. .. code:: xml true ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Specifies whether files marked as documentation should be skipped during installation. .. code:: xml true ~~~~~~~~~~~~~~~~~~~~~~~ Specifies the name of the console keymap to use. The value corresponds to a map file in `/usr/share/kbd/keymaps/xkb`. .. code:: xml us ~~~~~~~~~~~~~~~~~~~~~~~ Specifies the time zone. Available time zones are located in the `/usr/share/zoneinfo` directory. Specify the attribute value relative to `/usr/share/zoneinfo`. For example, specify `Europe/Berlin` for `/usr/share/zoneinfo/Europe/Berlin`. .. code:: xml Europe/Berlin ~~~~~~~~~~~~~~~~~~~~~ Specifies the name of the UTF-8 locale to use, which defines the contents of the `RC_LANG` system environment variable used in the image and to run the custom scripts specified as part of the {kiwi} image description. Please note, only UTF-8 locales are supported here, which also means that the encoding must *not* be part of the locale information. This means you need to specify the locale using the 4-digit name, like the following example: `en_US` or `en_US,de_DE`. .. code:: xml en_US ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Specifies the name of the plymouth bootsplash theme to use. .. code:: xml bgrt ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Specifies the name of the bootloader theme to use if that used bootloader has theme support. .. code:: xml openSUSE Along with the version and the packagemanager, at least one image type element must be specified to indicate which image type should be built. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Specifies the distribution's global release version as consumed by package managers. Currently, the release version is not set or set to `0` for package managers that require a value to operate. With the optional `release-version` section, users have an opportunity to specify a custom value which is passed along the package manager to define the distribution release. .. note:: The release version information is currently used in dnf/dnf5 and microdnf package managers only. It might happen that it gets applied to the other package manager backends as well. This will happen on demand, though. ~~~~~~~~~~~~~~~~~~~~~~~~~~ Specifies the name of a license to be displayed in a dialog window at boot time. The element may be provided multiple times to show more than one license. .. code:: xml license_name ~~~~~~~~~~~~~~~~~~~ At least one type element must be configured. It is possible to specify multiple type elements in a preferences block. To set a given type description as the default image, use the boolean attribute `primary` and set its value to `true`: .. code:: xml The image type to be created is determined by the value of the image attribute. The following list describes the supported types and possible values of the image attribute: image="tbz" A simple tar archive image. The `tbz` type packs the contents of the image root tree into an xz-compressed tarball. image="btrfs|ext2|ext3|ext4|squashfs|erofs|xfs" A filesystem image. The image root tree data is packed into a filesystem image of the given type. An image of that type can be loop-mounted and accessed according to the capabilities of the selected filesystem. image="iso" An ISO image that can be dumped on a CD/DVD or USB stick and boots from this media without interfering with other system storage components. A useful pocket system for testing, demo, and debugging purposes. image="oem" An image representing an expandable system disk. This means after deployment, the system can resize itself to the new disk geometry. The resize operation is configurable as part of the image description, and an installation image for CD/DVD, USB stick, and network deployment can be created in addition. For use in cloud frameworks like Amazon EC2, Google Compute Engine, or Microsoft Azure, this disk type also supports the common virtual disk formats. image="docker" An archive image suitable for the Docker container engine. The image can be loaded via the `docker load` command and works within the scope of the container engine. image="oci" An archive image that builds a container matching the OCI (Open Container Initiative) standard. The container should be able to run with any OCI-compliant container engine. image="appx" An archive image suitable for the Windows Subsystem for Linux container engine. The image can be loaded from a Windows System that has support for WSL activated. image="wsl" An archive image suitable for the Windows Subsystem for Linux container engine >= v2.4.4. The image represents a gzip-compressed tar file as described in https://learn.microsoft.com/en-us/windows/wsl/build-custom-distro and can be loaded from a Windows System that has support for WSL in that version activated. image="kis" An optional root filesystem image associated with a kernel and initrd. The use case for this component image type is highly customizable. Many different deployment strategies are possible. image="pxe" The legacy network boot image type, superseded by `kis`. It builds the same kernel, initrd and root filesystem components but defaults to the {kiwi} initrd system rather than dracut. image="cpio" A cpio archive of the image root tree, as used for an initrd. image="enclave" An AWS Nitro Enclave image. Requires `enclave_format="aws-nitro"`. See :ref:`eif`. The complete set of accepted values is `btrfs`, `cpio`, `docker`, `enclave`, `erofs`, `ext2`, `ext3`, `ext4`, `iso`, `kis`, `oci`, `oem`, `pxe`, `squashfs`, `tbz`, `wsl`, `xfs` and `appx`. For completion of a type description, there could be several other optional attributes and child elements. The `type` element supports a plethora of optional attributes; some of these are only relevant for certain build types and will be covered in extra chapters that describe the individual image types in more detail. Certain attributes are, however, useful for nearly all build types and will be covered next: bootpartition="true|false": A boolean parameter notifying {kiwi} whether an extra boot partition should be used or not (the default depends on the current layout). This will override {kiwi}'s default layout. Only available for the `oem` type. bootpartsize="nonNegativeInteger": For images with a separate boot partition, this attribute specifies the size in MB. If not set, the boot partition size is set to 300 MB. Only available for the `oem` type. eficsm="true|false": For images with an EFI layout, specify if the legacy CSM (BIOS) mode should be supported or not. By default, CSM mode is enabled. Only available for the `oem` and `iso` types. efipartsize="nonNegativeInteger": For images with an EFI fat partition, this attribute specifies the size in MB. If not set, the EFI partition size is set to 20 MB. Only available for the `oem` type. efimountoptions="option_string": For images with an EFI fat partition, this attribute specifies the mount options of the EFI partition as written to :file:`/etc/fstab`, for example `umask=0077,shortname=winnt`. If not set, the `defaults` mount option is used. Only available for the `oem` type. efifatimagesize="nonNegativeInteger": For ISO images (live and install), the EFI boot requires an embedded FAT image. This attribute specifies the size in MB. If not set, the FAT image size is set to 20 MB. Only available for the `oem` and `iso` types. efiparttable="msdos|gpt": For images with an EFI firmware, specifies the partition table type to use. If not set, it defaults to the GPT partition table type. Only available for the `oem` and `iso` types. dosparttable_extended_layout="true|false": For OEM disk images, specifies to make use of logical partitions inside of an extended one. If set to true and if the msdos table type is active, this will cause the fourth partition to be an extended partition, and all following partitions will be placed as logical partitions inside of that extended partition. This setting is useful if more than 4 primary partitions need to be created in an msdos table. Only available for the `oem` type. btrfs_quota_groups="true|false": A boolean parameter to activate filesystem quotas if the filesystem is `btrfs`. By default, quotas are inactive. Only available for the `oem` type. btrfs_set_default_volume="true|false": For OEM disk images using the btrfs filesystem, this requests to set a default volume for the rootfs, which is used when the filesystem gets mounted. In case a `true` value is provided or the attribute is not specified at all, kiwi will make a volume the default volume. This can be either `/` or the configured root subvolume or the configured root snapshot. Consequently, the entry created for the rootfs in the `/etc/fstab` file will not contain any specific volume definition. In case a `false` value is provided, kiwi will not set any default volume, which also means that the entry for the rootfs in the `/etc/fstab` file requires a volume definition which is placed by kiwi as a `subvol=` parameter in the respective fstab field entry. In addition, the parameter `rootflags=subvol=` is added to the kernel commandline such that early initrd code has a chance to know about the rootfs volume. btrfs_root_is_subvolume="true|false": Tell kiwi to create a root volume to host (/) inside. The name of this subvolume is, by default, set to: `@`. The name of the subvolume can be changed via a volume entry of the form: .. code:: xml By default, the creation of a top-level volume is set to `true`. Only available for the `oem` type. btrfs_root_is_snapper_snapshot="true|false": A boolean parameter that tells {kiwi} to install the system into a btrfs snapshot. The snapshot layout is compatible with the snapper management toolkit and follows a concept by SUSE. By default, snapshots are turned off. Only available for the `oem` type. btrfs_root_is_readonly_snapshot="true|false": A boolean parameter notifying {kiwi} that the btrfs root filesystem snapshot has to be made read-only. If this option is set to true, the root filesystem snapshot will be turned into read-only mode once all data has been placed in it. The option is only effective if `btrfs_root_is_snapper_snapshot` is also set to true. By default, the root filesystem snapshot is writable. Only available for the `oem` type. compressed="true|false": Specifies whether the root filesystem image should be xz-compressed or not. Only available for the `pxe` and `kis` types. If set to `true`, the tar archive that contains the build results is not compressed again; otherwise, the tar archive is xz-compressed. archive="true|false": Specifies whether the image output file should be an archive or not. This option is only available for the `kis` type. When set to `true`, all image build results will be placed into an archive file. When set to `false`, the build results will stay as individual files in the build directory. The default is `true`. editbootconfig="file_path": Specifies the path to a script that is called right before the bootloader is installed. The script runs relative to the directory that contains the image structure. Only available for the `oem` and `iso` types. editbootinstall="file_path": Specifies the path to a script that is called right after the bootloader is installed. The script runs relative to the directory that contains the image structure. Only available for the `oem` type. filesystem="btrfs|ext2|ext3|ext4|squashfs|erofs|xfs": The root filesystem. Available for the `oem`, `pxe`, `kis` and `iso` types, and **required** for the `oem` type. firmware="efi|uefi|bios|ec2|ofw|opal|custom": Specifies the boot firmware of the appliance. This attribute is used to differentiate the image according to the firmware which boots up the system. It mostly impacts the disk layout and the partition table type. By default, `bios` is used on x86, `ofw` on PowerPC, and `efi` on ARM, RISC-V and LoongArch. Only available for the `oem`, `pxe` and `iso` types. * `efi` Standard EFI layout. * `uefi` Standard EFI layout for secure boot. * `bios` Standard BIOS layout for x86. * `ec2` Standard BIOS layout for x86 using Xen grub modules for old- style Xen boot in Amazon EC2. * `ofw` Standard PPC layout. * `opal` Standard openPOWER PPC64 layout. kexec-based boot process. * `custom` The firmware setup is entirely provided by custom scripts and {kiwi} takes no further action. force_mbr="true|false": A boolean parameter to force the usage of an MBR partition table even if the system would default to GPT. This is occasionally required on ARM systems that use an EFI partition layout but must not be stored in a GPT. Note that forcing an MBR partition table incurs limitations with respect to the number of available partitions and their sizes. Only available for the `oem` type. apply_dps_codes="true|false": A boolean parameter to apply the partition type codes of the `Discoverable Partitions Specification `_ (DPS) to the partitions of a GPT which match a DPS partition type, e.g the root partition gets the root partition type of the image architecture and the boot partition the extended boot loader (XBOOTLDR) type. The type codes are taken from `systemd-id128 show` on the build host, or from a built-in table if it is not available. By default the type codes are not applied and the partitions keep the type of their purpose, e.g Linux filesystem data for the root partition. Only available for the `oem` type. fsmountoptions="option_string": Specifies the filesystem mount options that are passed via the `-o` flag to :command:`mount` and are included in :file:`/etc/fstab`. fscreateoptions="option_string": Specifies the filesystem options used to create the filesystem. In {kiwi}, the filesystem utility to create a filesystem is called without any custom options. The default options are filesystem- specific and are provided along with the package that provides the filesystem utility. For the Linux `ext[234]` filesystem, the default options can be found in the :file:`/etc/mke2fs.conf` file. Other filesystems provide this differently and document information about options and their defaults in the respective manual page, e.g., :command:`man mke2fs`. With the `fscreateoptions` attribute, it's possible to directly influence how the filesystem will be created. The options provided as a string are passed to the command that creates the filesystem without any further validation by {kiwi}. For example, to turn off the journal on the creation of an ext4 filesystem, the following option would be required: .. code:: xml kernelcmdline="string": Additional kernel parameters passed to the kernel by the bootloader. Only available for the `oem`, `iso`, `pxe`, `kis` and `enclave` types. root_clone="number" For OEM disk images, this attribute allows you to create `number` clone(s) of the root partition, with `number` >= 1. A clone partition is content-wise an exact byte-for-byte copy of the origin root partition. However, to avoid conflicts at boot time, the UUID of any cloned partition will be made unique. In the sequence of partitions, the clone(s) will always be created first, followed by the partition considered the origin. The origin partition is the one that will be referenced and used by the system. Also, see :ref:`clone_partitions`. Only available for the `oem` type. boot_clone="number" Same as `root_clone` but applied to the boot partition if present. Only available for the `oem` type. luks="passphrase|file:///path/to/keyfile|random": Supplying a value will trigger the encryption of the partition serving the root filesystem using the LUKS extension. The supplied value represents either the passphrase string or the location of a key file if specified as a `file://...` resource or the reserved name `random`. When using a passphrase, the system will interactively ask for that passphrase on first boot unless it is set empty. In case of an empty passphrase, the system cannot be considered secure. When using a key file, the information from the file is read and used as a passphrase. The given key file is **not automatically** placed into the system or added to `/etc/crypttab`, which means the passphrase in the key file is, by default, requested from an interactive dialog at boot time. When using the reserved word `random`, kiwi will create a key file with a random passphrase and place this information into `/etc/crypttab`. This allows the system to boot without user interaction but also requires the initrd to be protected in some way because it will contain the key file. The use of `random` is therefore only secure if the image adds additional security that encrypts the initrd, as is, e.g., done in the IBM secure execution process. If the encryption of the system is combined with the attribute `bootpartition="false"`, it's important to understand that this will place `/boot` into the encrypted area of the system and leave reading boot data from it as a responsibility to the bootloader. Not every bootloader can cope with that, and those that can, e.g., grub, will then open an interactive dialog at the bootloader level asking for the credentials to decrypt the root filesystem. Only available for the `oem`, `iso`, `pxe` and `kis` types. luks_version="luks|luks1|luks2": Specify which `LUKS` version should be used. If not set, and by default, `luks` is used. The interpretation of the default depends on the distribution and could result in either 'luks1' or 'luks2'. The specification of the `LUKS` version allows using a different set of `luksformat` options. To investigate the differences between the two, please consult the `cryptsetup` manual page. Only available for the `oem`, `iso`, `pxe` and `kis` types. target_blocksize="number": Specifies the image blocksize in bytes, which has to match the logical blocksize of the target storage device. By default, 512 bytes is used, which works on many disks. You can obtain the blocksize from the `SSZ` column in the output of the following command: .. code:: shell-session blockdev --report $DEVICE Only available for the `oem` and `kis` types. target_removable="true|false": Indicate if the target disk for OEM images is deployed to a removable device, e.g., a USB stick or not. This only affects the EFI setup if requested, and in the end, avoids the creation of a custom boot menu entry in the firmware of the target machine. By default, the target disk is expected to be non-removable. Only available for the `oem` type. selinux_policy="targeted|mls|minimum": The `selinux_policy` attribute sets the SELinux policy to use. The `targeted` policy is the default policy. Only change this option if you want to use the `mls` or `minimum` policy. spare_part="number": Request a spare partition right before the root partition of the requested size. The attribute takes a size value and allows a unit in MB or GB, e.g., 200M. If no unit is given, the value is considered to be mbytes. A spare partition can only be configured for the disk image type oem. spare_part_mountpoint="dir_path": Specify a mount point for the spare partition in the system. Can only be configured for the disk image type oem. spare_part_fs="btrfs|ext2|ext3|ext4|xfs": Specify a filesystem for the spare partition in the system. Can only be configured for the disk image type oem. spare_part_fs_attributes="attribute_list": Specify filesystem attributes for the spare partition. Attributes can be specified as a comma-separated list. Currently, the attributes `no-copy-on-write` and `synchronous-updates` are available. Can only be configured for the disk image type oem. spare_part_is_last="true|false": Specify if the spare partition should be the last one in the partition table. It can only be configured for the `oem` type with oem-resize switched off. By default, the root partition is the last one, and the spare partition lives before it. With this attribute, that setup can be toggled. However, if the root partition is no longer the last one, the OEM repart/resize code can no longer work because the spare part would block it. Because of that, moving the spare part at the end of the disk is only applied if oem-resize is switched off. There is a runtime check in the {kiwi} code to check this condition. devicepersistency="by-uuid|by-label|by-partuuid": Specifies which method to use for persistent device names. This will affect all files written by kiwi that include device references, for example, `/etc/fstab` or the `root=` parameter in the kernel command line. By default, by-uuid is used. .. note:: devicepersistency and its impact to install images Please note that specifying `devicepersistency` also affects an eventually generated install image. This means that the installation media created from the image description will also use the specified device persistency method. It is possible that the selected method does not provide device representations for the disk devices found by the installation process. In this case the fallback to the raw unix device node e.g., `/dev/sda` will be used. If the installation media is created to allow user interaction and there are more than one disk device found during installation, the user will be prompted with a list of disk device names to select from. If the list shows the raw unix device nodes, it might be difficult for the user to select the correct disk. In this case, it is recommended to explicitly set the persistency method to use for the installation media via the `rd.kiwi.install.devicepersistency` kernel command line parameter. The parameter can also be set as a fixed value in the `kernelcmdline` attribute of the image description. Available persistency methods useful for disk device mappings are: `by-id` and `by-path`. squashfscompression="uncompressed|gzip|lzo|lz4|xz|zstd": Specifies the compression type for mksquashfs. Only available for the `oem`, `pxe`, `kis`, `iso` and `squashfs` types. erofscompression="text" Specifies the compression type and level for erofs. The attribute is a free-form text because erofs allows parameters for the different compression types. Please consult the erofs man page for details on how to specify a value for the `-z` option on `mkfs.erofs` and pass a proper value as `erofscompression`. Only available for the `oem`, `pxe`, `kis`, `iso` and `erofs` types. standalone_integrity="true|false": For the `oem` type only, specifies to create a standalone `dm_integrity` layer on top of the root filesystem. integrity_legacy_hmac="true|false": For the `oem` type only and in combination with the `standalone_integrity` attribute, this allows the use of old, flawed HMAC calculations (does not protect the superblock). .. warning:: Do not use this attribute unless compatibility with a specific old kernel is required! integrity_keyfile="filepath": For the `oem` type only, and in combination with the `standalone_integrity` attribute, this protects access to the integrity map using the given keyfile. integrity_metadata_key_description="string": For the `oem` type only, and in combination with the `embed_integrity_metadata` attribute, specifies a custom description of an integrity key as it is expected to be present in the kernel keyring. The information is placed in the integrity metadata block. If not specified, kiwi creates a key argument string instead, which is based on the given `integrity_keyfile` filename. The format of this key argument is: .. code:: bash :BASENAME_OF_integrity_keyfile_WITHOUT_FILE_EXTENSION embed_integrity_metadata="true|false": For the `oem` type only, and in combination with the `standalone_integrity` attribute, specifies to write a binary block at the end of the partition serving the root filesystem, containing information to create the `dm_integrity` device map in the following format: .. code:: bash |header|0xFF|dm_integrity_meta|0xFF|0x0| header: Is a string of the following information separated by spaces: * **version**: currently set to `1` * **fstype**: name of the `filesystem` attribute * **access**: either `ro` or `rw`, depending on the filesystem capabilities * `integrity`: fixed identifier value dm_integrity_meta: Is a string of the following information separated by spaces: * **provided_data_sectors**: number of data sectors * **sector_size**: sector size in bytes; defaults to 512 * **parameter_count**: number of parameters needed to construct the integrity device map. After the `parameter_count`, a list of space-separated parameters follows, and the `parameter_count` specifies the quantity of these parameters. * **parameters**: The first element of the parameter list contains information about the used hash algorithm, which is not part of the superblock and is provided according to the parameters passed along when {kiwi} calls `integritysetup`. As of now, this defaults to: - internal_hash:sha256 All subsequent parameters are taken from the `flags` field of the dm-integrity superblock. see the dm-integrity documentation on the web for possible flag values. verity_blocks="number|all": For the `oem` and `iso` types only, specifies to create a dm-verity hash from the number of given blocks (or all) placed at the end of the root filesystem. For later verification of the device, the credentials information produced by `veritysetup` from the cryptsetup tools are needed. This data as of now is only printed as debugging information to the build log file. A concept to persistently store the verification metadata as part of the partition(s) will be a next step. embed_verity_metadata="true|false": For the `oem` type only, and in combination with the `verity_blocks` attribute, specifies to write a binary block at the end of the partition serving the root filesystem, containing information for `dm_verity` verification in the following format: .. code:: bash |header|0xFF|dm_verity_credentials|0xFF|0x0| header: Is a string of the following information separated by spaces: * **version**: currently set to `1` * **fstype**: name of `filesystem` attribute * **access**: either `ro` or `rw` depending on the filesystem capabilities * `verity`: fixed identifier value dm_verity_credentials: Is a string of the following information separated by spaces: * **hash_type**: hash type name as returned by `veritysetup` * **data_blksize**: data blocksize as returned by `veritysetup` * **hash_blksize**: hash blocksize as returned by `veritysetup` * **data_blocks**: number of data blocks as returned by `veritysetup` * **hash_start_block**: hash start block as required by the kernel to construct the device map * **algorithm**: hash algorithm as returned by `veritysetup` * **root_hash**: root hash as returned by `veritysetup` * **salt**: salt hash as returned by `veritysetup` .. note:: dm-verity Runtime Options Additional veritysetup options can be provided at boot time using the kernel parameter `rd.kiwi.verity_options=option1,option2`. This allows runtime customization. KIWI automatically provides `hash-offset` and `hash-block-size` parameters based on the image configuration. These should not be specified manually via `rd.kiwi.verity_options=`. **Common Options:** * `panic-on-corruption`: System panics on corruption detection. * `restart-on-corruption`: System restarts on corruption (often default). * `ignore-corruption`: Ignore corruption (debugging only). * `ignore-zero-blocks`: Skip verification of zero blocks. * `check-at-most-once`: Verify each block only once. For complete options, see `veritysetup(8) `_. overlayroot="true|false": For the `oem` type only, specifies to use an `overlayfs`-based root filesystem consisting of a squashfs-compressed read-only root filesystem combined with an optional write partition or tmpfs. The optional kernel boot parameter `rd.root.overlay.temporary` can be used to point the write area into a `tmpfs` instead of a persistent write partition. In this mode, all written data is temporary until the system is rebooted. The kernel boot parameter `rd.root.overlay.size` can be used to configure the size for the `tmpfs` that is used for the `overlayfs` mount process if `rd.root.overlay.temporary` is requested. That size configures the amount of space available for writing new data during the runtime of the system. The default value is set to `50%`, which means one half of the available RAM space can be used for writing new data. By default, the persistent write partition is used. The size of that partition can be influenced via the optional `` element in the `` section or via the optional `` element in the `` section of the XML description. Setting a fixed `` value will set the size of the image disk to that value and results in an image file of that size. The available space for the write partition is that size, reduced by the size the squashfs read-only system needs. If the `` element is set to `true`, an eventually given `` element will not have any effect because the write partition will be resized on first boot to the available disk space. To disable the use of any overlay, the kernel boot parameter `rd.root.overlay.readonly` can be used. It takes precedence over all other overlay kernel parameters because it leads to the deactivation of any overlayfs-based action and just boots up with the squashfs root filesystem. In fact, this mode is the same as not installing the `kiwi-overlay` dracut module. overlayroot_readonly_filesystem="squashfs|erofs": For the `oem` type only, specifies the filesystem type to use as a read-only filesystem in an `overlayroot` setup. By default, `squashfs` is used. overlayroot_readonly_createoptions="string": For the `oem` type only, specifies additional creation options passed to the tool that builds the read-only filesystem of an `overlayroot` setup (`mkfs.erofs` or `mksquashfs`). The value is a whitespace separated list of options, analogous to `fscreateoptions` for the read-write root filesystem. A typical use is to select a larger EROFS physical cluster for a better compression ratio, for example `overlayroot_readonly_createoptions="-C 1048576"`. overlayroot_write_partition="true|false": For the `oem` type only, this allows you to specify if the extra read-write partition in an `overlayroot` setup should be created or not. By default, the partition is created, and the kiwi-overlay dracut module also expects it to be present. However, the overlayroot feature can also be used without dracut (`initrd_system="none"`), and under certain circumstances, it is handy to configure whether the partition table should contain the read-write partition or not. overlayroot_readonly_partsize="mbsize": Specifies the size in MB of the partition that stores the squashfs-compressed read-only root filesystem in an overlayroot setup. If not specified, kiwi calculates the needed size by a preliminary creation of the squashfs compressed file. However, this is only accurate if no changes to the root filesystem data happen after this calculation, which cannot be guaranteed as there is at least one optional script hook that is allowed and applied after the calculation. In addition, the pre-calculation requires some time in the build process. If the value can be provided beforehand, this also speeds up the build process significantly. Only available for the `oem` type. bootfilesystem="btrfs|ext2|ext3|ext4|xfs|fat32|fat16": If an extra boot partition is required, this attribute specifies which filesystem should be used for it. The type of the selected bootloader might overwrite this setting if there is no alternative possible, though. Only available for the `oem` type. flags="overlay|dmsquash": For the ISO image type, this specifies the live ISO technology and dracut module to use. If set to `overlay`, the kiwi-live dracut module will be used to support a live ISO system based on squashfs+overlayfs. If set to `dmsquash`, the dracut standard dmsquash-live module will be used to support a live ISO system based on the capabilities of the upstream dracut module. format="format_name": For disk image type `oem`, this specifies the format of the virtual disk so that it can run on the desired target virtualization platform. The supported format names are: * `gce`: Google Compute Engine image format. * `ova`: Open Virtualization Format Archive. * `qcow2`: QEMU Copy-On-Write version 2. * `vagrant`: Vagrant box format (tar.gz). * `vmdk`: VMware Virtual Machine Disk. * `vdi`: VirtualBox Disk Image. * `vhd`: Microsoft Virtual Hard Disk. * `vhdx`: Microsoft Virtual Hard Disk version 2. * `vhd-fixed`: Microsoft Virtual Hard Disk with fixed size. * `oci:image_format`: OCI image archive (oci format). * `docker:image_format`: OCI image archive (docker format). The `(oci|docker):image_format` format is a special case that stores the disk image inside of an OCI-compliant container. The disk image is stored in the specified `image_format` in the `disk/` directory of the container. The disk format can be one of the above formats, except `vagrant` and the container formats themselves, or just `raw` if the disk should be stored as a raw disk inside of the container. Custom naming conventions for the disk image can be applied by using the `bundle_format` attribute. The `derived_from` attribute can be used to specify the source container. The resulting container image will be built by adding the disk image as a new layer on top of the specified reference container. If there is no `derived_from` attribute, the container image will be built from scratch using an empty root directory. This format is particularly useful for building an image which bundles the actual disk image and its runtime requirements into one artifact. formatoptions="string": Specifies additional format options passed on to `qemu-img`. `formatoptions` is a comma-separated list of format-specific options in a `name=value` format, as `qemu-img` expects it. kiwi will take the information and pass it as a parameter to the `-o` option in the `qemu-img` call. Only available for the `oem` type. gpt_hybrid_mbr="true|false": For disk types, create a hybrid GPT/MBR partition table with an 'accurate' MBR table that will have no 'bootable' flagged partition. For ISO types, create a hybrid GPT/MBR partition table where the MBR partition table contains a whole-disk 'protective' partition and a second bootable-flagged partition (intended to make the image bootable in both UEFI and BIOS modes on as much hardware as possible). In both cases, it only has an effect if the EFI partition table type is GPT. Only available for the `oem` and `iso` types. hybridpersistent="true|false": For the live ISO type, this triggers the creation of a partition for a COW file to keep data persistent over a reboot. Only available for the `iso` and `pxe` types. hybridpersistent_filesystem="ext4|xfs": For the live ISO type, set the filesystem to use for persistent writing if a hybrid image is used as a disk on, e.g., a USB Stick. By default, the ext4 filesystem is used. Only available for the `iso` and `pxe` types. initrd_system="kiwi|dracut|none": Specify which initrd builder to use; the default is set to `dracut`, except for the `pxe` type, which defaults to `kiwi`. If set to `none`, the image is built without an initrd. Depending on the image type, this can lead to a non-bootable system, as it's now a kernel responsibility if the given root device can be mounted or not. Only available for the `oem`, `pxe` and `kis` types. metadata_path="dir_path": Specifies a path to additional metadata required for the selected image type or its tools used to create that image type. .. note:: Currently, this is only effective for the `appx` container image type, where it is **mandatory**. installboot="failsafe-install|harddisk|install": Specifies the bootloader's default boot entry for the initial boot of a {kiwi} install image. .. note:: This value is only evaluated for grub. install_continue_on_timeout="true|false": Specifies the boot timeout handling for the {kiwi} install image. If set to "true", the configured timeout or its default value applies. If set to "false", no timeout applies in the boot menu of the install image. installprovidefailsafe="true|false": Specifies if the bootloader menu should provide a failsafe entry with special kernel parameters or not. Only available for the `oem` type. installiso="true|false" Specifies if an install ISO image should be created. This attribute is only available for the `oem` type. The generated ISO image is a hybrid ISO that can be used as a disk on, e.g., a USB stick or as an ISO. installstick="true|false": Specifies if an install stick image should be created. Only available for the `oem` type. installpxe="true|false": Specifies if a tarball that contains all data for a PXE network installation should be created. This attribute is only available for the `oem` type. mediacheck="true|false": For ISO images, specifies whether the bootloader menu should provide a mediacheck entry to verify ISO integrity or not. It is disabled by default and only available for the x86 arch family. mdraid="mirroring|striping": Set up software RAID in degraded mode with one disk. Thus, only mirroring and striping are possible. Only available for the `oem` type. primary="true|false": Specifies this type to be the primary type. If no type option is given on the commandline, {kiwi} will build this type. ramonly="true|false": For all images that are configured to use the overlay filesystem, this setting forces any COW(Copy-On-Write) action to happen in RAM. Only available for the `oem` type. rootfs_label="string": A label name to set for the root filesystem. By default, `ROOT` is used. Only available for the `oem`, `pxe`, `kis` and `docker` types. volid="string": For the `iso` and `oem` install ISO only, this specifies the volume ID (volume name or label) to be written into the master block. Can be at most 32 characters. application_id="string": For the ISO/(oem install ISO) type only, specifies the Application ID to be written into the master block. There is space for 128 characters. vhdfixedtag="GUID_string": For the VHD disk format, this specifies the GUID. Only available for the `oem` type. derived_from="string": For container images, specifies the image URI of the container image. The image created by {kiwi} will use the specified container as the base root to work on. Only available for the `docker`, `oci` and `oem` types. On the `oem` type it may only be combined with a container output format, that is `format="oci:..."` or `format="docker:..."`. delta_root="true|false": For container images and in combination with the `derived_from` attribute. If `delta_root` is set to `true`, {kiwi} creates a container image that only contains the differences compared to the given `derived_from` container. Such a container is, on its own, no longer functional and requires a tool that is able to provision a container instance from the `derived_from` container combined with the `delta_root` application container. Such a tool exists with the `oci-pilot `_ project and allows you to manage applications as containers that feel like native applications on the host system. Only available for the `docker` and `oci` types. ensure_empty_tmpdirs="true|false": For OCI container images, this specifies whether to ensure the `/run` and `/tmp` directories are empty in the container image created by {kiwi}. The default is true. Only available for the `docker` and `oci` types. publisher="string": For ISO images, this specifies the publisher name of the ISO. Only available for the `iso` type. eficsmpart_id="number": For OEM images, this specifies the partition number for the EFI CSM (legacy BIOS) partition. For details about the evaluation and impact of custom partition ids, please see: :ref:`custom_partitions`. efipart_id="number": For OEM images, specifies the partition number for the EFI partition. For details about the evaluation and impact of custom partition ids, please see: :ref:`custom_partitions`. rootpart_id="number": For OEM images, this specifies the partition number for the ROOT partition. For details about the evaluation and impact of custom partition ids, please see: :ref:`custom_partitions`. bootpart_id="number": For OEM images, specifies the partition number for the BOOT partition. For details about the evaluation and impact of custom partition ids, please see: :ref:`custom_partitions`. boot="path": Path to a {kiwi} boot image description used to build the initrd. Requires `initrd_system="kiwi"`. A relative path is looked up below :file:`/usr/share/kiwi/custom_boot`. Only available for the `oem` and `pxe` types. bootkernel="name": Name of the kernel profile of the boot image description to use. Passed on as `add-profile` when the boot image is built. bootprofile="name": Name of the profile of the boot image description to use. Passed on as `add-profile` when the boot image is built. Only available for the `oem`, `iso`, `pxe` and `cpio` types. bundle_format="string": Base name pattern used for all target image files by :command:`kiwi-ng result bundle`. See :ref:`image_types` for the list of supported placeholders. disk_start_sector="number": First usable sector of the partition table. The minimum, and the default, is 2048. Only available for the `oem` type. enclave_format="aws-nitro": Target format of the enclave image. `aws-nitro` is currently the only supported value. Only available for the `enclave` type. gcelicense="string": License tag to embed into an image built with `format="gce"`. Only available for the `oem` type. luksOS="sle12": Passes a predefined set of cipher, keysize and hash format options to the :command:`cryptsetup` call, producing a format compatible with the named distribution. Only available for the `oem`, `iso`, `pxe` and `kis` types. luks_pbkdf="pbkdf2|argon2i|argon2id": Key derivation function used by LUKS to derive the encryption key from the password. Only available for the `oem`, `iso`, `pxe` and `kis` types. luks_randomize="true|false": By default all blocks of a LUKS volume are filled with pseudo-random data. Set this to `false` to reduce the image size when shipping an image with a well-known key that is re-encrypted at deployment time. Only available for the `oem`, `iso`, `pxe` and `kis` types. provide_system_files="true|false": Emit a metadata file listing the system files of the image, for later consumption by a derived build. Only available for the `docker` and `oci` types. Use a `` section to filter the generated list. require_system_files="true|false": Consume the system file metadata provided by a base image. Only available for the `docker` and `oci` types. wwid_wait_timeout="number": Seconds to wait for a device WWID to appear. Defaults to 3. Only available for the `oem` type. xen_server="true|false": Marks the image as a Xen dom0 (server) rather than a Xen guest. Only available for the `oem` type. See also `check_xen_uniquely_setup_as_server_or_guest`. The following sections show the supported child elements of the `type` element, including references to their usage in a detailed type setup: .. _preferences-type-luksformat: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ The `luksformat` element is used to specify additional luks options passed on to the `cryptsetup luksFormat` call. The element requires the attribute `luks` to be set in the `` section referring to `luksformat`. Several custom settings related to the LUKS and LUKS2 format features can be set up. For example, the setup of the `dm_integrity` feature: .. code:: xml .. _preferences-type-bootloader: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ The `bootloader` element is used to select the bootloader. At the moment, `grub2`, `systemd_boot`, and the combination of zipl plus userspace grub2, `grub2_s390x_emu`, are supported. The special `custom` entry allows you to skip the bootloader configuration and installation and leaves this up to the user, which can be done by using the `editbootinstall` and `editbootconfig` custom scripts. .. note:: Bootloaders provide a very different set of features and only work within their individual implementation priorities. {kiwi} provides an API for bootloaders, but not all API methods can be implemented for all bootloaders due to the fact that some features only exist in one but not in another bootloader. If a bootloader setting is used that is not understood by the selected bootloader, the image build process will fail with an exception message. name="grub2|grub2_s390x_emu|systemd_boot|custom|zipl": Specifies the bootloader to use for this image. .. note:: systemd_boot ESP size The implementation to support systemd-boot reads all data from the ESP (EFI System Partition). This also includes the kernel and initrd, which requires the size of the ESP to be configured appropriately. By default, {kiwi} configures the ESP with 20MB. For systemd_boot, this is usually too small and can be changed with the `efipartsize` attribute. Reading boot-relevant files from another filesystem requires providing alternative EFI filesystem drivers, e.g., efifs, and also needs adaptations on the setup of `bootctl`. .. note:: systemd_boot and shim At the moment, the EFI image provided along with systemd-boot is not compatible with the shim-signed loader provided in an extra effort by the distributions. In addition to the mandatory name attribute, the following optional attributes are supported: bls="true|false": Specifies whether to use Bootloader Spec-style configuration if `grub` in the image supports it. It is a no-op if the `blscfg` module is not available. This option is only available for `grub` and defaults to true if not set. output_console="none|console|gfxterm|serial|vga_text|mda_text|morse|spkmodem": Specifies the bootloader output console. The attribute is available for the `grub` bootloader type. Multiple console types can be provided, separated by a space. input_console="none|console|serial|at_keyboard|usb_keyboard": Specifies the bootloader input console. The attribute is available for the `grub` bootloader type. Multiple console types can be provided, separated by a space. If no `input_console` is provided, the value for the `output_console` is used if specified. grub_template="filename": Specifies a custom grub bootloader template file that will be used instead of the one provided with {kiwi}. A static bootloader template to create the grub config file is only used in {kiwi} if the native method via the grub `mkconfig` toolchain does not work properly. As of today, this is only the case for live and install ISO images. Thus, this setting only affects the oem and iso image types. The template file should contain a `Template string `_ and can use the following variables: +-----------------------+----------------------------------------------+ | Variable | Description | +=======================+==============================================+ | search_params | parameters needed for grub's `search` | | | command to locate the root volume | +-----------------------+----------------------------------------------+ | default_boot | number of the default menu item to boot | +-----------------------+----------------------------------------------+ | kernel_file | the name of the kernel file | +-----------------------+----------------------------------------------+ | initrd_file | the name of the initial ramdisk file | +-----------------------+----------------------------------------------+ | boot_options | kernel command-line options for booting | | | normally | +-----------------------+----------------------------------------------+ | failsafe_boot_options | kernel command-line options for booting in | | | failsafe mode | +-----------------------+----------------------------------------------+ | gfxmode | the resolution to use for the bootloader; | | | passed to grub's `gfxmode` command | +-----------------------+----------------------------------------------+ | theme | the name of a graphical theme to use | +-----------------------+----------------------------------------------+ | boot_timeout | the boot menu timeout, set by the `timeout` | | | attribute | +-----------------------+----------------------------------------------+ | boot_timeout_style | the boot timeout style, set by the | | | `timeout_style` attribute | +-----------------------+----------------------------------------------+ | serial_line_setup | directives used to initialize the serial | | | port, set by the `serial_line` attribute | +-----------------------+----------------------------------------------+ | title | a title for the image: this will be the | | | `` tag's `displayname` attribute or | | | its `name` attribute if `displayname` is not | | | set; see: :ref:`sec.image` | +-----------------------+----------------------------------------------+ | bootpath | the bootloader lookup path | +-----------------------+----------------------------------------------+ | boot_directory_name | the name of the grub directory | +-----------------------+----------------------------------------------+ | efi_image_name | architecture-specific EFI boot binary name | +-----------------------+----------------------------------------------+ | terminal_setup | the bootloader console mode, set by the | | | `console` attribute | +-----------------------+----------------------------------------------+ | title_N, | title, kernel and initrd file name of the | | kernel_file_N, | further kernel flavors, numbered from 1, set | | initrd_file_N | by the `kernel_flavor` attribute. title, | | | kernel_file and initrd_file belong to the | | | first flavor in this case | +-----------------------+----------------------------------------------+ serial_line="string": Specifies the bootloader serial line setup. The setup is effective if the bootloader console is set to use the serial line. The attribute is available for the grub bootloader only. video_mode="string": Specifies the video mode to use for the bootloader. The attribute is available for the grub bootloader only and is passed to grub's `gfxmode` command. For details on the supported video modes, please see the grub manual at https://www.gnu.org/software/grub/manual/grub/html_node/gfxmode.html. timeout="number": Specifies the boot timeout in seconds prior to launching the default boot option. By default, the timeout is set to 10 seconds. It makes sense to set this value to `0` for images intended to be started non-interactively (e.g., virtual machines). timeout_style="countdown|hidden|menu": Specifies the boot timeout style to control the way in which the timeout interacts with displaying the menu. If set, the display of the bootloader menu is delayed after the timeout has expired. In countdown mode, an indication of the remaining time is displayed. The attribute is available for the grub loader only. targettype="CDL|FBA|SCSI|GPT": Specifies the device type of the disk zipl should boot. On zFCP and/or KVM devices, use `SCSI` or `GPT`; on DASD devices, use `CDL`; on emulated DASD devices, use `FBA`. The attribute is available for the `grub2_s390x_emu` and `zipl` loaders only. use_disk_password="true|false": When `/boot` is encrypted, makes the bootloader store the password in its configuration file (in cleartext). This is useful for full disk encryption images. kernel_flavor="flavor,...": Specifies one or more kernel flavors as a comma-separated list, for example, `kernel_flavor="rt,default"`. {kiwi} creates an initrd and a boot menu entry for the latest installed kernel of each flavor. The menu entries follow the order of the list, and the entry of the first flavor is the default entry. In the example above, the entry of the `rt` kernel is selected by default. If not specified, the boot menu entry is created for the latest installed kernel only. The flavor is the end of the kernel version following the release, separated by `-` or `+`. For example, `6.4.0-150600.23.25-rt` is of flavor `rt`, `6.1.0-21-rt-amd64` is of flavor `rt-amd64`, and `5.14.0-427.13.1.el9_4.x86_64+rt` is of flavor `rt`. A kernel of each flavor must be installed in the image. The menu entry titles are extended by the flavor name, for example `Title (rt)`. The special flavor `none` stands for kernels whose version does not end with a flavor name, for example `7.2.15-100.fc43.x86_64` of the Fedora `kernel` package. The version of such a kernel ends with its release, a part with a dot or a part without letters, after the last `-` or `+`. To boot the Fedora `kernel` by default and provide a menu entry for `kernel-rt` as well, set `kernel_flavor="none,rt"`. The menu entry title of the `none` flavor is not extended. The attribute is available for the `grub2`, `grub2_s390x_emu`, `systemd_boot` and `zipl` loaders and is handled as follows: grub2 (disk images): The menu entries are created by `grub2-mkconfig` for all installed kernels. {kiwi} selects the entry of the first flavor as the default entry by setting the `saved_entry` variable in the grub environment. This requires `GRUB_DEFAULT=saved`, which is the {kiwi} default. grub2 (live and install ISO images): The ISO image contains the kernel and initrd of each flavor. The files of the first flavor are named `linux` and `initrd`, those of further flavors have the flavor appended, for example `linux-default`. The boot menu provides one boot entry (live) or install entry (install) per flavor. Failsafe and mediacheck entries use the kernel of the first flavor, as does the system booted after the installation. systemd_boot: A loader entry is written for each flavor, and the entry of the first flavor is set as the default in `loader.conf`. zipl: A loader entry is written for each flavor, and the entry of the first flavor is set as the default section. The attribute requires the `dracut` initrd system. It is not supported in combination with a UKI (``), or with zipl secure execution (``). ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Used to specify data required to set up secure Linux execution. Secure Linux execution reads the kernel, initrd, and boot parameters from an encrypted data blob and couples the image to the machine it gets executed on. Typically, the private key is protected in hardware on the machine itself. {kiwi} supports secure execution for the IBM secure Linux target on the s390 platform, along with the bootloaders `zipl` and `grub2_s390x_emu`. .. code:: xml The `securelinux` element itself can be specified multiple times, for example to couple one image to several machines that use different signing certificates. hkd_ca_cert: Mandatory attribute providing the `Common Authority` certificate (signed by the root CA) that is used to establish a chain of trust for the verification of the `Host Key Document`. hkd_sign_cert: Mandatory attribute providing the `Signing` certificate that is used to establish a chain of trust for the verification of the `Host Key Document`. hkd_cert: Child element, required at least once. The file specified in the `name` attribute defines the `Host Key Document` and tightly couples the image to the host matching the document. Can be specified multiple times. hkd_revocation_list: Optional child element, providing in its `name` attribute the revocation list to check on the use of expired certificates in the chain of trust. Can be specified multiple times. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Used to specify custom arguments for the tools called to set up the bootloader: * secure boot via ``, e.g., `shim-install` * installation of the bootloader via ``, e.g., `grub-install` * configuration of the bootloader via ``, e.g., `grub-mkconfig` * setup of bootloader environment variables via ``, e.g., `grub2-editenv` .. code:: xml .. note:: {kiwi} does not judge the given parameters, and if the provided data is effectively used depends on the individual bootloader implementation. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Used to describe the container configuration metadata in docker or wsl image types. For details, see: :ref:`building_container_build` and: :ref:`building_wsl_build`. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Used to describe vagrant configuration metadata in a disk image that is being used as a vagrant box. For details, see: :ref:`setup_vagrant`. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Used to describe the volumes of the disk area, which contains the root filesystem. Volumes are either a feature of the used filesystem, or LVM is used for this purpose. For details, see: :ref:`custom_volumes`. .. note:: When both `` and `` are used, `` are evaluated first, and mount points defined in `` cannot be redefined as `` volumes. The two types define a complete disk setup, so there cannot be any overlapping volumes or mount points. As a result, whatever is written in `` cannot be expressed in the same way in ``. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Used to describe the geometry of the disk on the level of the partition table. For details, see: :ref:`custom_partitions`. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Used to customize the deployment process in an OEM disk image. For details, see: :ref:`oem_customize`. ~~~~~~~~~~~~~~~~~~~~~~~~~ Used to customize the size of the resulting disk image in an OEM image. For details, see: :ref:`disk-the-size-element`. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Used to customize the virtual machine configuration, which describes the components of an emulated hardware. For details, see: :ref:`disk-the-machine-element`. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Used to customize the installation media images created for OEM images deployment. For details, see: :ref:`installmedia_customize`. ~~~~~~~~~~~~~~~~~~~~~~~~~~~ Used to specify custom arguments for the initrd tooling, e.g., dracut. .. code:: xml dracut.uefi.true: As part of the `setup` action, this enables creating a UKI EFI binary. dracut.module.NAME: As part of the `add` or `omit` action, this adds or omits the given module name. The element can be specified multiple times. dracut.driver.NAME: As part of the `add` or `omit` action, this adds or omits the given kernel driver. The element can be specified multiple times and accepts kernel driver names without the `.ko` extension. .. _sec.registry: ------------ Set up containers to fetch from a registry assigned to one of the supported container backends. .. code:: xml The optional containers element specifies the location of one or more containers on a registry `source` server. {kiwi} will take this information and fetch the containers as OCI archives to the image. On first boot, these container archives will be loaded into the local container backend store for the selected backend, and the archive files will be deleted. Supported `backend` values are `docker`, `podman`, and `container-snap`. The `backend` attribute is mandatory and specifies for which container backend the image should be available in the system. The `containers` element has the following optional attributes: arch="arch" The containers section can be configured to apply only for a certain architecture. In this case, specify the `arch` attribute with a value as it is reported by :command:`uname -m`. profiles="profile_a,profile_b" Fetch the containers of this section only when one of the listed build profiles is active (see :ref:`sec.profiles`). ----------------------- Details about the container. .. code:: xml The `name` attributes are mandatory and specify the name of the container as it exists in the registry. The `container` element has the following optional attributes: path="some/path" The path to the container in the registry. If not specified, the value defaults to `/`. fetch_only="true|false" If set to `true`, kiwi will only fetch the container but will not set up the systemd unit for loading the container into the local registry. In this mode, the container archive file stays in the system and can be handled in a custom way. By default, `fetch_only` is set to `false`. tag="tagname" Specifies the container tag to fetch. If not set, the tag name defaults to `latest`. arch="arch" The container section can be configured to apply only for a certain architecture. In this case, specify the `arch` attribute with a value as it is reported by :command:`uname -m`. .. _sec.repository: ------------- Set up software sources for the image. .. code:: xml The repository element specifies the location and type of a repository to be used by the package manager as a package installation source. It is optional and may be provided multiple times, but at least one repository is required for {kiwi} to be able to install software. {kiwi} supports apk, apt, dnf4, dnf5, microdnf, pacman, and zypper as package managers, specified via the packagemanager element. The repository element has the following optional attributes: alias="name" Specifies an alternative name for the configured repository. If the attribute is not specified, {kiwi} will generate a random alias name for the repository. The specified name must match the pattern: `[a-zA-Z0-9_\-\.]+`. type="apk|apt-deb|apt-rpm|deb-dir|mirrors|rpm-md" Specifies the repository metadata format. If not set, {kiwi} derives a suitable default from the configured package manager. arch="arch_name[,arch_name]" Use this repository only when building on one of the listed host architectures. profiles="profile_a,profile_b" Use this repository only when one of the listed build profiles is active (see :ref:`sec.profiles`). architectures="arch_name[,arch_name]" Used for `apt-deb` repositories only. Declares which architectures this repository provides packages for. components="name" Used for Debian (apt) based repositories only. Specifies the component name that should be used from the repository. By default, the `main` component is used. distribution="name" Used for Debian (apt) based repositories only. Specifies the distribution name used in the repository data structure. imageonly="true|false" Specifies whether or not this repository should be configured in the resulting image without using it at build time. By default, the value is set to false. This attribute is mutually exclusive with `imageinclude`. repository_gpgcheck="true|false" Specifies whether or not this specific repository values the result of the repository signature validation. If not set, the default is `false`. If set, the relevant key information needs to be provided on the {kiwi} commandline using the `--signing-key` option or via the `` element as part of the `` setting in the image description. Some distributions provides the signing keys as part of the `distribution-gpg-keys` package. In that case, the keys can be included in the image by specifying a repository like the following: .. code:: xml Debian based distributions, on the other hand, usually provide the keys at https://ftp-master.debian.org/keys.html. Fetch the relevant key for the image target distribution from there and use them in the same way as described above. package_gpgcheck="true|false" Specify whether or not this specific repository values the result of the package signature validation for each package taken from this repository. If not set, the default value is `false`. If set, the same key information requirements as for the `repository_gpgcheck` attribute apply. customize="/path/to/custom_script" A custom script hook that is invoked with the repo file as a parameter for each file created by {kiwi}. .. note:: If the script is provided as a relative path, it will be searched in the image description directory. imageinclude="true|false" Specifies whether the given repository should be configured as a repository in the image or not. The default behavior is that repositories used to build an image are not configured as a repository inside the image. This feature allows you to change the behavior by setting the value to true. .. note:: Scope of repository uri's The repository is configured in the image according to the source path as specified with the `path` attribute of the source element. Therefore, if the path is not a fully qualified URL, you may need to adjust the repository file in the image to accommodate the expected location. It is recommended that you use the alias attribute in combination with the `imageinclude` attribute to avoid having unpredictable random names assigned to the repository you wish to include in the image. password="string" Specifies a password for the given repository. The password attribute must be used in combination with the username attribute. Dependent on the repository location, this information may not be used. username="name" Specifies a user name for the given repository. The username attribute must be used in combination with the password attribute. Dependent on the repository location, this information may not be used. priority="number" Specifies the repository priority for this given repository. Priority values are treated differently by different package managers. Repository priorities allow the package management system to disambiguate packages that may be contained in more than one of the configured repositories. The zypper package manager, for example, prefers packages from a repository with a *lower* priority over packages from a repository with higher priority values. The apt package manager behaves the other way round: {kiwi} writes the value verbatim as ``Pin-Priority`` into an apt preferences file for the repository, and apt prefers packages from the repository with the *higher* priority. The default priority of a repository in apt is 500. A value of 1, for example, causes apt to use a package from this repository only if no other repository provides it, even if the version in this repository is newer. A value above 1000 forces apt to use packages from this repository, even if this means a downgrade. The priority is pinned to the host name of the repository URI, or to all local repositories in case of a local path. Thus it also applies to all other repositories from the same host, or to all other local repositories. For details see ``apt_preferences(5)``. If the attribute is not set, {kiwi} writes no priority into the generated repository configuration, so the package manager's own default applies. For other package managers, please refer to the individual documentation about repository priorities. sourcetype="baseurl|metalink|mirrorlist" Specifies the source type of the repository path. Depending on whether the source path is a simple URL or a pointer to a metadata file or mirror list, the configured package manager needs to be set up appropriately. By default, the source is expected to be a simple repository baseurl. ~~~~~~~~~~~~~~~~~~~~ The location of a repository is specified by the path attribute of the mandatory source child element: .. code:: xml The location specification may include the `%arch` macro, which will expand to the architecture of the image building host. The value for the path attribute may begin with any of the following location indicators: * ``file:///local/path/to/file`` An absolute path to a file accessible through the local filesystem. * ``ftp://`` A ftp-protocol-based network location. * ``http://`` A http-protocol-based network location. * ``https://`` A https-protocol-based network location. .. note:: https repositories When specifying a https location for a repository, it is generally necessary to include the openssl certificates and a cracklib word dictionary as package entries in the bootstrap section of the image configuration. The names of the packages to include are individual to the used distribution. On SUSE systems, as one example, this would be `openssl-certs` and `cracklib-dict-full`. * ``obs://Open:Build:Service:Project:Name`` A reference to a project in the Open Build Service (OBS). {kiwi} translates the given project path into a remote URL at which the given project hosts the packages. * ``obsrepositories:/`` A placeholder for the Open Build Service (OBS) to indicate that all repositories are taken from the project configuration in OBS. A repository `` element can optionally contain one or more signing keys for the packages from this repository, as shown in the following example: .. code:: xml The `key` attribute is a URI which can point to a remote location via `http://`, `https://` or `ftp://`, or to a local file. According to RFC 8089, a local file must be specified with an absolute path, either as `file:/path/to/key` or as `file:///path/to/key`. Relative paths like `file:path/to/key` or `file://path/to/key` are not supported. To use a key file stored in the image description directory, use the `this://` URI type: .. code:: xml All signing keys from all repositories will be collected and incorporated into the keyring as used by the selected package manager. .. note:: Signing keys of image repositories with apt For the `apt` package manager, the signing keys are only available at build time, unless the repository is marked with `imageinclude` or `imageonly`. For such a repository, its signing keys are stored permanently in the image as :file:`/usr/share/keyrings/ALIAS-archive-keyring.[asc|gpg]` and referenced via the `Signed-By` option of the repository configuration in the image. This follows the `Debian recommendation for third party repositories `_. Use the `alias` attribute to get a predictable keyring file name. .. _sec.packages: ----------- Set up software components to be installed in the image. .. code:: xml The packages element specifies the setup of a packages group for the given type. It is optional and may be provided multiple times, but in practice at least a `bootstrap` group is required to produce a usable appliance. The value of the type attribute specifies at which state in the build process the packages group is handled. The attribute accepts the following set of values: type="bootstrap" Bootstrap packages, a list of packages to be installed first into a new (empty) root tree. The packages list the required components to support a chroot environment from which further software components can be installed. type="image" Image packages, a list of packages to be installed as part of a chroot operation inside the new root tree. type="uninstall|delete" Packages to be uninstalled or deleted. For further details, see :ref:`uninstall-system-packages`. type="docker|iso|kis|oci|oem|pxe" Packages to be installed only when the named image type is being built. For example, with `type="iso"` the packages in this group are installed only if the ISO image type is built. Note that these six are the only image type names accepted here. Other `` values such as `appx`, `wsl`, `enclave`, `tbz`, `cpio` and the plain filesystem types have no corresponding packages group, use `type="image"` for those. type="systemfiles" Used together with the `provide_system_files` and `require_system_files` type attributes. The group typically holds `` entries naming packages to filter out of the generated system file list. In addition to `type`, the `packages` element accepts the following optional attributes: profiles="profile_a,profile_b" Use this packages group only when one of the listed build profiles is active (see :ref:`sec.profiles`). patternType="onlyRequired|plusRecommended" Controls how `namedCollection` entries are resolved. bootstrap_package="package_name" For use with the `apt` package manager only, and only on a `type="bootstrap"` group. Specifies the name of a bootstrap package that provides a bootstrap tarball in :file:`/var/lib/bootstrap/PACKAGE_NAME.ARCH.tar.xz`. The tarball is unpacked and used as the bootstrap rootfs to begin with, providing an alternative bootstrap method. For further details, see :ref:`debianbootstrap_alternative`. The packages element may contain any number of the following child elements, which provide specific configuration information for the specified packages group: ~~~~~~~~~~~~~~~~~~~ .. code:: xml The package element installs the given package name. The optional `arch` attribute can be used to limit the installation of the package to the host architecture from which {kiwi} is called. The `arch` attribute is also available in all of the following elements. Two further optional attributes control the {kiwi} initrd: bootinclude="true|false" Additionally install this package into the {kiwi} initrd. bootdelete="true|false" Remove this package from the {kiwi} initrd again. Only evaluated in combination with `bootinclude`. ~~~~~~~~~~~~~~~~~~~~~~~~~~~ .. code:: xml The `namedCollection` element is used to install a number of packages grouped together under a name. This is a feature of the individual distribution and is used in the implementation of the {kiwi} package manager backend. At the moment, collections are only supported for SUSE- and Red Hat-based distributions. The optional `patternType` attribute is used to control the behavior of the dependency resolution of the package collection. `onlyRequired` installs only the collection and its required packages. `plusRecommended` installs the collection, any of its required packages, and any recommended packages. .. note:: Collections on SUSE On SUSE-based distributions, collections are called `patterns` and are just simple packages. To get the names of the patterns such that they can be used in a namedCollection type, use the following command: `$ zypper patterns`. If for some reason the collection name cannot be used, it is also possible to add the name of the package that provides the collection as part of a `package` element. To get the names of the pattern packages, type the following command: `$ zypper search patterns`. By convention, all packages that start with the name "patterns-" represent a pattern package. .. note:: Collections on Red Hat On Red Hat-based distributions, collections are called `groups` and are extra metadata. To get the names of these groups, type the following command: `$ dnf group list -v`. Please note that since {kiwi} v9.23.39, group IDs are allowed only, e.g.: ``. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ .. code:: xml In CentOS Stream >= 8 and Red Hat Enterprise Linux >= 8, there are Application Streams that are offered in the form of modules (using Fedora Modularity technology). To build images that use this content, {kiwi} offers to enable/disable modules when using the `dnf` or `microdnf` package manager backend. Modules are set up prior to the bootstrap phase, and their setup persists as part of the image. There are the following constraints when adding `collectionModule` elements: * `collectionModule` elements can only be specified as part of the `` section. This is because the setup of modules must be done once and as early as possible in the process of installing the image root tree. * Disabling a module can only be done as a whole, and therefore, the `stream` attribute is not allowed for disabling modules. For enabling modules, the `stream` attribute is optional. * The `enable` attribute is mandatory because it should be an explicit setting if a module is effectively used or not. ~~~~~~~~~~~~~~~~~~~ .. code:: xml The `file` element takes the `name` attribute and looks up the given name as a file on the system. If specified as a relative path, {kiwi} looks up the name in the image description directory. The file is installed using the `rsync` program. The file element has the following optional attributes: owner="user:group" The `owner` attribute can be specified to make the file belong to the specified owner and group. The ownership of the original file is meaningless in this case. The provided value is passed along to the `chown` program. permissions="perms" The `permissions` attribute can be specified to store the file with the provided permission. The permission bits of the original file are meaningless in this case. The provided value is passed along to the `chmod` program. target="some/path" The `target` attribute can be used to specify a target path to install the file to the specified directory and name. Eventually, missing parent directories will be created. ~~~~~~~~~~~~~~~~~~~ .. code:: xml The `archive` element takes the `name` attribute and looks up the given name as a file on the system. If specified as a relative path, {kiwi} looks up the name in the image description directory. The archive is installed using the `tar` program. Thus, the file name is expected to be a tar archive. The compression of the archive is detected automatically by the tar program. The optional `target_dir` attribute can be used to specify a target directory to unpack the archive inside the image root tree. The optional `bootinclude` attribute additionally unpacks the archive into the {kiwi} initrd. ~~~~~~~~~~~~~~~~~~ .. code:: xml The `ignore` element instructs the used package manager to ignore the given package name at installation time. Please note whether or not the package can be ignored is up to the package manager. Packages that are hard-required by other packages in the install procedure cannot be ignored, and the package manager will simply ignore the request. ~~~~~~~~~~~~~~~~~~~ .. code:: xml The `product` element instructs the used package manager to install the given product. What the installation of a product means is up to the package manager and is also distribution-specific. This feature currently only works on SUSE-based distributions. .. _sec.users: -------- Set up image users. .. code:: xml The optional `users` element contains the user setup {kiwi} should create in the system. The optional `arch` attribute can be used to limit the user's setup to the host architecture from which {kiwi} is called. At least one user child element must be specified as part of the `users` element. Multiple user elements may be specified. Each `user` element represents a specific user that is added or modified. The following attributes are mandatory: name="name": the UNIX username. password="string" The password for this user account. It can be provided either in cleartext form or encrypted. An encrypted password can be created using `openssl` as follows: .. code:: $ openssl passwd -1 -salt xyz PASSWORD It is also possible to specify the password as a non-encrypted string by using the `pwdformat` attribute and setting its value to `plain`. {kiwi} will then encrypt the password prior to the user being added to the system. .. warning:: plain text passwords We do not recommend plain passwords, as they will be readable in the image configuration in plain text. All specified users and groups will be created if they do not already exist. The defined users will be part of the group(s) specified with the `groups` attribute or belong to the default group as configured in the system. If specified, the first entry in the groups list is used as the login group. Additionally, the following optional attributes can be specified: home="path": The path to the user's home directory. groups="group_a,group_b,group_c:id": A comma-separated list of UNIX groups. The first element of the list is used as the user's primary group. The remaining elements are appended to the user's supplementary groups. When no groups are assigned, then the system's default primary group will be used. If a group should be of a specific group ID, it can be appended to the name, separated by a colon. .. note:: Group IDs can only be set for groups that do not yet exist at the time when {kiwi} creates them. A check is made if the desired group is already present, and if it exists, the user will become a member of that group, but any given group ID from the {kiwi} configuration will **not** be taken into account. Usually, all standard system groups are affected by this behavior because they are provided by the OS itself. Thus, it's by intention not possible to overwrite the group ID of an existing group. id="number": The numeric user ID of this account. pwdformat="plain|encrypted": The format in which `password` is provided. The default, if not specified, is `encrypted`. realname="string": The full name of the user, stored in the GECOS field. shell="path": The login shell for this account. The `users` element itself may be provided multiple times and accepts the following optional attributes to restrict a whole group of accounts: arch="arch_name[,arch_name]" Create the users of this section only when building on one of the listed host architectures. profiles="profile_a,profile_b" Create the users of this section only when one of the listed build profiles is active (see :ref:`sec.profiles`). .. _sec.drivers: --------- .. code:: xml Lists kernel driver modules to include in the {kiwi} initrd. Each `file` child element takes a `name` attribute holding a path relative to the kernel module directory (shell globs are supported). The `drivers` element may be provided multiple times and accepts the following optional attribute: profiles="profile_a,profile_b" Include the drivers of this section only when one of the listed build profiles is active (see :ref:`sec.profiles`). .. _sec.strip: ------- .. code:: xml Lists files to remove from, or to keep in, the image root tree. The mandatory `type` attribute selects the meaning of the `file` children: type="delete" A list of custom files and directories to delete. type="tools" A list of file names in the Linux `bin` and `sbin` directories to keep; everything else is removed. type="libs" A list of file names in the Linux library directories to keep; everything else is removed. The `strip` element may be supplied multiple times and accepts the following optional attribute: profiles="profile_a,profile_b" Apply the strip section only when one of the listed build profiles is active (see :ref:`sec.profiles`). .. _sec.extension: ----------- An optional container for namespaced XML belonging to a {kiwi} plugin. Each XML namespace may appear at most once, and its content is validated against an external RELAX NG schema resolved through the XML catalog. See :doc:`../contributing/schema_extensions` for how to register and consume one. .. _sec.profiles: ----------- Manage image namespace(s). .. code:: xml The optional profiles section lets you maintain one image description while allowing for variation of other sections that are included. A separate profile element must be specified for each variation. The profile child element specifies an alias name used to mark sections as belonging to a profile, and a short description explaining what this profile does. Both `name` and `description` are **mandatory**. Two further attributes are optional: import="true|false" Select this profile automatically when no profile was given on the command line. If any profile is passed via `--profile`, `import` is ignored entirely and only the profiles named on the command line plus their transitive `requires` are used. arch="arch_name" Limit this profile to the listed host architectures. A profile can require other profiles, and the required profiles will be evaluated in the order of their declaration. The optional arch attribute can be used to limit the profile and required profiles to a certain architecture. For example: .. code:: xml For example, to mark a set of packages as belonging to a profile, simply annotate them with the profiles attribute, as shown below: .. code:: xml It is also possible to mark sections as belonging to multiple profiles by separating the names in the profiles attribute with a comma: .. code:: xml The `profiles` attribute is supported on the following elements: * :ref:`sec.certificates` * :ref:`sec.preferences` * :ref:`sec.users` * :ref:`sec.drivers` * :ref:`sec.strip` * :ref:`sec.repository` * :ref:`sec.registry` * :ref:`sec.packages` Child elements, for example ``, `` or ``, do not support the `profiles` attribute. To make them profile specific, place them into a parent section that carries the `profiles` attribute. If a section tag does not have a profiles attribute, it is globally present in the configuration. If global sections and profiled sections contain the same sub-sections, the profiled sections will overwrite the global sections in the order of the provided profiles. For a better overview of the result configuration when profiles are used we recommend to put data that applies in any case to non profiled (global) sections and only extend those global sections with profiled data. For example: .. code:: xml 1.2.3 zypper The above example configures two versions of the same oem type. One builds a disk in qcow2 format the other builds a disk in vmdk format. The global preferences section without a profile assigned will be used in any case and defines those preferences settings that are common to any build process. A user can select both profiles at a time but that will result in building the disk format that is specified last because one is overwriting the other. Use of one or more profile(s) during image generation is triggered by the use of the ``--profile`` command line argument. Multiple profiles can be selected by passing this option multiple times. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7355366 kiwi-11.1.8/doc/source/image_description.rst0000644000000000000000000001627615273675667016023 0ustar00.. _image-description: Image Description ================= KIWI builds images from a description directory. The directory describes what packages to install, how to configure the target system, and which image types should be created from the prepared root tree. .. contents:: On this page :local: :depth: 2 Description Directory Layout ---------------------------- A description directory usually contains these files: :file:`config.xml` or :file:`*.kiwi` The main image description. It defines metadata, repositories, packages, users, image types, and optional profile-specific variants. :file:`root/` or :file:`root.tar.gz` Overlay content copied into the prepared root tree after package installation. :file:`config.sh` An optional shell hook executed near the end of the prepare step. :file:`images.sh` An optional shell hook executed at the beginning of the create step. :file:`config-cdroot.tar[.*]` Optional additional files for ISO-style images, such as licenses or offline documentation. Referenced archives, drivers, certificate files, and include files Additional resources referenced from the image description itself. Minimal Example --------------- The following description is enough to prepare a root tree and create a simple image from it: .. code:: xml Example Author example@example.invalid Small example image 1.0.0 zypper Top-Level Schema Layout ----------------------- The :file:`kiwi/schema/kiwi.rnc` schema organizes the document below the :ref:`sec.image` root element in this order: .. list-table:: Top-level sections :widths: 18 34 32 16 :header-rows: 1 * - Section - Purpose - Main attributes and children - Reference * - ```` - Root node of the description. - Required: ``name``, ``schemaversion``. Optional: ``displayname``, ``id``. - :ref:`sec.image` * - ```` - Insert the inner content of another XML description file. - ``from`` URI attribute. - :ref:`sec.include` * - ```` - Import additional CA certificates during the build. - ``target_distribution`` and optional ``profiles`` with one or more ```` entries. - :ref:`sec.certificates` * - ```` - Define human-readable identity and ownership. - ``type`` plus ````, ````, ````, and optional ````. - :ref:`sec.description` * - ```` - Define versions, package manager behavior, and one or more image types. - Optional ``arch`` and ``profiles`` filters; includes ````, ````, ````, locale, timezone, themes, and release settings. - :ref:`sec.preferences` * - ```` - Group conditional variants of the same description. - ```` entries with ``name``, ``description``, ``arch``, ``import``, and optional ````. - :ref:`sec.profiles` * - ```` - Create or adjust users and groups in the image. - Optional ``arch`` and ``profiles`` filters; user records, group membership, home, shell, and password data. - :ref:`sec.users` * - ```` - Add driver files to the image description. - Optional ``profiles`` filter; one or more ```` references. - :ref:`sec.drivers` * - ```` - Remove files, libraries, or toolchains from the prepared root tree. - Required ``type`` (``delete``, ``tools``, or ``libs``) and optional ``profiles`` with one or more ```` entries. - :ref:`sec.strip` * - ```` - Point KIWI to package sources. - Repository type, optional ``arch`` and ``profiles`` filters, source type, priority, GPG behavior, credentials, and source URLs. - :ref:`sec.repository` * - ```` - Define containers to fetch from a registry into the image. - Required ``source`` and ``backend``, optional ``arch`` and ``profiles`` with one or more ```` entries. - :ref:`sec.registry` * - ```` - Define what KIWI installs, deletes, or imports. - ``type``, optional ``profiles``, ``patternType``, ``bootstrap_package`` with package, collection, product, file, ignore, and archive entries. - :ref:`sec.packages` * - ```` - Attach custom XML namespaces validated outside the built-in schema. - Arbitrary namespaced content. - :ref:`sec.extension` What to Configure First ----------------------- When you create or review an image description, work in this order: #. Start with :ref:`sec.description` so the image has clear ownership and a purpose. #. Add at least one :ref:`sec.preferences` block with a version, package manager, and one or more :ref:`type definitions `. #. Add the :ref:`sec.repository` entries that provide the packages needed for the build. #. Add one or more :ref:`sec.packages` sections to populate the root tree. #. Add optional sections such as :ref:`sec.users`, :ref:`sec.profiles`, or :ref:`sec.certificates` only when the use case needs them. Common Patterns --------------- Use profiles when one description should build multiple variants. .. code:: xml 1.0.0 zypper 1.0.0 zypper Use multiple package sections to separate bootstrap packages from the final image content. .. code:: xml Complete Schema Reference ------------------------- The exhaustive element and attribute reference is documented in :doc:`image_description/elements`. That reference follows the schema in :file:`kiwi/schema/kiwi.rnc` and covers: * every top-level section allowed below ````; * all common and type-specific attributes of ````; * repository, package, user, profile, bootloader, storage, and container substructures; and * examples for the most frequently used sections. Use this page as the guide to the structure of a description directory and use :doc:`image_description/elements` as the schema-backed lookup for every valid section and attribute. .. toctree:: :maxdepth: 1 image_description/elements.rst ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7363155 kiwi-11.1.8/doc/source/image_types_and_results.rst0000644000000000000000000002440415273675667017237 0ustar00.. _image_types: Image Types =========== .. note:: Before building an image with {kiwi}, it's important to understand the different image types and their meaning. This document provides an overview of the supported {kiwi} image types, their results, and some words about the environment to run the build. ISO Hybrid Live Image An ISO image that can be dumped on a CD/DVD or USB stick and boots from this media without interfering with other system storage components. A useful pocket system for testing, demo, and debugging purposes. For further details, refer to :ref:`hybrid_iso`. Virtual Disk Image An image representing the system disk, useful for cloud frameworks like Amazon EC2, Google Compute Engine, or Microsoft Azure. For further details, refer to :ref:`simple_disk`. OEM Expandable Disk Image An image representing an expandable system disk. This means after deployment, the system can resize itself to the new disk geometry. The resize operation is configurable as part of the image description, and an installation image for CD/DVD, USB stick, and network deployment can be created in addition. For further details, refer to: :ref:`expandable_disk`. Docker Container Image An archive image suitable for the Docker container engine. The image can be loaded via the `docker load` command and works within the scope of the container engine. For further details, refer to: :ref:`building_container_build`. WSL Container Image An archive image suitable for the Windows Subsystem for Linux container engine. The image can be loaded from a Windows System that has support for WSL activated. For further details, refer to: :ref:`building_wsl_build`. KIS Root Filesystem Image An optional root filesystem image associated with a kernel and initrd. The use case for this component image type is highly customizable. Many different deployment strategies are possible. For further details, refer to: :ref:`kis`. AWS Nitro Enclave An initrd-based image using the `eif` binary format. The image is expected to be used in the AWS Nitro Enclave system or for testing in QEMU. For further details, refer to: :ref:`eif`. Image Results ------------- {kiwi} execution results in an appliance image after a successful run of the :ref:`kiwi_system_build` or :ref:`kiwi_system_create` command. The result is the image binary plus some additional metadata files that are needed for image deployment and/or exist for informative reasons. By default, the output files follow this naming convention: `.\-\.\` where `` is the name stated in the :ref:`image-description` as an attribute of the :ref:`sec.image` element. The `` is the CPU architecture used for the build, `` is the image version defined in the :ref:`` element of the image description, and the `` is dependent on the image type and its definition. Any {kiwi} appliance build results in, at least, the following output files: 1. The image binary, `.\-\.\`: This is the file containing the actual image binary. Depending on the image type and its definition, it can be a virtual disk image file, an ISO image, a tarball, etc. 2. The `.-.packages` file: This file includes a sorted list of the packages that are included in the image. In fact, this is a normalized dump of the package manager database. It follows the following CSV format, where each line is represented by: `|\|\|\|\|\|\` The values represented here are mainly based on RPM packages' metadata. Other package managers may not provide all of these values. In such cases, the format is the same, and the fields that cannot be provided are set as `None`. This list can be used to track changes across multiple builds of the same image description over time by diffing the packages installed. 3. The `.-.verified` file: This file is the output of a verification done by the package manager against the package database. More specifically, it is the output of the `rpm` verification process or `dpkg` verification, depending on the packaging technology selected for the image. In both cases, the output follows the RPM verification syntax. This provides an overview of all package statuses right before any boot of the image. Depending on the image type, the following output files exist: image="tbz" For this image type, the result is mainly a root tree packed in a tarball: - **root archive**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.tar.xz` image="btrfs|ext2|ext3|ext4|squashfs|erofs|xfs" The image root tree data is packed into a filesystem image of the given type; hence, the result for an `ext4` image would be: - **filesystem image**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.ext4` image="iso" The image result is an ISO file: - **live image**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.iso` image="oem" An image representing an expandable disk image. {kiwi} can also produce an installation ISO for this disk image by setting `installiso="true"` in the :ref:`\\` section or a tarball, including the artifacts for a network deployment, by setting `installpxe="true"`. For further details, see :ref:`expandable_disk`. The results for `oem` can be: - **disk image**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.raw` - **installation image (optional)**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.install.iso` - **installation pxe archive (optional)**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.install.tar` The disk image can also be provided in one of the various virtual disk formats, which can be specified in the `format` attribute of the :ref:`\\` section. For further details, see :ref:`simple_disk`. The result for e.g., `format="qcow2"` would be: - **disk image**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.qcow2` instead of the `.raw` default disk format. image="docker" An archive image suitable for the Docker container engine. The result is a loadable (`docker load -i `) tarball: - **container**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.docker.tar.xz` image="oci" An archive image that builds a container matching the OCI (Open Container Initiative) standard. The result is a tarball matching OCI standards: - **container**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.oci.tar.xz` image="appx" An archive image suitable for the Windows Subsystem for Linux container engine. The result is an `appx` binary file: - **container**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.appx` image="wsl" An archive image suitable for the Windows Subsystem for Linux container engine >= v2.4.4. The result is a gzip-compressed tar archive with the `.wsl` extension: - **container**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.wsl` image="kis" An optional root filesystem image associated with a kernel and initrd. All three binaries are packed in a tarball. See :ref:`kis` for further details about the kis archive: - **kis archive**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.tar.xz` image="enclave" An initrd-based image in the `eif` binary format for the AWS Nitro Enclave system. See :ref:`eif` for further details: - **enclave image**: :file:`{exc_image_base_name}.x86_64-{exc_image_version}.eif` Image Bundle Format ------------------- The result files as mentioned above are used in the {kiwi} result bundler. The `kiwi-ng result bundle` command can be used to copy or package the mandatory image files to create a customer release. In this process, it's possible to apply a specific name pattern suitable for the requirements of the release. A typical result bundle call can look like the following: .. code:: bash $ kiwi-ng result bundle --target-dir /path/to/image/build_result \ --bundle-dir=/path/to/image/release_result \ --id=release_identifier In this call, and depending on the image type, the required files as they exist in :file:`/path/to/image/build_result` are copied to :file:`/path/to/image/release_result/`. The only modification to the file names is the `--id` information, which is appended with a `-` at the end of the version substring. If we take :file:`{exc_image_base_name}.x86_64-{exc_image_version}.iso` as an example. This file would be bundled as :file:`{exc_image_base_name}.x86_64-{exc_image_version}-release_identifier.iso`. Depending on the use case and the customer requirements, this naming schema and the default way the kiwi bundler processes the result files is not appropriate. To allow for a more flexible naming schema when bundling results, {kiwi} allows you to specify a bundle_format per type, like in the following example: .. code:: xml The specified `name_pattern` is used as the base name for the image files the bundler uses. As part of the `name_pattern`, the following placeholders, which are replaced by their real value, can be used: %N Turns into the contents of the `name` attribute of the `` section. %P Turns into the profile name used at build time of the image. If multiple profiles were used to build the image, the result name consists of the individual profile names concatenated by a `_` in the order of their specification in the image description and/or the command line. %A Turns into the architecture name at build time of the image. Arch names are taken from Python's `platform.machine` information. %I Turns into the identifier name given via the `--id` option at the call time of the bundler. %T Turns into the contents of the `image` attribute of the `` section. %M Turns into the major number of the `` section. %m Turns into the minor number of the `` section. %p Turns into the patch number of the `` section. %v Turns into the version text of the `` section. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7363155 kiwi-11.1.8/doc/source/index.rst0000644000000000000000000001524215273675667013435 0ustar00.. kiwi documentation master file .. only:: suse .. include:: suse_metadata.rst Welcome to KIWI NG ================== **Build Linux images from one description in a predictable two-step workflow.** KIWI NG is a command-line image builder for Linux distributions. It creates bootable, reproducible images for virtual machines, cloud platforms, removable media, containers, and specialized deployment targets. .. note:: This documentation covers {kiwi-product} |version|. .. toctree:: :maxdepth: 1 :hidden: overview installation quickstart concept_and_workflow commands image_description build_methods example_use_cases image_types_and_results troubleshooting contributing Build Architecture ------------------ .. figure:: .images/architecture.svg :align: center :alt: KIWI NG needs an image description and repositories with packages. The prepare step creates a new root tree, and the create step turns it into one or more images. KIWI NG builds from an image description and the repositories that provide the packages for it. In the *prepare* step, KIWI creates a new root tree. In the *create* step, KIWI converts that prepared root tree into one or more image artifacts. Diagram description: The diagram shows two required inputs: an image description and the repositories that contain the packages used for the build. Both feed the *prepare* step, which creates a new root tree. The *create* step then turns that prepared root tree into one or more images such as disk, ISO, or container artifacts. The image description directory typically contains: * :file:`config.xml` or a :file:`*.kiwi` file with the image definition. * Repository definitions that point to the package sources used during the build. * Optional overlays, archives, and shell hooks that customize the prepared root tree or the final image artifacts. Why KIWI? --------- * **One source, multiple outputs**: prepare a root filesystem once and create one or more image formats from it. * **Declarative image definitions**: keep image metadata, repositories, packages, users, and storage settings in a versioned description. * **Broad target support**: build for bare metal, virtual machines, cloud environments, live media, and containers. * **Distribution-aware builds**: work with the package managers and repository layouts used by the supported Linux distributions. * **Controlled customization**: extend builds with overlays, archives, and scripts when the schema alone is not enough. .. sidebar:: Links * `GitHub Sources `__ * `GitHub Releases `__ * `RPM Packages `__ * `Build Tests TumbleWeed(x86) `__ * `Build Tests TumbleWeed(arm) `__ * `Build Tests TumbleWeed(s390) `__ * `Build Tests TumbleWeed(ppc64le) `__ * `Build Tests RawHide(x86) `__ * `Build Tests RawHide(s390) `__ * `Build Tests Leap(x86) `__ * `Build Tests Fedora(x86) `__ * `Build Tests Fedora(arm) `__ * `Build Tests CentOS(x86) `__ * `Build Tests Ubuntu(x86) `__ * `Build Tests Ubuntu(arm) `__ * `Build Tests Debian(x86) `__ * `Build Tests ArchLinux(x86) `__ Get Started ----------- Start with :doc:`quickstart` for a first build, :doc:`concept_and_workflow` for workflow details, and :doc:`image_description` for the schema-backed reference for description files. System Requirements ------------------- To build images with {kiwi}, you need: * A recent Linux distribution. See :ref:`supported-distributions` for the tested targets. * Enough free disk space for the build root, caches, and resulting images. A minimum of 15 GB is recommended. * Python 3.9 or newer. * Git to clone image descriptions and example repositories. * Optionally, a virtualization environment such as QEMU to boot and inspect the resulting images. The project officially tests and supports the following distributions: ============================================================ ================= Distribution Version ============================================================ ================= `Fedora Linux `_ 43+ `CentOS Stream `_ 10+ `CentOS Stream Hyperscale `_ 10+ `openSUSE Tumbleweed `_ after April 2025 `openSUSE Leap 16.0+ `_ 16.0+ `Canonical Ubuntu Linux `_ 26.04+ `Debian GNU/Linux `_ 13+ `Arch Linux `_ after April 2025 ============================================================ ================= Contact ------- * `Mailing list `__ The `kiwi-images` group is an open group, and anyone can `subscribe `__, even if you do not have a Google account. * `Matrix `__ An open network for secure, decentralized communication. Please find the ``#kiwi:matrix.org`` room via `Matrix `__ on the web or by using the supported `clients `__. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7363155 kiwi-11.1.8/doc/source/installation.rst0000644000000000000000000000567115273675667015034 0ustar00.. _kiwi-installation: Installation ============ .. note:: This document describes how to install {kiwi}. Apart from the preferred method of installing {kiwi} via a distribution package manager, it is also available on `pypi `__ and can be installed using Python's package manager, pip, as follows: .. code:: shell-session $ sudo pip install kiwi .. _installation-from-obs: Installation from OBS --------------------- The most up-to-date packages of {kiwi} can be found on the Open Build Service in the `Virtualization:Appliances:Builder `__ project. To install {kiwi}, follow these steps: 1. Open the URL https://download.opensuse.org/repositories/Virtualization:/Appliances:/Builder in your browser. 2. Right-click on the link of your preferred operating system and copy the URL. In Firefox, it is the menu :menuselection:`Copy link address`. 3. Insert the copied URL from the last step into your shell. The `DIST` placeholder contains the respective distribution. Use :command:`zypper addrepo` to add it to the list of your repositories: .. code:: shell-session $ sudo zypper addrepo \ http://download.opensuse.org/repositories/Virtualization:/Appliances:/Builder/ \ kiwi-appliance-builder 4. Install {kiwi}: .. code:: shell-session $ sudo zypper --gpg-auto-import-keys install python3-kiwi .. note:: Other Distributions If your distribution is not using `zypper`, please use your package manager's appropriate command instead. For `dnf`, as an example, that is: .. code:: shell-session $ sudo dnf config-manager \ --add-repo https://download.opensuse.org/repositories/Virtualization:/Appliances:/Builder//Virtualization:Appliances:Builder.repo $ sudo dnf install python3-kiwi Installation from Distribution Repositories ------------------------------------------- Some Linux distributions ship {kiwi} in their official repositories. These include **openSUSE** and **Fedora** since version 28. Note that these packages tend not to be as up-to-date as the packages from OBS, so some features described here might not exist yet. .. note:: There are many packages that contain the name *kiwi* in their name; some of these are not even Python packages. Please double-check the package's description to see whether it is actually the {kiwi} Appliance builder before installing it. Please also note that, depending on how the responsible packager has integrated {kiwi} into the distribution, the install name can be different from the instructions provided in: :ref:`installation-from-obs`. To install {kiwi} for the desired distribution, run the following command: Leap/Tumbleweed: .. code:: shell-session $ sudo zypper install python3-kiwi Fedora/Rawhide: .. code:: shell-session $ sudo dnf install kiwi-cli ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7363155 kiwi-11.1.8/doc/source/overview/workflow.rst0000644000000000000000000001010315273675667016035 0ustar00Basic Workflow ============== .. note:: **Abstract** The installation of a Linux system generally occurs by booting the target system from an installation source such as an installation CD/DVD, a live CD/DVD, or a network boot environment (PXE). The installation process is often driven by an installer that interacts with the user to collect information about the installation. This information generally includes the *software to be installed*, the *timezone*, system *user* data, and other information. Once all the information is collected, the installer installs the software onto the target system using packages from the available software sources (repositories). After the installation is complete, the system usually reboots and enters a configuration procedure upon startup. The configuration may be fully automatic, or it may include user interaction. This description applies for version |version|. A system image (usually called an "image") is a *complete installation* of a Linux system within a file. The image represents an operating system and, optionally, contains the "final" configuration. The behavior of the image upon deployment varies depending on the image type and the image configuration since {kiwi} allows you to completely customize the initial startup behavior of the image. Among others, this includes images that: * can be deployed inside an existing virtual environment without requiring configuration at startup. * automatically configure themselves in a known target environment. * prompt the user for an interactive system configuration. The image creation process with {kiwi} is automated and does not require any user interaction. The information required for the image creation process is provided by the primary configuration file named :file:`config.xml`. This file is validated against the schema documented in: :ref:`image-description`. In addition, the image can optionally be customized using the :file:`config.sh` and :file:`images.sh` scripts and by using an *overlay tree (directory)* called :file:`root`. See the :ref:`description_components` section for further details. .. note:: Previous Knowledge This documentation assumes that you are familiar with the general concepts of Linux, including the boot process and distribution concepts such as package management. .. _description_components: Components of an Image Description ---------------------------------- A {kiwi} image description can be composed of several parts. The main part is the {kiwi} description file itself (named :file:`config.xml` or an arbitrary name plus the :file:`*.kiwi` extension). The configuration XML is the only required component; others are optional. These are the optional components of an image description: #. Shell scripts There are optional hook scripts to influence the build process at several stages. For details about the different script break points see :ref:`User-Defined Scripts ` #. Overlay tree directory The *overlay tree* is a folder (called :file:`root`) or a tarball file (called :file:`root.tar.gz`) that contains files and directories that will be copied to the target image build tree during the :ref:`prepare step `. It is applied after all the packages included in the :file:`config.xml` file have been installed. Any already present file is overwritten. #. CD root user data For live ISO images and install ISO images, an optional cdroot archive is supported. This is a tar archive matching the name :file:`config-cdroot.tar[.compression_postfix]`. If present, it will be unpacked as user data on the ISO image. This is mostly useful to add, e.g., license files or user documentation on the CD/DVD, which can be read directly without booting from the media. #. Archives included in the :file:`config.xml` file. The archives that are included in the `` using the `` subsection: .. code:: xml ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7363155 kiwi-11.1.8/doc/source/overview.rst0000644000000000000000000000544315273675667014176 0ustar00.. _db_overview: Overview ======== .. note:: **Abstract** This document provides a conceptual overview of the steps of creating an image with {kiwi}. It also explains the terminology regarding the concept and process when building system images with {kiwi} |version|. .. toctree:: :maxdepth: 1 overview/workflow Conceptual Overview ------------------- A system image (usually called an "image") is a *complete installation* of a Linux system within a file. The image represents an operating system and, optionally, contains the "final" configuration. {kiwi} creates images in a two-step process: 1. The first step, the *prepare operation*, generates a so-called *unpacked image tree* (directory) using the information provided in the image description. 2. The second step, the *create operation*, creates the *packed image* or *image* in the specified format based on the unpacked image and the information provided in the configuration file. The image creation process with {kiwi} is automated and does not require any user interaction. The information required for the image creation process is provided by the image description. Terminology ----------- Appliance An appliance is a ready-to-use image of an operating system, including a pre-configured application for a specific use case. The appliance is provided as an image file and needs to be deployed to or activated in the target system or service. Image The result of a {kiwi} build process. Image Description A specification to define an appliance. The image description is a collection of human-readable files in a directory. At least one XML file, :file:`config.xml` or :file:`*.kiwi`, is required. In addition, there may be other files, like scripts or configuration data. These can be used to customize certain parts of either the {kiwi} build process or the initial startup behavior of the image. Overlay Files A directory structure with files and subdirectories stored as part of the Image Description. This directory structure is packaged as a file, :file:`root.tar.gz`, or stored inside a directory named :file:`root`. Additional overlay directories for selected profiles are also supported and are taken into account if the directory name matches the name of the profile. The content of each of the directory structures is copied on top of the existing filesystem (overlayed) of the appliance root. This also includes permissions and attributes as a supplement. {kiwi} An OS appliance builder. Virtualization Technology Software-simulated computer hardware. A virtual machine acts like a real computer but is separated from the physical hardware. Within this documentation, the QEMU virtualization system is used. Another popular alternative is VirtualBox. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7363155 kiwi-11.1.8/doc/source/quickstart.rst0000644000000000000000000000445715273675667014526 0ustar00.. _quick-start: Quick Start =========== .. note:: **Abstract** This document describes how to start working with {kiwi}, an OS appliance builder. This description applies to version |version|. Before you start ---------------- 1. Install {kiwi} first, either via your distribution's package manager (see :ref:`kiwi-installation`) or via: .. code:: bash $ sudo pip install kiwi 2. Clone the {kiwi} repository containing example appliances: .. code:: bash $ git clone https://github.com/OSInside/kiwi .. note:: Please see the :ref:`troubleshooting` chapter and/or our `Contact` info on the main page if the following procedure causes any trouble. Choose a First Image -------------------- Find example appliance descriptions in the {kiwi} repository checkout as follows: .. code:: bash $ tree -L 3 kiwi/build-tests Take a look at which images are available in the example appliances repository and select one that matches your desired image as closely as possible. Or just use the one given in the examples below. Build your First Image ---------------------- Your first image will be a simple system disk image that can run in any full virtualization system like QEMU. Invoke the following {kiwi} command in order to build it: .. code:: bash $ sudo kiwi-ng system build \ --description kiwi/build-tests/{exc_description_disk} \ --set-repo {exc_repo_leap} \ --target-dir /tmp/myimage The resulting image will be placed into the folder :file:`/tmp/myimage` with the suffix :file:`.raw`. If you don't wish to create an openSUSE Leap {exc_os_version} image, substitute the folder following the ``--description`` option with another folder that contains the image description which you selected. Run your Image -------------- Running an image actually means booting the operating system. To do that, attach the disk image to a virtual system. In this example, we use QEMU and boot it as follows: .. code:: bash $ sudo qemu -boot c \ -drive file=/tmp/myimage/{exc_image_base_name_disk}.x86_64-{exc_image_version}.raw,format=raw,if=virtio \ -m 4096 -serial stdio Tweak and Customize your Image ------------------------------ Now that you have successfully built and started your first image, you can start tweaking it to match your needs. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7363155 kiwi-11.1.8/doc/source/spelling_wordlist.txt0000644000000000000000000000026415273675667016077 0ustar00KIWI NG QEMU OBS zypper dnf microdnf apt apk dracut initrd snapper qcow2 vmdk vhdx PXE OCI Vagrant VMware Rawhide Tumbleweed openSUSE SUSE CentOS Ubuntu Debian Archlinux LoongArch ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7363155 kiwi-11.1.8/doc/source/suse_metadata.rst0000644000000000000000000000040715273675667015142 0ustar00:meta: :description: Your flexible operating system image and appliance builder :keyword: KIWI :social-descr: The SEO description :seo-title: KIWI - Appliance Builder Next Generation :task: Deployment, Installation :series: Products & Solutions ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7363155 kiwi-11.1.8/doc/source/troubleshooting/architectures.rst0000644000000000000000000000353715273675667020426 0ustar00Architectures ------------- With regards to the information in :ref:`supported-distributions`, one requirement between the build host and the image, when it comes to architecture support, is that the image architecture should match the build host architecture. Cross-arch building would require any core tool that is used to build an image to be cross-arch capable. To patch, e.g., an x86_64 system such that it can build an aarch64 image would require some work on binutils and hacks as well as performance tweaks, which is all not worth the effort and can still lead to broken results. Thus, we recommend providing native systems for the target architecture and building there. One possible alternative is to use the {kiwi} `boxbuild` command (see :ref:`self_contained`), together with a box created for the desired architecture. However, keep in mind the performance problems when running a VM of a different architecture. The majority of the image builds are based on the x86 architecture. As mentioned, {kiwi} also supports other architectures, as shown in the table below: .. table:: :align: left +--------------+---------------------+ | Architecture | Supported | +==============+=====================+ | x86_64 | yes | +--------------+---------------------+ | ix86 | yes **note:distro** | +--------------+---------------------+ | s390/s390x | yes **note:distro** | +--------------+---------------------+ | arm/aarch64 | yes **note:distro** | +--------------+---------------------+ | ppc64 | yes **note:distro** | +--------------+---------------------+ .. admonition:: distro The support status for an architecture depends on the distribution. If the distribution does not build its packages for the desired architecture, {kiwi} will not be able to build an image for it. ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.737635 kiwi-11.1.8/doc/source/troubleshooting/boxbuild_tweaks.rst0000644000000000000000000000467615273675667020754 0ustar00Boxbuild Tweaks =============== .. note:: Abstract This document describes a few ways to modify box-build VMs for testing and debugging. Increase Box Build Image Size ----------------------------- In particularly large builds, you may find that the upstream build boxes are not quite large enough and fail to build during the final few steps. While it is a bit of a kludge, it is possible to increase the size of the build box. To do so, follow these steps: .. note:: For this example, we will assume the box increase in question is an Ubuntu box, located in `~/.kiwi_boxes/ubuntu`. 1. While the VM is offline, locate the VM you want to modify and resize with `qemu-img`. Here, we will increase the size by 20G. The VM will have to be told to utilize this space in the following steps. .. code:: bash $ qemu-img resize Ubuntu-Box.x86_64-System.qcow2 +20G 2. When relaunching your `kiwi-ng` box build, make sure you use the `--no-snapshot` and `--box-debug` options within your build command/script. Example: .. code:: bash $ kiwi-ng --debug --profile="Disk" --type oem system boxbuild --no-snapshot \ --box-memory=32G --box-smp-cpus=16 --box-debug --box ubuntu kiwi \ --description ./ubuntu-jammy --target-dir /build/kiwi/outputs/ 3. When the build fails and drops you into the VM console, you will need to extend the partition of the VM's rootfs, then resize it with `resize2fs`. In this example, `parted` was used, and the partition in question was `/dev/vda3`. .. code:: bash $ parted # You can run parted print to check for relevant partitions if needed. (parted) $ print (parted) $ resizepart 3 100% # Exit from parted (parted) $ quit # Run resize2fs to grow the filesystem to fill the space $ resize2fs /dev/vda3 4. From this point, depending on where your build failed, it may be possible to continue your build from inside the box using the existing 9p mount points defined by your build command. Using the command above as an example, the build results within the box are stored below `/result`, and it's possible to run: .. code:: bash $ kiwi-ng --profile="Disk" --type oem system create \ --root=/result/build/image-root/ --target-dir=/result 5. If the rebuild from within was successful, you can copy the files from `/result` to `/bundle` from within the VM, where `/bundle` maps to your `target-dir` on the host. ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.737635 kiwi-11.1.8/doc/source/troubleshooting/buildhost_constraints.rst0000644000000000000000000001130715273675667022177 0ustar00.. _supported-distributions: Build Host Constraints ====================== For building images, a host system is required that runs the build process. Tools to create the image are used from that host, and this creates an indirect dependency on the target image. For example, building an Ubuntu image requires the apt and dpkg tools and metadata to be available and functional on the host to build an Ubuntu image. There are many more of those host vs. image dependencies, and not all of them can be resolved in a clear and clean way. The most compatible environment is provided if the build host is of the same distribution as the target image. In other cases, our recommendation is that the build host is of the same distribution as the target and near to the major version (+-1) compared to the target. Such an environment can be found in: * The Open Build Service `OBS `__. * The {kiwi} `boxbuild` command: :ref:`self_contained` In general, our goal is to support any major distribution with {kiwi}. However, for building images, we rely on core tools that are not under our control. Also, several design aspects of distributions like **secure boot** and working with **upstream projects** are different and not influenced by us. There are many side effects that can be annoying, especially if the build host is not of the same distribution vendor as the image target. Package Manager Behavior ------------------------ One of the key requirements for {kiwi} is that the target distribution consists of a collection of software packages provided through software repositories. As of today, this applies to every Linux distribution in some shape or form. For the installation of these software packages, there are tools available called `package manager`, and {kiwi} implements an API for a variety of package managers to support the different Linux distributions. In {kiwi}, the package manager tools are called in a way that allows for a non-interactive installation of the packages specified in the image description. However, {kiwi} does not intentionally configure other features of the package manager to keep their distribution default behavior as much as possible. There are many options that can be set for a package manager to behave differently. This part of the troubleshooting exists to inform about the most common surprises or unexpected behavior of certain package managers and solutions on how to address them. .. note:: All of the following information applies to package manager calls performed inside of the image root tree. Meaning, `after` the image bootstrap phase. During the image bootstrap phase, all package manager calls happen on the build host, and their behavior can only be influenced by changing the setup of the build host. An isolated build environment is required to address issues in this area. See :ref:`self_contained` for details. zypper: modalias matching ~~~~~~~~~~~~~~~~~~~~~~~~~ A module alias is an identifier that exists if the respective hardware was found by the kernel on this system. The package manager can use this information to match package(s) that holds a reference to the alias name and installs it automatically. For example: Automatically install a driver package if the respective hardware is present. In zypper, this behavior is by default enabled. When building an image, this feature can be unwanted and lead to interesting side effects. As it's required to build the image on some host, there is also some hardware available during the build. This must not necessarily be the same or compatible hardware the image is expected to run on later. For example, the build host has a NVIDIA graphics card. An image build process would install the NVIDIA driver package due to the modalias match. The image is expected to run on a system without an NVIDIA card. The build process would install unneeded software. To switch off modalias matching in zypper, follow these steps: 1. Add a `post_bootstrap.sh` hook script to your image description with the following code: .. code:: bash echo 'ZYPP_MODALIAS_SYSFS=""' > .kiwi.package_manager.env 2. Optionally, add a `config.sh` hook script to your image description with the following code: .. code:: bash rm .kiwi.package_manager.env This will delete the custom environment file so that it does not appear in the final image. 3. Rebuild your image. The `.kiwi.package_manager.env` environment file is used by kiwi and added to the execution environment of the package manager. The `ZYPP_MODALIAS_SYSFS` variable can be used to switch off the modalias matching. For more details on zypper settings, please refer to: https://doc.opensuse.org/projects/libzypp/HEAD/zypp-envars.html ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.737635 kiwi-11.1.8/doc/source/troubleshooting/filesystems.rst0000644000000000000000000000557715273675667020136 0ustar00Incompatible Filesystem Settings on Host vs. Image ================================================== .. note:: **Abstract** This page provides further information on how to solve image boot problems if the filesystem toolchain on the image build host is incompatible with the image's target distribution. When {kiwi} builds an image that requests the creation of a filesystem, the required filesystem creation tool, for example, `mkfs.xfs`, is called from the host on which {kiwi} is running. It is expected that the generated filesystem is compatible with the image's target distribution. This expectation is not always correct and depends on the compatibility of the filesystem default settings between build host and image target. We know about the following settings that cause an incompatible filesystem, which will not be able to be used on boot: Ext[2,3,4] Check `/etc/mke2fs.conf` on the build host and make sure the configured `inode_size` is the same as the setting used for the target image. To solve an issue of this type, use the following filesystem creation option in your {kiwi} image configuration: .. code:: xml XFS Check the XFS metadata setup on the build host and make sure the settings are compatible with the target image. XFS has the default settings compiled-in, thus it might be needed to build the image first and use the `xfs_info` tool in a `disk.sh` script to fetch the settings at the build time of the image. We know from community reports that the setting `sparse=1` will cause issues on older versions of grub's xfs module, which does not know how to handle this setting properly. To solve an issue of this type, use the following filesystem creation option in your {kiwi} image configuration: .. code:: xml btrfs btrfs and default page sizes (4k vs 64k). By default, btrfs autodetects the sector size according to the used kernel page size. If the sector size differs from the page size, the created filesystem cannot be mounted by the image's target kernel. If there is a different kernel page size between the kernel on the system the image is built on and the later kernel used for the image, it's required to specify the filesystem sector size to match with the kernel page size of the kernel used for the image. This can be done as in the following example: .. code:: xml .. note:: There can be more inconsistencies in the area of filesystems that we have not listed here. In general, it's advisable to build the image in a compatible environment. At best, the build host distribution is of the same major Linux version as the image target. For this purpose, {kiwi} provides the `boxbuild` command. Further details can be found in :ref:`self_contained`. ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.737635 kiwi-11.1.8/doc/source/troubleshooting/security.rst0000644000000000000000000000447315273675667017430 0ustar00Host Security Settings Conflicts with KIWI ========================================== .. note:: **Abstract** This page provides further information on how to solve image build problems caused by `selinux` security policies. Linux systems are protected against write/read or other operations depending on the application that wants to access or modify data. The rules for this protection are provided in security policies. There are several applications enforcing these security settings, e.g. `apparmor` or `selinux`. In this troubleshooting chapter, the focus is on `selinux`. Protecting files, process groups, kernel filesystems, device nodes and more from unauthorized access and restricting it to a certain set of applications is a nice concept. However, if taken seriously, no other application except the ones configured in the security policy will function properly. When building an appliance, the appliance builder has to have access to a wide range of services. It must be able to create a new package database elsewhere in the system. It must be able to create, read and write device nodes, create filesystems, partitions, bootloader configurations, etc. The list is very long and no security policy could cover this in a way that it would not be open to everything, which in the end leads to a pointless exercise and no security at all. This means for users who would like to keep the security settings of the system enforced and unchanged, the only way to allow {kiwi} to do its job is to run it through `boxbuild` as explained in :ref:`self_contained`. For users who can afford to open the system security policy, the following procedure will allow {kiwi} to work: .. code:: bash sudo setenforce 0 This action disables selinux temporarily. To disable selinux permanently, perform the following steps: 1. Open the SELinux configuration file: :file:`/etc/selinux/config` 2. Locate the following line: `SELINUX=enforcing` 3. Change the value to disabled: .. code:: bash SELINUX=disabled 4. On the next reboot, SELinux is permanently disabled. .. note:: Similar instructions apply to other application security subsystems like `apparmor`. Due to the complexity of these systems, this article only mentions the most common issue people run into when building images on systems protected by `selinux`. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7363155 kiwi-11.1.8/doc/source/troubleshooting.rst0000644000000000000000000000076515273675667015561 0ustar00.. _troubleshooting: Troubleshooting =============== .. note:: **Abstract** This document describes situations that lead to issues during build or boot time of the image built with {kiwi}. The suggested solutions are considered best practice but are just one of many possible solutions. .. toctree:: :maxdepth: 1 troubleshooting/buildhost_constraints troubleshooting/architectures troubleshooting/security troubleshooting/filesystems troubleshooting/boxbuild_tweaks ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7378054 kiwi-11.1.8/dracut/modules.d/50kiwi-verity/.gitignore0000644000000000000000000000002315273675667017312 0ustar00/kiwi-parse-verity ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7378643 kiwi-11.1.8/dracut/modules.d/50kiwi-verity/Makefile0000644000000000000000000000067415273675667016776 0ustar00buildroot ?= / CROSS_COMPILE ?= CC ?= $(CROSS_COMPILE)gcc CFLAGS += -Werror -Wall -Wextra BINARY := kiwi-parse-verity .PHONY: all all: build .PHONY: install install: build install -Dm0755 \ kiwi-verity-setup.sh kiwi-veritytab-setup.sh module-setup.sh \ -t ${buildroot}usr/lib/dracut/modules.d/50kiwi-verity install -Dm0755 $(BINARY) ${buildroot}usr/bin/$(BINARY) .PHONY: build build: $(BINARY) .PHONY: clean clean: rm -f $(BINARY) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7378643 kiwi-11.1.8/dracut/modules.d/50kiwi-verity/README.rst0000644000000000000000000000477015273675667017026 0ustar00kiwi-parse-verity ================= Overview -------- This tool is used to parse the information stored by `Kiwi `__ inside the unused space of a disk partition when using a SquashFS root filesystem backed by ``dm-verity``. This data is stored at a known offset (generally 4096 bytes, or 1 block, from the end of the partition) and follows the layout as described in the `Kiwi documentation `__ for the attribute ``embed_verity_metadata``. Usage ----- The following parameters are required in the Kiwi appliance description: - ``verity_blocks="all"`` - ``embed_verity_metadata="true"`` The tool is used to pull a specific entry from the metadata and will return that entry as plain text. It can be called using the following syntax: :: kiwi-parse-verity -p -o The data type is one of the entries stored by Kiwi inside the metadata, such as ``root-hash`` or ``algorithm``. More information about the parameters can be found by calling ``kiwi-parse-verity --help``. You will probably need all of the metadata to successfully map the device, as Kiwi sets up the ``dm-verity`` device with the ``--no-superblock`` option, which does not store any data inside the partition, meaning all parameters need to be passed to it on the command line. Example ~~~~~~~ Detailed example of pulling all of the metadata from the partition and mapping the device using ``veritysetup``: :: VERITY_ROOT=/dev/sda7 ROOT_HASH=$(kiwi-parse-verity -p ${VERITY_ROOT} -o root-hash) ALGORITHM=$(kiwi-parse-verity -p ${VERITY_ROOT} -o algorithm) HASH_TYPE=$(kiwi-parse-verity -p ${VERITY_ROOT} -o hash-type) HASH_BLOCK_SIZE=$(kiwi-parse-verity -p ${VERITY_ROOT} -o hash-blocksize) DATA_BLOCK_SIZE=$(kiwi-parse-verity -p ${VERITY_ROOT} -o data-blocksize) SALT=$(kiwi-parse-verity -p ${VERITY_ROOT} -o salt) DATA_BLOCKS=$(kiwi-parse-verity -p ${VERITY_ROOT} -o data-blocks) HASH_START_BLOCK=$(kiwi-parse-verity -p ${VERITY_ROOT} -o hash-start-block) HASH_OFFSET=$(( ${HASH_START_BLOCK} * ${HASH_BLOCK_SIZE} )) veritysetup open ${VERITY_ROOT} verityRoot ${VERITY_ROOT} ${ROOT_HASH} \ --no-superblock --hash ${ALGORITHM} --format ${HASH_TYPE} \ --hash-block-size ${HASH_BLOCK_SIZE} --data-block-size ${DATA_BLOCK_SIZE} \ --salt ${SALT} --data-blocks ${DATA_BLOCKS} --hash-offset ${HASH_OFFSET} The device will then be mapped to ``/dev/mapper/verityRoot``. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7378643 kiwi-11.1.8/dracut/modules.d/50kiwi-verity/kiwi-parse-verity.c0000644000000000000000000003147015273675667021073 0ustar00// vi: set sw=4 ts=4 : // SPDX-License-Identifier: GPL-2.0-or-later // Copyright (C) 2023 Canonical Ltd // Author: Isaac True // // This file is part of kiwi. // // kiwi is free software: you can redistribute it and/or modify // it under the terms of the GNU General Public License as published by // the Free Software Foundation, either version 3 of the License, or // (at your option) any later version. // // kiwi is distributed in the hope that it will be useful, // but WITHOUT ANY WARRANTY; without even the implied warranty of // MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the // GNU General Public License for more details. // // You should have received a copy of the GNU General Public License // along with kiwi. If not, see // #define _POSIX_C_SOURCE (200809L) #define _LARGEFILE64_SOURCE #include #include #include #include #include #include #include #include #include #include #include #include enum output_type { OUTPUT_VERSION, OUTPUT_FSTYPE, OUTPUT_ACCESS, OUTPUT_IDENTIFIER, OUTPUT_HASH_TYPE, OUTPUT_DATA_BLOCK_SIZE, OUTPUT_HASH_BLOCK_SIZE, OUTPUT_DATA_BLOCKS, OUTPUT_HASH_START_BLOCK, OUTPUT_ALGORITHM, OUTPUT_ROOT_HASH, OUTPUT_SALT, OUTPUT_UNKNOWN, }; struct args { char *path; uint64_t block_size; uint64_t end_offset; bool verbose; enum output_type output; }; struct kiwi_verity_header { /* currently set to 1 */ char version; /* name of filesystem attribute */ char *fstype; /* either ro or rw depending on the filesystem capabilities */ char *access; /* fixed identifier value */ char *identifier; }; struct kiwi_verity_metadata { /* hash type name as returned by veritysetup */ char hash_type; /* data blocksize as returned by veritysetup */ char *data_blksize; /* hash blocksize as returned by veritysetup */ char *hash_blksize; /* number of data blocks as returned by veritysetup */ char *data_blocks; /* hash start block as required by the kernel to construct the device map */ char *hash_start_block; /* hash algorithm as returned by veritysetup */ char *algorithm; /* root hash as returned by veritysetup */ char *root_hash; /* salt hash as returned by veritysetup */ char *salt; }; static const char *const output_table[] = { [OUTPUT_VERSION] = "version", [OUTPUT_FSTYPE] = "fs-type", [OUTPUT_ACCESS] = "access", [OUTPUT_IDENTIFIER] = "identifier", [OUTPUT_HASH_TYPE] = "hash-type", [OUTPUT_DATA_BLOCK_SIZE] = "data-blocksize", [OUTPUT_HASH_BLOCK_SIZE] = "hash-blocksize", [OUTPUT_DATA_BLOCKS] = "data-blocks", [OUTPUT_HASH_START_BLOCK] = "hash-start-block", [OUTPUT_ALGORITHM] = "algorithm", [OUTPUT_ROOT_HASH] = "root-hash", [OUTPUT_SALT] = "salt", }; static void print_usage(char *const argv[]); static enum output_type parse_output_type(const char *const str); static int parse_args(struct args *const args, const int argc, char *const argv[]); static int kiwi_read_verity_info(const struct args *const args, struct kiwi_verity_header *const header, struct kiwi_verity_metadata *const metadata); static bool is_data_separator(char c); static int read_string(int fd, char **const dest); static int read_char(int fd, char *const dest); static void cleanup(struct kiwi_verity_header *const header, struct kiwi_verity_metadata *const metadata); static enum output_type parse_output_type(const char *const str) { char buffer[32] = {'\0'}; assert(str); /* * Copy the string to a temporary buffer so we can ensure it's * NULL-terminated. */ memcpy(buffer, str, strnlen(str, sizeof(buffer) - 1)); buffer[sizeof(buffer) - 1] = '\0'; for (size_t i = 0; i < (sizeof(output_table) / sizeof(output_table[0])); i++) { if (!memcmp(buffer, output_table[i], strnlen(output_table[i], sizeof(buffer) - 1) + 1)) { return (enum output_type)i; } } return OUTPUT_UNKNOWN; } static int parse_args(struct args *const args, const int argc, char *const argv[]) { int c; assert(args); assert(argc > 0); assert(argv); while ((c = getopt(argc, argv, "p:b:e:vo:")) != -1) switch (c) { case 'p': args->path = optarg; break; case 'b': args->block_size = strtoul(optarg, NULL, 10); break; case 'e': args->end_offset = strtoul(optarg, NULL, 10); break; case 'v': args->verbose = true; break; case 'o': args->output = parse_output_type(optarg); break; case '?': return 1; default: print_usage(argv); return 1; } return 0; } static void print_usage(char *const argv[]) { assert(argv); puts("kiwi-parse-verity"); puts("Tool for extracting verity information from a Kiwi image"); puts("Written by Isaac True "); puts(""); printf("Usage: %s -p [options]\n", argv[0]); puts(" -p : path to the device where the verity data is stored"); puts(" -o : data to extract (default root-hash). Can be one of the following:"); for (size_t i = 0; i < (sizeof(output_table) / sizeof(output_table[0])); i++) { printf(" %s\n", output_table[i]); } puts(" -e : offset in blocks from the end of the target device where the data is stored (default 1)"); puts(" -b : hash block size (default 4096)"); puts(" -v: enable verbose mode"); } static int kiwi_read_verity_info(const struct args *const args, struct kiwi_verity_header *const header, struct kiwi_verity_metadata *const metadata) { int fd; int ret; off64_t offset; assert(args); assert(header); assert(metadata); fd = open(args->path, O_RDONLY); if (fd < 0) { printf("Failed to open %s: %s (%d)\n", args->path, strerror(errno), errno); return -errno; } offset = (off64_t)args->block_size * (off64_t)args->end_offset; if (lseek64(fd, -offset, SEEK_END) < 0) { printf("Failed to go to offset %"PRIu64" in %s: %s (%d)\n", offset, args->path, strerror(errno), errno); return -errno; } /* * Make sure that we are parsing a known version. This also serves as * a basic preliminary sanity check. */ ret = read_char(fd, &header->version); if (ret < 0) { return ret; } if (header->version != '1') { printf("Invalid Kiwi verity metadata version: %c\n", header->version); return -EINVAL; } ret = read_string(fd, &header->fstype); if (ret < 0) { return ret; } ret = read_string(fd, &header->access); if (ret < 0) { return ret; } ret = read_string(fd, &header->identifier); if (ret < 0) { return ret; } ret = read_char(fd, &metadata->hash_type); if (ret < 0) { return ret; } ret = read_string(fd, &metadata->data_blksize); if (ret < 0) { return ret; } ret = read_string(fd, &metadata->hash_blksize); if (ret < 0) { return ret; } ret = read_string(fd, &metadata->data_blocks); if (ret < 0) { return ret; } ret = read_string(fd, &metadata->hash_start_block); if (ret < 0) { return ret; } ret = read_string(fd, &metadata->algorithm); if (ret < 0) { return ret; } ret = read_string(fd, &metadata->root_hash); if (ret < 0) { return ret; } ret = read_string(fd, &metadata->salt); if (ret < 0) { return ret; } close(fd); return 0; } static bool is_data_separator(char c) { return (c == ' ' || c == '\xff'); } static int read_string(int fd, char **const dest) { char buffer[256] = {'\0'}; size_t i = 0; assert(fd >= 0); assert(dest); do { ssize_t ret = read(fd, &buffer[i], 1); if (ret < 0) { return -errno; } else if (ret < 1) { return -ENOSPC; } if (is_data_separator(buffer[i])) { /* End the string here */ buffer[i] = '\0'; break; } } while (i++ < (sizeof(buffer) - 1)); *dest = strdup(buffer); if (!*dest) { return -errno; } return 0; } static int read_char(int fd, char *const dest) { char *buffer = NULL; int ret; assert(fd >= 0); assert(dest); ret = read_string(fd, &buffer); if (ret < 0) { return 0; } assert(buffer); *dest = buffer[0]; free(buffer); return 0; } static void cleanup(struct kiwi_verity_header *const header, struct kiwi_verity_metadata *const metadata) { assert(header); assert(metadata); if (header->access != NULL) { free(header->access); } if (header->fstype != NULL) { free(header->fstype); } if (header->identifier != NULL) { free(header->identifier); } if (metadata->algorithm != NULL) { free(metadata->algorithm); } if (metadata->data_blksize != NULL) { free(metadata->data_blksize); } if (metadata->data_blocks != NULL) { free(metadata->data_blocks); } if (metadata->hash_blksize != NULL) { free(metadata->hash_blksize); } if (metadata->hash_start_block != NULL) { free(metadata->hash_start_block); } if (metadata->root_hash != NULL) { free(metadata->root_hash); } if (metadata->salt != NULL) { free(metadata->salt); } } int main(int argc, char *argv[]) { int ret = 0; struct args args = { .path = NULL, .block_size = 4096, .end_offset = 1, .verbose = false, .output = OUTPUT_ROOT_HASH, }; struct kiwi_verity_header header = {0}; struct kiwi_verity_metadata metadata = {0}; ret = parse_args(&args, argc, argv); if (ret) { return ret; } if (args.path == NULL || args.output == OUTPUT_UNKNOWN || args.block_size == 0 || args.end_offset == 0) { print_usage(argv); return -1; } if (args.verbose) { printf("Reading from %s, block size %"PRIu64", block offset from end %"PRIu64"\n", args.path, args.block_size, args.end_offset); } ret = kiwi_read_verity_info(&args, &header, &metadata); if (ret) { printf("Failed to read metadata: %s (%d)\n", strerror(-ret), ret); goto exit; } if (args.verbose) { printf("\nHeader:\n"); printf(" Version: %c\n", header.version); printf(" FS Type: %s\n", header.fstype); printf(" Access: %s\n", header.access); printf(" Identifier: %s\n", header.identifier); printf("\nMetadata:\n"); printf(" Hash type: %c\n", metadata.hash_type); printf(" Data blksize: %s\n", metadata.data_blksize); printf(" Hash blksize: %s\n", metadata.hash_blksize); printf(" Data blocks: %s\n", metadata.data_blocks); printf(" Hash start block: %s\n", metadata.hash_start_block); printf(" Algorithm: %s\n", metadata.algorithm); printf(" Root hash: %s\n", metadata.root_hash); printf(" Salt: %s\n", metadata.salt); } switch (args.output) { case OUTPUT_VERSION: printf("%c\n", header.version); break; case OUTPUT_FSTYPE: printf("%s\n", header.fstype); break; case OUTPUT_ACCESS: printf("%s\n", header.access); break; case OUTPUT_IDENTIFIER: printf("%s\n", header.identifier); break; case OUTPUT_HASH_TYPE: printf("%c\n", metadata.hash_type); break; case OUTPUT_DATA_BLOCK_SIZE: printf("%s\n", metadata.data_blksize); break; case OUTPUT_HASH_BLOCK_SIZE: printf("%s\n", metadata.hash_blksize); break; case OUTPUT_DATA_BLOCKS: printf("%s\n", metadata.data_blocks); break; case OUTPUT_HASH_START_BLOCK: printf("%s\n", metadata.hash_start_block); break; case OUTPUT_ALGORITHM: printf("%s\n", metadata.algorithm); break; case OUTPUT_ROOT_HASH: printf("%s\n", metadata.root_hash); break; case OUTPUT_SALT: printf("%s\n", metadata.salt); break; default: return -1; } exit: cleanup(&header, &metadata); return ret; } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7378643 kiwi-11.1.8/dracut/modules.d/50kiwi-verity/kiwi-verity-setup.sh0000755000000000000000000000403315273675667021307 0ustar00#!/bin/sh # SPDX-License-Identifier: GPL-2.0-or-later # Copyright (C) 2023 Canonical Ltd # Author: Isaac True # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # # shellcheck disable=SC1091 type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh if ! getarg "verityroot="; then return fi VERITY_ROOT=$(getarg "verityroot=") if [ ! -e "${VERITY_ROOT}" ]; then # Source device does not exist (yet?) exit 1 fi if [ -e "/dev/mapper/verityRoot" ]; then # Mapping already exists - we don't need to do it again exit 0 fi ROOT_HASH=$(kiwi-parse-verity -p "${VERITY_ROOT}" -o root-hash) ALGORITHM=$(kiwi-parse-verity -p "${VERITY_ROOT}" -o algorithm) HASH_TYPE=$(kiwi-parse-verity -p "${VERITY_ROOT}" -o hash-type) HASH_BLOCK_SIZE=$(kiwi-parse-verity -p "${VERITY_ROOT}" -o hash-blocksize) DATA_BLOCK_SIZE=$(kiwi-parse-verity -p "${VERITY_ROOT}" -o data-blocksize) SALT=$(kiwi-parse-verity -p "${VERITY_ROOT}" -o salt) DATA_BLOCKS=$(kiwi-parse-verity -p "${VERITY_ROOT}" -o data-blocks) HASH_START_BLOCK=$(kiwi-parse-verity -p "${VERITY_ROOT}" -o hash-start-block) HASH_OFFSET=$(( "${HASH_START_BLOCK}" * "${HASH_BLOCK_SIZE}" )) veritysetup open "${VERITY_ROOT}" verityRoot "${VERITY_ROOT}" "${ROOT_HASH}" \ --no-superblock --hash "${ALGORITHM}" --format "${HASH_TYPE}" \ --hash-block-size "${HASH_BLOCK_SIZE}" --data-block-size "${DATA_BLOCK_SIZE}" \ --salt "${SALT}" --data-blocks "${DATA_BLOCKS}" --hash-offset "${HASH_OFFSET}" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7378643 kiwi-11.1.8/dracut/modules.d/50kiwi-verity/kiwi-veritytab-setup.sh0000755000000000000000000000321015273675667021772 0ustar00#!/bin/sh # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # # shellcheck disable=SC1091 type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh if [ ! -e "/etc/veritytab" ];then return fi read -r name data_device hash_device root_hash options < /etc/veritytab if [ "$(echo "${data_device}" | cut -f1 -d=)" = "UUID" ];then data_device=/dev/disk/by-uuid/$(echo "${data_device}" | cut -f2 -d=) fi if [ "$(echo "${hash_device}" | cut -f1 -d=)" = "UUID" ];then hash_device=/dev/disk/by-uuid/$(echo "${hash_device}" | cut -f2 -d=) fi # Read kernel command line verity options and merge the options kiwi_verity_options=$(getarg rd.kiwi.verity_options=) if [ -n "${kiwi_verity_options}" ]; then if [ -n "${options}" ]; then options="${options},${kiwi_verity_options}" else options="${kiwi_verity_options}" fi fi veritysetup="veritysetup open " veritysetup="${veritysetup} ${data_device} ${name} ${hash_device} ${root_hash}" for option in $(echo "${options}" | tr , " ");do veritysetup="${veritysetup} --${option}" done eval "${veritysetup}" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7378643 kiwi-11.1.8/dracut/modules.d/50kiwi-verity/module-setup.sh0000755000000000000000000000231415273675667020311 0ustar00#!/bin/bash # SPDX-License-Identifier: GPL-2.0-or-later # Copyright (C) 2023 Canonical Ltd # Author: Isaac True # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # declare moddir=${moddir} check() { require_binaries /usr/bin/kiwi-parse-verity || return 1 require_binaries /usr/sbin/veritysetup || return 1 } depends() { return 0 } install() { inst_multiple \ /usr/bin/kiwi-parse-verity \ /usr/sbin/veritysetup \ cut \ tr inst_hook initqueue/settled 70 "$moddir/kiwi-verity-setup.sh" inst_hook initqueue/settled 71 "$moddir/kiwi-veritytab-setup.sh" } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7378643 kiwi-11.1.8/dracut/modules.d/55kiwi-dump/Makefile0000644000000000000000000000022615273675667016417 0ustar00buildroot = / install: install -d -m 755 ${buildroot}usr/lib/dracut/modules.d/55kiwi-dump cp -a * ${buildroot}usr/lib/dracut/modules.d/55kiwi-dump ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7381246 kiwi-11.1.8/dracut/modules.d/55kiwi-dump/kiwi-dump-image.sh0000755000000000000000000012712515273675667020314 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh type setup_debug >/dev/null 2>&1 || . /lib/kiwi-lib.sh type run_dialog >/dev/null 2>&1 || . /lib/kiwi-dialog-lib.sh type get_block_device_kbsize >/dev/null 2>&1 || . /lib/kiwi-partitions-lib.sh type fetch_file >/dev/null 2>&1 || . /lib/kiwi-net-lib.sh #====================================== # Functions #-------------------------------------- function scan_multipath_devices { # """ # starts multipath daemon from multipath module # """ systemctl start multipathd } function find_disk_entry { # """ # lookup disk entry by name and echo the # associated entry parameter (size) when found # """ local list_items=$1 local search=$2 local count=0 local found= for entry in ${list_items};do if [ -n "${found}" ];then echo "${entry}" return fi if [ $((count % 2)) -eq 0 ];then if [ "${entry}" = "${search}" ];then found=1 fi fi count=$((count + 1)) done } function sort_disk_entries { # """ # sort the disk entry names # """ local list_items=$1 local count=0 local device_index=0 local device_array local list_items_sorted for entry in ${list_items};do if [ $((count % 2)) -eq 0 ];then device_array[${device_index}]=${entry} device_index=$((device_index + 1)) fi count=$((count + 1)) done printf '%s\0' "${device_array[@]}" | sort -z > list_items_sorted.txt readarray -td '' list_items_sorted < list_items_sorted.txt echo "${list_items_sorted[*]}" } function load_ramdisk_driver { declare kiwi_oemramdisksize=${kiwi_oemramdisksize} local rd_size local custom_rd_size local modfile=/etc/modprobe.d/99-brd.conf custom_rd_size=$(getarg ramdisk_size=) if [ -n "${custom_rd_size}" ];then rd_size="${custom_rd_size}" elif [ -n "${kiwi_oemramdisksize}" ];then rd_size="${kiwi_oemramdisksize}" fi mkdir -p /etc/modprobe.d if [ -n "${rd_size}" ];then echo "options brd rd_size=${rd_size}" > ${modfile} fi modprobe brd udev_pending } function get_disk_list { declare kiwi_oemdevicefilter=${kiwi_oemdevicefilter} declare kiwi_oemmultipath_scan=${kiwi_oemmultipath_scan} declare kiwi_devicepersistency=${kiwi_devicepersistency} declare kiwi_install_volid=${kiwi_install_volid} declare kiwi_oemunattended=${kiwi_oemunattended} declare kiwi_oemunattended_id=${kiwi_oemunattended_id} local disk_id="by-id" local disk_size local disk_device local disk_device_by_id local disk_trans local disk_meta local list_items local list_items_sorted local max_disk local kiwi_oem_maxdisk local blk_opts="-p -n -r --sort NAME -o NAME,SIZE,TYPE,TRAN" local message local blk_opts_plus_label="${blk_opts},LABEL" local kiwi_install_disk_part if [ -n "${kiwi_devicepersistency}" ];then disk_id=${kiwi_devicepersistency} fi max_disk=0 kiwi_install_devicepersistency=$(getarg rd.kiwi.install.devicepersistency=) kiwi_oemmultipath_scan=$(bool "${kiwi_oemmultipath_scan}") kiwi_oem_maxdisk=$(getarg rd.kiwi.oem.maxdisk=) kiwi_oem_installdevice=$(getarg rd.kiwi.oem.installdevice=) # Check for smallest disk parameter # - Configure lsblk options based on the selection mode if getargbool 0 rd.kiwi.oem.smallest_disk; then # Sort by SIZE (ascending), include TRAN to identify USBs blk_opts="-p -n -r --sort SIZE -o NAME,SIZE,TYPE,TRAN" blk_opts_plus_label="${blk_opts},LABEL" fi if [ -n "${kiwi_install_devicepersistency}" ];then disk_id=${kiwi_install_devicepersistency} fi if [ -n "${kiwi_oem_maxdisk}" ]; then max_disk=$(binsize_to_bytesize "${kiwi_oem_maxdisk}") || max_disk=0 fi if getargbool 0 rd.kiwi.ramdisk; then # target should be a ramdisk on request. Thus actively # load the ramdisk block driver and support custom sizes load_ramdisk_driver # target should be a ramdisk on request. Thus instruct # lsblk to list only ramdisk devices (Major=1) blk_opts="-I 1 ${blk_opts}" elif [ "${kiwi_oemmultipath_scan}" = "true" ];then scan_multipath_devices fi kiwi_install_disk_part=$( eval lsblk "${blk_opts_plus_label}" | \ tr -s ' ' ":" | \ grep ":${kiwi_install_volid}$" | \ cut -f1 -d: ) for disk_meta in $( eval lsblk "${blk_opts}" | grep -E "disk|raid" | tr ' ' ":" );do disk_device="$(echo "${disk_meta}" | cut -f1 -d:)" if [[ "${kiwi_install_disk_part}" == "${disk_device}"* ]]; then # ignore install source device continue fi disk_mpath_child=$( eval lsblk "${blk_opts}" "${disk_device}" | grep mpath | \ tr ' ' ":" ) if [[ -n "${disk_mpath_child}" ]];then # use mpath device instead of parent device for multipath disk_device="$(echo "${disk_mpath_child}" | cut -f1 -d:)" fi # Filter USBs if smallest disk is requested disk_trans=$(echo "${disk_meta}" | cut -f4 -d:) if getargbool 0 rd.kiwi.oem.smallest_disk; then if [[ "${disk_trans}" == "usb" ]]; then continue fi fi disk_size=$(echo "${disk_meta}" | cut -f2 -d:) if [ "${max_disk}" -gt 0 ]; then local disk_size_bytes disk_size_bytes=$(binsize_to_bytesize "${disk_size}") || \ disk_size_bytes=0 if [ "${disk_size_bytes}" -gt "${max_disk}" ]; then message="${disk_device} filtered out by" message="${message} rd.kiwi.oem.maxdisk=${kiwi_oem_maxdisk}" message="${message} (disk size is: ${disk_size})" info "${message}" >&2 continue fi fi disk_device_by_id=$( get_persistent_device_from_unix_node "${disk_device}" "${disk_id}" ) if [ -n "${disk_device_by_id}" ];then disk_device=${disk_device_by_id} fi # check for static filter rules if [[ ${disk_device} =~ ^/dev/fd ]];then # ignore floppy disk devices continue fi # check for custom filter rule if [ -n "${kiwi_oemdevicefilter}" ];then if [[ ${disk_device} =~ ${kiwi_oemdevicefilter} ]];then message="${disk_device} filtered out by rule:" message="${message} ${kiwi_oemdevicefilter}" info "${message}" >&2 continue fi fi if [[ "${list_items}" == *"${disk_device}"* ]];then # device already in the list, can happen in multipath systems continue fi list_items="${list_items} ${disk_device} ${disk_size}" done if [ -n "${kiwi_oem_installdevice}" ];then # install device overwritten by cmdline. local device=${kiwi_oem_installdevice} local device_meta local device_size if [ ! -e "${device}" ];then local no_dev="Given device ${device} does not exist" report_and_quit "${no_dev}" fi if [ ! -b "${device}" ];then local no_block_dev="Given device ${device} is not a block special" report_and_quit "${no_block_dev}" fi device_meta=$( eval lsblk "${blk_opts}" "${device}" |\ grep -E "disk|raid|mpath" | tr ' ' ":" ) device_size=$(echo "${device_meta}" | cut -f2 -d:) list_items="${device} ${device_size}" fi if [ -z "${list_items}" ];then local no_device_text="No device(s) for installation found" report_and_quit "${no_device_text}" fi # Conditional Sorting if getargbool 0 rd.kiwi.oem.smallest_disk; then # If looking for smallest disk, preserve the lsblk size-sort order echo "${list_items}" else # Default behavior: # apply final alphabetical sorting for the used disk_device names list_items_sorted=$(sort_disk_entries "${list_items}") for entry in ${list_items_sorted[*]}; do echo -n "${entry} $(find_disk_entry "${list_items}" "${entry}") " done echo fi } function validate_disk_selection { local selected=$1 local disk_list local entry local count=0 disk_list=$(get_disk_list) for entry in ${disk_list};do if [ $((count % 2)) -eq 0 ];then if [ ! "${entry}" = "${selected}" ];then # check system_identifier for the not selected disk # if one of them matches the system_identifier because # that would produce a global system inconsistency if disk_matches_system_identifier "${entry}";then report_and_quit "Disk ${entry} has the same partition UUID" fi fi fi count=$((count + 1)) done } function get_selected_disk { declare kiwi_oemunattended=${kiwi_oemunattended} declare kiwi_oemunattended_id=${kiwi_oemunattended_id} local disk_list local device_array kiwi_oemunattended=$(bool "${kiwi_oemunattended}") disk_list=$(get_disk_list) if [ -n "${disk_list}" ];then local count=0 local device_index=0 for entry in ${disk_list};do if [ $((count % 2)) -eq 0 ];then device_array[${device_index}]=${entry} device_index=$((device_index + 1)) fi count=$((count + 1)) done if [ "${device_index}" -eq 1 ];then # one single disk device found, use it echo "${device_array[0]}" elif [ "${kiwi_oemunattended}" = "true" ];then if [ -z "${kiwi_oemunattended_id}" ];then # unattended mode requested but no target specifier, # thus use first device from list echo "${device_array[0]}" else # unattended mode requested with target specifier # use this device if present local device for device in "${device_array[@]}"; do if [[ ${device} =~ ${kiwi_oemunattended_id} ]];then echo "${device}" return fi done fi else # manually select from storage list if ! run_dialog \ --menu "\"Select Installation Disk\"" 20 75 15 "${disk_list}" then report_and_quit "System installation canceled" fi get_dialog_result fi fi } function export_image_metadata { local image_source_files=$1 export checksum export blocks export blocksize export zblocks export zblocksize local meta_file meta_file="$(echo "${image_source_files}" | cut -f2 -d\|)" if ! read -r checksum blocks blocksize zblocks zblocksize < "${meta_file}" then report_and_quit "Reading ${meta_file} failed" fi echo "Image checksum: ${checksum}" echo "Image blocks: ${blocks} / blocksize: ${blocksize}" if [ -n "${zblocks}" ];then echo "Image compressed blocks: ${zblocks} / blocksize: ${zblocksize}" fi } function check_image_fits_target { local image_target=$1 local need_mbytes local have_mbytes need_mbytes=$((blocks * blocksize / 1048576)) have_mbytes=$(($(get_block_device_kbsize "${image_target}") / 1024)) echo "Have size: ${image_target} -> ${have_mbytes} MB" echo "Need size: ${image_source} -> ${need_mbytes} MB" if [ ${need_mbytes} -gt ${have_mbytes} ];then report_and_quit "Not enough space available for this image" fi } function check_image_matches_target_blocksize { declare kiwi_target_blocksize=${kiwi_target_blocksize} local image_blocksize=${kiwi_target_blocksize} local target_node local target_blocksize local message target_node="${1}" if [ -L "${target_node}" ];then target_node="$(readlink "${target_node}")" fi target_node=$(basename "${target_node}") target_blocksize="/sys/block/${target_node}/queue/logical_block_size" mountpoint -q /sys || mount -t sysfs sysfs /sys if [ -n "${image_blocksize}" ] && [ -e "${target_blocksize}" ];then read -r target_blocksize < "${target_blocksize}" if [ ! "${target_blocksize}" = "${image_blocksize}" ];then message="Target blocksize(${target_blocksize}b) doesn't match" message="${message} image blocksize(${image_blocksize}b)" report_and_quit "${message}" fi fi } function dump_image { declare kiwi_oemsilentinstall=${kiwi_oemsilentinstall} declare kiwi_oemunattended=${kiwi_oemunattended} local image_source_files=$1 local image_target=$2 local image_from_remote=$3 local image_source local image_basename kiwi_oemsilentinstall=$(bool "${kiwi_oemsilentinstall}") kiwi_oemunattended=$(bool "${kiwi_oemunattended}") image_source="$(echo "${image_source_files}" | cut -f1 -d\|)" image_basename=$(basename "${image_source}") local progress=/dev/install_progress local image_source_file=/image.raw local load_text="Loading ${image_basename}..." local title_text="Installation..." local dump local copy local parttable local count_32k local image_size local count=0 local block_size=32k # can we dump this check_image_fits_target "${image_target}" check_image_matches_target_blocksize "${image_target}" # select dump method if [ -n "${image_from_remote}" ];then if getargbool 0 rd.kiwi.install.partition_based; then copy=dump_remote_image dump=dump_local_image_partition_based else dump=dump_remote_image fi else if getargbool 0 rd.kiwi.install.partition_based; then if getargbool 0 rd.kiwi.install.clone_local; then copy=dump_local_image fi dump=dump_local_image_partition_based else dump=dump_local_image fi fi # preserve pre-dump partition table if getargbool 0 rd.kiwi.install.retain_past; then fetch_local_partition_table "${image_target}" /tmp/parttable_pre fi # setup blocks and blocksize to retain last if getargbool 0 rd.kiwi.install.retain_last || \ getargbool 0 rd.kiwi.install.retain_past then if [ -n "${image_from_remote}" ];then image_size=$((blocks * blocksize)) parttable=$( fetch_remote_partition_table "${image_source}" "${image_size}" ) else parttable=$( fetch_local_partition_table "${image_source}" ) fi if compatible_to_retain "${parttable}" "${image_target}"; then if getargbool 0 rd.kiwi.install.retain_last; then count=$(get_disk_offset_retain_last_partition "${parttable}") else # retain_past always dumps the complete image # the compatible_to_retain check for this image blob # has been done and the deployment can happen for # all blocks count=0 fi fi if [ "${count}" -gt 0 ];then block_size=$(get_sector_size_from_table_dump "${parttable}") count_32k=$( optimize_count_for_32k_blocksize "${block_size}" "${count}" ) if [ ! "${count}" = "${count_32k}" ];then count="${count_32k}" block_size=32k fi fi fi # last chance to stop us if [ "${kiwi_oemunattended}" = "false" ];then local ack_dump_text="Destroying ALL data on ${image_target}, continue ?" if ! run_dialog --yesno "\"${ack_dump_text}\"" 7 80; then local install_cancel_text="System installation canceled" report_and_quit "${install_cancel_text}" fi fi # deploy echo "${load_text} [${image_target}]..." if with_progress && [ "${kiwi_oemsilentinstall}" = "false" ]; then # dump with dialog based progress information setup_progress_fifo ${progress} if [ -n "${copy}" ];then eval \ "${copy}" \ "${image_source}" \ "${image_source_file}" \ "${count}" \ "${block_size}" \ "${progress}" \ & run_progress_dialog "${load_text}" "${title_text}" image_source="${image_source_file}" fi eval \ "${dump}" \ "${image_source}" \ "${image_target}" \ "${count}" \ "${block_size}" \ "${progress}" \ & run_progress_dialog "${load_text}" "${title_text}" else # dump with silently blocked console if [ -n "${copy}" ];then if ! eval \ "${copy}" \ "${image_source}" \ "${image_source_file}" \ "${count}" \ "${block_size}" then report_and_quit "Failed to copy image" fi image_source="${image_source_file}" fi if ! eval \ "${dump}" \ "${image_source}" \ "${image_target}" \ "${count}" \ "${block_size}" then report_and_quit "Failed to install image" fi fi # recreate last partition from pre-dump table if getargbool 0 rd.kiwi.install.retain_past && \ [ ! -e /tmp/retain_not_applicable ] then recreate_last_partition "${image_target}" fi # update EFI boot entry for the installed system remove_efi_boot_entry add_efi_boot_entry "${image_target}" } function efi_boot_manager_available { # """ # check if EFI boot entries can be managed on this system # """ if [ ! -d /sys/firmware/efi ];then warn "System not booted in EFI mode, skipping EFI boot entry setup" return 1 fi if ! command -v efibootmgr &>/dev/null;then warn "efibootmgr not found, skipping EFI boot entry setup" return 1 fi return 0 } function get_esp_partition { # """ # lookup the EFI system partition on the given disk # by its filesystem label EFI # """ local disk_device=$1 udev_pending lsblk -p -n -r -o NAME,LABEL "${disk_device}" |\ awk '$2 == "EFI" { print $1; exit }' } function get_partition_number { # """ # get the partition number of the given partition device # """ local partition_device=$1 local partition_node local partition_number partition_node=$(readlink -f "${partition_device}") partition_node=${partition_node##*/} if [ -e "/sys/class/block/${partition_node}/partition" ];then read -r partition_number \ < "/sys/class/block/${partition_node}/partition" elif [[ "${partition_device}" =~ ([0-9]+)$ ]];then # e.g. device mapper partitions created by kpartx partition_number=${BASH_REMATCH[1]} fi echo "${partition_number}" } function find_efi_binary { # """ # print the first EFI binary found in the given directories. # The name patterns are tried in the given order, each one # across all directories before the next pattern is tried # """ local patterns local pattern local efi_dir local candidate local candidate_name read -r -a patterns <<< "$1" shift for pattern in "${patterns[@]}";do for efi_dir in "$@";do # shellcheck disable=SC2231 for candidate in "${efi_dir}"/${pattern};do [ -f "${candidate}" ] || continue candidate_name=${candidate##*/} # skip MokManager and fallback helpers shipped next to shim case "${candidate_name,,}" in mm*|fb*|mokmanager*|fallback*) continue ;; esac echo "${candidate}" return 0 done done done return 1 } function get_efi_loader_path { # """ # mount the given ESP read-only and search for an EFI binary. # Any directory below EFI except BOOT is a vendor directory # and searched first. The EFI/BOOT removable media path is # searched last. In both cases shim is preferred over any # other loader. The result is printed in EFI path notation, # e.g \EFI\opensuse\shim.efi # """ local esp_device=$1 local esp_mount=/run/kiwi-esp local efi_dir local efi_dir_name local vendor_dirs=() local boot_dirs=() local loader mkdir -p "${esp_mount}" if ! mount -o ro "${esp_device}" "${esp_mount}";then warn "Failed to mount ESP ${esp_device}" rmdir "${esp_mount}" return 1 fi # FAT is case insensitive, match the same way shopt -s nullglob nocaseglob for efi_dir in "${esp_mount}"/[Ee][Ff][Ii]/*/;do efi_dir=${efi_dir%/} efi_dir_name=${efi_dir##*/} if [ "${efi_dir_name,,}" = "boot" ];then boot_dirs+=("${efi_dir}") else vendor_dirs+=("${efi_dir}") fi done if [ ${#vendor_dirs[@]} -gt 0 ];then loader=$( find_efi_binary "shim*.efi grub*.efi *.efi" "${vendor_dirs[@]}" ) fi if [ -z "${loader}" ] && [ ${#boot_dirs[@]} -gt 0 ];then loader=$( find_efi_binary "shim*.efi boot*.efi *.efi" "${boot_dirs[@]}" ) fi shopt -u nullglob nocaseglob umount "${esp_mount}" rmdir "${esp_mount}" if [ -z "${loader}" ];then warn "No EFI binary found on ESP ${esp_device}" return 1 fi loader=${loader#"${esp_mount}"} echo "${loader//\//\\}" } function remove_efi_boot_entry { # """ # delete all EFI boot entries labeled with the name given # in rd.kiwi.install.efi_display_label # """ local label local line local bootnum local bootnums local entry_regex='^Boot([0-9A-Fa-f]{4})[* ] (.*)$' label=$(getarg rd.kiwi.install.efi_display_label=) if [ -z "${label}" ] || ! efi_boot_manager_available;then return fi while read -r line;do if [[ "${line}" =~ ${entry_regex} ]];then # newer efibootmgr versions append the device path # to the label separated by a tab if [ "${BASH_REMATCH[2]%%$'\t'*}" = "${label}" ];then bootnums="${bootnums} ${BASH_REMATCH[1]}" fi fi done < <(efibootmgr) for bootnum in ${bootnums};do info "Removing EFI boot entry Boot${bootnum} (${label})" if ! efibootmgr --quiet --bootnum "${bootnum}" --delete-bootnum;then warn "Failed to remove EFI boot entry Boot${bootnum}" fi done } function add_efi_boot_entry { # """ # create an EFI boot entry labeled with the name given in # rd.kiwi.install.efi_display_label for the ESP on the # given disk # """ local disk_device=$1 local label local esp_device local esp_partnum local loader label=$(getarg rd.kiwi.install.efi_display_label=) if [ -z "${label}" ] || ! efi_boot_manager_available;then return fi esp_device=$(get_esp_partition "${disk_device}") if [ -z "${esp_device}" ];then warn "No partition labeled EFI found on ${disk_device}" return fi esp_partnum=$(get_partition_number "${esp_device}") if [ -z "${esp_partnum}" ];then warn "Failed to get partition number of ESP ${esp_device}" return fi if ! loader=$(get_efi_loader_path "${esp_device}");then return fi info "Adding EFI boot entry ${label}: ${loader} on ${esp_device}" if ! efibootmgr --quiet --create \ --disk "$(readlink -f "${disk_device}")" --part "${esp_partnum}" \ --label "${label}" --loader "${loader}" then warn "Failed to add EFI boot entry ${label}" fi } function with_progress { if getargbool 0 rd.debug || ! command -v pv &>/dev/null; then return 1 fi return 0 } function fetch_local_partition_table { local image_source=$1 local parttable=$2 if [ -z "${parttable}" ];then parttable=/tmp/parttable fi sfdisk -d "${image_source}" > "${parttable}" 2>/dev/null echo "${parttable}" } function recreate_last_partition { # recreate last partition as it existed prior dump local image_target=$1 local table_type table_type=$(get_partition_table_type "${image_target}") if [ "${table_type}" = "gpt" ];then relocate_gpt_at_end_of_disk "${image_target}" fi # parttable after image dump, the OS sfdisk -d "${image_target}" > /tmp/parttable_1 2>/dev/null # last partition of table as it existed prior dump tail -n 1 /tmp/parttable_pre > /tmp/parttable_2 # combine table snippets. Please note there can now be a gap # between the end of the OS table and the start of the last # partition of the table prior dump. Please also note, if the # table prior dump had more partitions than only the last # one to retain, this table concat will not retain those. # and the OS dump might have overwritten them. A more # sophisticated concat procedure would be needed to support # this case here in this code and also in the # compatible_to_retain() method cat /tmp/parttable_1 /tmp/parttable_2 > /tmp/parttable set_device_lock "${image_target}" \ sfdisk -f "${image_target}" < /tmp/parttable } function fetch_remote_partition_table { local image_source=$1 local image_size=$2 local parttable=/tmp/parttable dd if=/dev/zero of=/tmp/table bs=1 count=0 seek="${image_size}" &>/dev/null fetch_file "${image_source}" 2>/dev/null | dd of=/tmp/table bs=512 count=1 conv=notrunc &>/dev/null sfdisk -d /tmp/table > "${parttable}" 2>/dev/null echo "${parttable}" } function get_sector_size_from_table_dump { local parttable=$1 sector_size=$(grep sector-size: "${parttable}" | cut -f2 -d:) echo "${sector_size}" } function compatible_to_retain { local parttable=$1 local image_target=$2 local source_start local target_start source_start=$( tail -n 1 "${parttable}" | cut -f2 -d= | cut -f1 -d, ) target_start=$( sfdisk -d "${image_target}" 2>/dev/null |\ tail -n 1 | cut -f2 -d= | cut -f1 -d, ) if [ -z "${source_start}" ] || [ -z "${target_start}" ];then # no partition information for either source or target # broken or net new deployment on empty disk touch /tmp/retain_not_applicable return 1 fi if getargbool 0 rd.kiwi.install.retain_last; then if [ ! "${source_start}" = "${target_start}" ];then report_and_quit "Cannot retain partition, start address mismatch" fi elif getargbool 0 rd.kiwi.install.retain_past; then if [ "${source_start}" -gt "${target_start}" ];then report_and_quit "Cannot retain partition, image overlaps" fi fi return 0 } function get_disk_offset_retain_last_partition { local parttable=$1 local next_to_last local start local size local offset next_to_last=$(tail -n 2 "${parttable}" | head -n 1) if [ -n "${next_to_last}" ];then start=$(echo "${next_to_last}" | cut -f2 -d= | cut -f1 -d,) size=$(echo "${next_to_last}" | cut -f3 -d= | cut -f1 -d,) offset=$((start + size)) echo "${offset}" else echo 0 fi } function optimize_count_for_32k_blocksize { local block_size=$1 local count=$2 local dump_bytes dump_bytes=$((block_size * count)) if [ $((dump_bytes % 32768)) -eq 0 ];then # dump_bytes is a multiple of 32k, use it for better I/O performance count=$((dump_bytes / 32768)) fi echo "${count}" } function dump_local_image { local image_source=$1 local image_target=$2 local count=$3 local block_size=$4 local progress=$5 if [ "${count}" -gt 0 ];then count="count=${count}" else unset count fi # shellcheck disable=SC2086 if [ -e "${progress}" ];then ( pv -n "${image_source}" |\ dd bs="${block_size}" ${count} of="${image_target}" &>/dev/null ) 2>"${progress}" else dd \ if="${image_source}" bs="${block_size}" ${count} \ of="${image_target}" &>/dev/null fi } function clone_partition_table { local image_source=$1 local image_target=$2 fetch_local_partition_table "${image_source}" sfdisk "${image_target}" < /tmp/parttable # clone MBR bootloader code dd if="${image_source}" of="${image_target}" bs=1 count=446 partx -u "${image_target}" udev_pending } function btrfs_seed_device_on_target { local source_device=$1 local target_device=$2 local seed=/seed if [ -n "${source_device}" ]; then mkdir -p "${seed}" if getargbool 0 rd.kiwi.install.clone_local; then btrfstune -S 1 "${source_device}" fi mount "${source_device}" "${seed}" btrfs device add "${target_device}" "${seed}" umount "${seed}" mount "${target_device}" "${seed}" btrfs device delete "${source_device}" "${seed}" umount "${seed}" fi } function btrfs_replay_uuid { local target_device=$1 local uuid=$2 if [ -n "${uuid}" ];then btrfstune -f -U "${uuid}" "${target_device}" fi } function check_partition_based_compatibility { # partition based mode always clones the complete partition # table of the image to the target, which would wipe out the # partition to retain if getargbool 0 rd.kiwi.install.partition_based; then if getargbool 0 rd.kiwi.install.retain_last || \ getargbool 0 rd.kiwi.install.retain_past then report_and_quit \ "rd.kiwi.install.partition_based can't be combined with retain_last|retain_past" fi fi } function clean_partition_map { local source_disk=$1 kpartx -d "${source_disk}" && losetup -d "${source_disk}" } function dump_local_image_partition_based { local image_source=$1 local image_target=$2 local count=$3 local block_size=$4 local progress=$5 local source_disk local device_index=0 local source_device_array local target_device_array local btrfs_source_device_array local btrfs_target_device_array local btrfs_source_uuid_array local filesystem local part # no partial dump in partition based mode unset count # clone partition table to target clone_partition_table "${image_source}" "${image_target}" # map source image partitions source_disk=$(losetup --show --find "${image_source}") kpartx -a "${source_disk}" # walk through source image partitions and store them for part in $( lsblk -p -n -r --sort SIZE -o NAME,TYPE "${source_disk}" |\ grep part | cut -f1 -d" " );do filesystem=$(blkid "${part}" -s TYPE -o value) uuid=$(blkid "${part}" -s UUID -o value) if [ "${filesystem}" = "btrfs" ];then btrfs_source_device_array[device_index]=${part} btrfs_source_uuid_array[device_index]=${uuid} else source_device_array[device_index]=${part} fi device_index=$((device_index + 1)) done # walk through target image partitions and store them device_index=0 for part in $( lsblk -p -n -r --sort SIZE -o NAME,TYPE "${image_target}" |\ grep part | cut -f1 -d" " );do if [ -n "${btrfs_source_device_array[${device_index}]}" ];then btrfs_target_device_array[device_index]=${part} else target_device_array[device_index]=${part} fi device_index=$((device_index + 1)) done # seed/sprout for btrfs based partitions for ((index=0; index>/seed.log done # dump standard partitions... if [ -e "${progress}" ];then ( for ((index=0; index/dev/null fi done clean_partition_map "${source_disk}" &>/dev/null for ((index=0; index/dev/null done ) 2>"${progress}" else for ((index=0; index/dev/null fi done clean_partition_map "${source_disk}" &>/dev/null for ((index=0; index/dev/null done fi } function dump_remote_image { local image_source=$1 local image_target=$2 local count=$3 local block_size=$4 local progress=$5 local image_size image_size=$((blocks * blocksize)) if [ "${count}" -gt 0 ];then count="count=${count}" else unset count fi # shellcheck disable=SC2086 if [ -e "${progress}" ];then ( fetch_file "${image_source}" "${image_size}" |\ dd bs="${block_size}" ${count} of="${image_target}" &>/dev/null ) 2>"${progress}" else fetch_file "${image_source}" |\ dd bs="${block_size}" ${count} of="${image_target}" &>/dev/null fi } function check_image_integrity { declare kiwi_oemskipverify=${kiwi_oemskipverify} declare kiwi_oemsilentverify=${kiwi_oemsilentverify} local image_target=$1 local progress=/dev/install_verify_progress local verify_text="Verifying ${image_target}" local title_text="Installation..." local verify_result local shasum local sha_extension kiwi_oemskipverify=$(bool "${kiwi_oemskipverify}") kiwi_oemsilentverify=$(bool "${kiwi_oemsilentverify}") shasum=$(shasum_tool) sha_extension=$(shasum_extension) verify_result=/dumped_image."${sha_extension}" if [ "${kiwi_oemskipverify}" = "true" ];then # no verification wanted return fi if getargbool 0 rd.kiwi.install.retain_last || \ getargbool 0 rd.kiwi.install.retain_past then if [ ! -e /tmp/retain_not_applicable ];then # no verification possible as only a portion of # the image got deployed intentionally (retain_last) # or parts of the former partition table got # restored (retain_past) return fi fi if with_progress && [ "${kiwi_oemsilentverify}" = "false" ]; then # verify with dialog based progress information setup_progress_fifo ${progress} ( pv --size $((blocks * blocksize)) --stop-at-size \ -n "${image_target}" | "${shasum}" - > "${verify_result}" ) 2>${progress} & run_progress_dialog "${verify_text}" "${title_text}" else # verify with silently blocked console head --bytes=$((blocks * blocksize)) "${image_target}" |\ "${shasum}" - > "${verify_result}" fi local checksum_dumped_image local checksum_fileref read -r checksum_dumped_image checksum_fileref < "${verify_result}" echo "Dumped Image checksum: ${checksum_dumped_image}/${checksum_fileref}" if [ "${checksum}" != "${checksum_dumped_image}" ];then report_and_quit "Image checksum test failed" fi } function get_isoscan_devices { # """ # print the kernel names of the block device stack, e.g. # partition, LVM, RAID and disk, which holds the filesystem # with the ISO file loop mounted via iso-scan/filename # """ local isoscan_device=/run/initramfs/isoscandev local device if [[ -e "${isoscan_device}" ]];then device=$(readlink -f "${isoscan_device}") lsblk -p -n -r -s -o KNAME "${device}" fi } function target_holds_isoscan_file { # """ # check if the given install target disk holds the # ISO file loop mounted via iso-scan/filename # """ local target=$1 local target_device local device target_device=$(readlink -f "${target}") for device in $(get_isoscan_devices);do if [[ "${device}" = "${target_device}" ]];then return 0 fi done return 1 } function move_isoscan_file_to_ram { # """ # The install ISO file loop mounted via iso-scan/filename is # stored on the install target disk. Dumping the image would # overwrite the ISO file while reading from it. Thus copy the # ISO file into main memory, release the target disk and # continue the installation from the copy # """ declare root=${root} local target=$1 local iso_device="${root#install:}" local isoscan_mount=/run/initramfs/isoscan local iso_ram_mount=/run/initramfs/isoram local iso_ram_file="${iso_ram_mount}/install.iso" local iso_file local iso_loop local iso_size_bytes local iso_size_kb local mem_available_kb local mem_required_kb # keep some main memory for the installation process local mem_reserve_kb=524288 local message iso_file="${isoscan_mount}/$(getarg iso-scan/filename)" iso_loop=$(readlink -f "${iso_device}") if [[ ! -f "${iso_file}" ]] || [[ ! "${iso_loop}" =~ ^/dev/loop ]];then report_and_quit "Install ISO file not found on ${isoscan_mount}" fi iso_size_bytes=$(lsblk -n -b -d -o SIZE "${iso_loop}") iso_size_kb=$((iso_size_bytes / 1024 + 1024)) mem_required_kb=$((iso_size_kb + mem_reserve_kb)) mem_available_kb=$(awk '/^MemAvailable:/ { print $2 }' /proc/meminfo) if [[ "${mem_required_kb}" -gt "${mem_available_kb:-0}" ]];then message="Install ISO file is stored on target disk ${target}." message="${message} Not enough memory to copy it away, required:" message="${message} ${mem_required_kb}kB available:" message="${message} ${mem_available_kb}kB" report_and_quit "${message}" fi info "Install ISO file is stored on target disk ${target}" info "Copying ${iso_file} into main memory..." mkdir -p "${iso_ram_mount}" if ! mount -t tmpfs -o "size=${iso_size_kb}k,mode=0755" \ tmpfs "${iso_ram_mount}" then report_and_quit "Failed to create tmpfs for install ISO copy" fi if ! cp "${iso_file}" "${iso_ram_file}";then report_and_quit "Failed to copy install ISO file into main memory" fi # release the target disk udev_pending if ! losetup -d "${iso_loop}";then report_and_quit "Failed to detach install ISO loop ${iso_loop}" fi udev_pending if ! umount "${isoscan_mount}";then report_and_quit "Failed to release ${isoscan_mount} on ${target}" fi rm -f /run/initramfs/isoscandev # attach the ISO copy, udev recreates the install media label link if ! losetup -f -r "${iso_ram_file}";then report_and_quit "Failed to attach install ISO copy ${iso_ram_file}" fi udev_pending if [[ ! -e "${iso_device}" ]];then report_and_quit "Install ISO device ${iso_device} not found" fi } function get_local_image_source_files { declare root=${root} local iso_device="${root#install:}" local iso_mount_point=/run/install local image_mount_point=/run/image local sha_extension local image_source local image_sha sha_extension=$(shasum_extension) mkdir -m 0755 -p "${iso_mount_point}" if ! mount -n "${iso_device}" "${iso_mount_point}"; then report_and_quit "Failed to mount install ISO device" fi mkdir -m 0755 -p "${image_mount_point}" if ! mount -n "${iso_mount_point}"/*.squashfs ${image_mount_point};then report_and_quit "Failed to mount install image squashfs filesystem" fi image_source="$(echo "${image_mount_point}"/*.raw)" image_sha="$(echo "${image_mount_point}"/*."${sha_extension}")" echo "${image_source}|${image_sha}" } function get_remote_image_source_files { local image_uri local sha_extension local image_sha local install_dir=/run/install local metadata_dir="${install_dir}/boot/remote/loader" sha_extension=$(shasum_extension) local image_sha="${install_dir}/image.${sha_extension}" mkdir -p "${metadata_dir}" image_uri=$(getarg rd.kiwi.install.image=) # make sure the protocol type is tftp for metadata files. There is no need for # complex protocol types on small files and for standard PXE boot operations # only tftp can be guaranteed image_sha_uri=$( echo "${image_uri}" | awk '{ gsub("\\.xz",".'"${sha_extension}"'", $1); gsub("dolly:","tftp:", $1); print $1 }' ) image_initrd_uri=$( echo "${image_uri}" | awk '{ gsub("\\.xz",".initrd", $1); gsub("dolly:","tftp:", $1); print $1 }' ) image_kernel_uri=$( echo "${image_uri}" | awk '{ gsub("\\.xz",".kernel", $1); gsub("dolly:","tftp:", $1); print $1 }' ) image_config_uri=$( echo "${image_uri}" | \ awk '{ gsub("\\.xz",".config.bootoptions", $1); gsub("dolly:","tftp:", $1); print $1 }' ) # if we can not access image_sha_uri, maybe network setup # by dracut did fail, so collect some additional info if ! fetch_file "${image_sha_uri}" > "${image_sha}";then { echo "--- ip a ---"; ip a echo "--- ip r ---"; ip r } >> /tmp/fetch.info 2>&1 show_log_and_quit \ "Failed to fetch ${image_sha_uri}" /tmp/fetch.info fi if ! getargbool 0 rd.kiwi.ramdisk; then if ! fetch_file "${image_kernel_uri}" > "${metadata_dir}/linux";then show_log_and_quit \ "Failed to fetch ${image_kernel_uri}" /tmp/fetch.info fi if ! fetch_file "${image_initrd_uri}" > "${install_dir}/initrd.system_image" then show_log_and_quit \ "Failed to fetch ${image_initrd_uri}" /tmp/fetch.info fi fi if ! fetch_file "${image_config_uri}" > "/config.bootoptions" then show_log_and_quit \ "Failed to fetch ${image_config_uri}" /tmp/fetch.info fi echo "${image_uri}|${image_sha}" } #====================================== # Perform image dump/install operations #-------------------------------------- setup_debug lib_initialize udev_pending check_partition_based_compatibility image_target=$(get_selected_disk) if getargbool 0 rd.kiwi.oem.disk.consistency; then validate_disk_selection "${image_target}" fi if ! getargbool 0 rd.kiwi.install.pxe && \ target_holds_isoscan_file "${image_target}" then move_isoscan_file_to_ram "${image_target}" fi if getargbool 0 rd.kiwi.install.pxe; then image_source_files=$(get_remote_image_source_files) else image_source_files=$(get_local_image_source_files) fi export_image_metadata "${image_source_files}" if getargbool 0 rd.kiwi.install.partition_based; then export kiwi_oemskipverify=true fi if getargbool 0 rd.kiwi.install.pxe; then dump_image "${image_source_files}" "${image_target}" "remote_image" else dump_image "${image_source_files}" "${image_target}" fi check_image_integrity "${image_target}" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7381246 kiwi-11.1.8/dracut/modules.d/55kiwi-dump/kiwi-installer-device.sh0000755000000000000000000000024115273675667021506 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh type setup_debug >/dev/null 2>&1 || . /lib/kiwi-lib.sh setup_debug info "Install Device is $1" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7381246 kiwi-11.1.8/dracut/modules.d/55kiwi-dump/kiwi-installer-genrules.sh0000755000000000000000000000102015273675667022067 0ustar00#!/bin/bash declare root=${root} case "${root}" in install:/dev/*) { printf 'KERNEL=="%s", RUN+="/sbin/initqueue --settled --onetime --unique /sbin/kiwi-installer-device %s"\n' \ "${root#install:/dev/}" "${root#install:}" printf 'SYMLINK=="%s", RUN+="/sbin/initqueue --settled --onetime --unique /sbin/kiwi-installer-device %s"\n' \ "${root#install:/dev/}" "${root#install:}" } >> /etc/udev/rules.d/99-installer-kiwi.rules wait_for_dev -n "${root#install:}" ;; esac ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7381246 kiwi-11.1.8/dracut/modules.d/55kiwi-dump/kiwi-mount-ramdisk.sh0000755000000000000000000000202415273675667021047 0ustar00#!/bin/bash type setup_debug >/dev/null 2>&1 || . /lib/kiwi-lib.sh type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh #====================================== # Functions #-------------------------------------- function mount_ramdisk { local root_dev local boot_options boot_options="/config.bootoptions" if [ ! -e "${boot_options}" ]; then die "Missing ${boot_options} file" fi # Add a space to /config.bootoptions to make sure the # following token based read captures all entries echo -n ' ' >> "${boot_options}" root_dev=$( while read -r -d ' ' opt; do echo "${opt}";done < "${boot_options}" |\ grep root= | cut -f2- -d= ) if [ -z "${root_dev}" ]; then die "'root=' argument not found in ${boot_options}" fi mount --options defaults "${root_dev}" /sysroot } #====================================== # Mount ramdisk root in /sysroot #-------------------------------------- setup_debug if getargbool 0 rd.kiwi.ramdisk; then mount_ramdisk fi ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7381246 kiwi-11.1.8/dracut/modules.d/55kiwi-dump/kiwi-ramdisk-deployment-generator.sh0000755000000000000000000000321115273675667024050 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh if ! getargbool 0 rd.kiwi.ramdisk; then # we create a sysroot generator only for the special # ramdisk deployment case exit 0 fi root_cmdline=$(getarg root=) if [ -z "${root_cmdline}" ];then # if the root= parameter is missing there is no guarantee # that the /config.bootoptions file is present on local # storage at the time this generator code is called. This # case applies on PXE deployments which serves config.bootoptions # from the network. The mount process including config.bootoptions # paramters is then handled by the dracut # mount hook: kiwi-mount-ramdisk.sh exit 0 fi GENERATOR_DIR="$1" [ -z "${GENERATOR_DIR}" ] && exit 1 [ -d "${GENERATOR_DIR}" ] || mkdir -p "${GENERATOR_DIR}" [ -e /config.bootoptions ] || exit 1 root_uuid=$( awk '{ for(i=1; i <= NF; i++) {print $i } }' /config.bootoptions |\ grep root= | cut -f2- -d= ) [ -z "${root_uuid}" ] && exit 2 { echo "[Unit]" echo "Before=initrd-root-fs.target" echo "DefaultDependencies=no" echo "[Mount]" echo "Where=/sysroot" echo "What=${root_uuid}" _dev=$(systemd-escape -p /dev/disk/by-uuid/"${root_uuid#UUID=}") } > "$GENERATOR_DIR"/sysroot.mount if [ ! -e "$GENERATOR_DIR/initrd-root-fs.target.requires/sysroot.mount" ]; then mkdir -p "$GENERATOR_DIR"/initrd-root-fs.target.requires ln -s "$GENERATOR_DIR"/sysroot.mount \ "$GENERATOR_DIR"/initrd-root-fs.target.requires/sysroot.mount fi mkdir -p "$GENERATOR_DIR/$_dev.device.d" { echo "[Unit]" echo "JobTimeoutSec=infinity" } > "$GENERATOR_DIR/$_dev.device.d/timeout.conf" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7381246 kiwi-11.1.8/dracut/modules.d/55kiwi-dump/module-setup.sh0000755000000000000000000000320015273675667017734 0ustar00#!/bin/bash # called by dracut check() { return 255 } # called by dracut depends() { echo network rootfs-block dm kiwi-lib return 0 } # called by dracut installkernel() { instmods squashfs loop iso9660 vfat nls_cp437 nls_iso8859-1 } # called by dracut install() { declare moddir=${moddir} declare systemdutildir=${systemdutildir} declare dracutbasedir=${dracutbasedir} local dmsquashdir= inst_multiple \ tr lsblk dd sha256sum sha512sum head pv kexec \ basename awk kpartx sort mount mountpoint readlink \ btrfs btrfstune mount umount losetup cp inst_multiple -o efibootmgr # support booting the install ISO as a file on disk via # iso-scan/filename=, e.g. through a grub loopback setup dmsquashdir=$(find "${dracutbasedir}/modules.d" -name "*dmsquash-live") if [[ -n "${dmsquashdir}" ]] && \ [[ -f "${dmsquashdir}/parse-iso-scan.sh" ]] && \ [[ -f "${dmsquashdir}/iso-scan.sh" ]]; then inst_hook cmdline 31 "${dmsquashdir}/parse-iso-scan.sh" inst_script "${dmsquashdir}/iso-scan.sh" "/sbin/iso-scan" fi inst_hook pre-udev 30 "${moddir}/kiwi-installer-genrules.sh" inst_script "${moddir}/kiwi-installer-device.sh" \ "/sbin/kiwi-installer-device" inst_hook cmdline 30 "${moddir}/parse-kiwi-install.sh" inst_hook pre-mount 30 "${moddir}/kiwi-dump-image.sh" inst_hook mount 30 "${moddir}/kiwi-mount-ramdisk.sh" inst_script "${moddir}/kiwi-ramdisk-deployment-generator.sh" \ "${systemdutildir}/system-generators/dracut-kiwi-ramdisk-generator" inst_rules 60-cdrom_id.rules dracut_need_initqueue } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7381246 kiwi-11.1.8/dracut/modules.d/55kiwi-dump/parse-kiwi-install.sh0000755000000000000000000000167315273675667021044 0ustar00#!/bin/bash # install images are specified with # root=install:CDLABEL=label type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh [ -z "${root}" ] && root=$(getarg root=) if getargbool 0 rd.kiwi.install.pxe; then root="install:REMOTE" echo "rd.neednet=1" > /etc/cmdline.d/kiwi-generated.conf if ! getarg "ip="; then echo "ip=dhcp" >> /etc/cmdline.d/kiwi-generated.conf fi fi if [ "${root%%:*}" = "install" ] ; then installroot=${root} fi [ "${installroot%%:*}" = "install" ] || return 1 modprobe -q loop case "${installroot}" in install:CDLABEL=*|CDLABEL=*) \ root="${root#install:}" root="${root//\//\\x2f}" root="install:/dev/disk/by-label/${root#CDLABEL=}" rootok=1 ;; install:REMOTE) \ rootok=1 ;; esac [ "$rootok" = "1" ] || return 1 info "root was ${installroot}, is now ${root}" # make sure that init doesn't complain [ -z "${root}" ] && root="install" return 0 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7381246 kiwi-11.1.8/dracut/modules.d/55kiwi-live/Makefile0000644000000000000000000000022615273675667016411 0ustar00buildroot = / install: install -d -m 755 ${buildroot}usr/lib/dracut/modules.d/55kiwi-live cp -a * ${buildroot}usr/lib/dracut/modules.d/55kiwi-live ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7384837 kiwi-11.1.8/dracut/modules.d/55kiwi-live/kiwi-generator.sh0000755000000000000000000000342515273675667020243 0ustar00#!/bin/bash -x type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh type getOverlayBaseDirectory >/dev/null 2>&1 || . /lib/kiwi-live-lib.sh [ -z "${root}" ] && root=$(getarg root=) if [ "${root%%:*}" = "live" ] ; then liveroot="${root}" fi [ "${liveroot%%:*}" = "live" ] || exit 0 case "${liveroot}" in live:CDLABEL=*|CDLABEL=*) \ root="${root#live:}" root="${root//\//\\x2f}" root="live:/dev/disk/by-label/${root#CDLABEL=}" rootok=1 ;; live:AOEINTERFACE=*|AOEINTERFACE=*) \ root="${root#live:}" root="${root//\//\\x2f}" root="live:aoe:/dev/etherd/${root#AOEINTERFACE=}" rootok=1 ;; live:ftp:*|live:http:*|live:https:*|live:dolly:*) \ root="${root#live:}" root="live:net:${root}" rootok=1 ;; esac [ "${rootok}" != "1" ] && exit 0 GENERATOR_DIR="$2" [ -z "$GENERATOR_DIR" ] && exit 1 [ -d "$GENERATOR_DIR" ] || mkdir "$GENERATOR_DIR" OVERLAY_BASE="$(getOverlayBaseDirectory)" ROOTFLAGS="$(getarg rootflags)" { echo "[Unit]" echo "Before=initrd-root-fs.target" echo "DefaultDependencies=no" echo "[Mount]" echo "Where=/sysroot" echo "What=LiveOS_rootfs" echo "Options=${ROOTFLAGS},lowerdir=${OVERLAY_BASE}/rootfsbase,upperdir=${OVERLAY_BASE}/overlayfs/rw,workdir=${OVERLAY_BASE}/overlayfs/work" echo "Type=overlay" _dev=LiveOS_rootfs } > "$GENERATOR_DIR"/sysroot.mount if [ ! -e "$GENERATOR_DIR/initrd-root-fs.target.requires/sysroot.mount" ]; then mkdir -p "$GENERATOR_DIR"/initrd-root-fs.target.requires ln -s "$GENERATOR_DIR"/sysroot.mount \ "$GENERATOR_DIR"/initrd-root-fs.target.requires/sysroot.mount fi mkdir -p "$GENERATOR_DIR/$_dev.device.d" { echo "[Unit]" echo "JobTimeoutSec=3000" } > "$GENERATOR_DIR/$_dev.device.d/timeout.conf" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7384837 kiwi-11.1.8/dracut/modules.d/55kiwi-live/kiwi-live-checkmedia.sh0000755000000000000000000000042215273675667021261 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh type runMediaCheck >/dev/null 2>&1 || . /lib/kiwi-live-lib.sh if getargbool 0 mediacheck || getargbool 0 rd.live.check; then declare root=${root} initGlobalDevices "${root#live:}" runMediaCheck fi ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7384837 kiwi-11.1.8/dracut/modules.d/55kiwi-live/kiwi-live-genrules.sh0000755000000000000000000000255715273675667021043 0ustar00#!/bin/bash # shellcheck disable=SC1091 type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh declare root=${root} case "${root}" in live:/dev/*) { printf 'KERNEL=="%s", RUN+="/sbin/initqueue %s %s %s"\n' \ "${root#live:/dev/}" "--settled --onetime --unique" \ "/sbin/kiwi-live-root" "${root#live:}" printf 'SYMLINK=="%s", RUN+="/sbin/initqueue %s %s %s"\n' \ "${root#live:/dev/}" "--settled --onetime --unique" \ "/sbin/kiwi-live-root" "${root#live:}" } >> /etc/udev/rules.d/99-live-kiwi.rules wait_for_dev -n "${root#live:}" ;; live:aoe:/dev/*) { printf 'KERNEL=="%s", RUN+="/sbin/initqueue %s %s %s"\n' \ "${root#live:aoe:/dev/}" "--settled --onetime --unique" \ "/sbin/kiwi-live-root" "${root#live:aoe:}" } >> /etc/udev/rules.d/99-live-aoe-kiwi.rules wait_for_dev -n "${root#live:aoe:}" ;; live:net:*) system=$(getarg rd.kiwi.live.system=) if [ -z "${system}" ];then system=/dev/ram0 fi { printf 'KERNEL=="%s", RUN+="/sbin/initqueue %s %s %s"\n' \ "${system#/dev/}" "--settled --onetime --unique" \ "/sbin/kiwi-live-root" "${root}" } >> /etc/udev/rules.d/99-live-net-kiwi.rules wait_for_dev -n "${system}" ;; esac ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7384837 kiwi-11.1.8/dracut/modules.d/55kiwi-live/kiwi-live-lib.sh0000755000000000000000000004773315273675667017772 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh function getOverlayBaseDirectory { # initialize and print overlay base directory below which # the iso and overlayfs based mountpoints are managed local overlay_base=/run/overlay local overlay_size mkdir -p "${overlay_base}" if ! mountpoint -q "${overlay_base}";then overlay_size=$(getarg rd.live.overlay.size) [ -z "${overlay_size}" ] && overlay_size="50%" mount -t tmpfs -o "size=${overlay_size}" tmpfs "${overlay_base}" fi echo "${overlay_base}" } function ProvideIso { local root=$1 local iso_url=${root#live:net:} local system local rd_size local custom_rd_size local modfile=/etc/modprobe.d/99-brd.conf system=$(getarg rd.kiwi.live.system=) if [ ! -b "${system}" ];then system=/dev/ram0 fi ptable=$(blkid -s PTTYPE -o value "${system}" 2>/dev/null) case "${iso_url}" in ftp:*|http:*|https:*|dolly:*) \ if [ -z "${ptable}" ] || getargbool 0 rd.kiwi.live.reset; then custom_rd_size=$(getarg ramdisk_size=) if [ -n "${custom_rd_size}" ];then rd_size="${custom_rd_size}" else # set minimum default ramdisk size: 2G rd_size="2097152" fi mkdir -p /etc/modprobe.d if [ -n "${rd_size}" ];then echo "options brd rd_size=${rd_size}" > ${modfile} fi modprobe --remove brd modprobe brd udev_pending fetch_file "${iso_url}" | dd bs=32k of="${system}" &>/dev/null fi if [[ ${system} =~ ^/dev/ram ]];then echo "${system}" else udev_pending # This is not 100% safe as in theory the volume ID # of the live ISO could be configured in the kiwi image # description and doesn't have to be set to: CDROM. # The value could be obtained as follows: # label=$( # isoinfo -j utf-8 -d -i ${system} |\ # grep "Volume id:" | cut -f2 -d: # ) # but this would require an additional tool as part of the # initrd. Thus this is subject to a followup pull request echo "/dev/disk/by-label/CDROM" fi ;; *) \ echo "${root}" ;; esac } function lookupIsoDiskDevice { local root=$1 local iso_label=${root#/dev/disk/by-label/} local disk local mount_point local iso_volid for disk in $(lsblk -p -n -r -o NAME,TYPE | grep disk | cut -f1 -d' ');do if [[ ${disk} =~ ^/dev/fd ]];then # ignore floppy disk devices continue fi # 1. Mapping: # If the ISO is bootet as disk in hybrid mode the exposed LABEL # of the disk device matches the ISO label iso_volid=$(blkid -s LABEL -o value "${disk}") if [ "${iso_volid}" = "${iso_label}" ];then echo "${disk}%disk_boot" return fi # 2. Mapping: # If the ISO is booted via grub loopback the partition of the # disk device which contains the ISO file and was loopbacked # by grub is mounted to /run/initramfs/isoscan for mount_point in $(lsblk -p -n -r -o MOUNTPOINT "${disk}");do if [ "${mount_point}" = "/run/initramfs/isoscan" ];then echo "${disk}%loop_boot" return fi done done } function setupDebugMode { if getargbool 0 rd.kiwi.debug; then local log=/run/initramfs/log mkdir -p ${log} exec > ${log}/boot.kiwi exec 2>> ${log}/boot.kiwi set -x fi } function initialize { local profile=/.profile test -f ${profile} && cat ${profile} } function loadKernelModules { modprobe squashfs } function udev_pending { declare DEVICE_TIMEOUT=${DEVICE_TIMEOUT} local limit=120 if [[ "${DEVICE_TIMEOUT}" =~ ^[0-9]+$ ]]; then limit="${DEVICE_TIMEOUT}" fi udevadm settle --timeout="${limit}" } function set_device_lock { # """ # Set device lock, preferrable via udevadm or via # flock as fallback if systemd/udev does not provide # the command # """ if udevadm lock --help &>/dev/null;then udevadm lock --device "$@" else flock -x "$@" fi } function initGlobalDevices { if [ -z "$1" ]; then die "No root device for operation given" fi isodev="$1" local isodisk isodisk=$(lookupIsoDiskDevice "${isodev}") isodiskdev=$(echo "${isodisk}" | cut -f1 -d%) isodiskmode=$(echo "${isodisk}" | cut -f2 -d%) isofs_type=$(blkid -s TYPE -o value "${isodev}") media_check_device=${isodev} if [ -n "${isodiskdev}" ]; then media_check_device=${isodiskdev} fi export media_check_device export isodev export isodiskdev export isodiskmode export isofs_type } function initGlobalOptions { live_dir=$(getarg rd.live.dir -d live_dir) [ -z "${live_dir}" ] && live_dir="LiveOS" squash_image=$(getarg rd.live.squashimg) [ -z "${squash_image}" ] && squash_image="squashfs.img" cow_filesystem=$(getarg rd.live.overlay.cowfs) [ -z "${cow_filesystem}" ] && cow_filesystem="ext4" cow_file_mbsize=$(getarg rd.live.cowfile.mbsize) [ -z "${cow_file_mbsize}" ] && cow_file_mbsize="500" cow_file_path=$(getarg rd.live.cowfile.path) [ -z "${cow_file_path}" ] && cow_file_path="live_system.cow" } function mountIso { local overlay_base overlay_base=$(getOverlayBaseDirectory) ln -s "${isodev}" "${overlay_base}/isodev" local iso_mount_point="${overlay_base}/live" mkdir -m 0755 -p "${iso_mount_point}" if ! mount -o ro -n -t "${isofs_type}" "${isodev}" "${iso_mount_point}"; then die "Failed to mount live ISO device" fi echo "${iso_mount_point}" } function mountCompressedContainerFromIso { local iso_mount_point=$1 local overlay_base local squashfs_container overlay_base=$(getOverlayBaseDirectory) local container_mount_point="${overlay_base}/squashfs_container" squashfs_container="${iso_mount_point}/${live_dir}/${squash_image}" mkdir -m 0755 -p "${container_mount_point}" if activate_verity "${squashfs_container}";then squashfs_container=/dev/mapper/verityroot fi if activate_luks "${squashfs_container}" luks; then squashfs_container=/dev/mapper/luks fi if ! mount -n "${squashfs_container}" "${container_mount_point}";then die "Failed to mount live ISO compressed read-only container" fi echo "${container_mount_point}" } function activate_verity { # The method loopback mounts the given compressed root image # and calls veritysetup to activate the verity device. The # activatrion of the verity device can also be done with help # from systemd-veritysetup which would automatically be called # after losetup if the dracut module systemd-veritysetup # would be included to the initrd. Unfortunately no proper # veritytab file can be provided if the root image is based on # squashfs because there is no support for UUIDs in squashfs # which means the veritytab would have to be modified with the # plain loopback device after the losetup call. Such a modification # then requires to call "systemctl daemon-reload" followed by # "systemctl restart systemd-veritysetup@verityroot" to make # systemd-veritysetup aware of the changes in the veritytab. # To avoid this complexity the verity device is activated via # veritysetup directly. local compressed_root=$1 local verity_loop local verity_name local data_device local hash_device local root_hash local verity_options local kiwi_verity_options local veritysetup local option if [ -f /etc/veritytab ];then read -r \ verity_name data_device hash_device root_hash verity_options \ < /etc/veritytab verity_loop=$(losetup --show --find "${compressed_root}") udevadm wait "${verity_loop}" if [ "${data_device}" = "PLACEHOLDER" ];then # squashfs does not support UUIDs, therefore the initial # veritytab only contains a placeholder for the device name sed -ie "s|PLACEHOLDER|${verity_loop}|g" /etc/veritytab fi read -r \ verity_name data_device hash_device root_hash verity_options \ < /etc/veritytab if [ "$(echo "${data_device}" | cut -f1 -d=)" = "UUID" ];then data_device=/dev/disk/by-uuid/$(echo "${data_device}" | cut -f2 -d=) udevadm wait "${data_device}" fi if [ "$(echo "${hash_device}" | cut -f1 -d=)" = "UUID" ];then hash_device=/dev/disk/by-uuid/$(echo "${hash_device}" | cut -f2 -d=) udevadm wait "${hash_device}" fi # Read kernel command line verity options and merge the options kiwi_verity_options=$(getarg rd.kiwi.verity_options=) if [ -n "${kiwi_verity_options}" ]; then if [ -n "${verity_options}" ]; then verity_options="${verity_options},${kiwi_verity_options}" else verity_options="${kiwi_verity_options}" fi fi veritysetup="veritysetup open " veritysetup="${veritysetup} ${data_device} ${verity_name} " veritysetup="${veritysetup} ${hash_device} ${root_hash}" for option in $(echo "${verity_options}" | tr , " ");do veritysetup="${veritysetup} --${option}" done eval "${veritysetup}" set_device_lock "${verity_loop}" \ udevadm wait "/dev/mapper/verityroot" return 0 else return 1 fi } function activate_luks { local rootfs_image=$1 local mapname=$2 declare kiwi_luks_empty_passphrase=${kiwi_luks_empty_passphrase} if ! cryptsetup isLuks "${rootfs_image}" &>/dev/null;then return 1 fi if [ "${kiwi_luks_empty_passphrase}" = "true" ];then cryptsetup \ --key-file /dev/zero \ --keyfile-size 32 \ luksOpen "${rootfs_image}" "${mapname}" else systemd-cryptsetup attach "${mapname}" "${rootfs_image}" fi } function mountReadOnlyRootImageFromContainer { local container_mount_point=$1 local overlay_base overlay_base=$(getOverlayBaseDirectory) local rootfs_image="${container_mount_point}/${live_dir}/rootfs.img" local root_mount_point="${overlay_base}/rootfsbase" mkdir -m 0755 -p "${root_mount_point}" if activate_luks "${rootfs_image}" luks; then rootfs_image=/dev/mapper/luks fi if ! [ -e "${rootfs_image}" ] && [ -d "${container_mount_point}/proc" ]; then # It's the root filesystem directly, just do a bind mount mount -n --bind "${container_mount_point}" "${root_mount_point}" echo "${root_mount_point}" return fi if ! mount -n "${rootfs_image}" "${root_mount_point}"; then die "Failed to mount live ISO root filesystem" fi echo "${root_mount_point}" } function prepareTemporaryOverlay { local overlay_base overlay_base=$(getOverlayBaseDirectory) mkdir -m 0755 -p "${overlay_base}/overlayfs/rw" mkdir -m 0755 -p "${overlay_base}/overlayfs/work" } function preparePersistentOverlay { if [ -z "${isodiskmode}" ] || [ -z "${isodiskdev}" ]; then return 1 fi local overlay_base overlay_base=$(getOverlayBaseDirectory) local overlay_mount_point="${overlay_base}/overlayfs" mkdir -m 0755 -p "${overlay_mount_point}" if [ "${isodiskmode}" = "disk_boot" ];then if ! preparePersistentOverlayDiskBoot "${overlay_mount_point}"; then return 1 fi else if ! preparePersistentOverlayLoopBoot "${overlay_mount_point}"; then return 1 fi fi mkdir -m 0755 -p "${overlay_mount_point}/rw" mkdir -m 0755 -p "${overlay_mount_point}/work" } function preparePersistentOverlayLoopBoot { # Create or re-use a cow file on the filesystem the iso # was loopback booted from. If the file already exists # it will be used as presented. If not it will be created # with the custom size configured in rd.live.cowfile.mbsize # or the default size of 500MB local overlay_mount_point=$1 local isoscan_loop_mount=/run/initramfs/isoscan local cow_file_name="${isoscan_loop_mount}/${cow_file_path}" mkdir -m 0755 -p "${overlay_mount_point}" if ! mount -o "remount,rw" "${isoscan_loop_mount}"; then return 1 fi if activate_luks "${cow_file_name}" lukscow; then cow_file_name=/dev/mapper/lukscow fi if ! mount "${cow_file_name}" "${overlay_mount_point}"; then if ! dd if=/dev/zero of="${cow_file_name}" \ count=0 bs=1M seek="${cow_file_mbsize}"; then return 1 fi if getargbool 0 rd.live.encrypt; then if prepareEncryptedOverlay "${cow_file_name}" lukscow; then cow_file_name=/dev/mapper/lukscow fi fi if ! mkfs."${cow_filesystem}" "${cow_file_name}"; then return 1 fi if ! mount "${cow_file_name}" "${overlay_mount_point}"; then return 1 fi fi } function preparePersistentOverlayDiskBoot { # Create a write partition and filesystem on the iso # disk device with the cow label and mount it. If the # disk already populates a cow labeled partition it is # used as presented local overlay_mount_point=$1 local partitions_before_cow_part mkdir -m 0755 -p "${overlay_mount_point}" activate_luks /dev/disk/by-label/lukscow lukscow if ! mount -L cow "${overlay_mount_point}"; then partitions_before_cow_part=$(_partition_count) echo -e "n\np\n\n\n\nw\nq" | fdisk "${isodiskdev}" if ! set_device_lock "${isodiskdev}" partx -u "${isodiskdev}"; then return 1 fi udev_pending if [ "$(_partition_count)" -le "${partitions_before_cow_part}" ];then return 1 fi local write_partition write_partition=$(lsblk "${isodiskdev}" -p -l -n -o NAME | tail -n1) if getargbool 0 rd.live.encrypt; then if prepareEncryptedOverlay "${write_partition}" lukscow; then write_partition=/dev/mapper/lukscow fi fi if ! mkfs."${cow_filesystem}" -L cow "${write_partition}"; then return 1 fi if ! mount -L cow "${overlay_mount_point}"; then return 1 fi fi } function prepareEncryptedOverlay { # Create LUKS on provided read-write overlay local device=$1 local label=$2 cat >/run/dracut-interactive <<-EOF cryptsetup -q luksFormat \\ --force-password --type luks2 --label "${label}" "${device}" EOF _run_interactive systemd-cryptsetup attach "${label}" "${device}" } function runMediaCheck { # messages are redirected to stderr because this code is called # as part of the pre-mount hook via the dracut-pre-mount.service # which only shows messages on stderr to the console and we want # to see the check results during boot if ! command -v checkmedia &>/dev/null; then echo "No mediacheck program installed, mediacheck skipped" 1>&2 return fi local timeout=20 local check_result check_result=/run/initramfs/checkmedia.result set_device_lock "${media_check_device}" \ checkmedia --verbose "${media_check_device}" &>${check_result} local check_status=$? if [ ${check_status} != 0 ];then echo "ISO check failed" >> ${check_result} else echo "ISO check passed" >> ${check_result} fi echo "Press key to continue (waiting ${timeout}sec...)" >> ${check_result} _run_dialog --timeout ${timeout} --tailbox ${check_result} 20 70 if [ ${check_status} != 0 ];then die "Failed to verify system integrity" fi } function fetch_file { # Fetch file from remote location local source_url=$1 local source_uncompressed_bytes=$2 local fetch_info=/tmp/fetch.info local fetch local curl_options local dolly_options curl_options=$(getarg rd.kiwi.live.curl_options=) dolly_options=$(getarg rd.kiwi.live.dolly_options=) if [ -n "${curl_options}" ]; then curl_options=$(str_replace "${curl_options}" "," " ") fetch="curl ${curl_options} -f ${source_url}" else fetch="curl -f ${source_url}" fi if [ -n "${dolly_options}" ]; then dolly_options=$(str_replace "${dolly_options}" "," " ") fetch="dolly ${dolly_options} -f ${source_url}" fi if _is_dolly "${source_url}";then fetch="dolly" fi if _is_xz_compressed "${source_url}";then fetch="${fetch} | xz -d" fi if [ -z "${source_uncompressed_bytes}" ];then eval "${fetch}" 2>${fetch_info} else eval "${fetch}" 2>${fetch_info} |\ pv --size "${source_uncompressed_bytes}" --stop-at-size -n fi return "${PIPESTATUS[0]}" } function show_log_and_quit { local text_message="$1" local log_file="$2" local timeout timeout=$(_dialog_timeout) if [ "${timeout}" = "off" ];then _run_dialog --backtitle "\"${text_message}\"" \ --textbox "${log_file}" 15 80 else _run_dialog --timeout "${timeout}" --backtitle "\"${text_message}\"" \ --textbox "${log_file}" 15 80 fi if getargbool 0 rd.debug; then die "${text_message}" else reboot -f fi } #========================================= # Methods considered private #----------------------------------------- function _is_xz_compressed { local source_url=$1 [[ ${source_url} =~ .xz$ ]] } function _is_dolly { local source_url=$1 [[ ${source_url} =~ ^dolly ]] } function _setup_interactive_service { local service=/run/systemd/system/dracut-run-interactive.service mkdir -p /run/systemd/system [ -e ${service} ] && return { echo "[Unit]" echo "Description=Dracut Run Interactive" echo "DefaultDependencies=no" echo "After=systemd-vconsole-setup.service" echo "Wants=systemd-vconsole-setup.service" echo "Conflicts=emergency.service emergency.target" echo "[Service]" echo "Environment=HOME=/" echo "Environment=DRACUT_SYSTEMD=1" echo "Environment=NEWROOT=/sysroot" echo "WorkingDirectory=/" echo "ExecStart=/bin/bash /run/dracut-interactive" echo "Type=oneshot" echo "StandardInput=tty-force" echo "StandardOutput=inherit" echo "StandardError=inherit" echo "KillMode=process" echo "IgnoreSIGPIPE=no" echo "KillSignal=SIGHUP" } > ${service} } function _run_interactive { _setup_interactive_service systemctl start dracut-run-interactive.service } function _dialog_timeout { local timeout=60 custom_timeout=$(getarg "rd.kiwi.dialog.timeout=") [ -n "${custom_timeout}" ] && timeout="${custom_timeout}" echo "${timeout}" } function _run_dialog { # """ # Run the dialog program via the systemd service either in a # framebuffer terminal or on the console. The return code of # the function is the return code of the dialog call. The # output of the dialog call is stored in a file and can be # one time read via the get_dialog_result function # """ stop_plymouth local dialog_result=/tmp/dialog_result local dialog_exit_code=/tmp/dialog_code { echo "dialog $* 2>$dialog_result" echo "echo -n \$? >$dialog_exit_code" } >/run/dracut-interactive _run_interactive return "$(cat $dialog_exit_code)" } function stop_plymouth { if ! getargbool 0 rd.kiwi.allow_plymouth; then if command -v plymouth &>/dev/null;then plymouth --quit --wait fi fi } function _partition_count { if [ -z "${isodiskdev}" ]; then echo 0 else lsblk "${isodiskdev}" -p -r -n -o TYPE | grep -c part fi } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7384837 kiwi-11.1.8/dracut/modules.d/55kiwi-live/kiwi-live-net-genrules.sh0000755000000000000000000000060515273675667021617 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh if getargbool 0 rd.kiwi.live.pxe; then { echo -n "SUBSYSTEM==\"net\", ACTION==\"add\", " echo -n "DRIVERS==\"?*\", ATTR{address}==\"?*\", " echo -n "ATTR{dev_id}==\"0x0\", ATTR{type}==\"1\", " echo -n "KERNEL==\"?*\", NAME=\"lan0\"" echo } > /etc/udev/rules.d/90-net.rules fi ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7384837 kiwi-11.1.8/dracut/modules.d/55kiwi-live/kiwi-live-root.sh0000755000000000000000000000227215273675667020174 0ustar00#!/bin/bash # called from /etc/udev/rules.d/99-live-kiwi.rules type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh type mountIso >/dev/null 2>&1 || . /lib/kiwi-live-lib.sh PATH=/usr/sbin:/usr/bin:/sbin:/bin # init debug log file if wanted setupDebugMode # initialize profile environment initialize # load required kernel modules loadKernelModules # provide ISO when remote root=$(ProvideIso "$1") # device nodes and types initGlobalDevices "$root" # live options and their default values initGlobalOptions # prepare overlay for generated systemd LiveOS_rootfs service declare isodiskdev=${isodiskdev} if getargbool 0 rd.live.overlay.persistent && [ -n "${isodiskdev}" ]; then if ! preparePersistentOverlay; then warn "Failed to setup persistent write space !" warn "Falling back to temporary overlay" prepareTemporaryOverlay fi else prepareTemporaryOverlay fi # mount ISO device iso_mount_point=$(mountIso) # mount squashfs compressed container container_mount_point=$( mountCompressedContainerFromIso "${iso_mount_point}" ) # mount readonly root filesystem from container mountReadOnlyRootImageFromContainer "${container_mount_point}" need_shutdown exit 0 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7384837 kiwi-11.1.8/dracut/modules.d/55kiwi-live/module-setup.sh0000755000000000000000000000354615273675667017743 0ustar00#!/bin/bash # called by dracut check() { # a live host-only image doesn't really make a lot of sense declare hostonly=${hostonly} [[ ${hostonly} ]] && return 1 return 255 } # called by dracut depends() { # The kiwi-live hooks are bash scripts sourced by the dracut # /bin/sh scripts. Depending on bash makes bash the initrd # /bin/sh, also on hosts where /bin/sh is e.g. dash echo network rootfs-block dm bash return 0 } # called by dracut installkernel() { instmods squashfs loop aoe brd iso9660 overlay } # called by dracut install() { declare moddir=${moddir} declare systemdutildir=${systemdutildir} declare dracutbasedir=${dracutbasedir} local dmsquashdir= inst_multiple -o checkmedia inst_multiple \ umount dmsetup partx blkid lsblk dd losetup \ grep cut find wc fdisk tail mkfs.ext4 mkfs.xfs \ dialog cat mountpoint curl dolly dd cryptsetup veritysetup \ flock udevadm sed dmsquashdir=$(find "${dracutbasedir}/modules.d" -name "*dmsquash-live") if [ -n "${dmsquashdir}" ] && \ [ -f "${dmsquashdir}/parse-iso-scan.sh" ] && \ [ -f "${dmsquashdir}/iso-scan.sh" ]; then inst_hook cmdline 31 "${dmsquashdir}/parse-iso-scan.sh" inst_script "${dmsquashdir}/iso-scan.sh" "/sbin/iso-scan" fi inst_hook cmdline 30 "${moddir}/parse-kiwi-live.sh" inst_hook pre-udev 30 "${moddir}/kiwi-live-genrules.sh" inst_hook pre-udev 60 "${moddir}/kiwi-live-net-genrules.sh" inst_hook pre-mount 30 "${moddir}/kiwi-live-checkmedia.sh" inst_script "${moddir}/kiwi-live-root.sh" "/sbin/kiwi-live-root" inst_script "${moddir}/kiwi-generator.sh" \ "${systemdutildir}/system-generators/dracut-kiwi-generator" inst_simple "${moddir}/kiwi-live-lib.sh" "/lib/kiwi-live-lib.sh" inst_rules 60-cdrom_id.rules dracut_need_initqueue } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7384837 kiwi-11.1.8/dracut/modules.d/55kiwi-live/parse-kiwi-live.sh0000755000000000000000000000234115273675667020320 0ustar00#!/bin/bash # live images are specified with # root=live:CDLABEL=label # root=live:AOEINTERFACE=name type getOverlayBaseDirectory >/dev/null 2>&1 || . /lib/kiwi-live-lib.sh [ -z "${root}" ] && root=$(getarg root=) if [ "${root%%:*}" = "live" ] ; then liveroot=${root} fi [ "${liveroot%%:*}" = "live" ] || return 1 modprobe -q loop case "${liveroot}" in live:CDLABEL=*|CDLABEL=*) \ root="${root#live:}" root="${root//\//\\x2f}" root="live:/dev/disk/by-label/${root#CDLABEL=}" rootok=1 ;; live:AOEINTERFACE=*|AOEINTERFACE=*) \ modprobe -q aoe root="${root#live:}" root="${root//\//\\x2f}" root="live:aoe:/dev/etherd/${root#AOEINTERFACE=}" rootok=1 ;; live:ftp:*|live:http:*|live:https:*|live:dolly:*) \ modprobe -q brd root="${root#live:}" root="live:net:${root}" rootok=1 ;; esac [ "$rootok" = "1" ] || return 1 info "root was ${liveroot}, is now ${root}" # make sure that init doesn't complain [ -z "${root}" ] && root="live" OVERLAY_BASE="$(getOverlayBaseDirectory)" wait_for_dev -n "${OVERLAY_BASE}/rootfsbase" wait_for_dev -n "${OVERLAY_BASE}/overlayfs/rw" wait_for_dev -n "${OVERLAY_BASE}/overlayfs/work" return 0 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7384837 kiwi-11.1.8/dracut/modules.d/55kiwi-overlay/Makefile0000644000000000000000000000023415273675667017132 0ustar00buildroot = / install: install -d -m 755 ${buildroot}usr/lib/dracut/modules.d/55kiwi-overlay cp -a * ${buildroot}usr/lib/dracut/modules.d/55kiwi-overlay ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7387881 kiwi-11.1.8/dracut/modules.d/55kiwi-overlay/kiwi-generator.sh0000755000000000000000000000363115273675667020764 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh type getOverlayBaseDirectory >/dev/null 2>&1 || . /lib/kiwi-filesystem-lib.sh [ -z "${root}" ] && root=$(getarg root=) if [ "${root%%:*}" = "overlay" ] ; then overlayroot=${root} fi # Generate sysroot unit only if overlay is requested [ "${overlayroot%%:*}" = "overlay" ] || exit 0 GENERATOR_DIR="$2" [ -z "$GENERATOR_DIR" ] && exit 1 [ -d "$GENERATOR_DIR" ] || mkdir "$GENERATOR_DIR" OVERLAY_BASE="$(getOverlayBaseDirectory)" ROOTFLAGS="$(getarg rootflags)" if getargbool 0 rd.root.overlay.readonly; then { echo "[Unit]" echo "Before=initrd-root-fs.target" echo "DefaultDependencies=no" echo "After=run-overlay-rootfsbase.mount" echo "After=run-overlay.mount" echo "[Mount]" echo "Where=/sysroot" echo "What=${OVERLAY_BASE}/rootfsbase" echo "Options=bind" echo "Type=none" _dev=ReadOnlyOS_rootfs } > "$GENERATOR_DIR"/sysroot.mount else { echo "[Unit]" echo "Before=initrd-root-fs.target" echo "DefaultDependencies=no" echo "After=run-overlay-rootfsbase.mount" echo "After=run-overlay.mount" echo "[Mount]" echo "Where=/sysroot" echo "What=OverlayOS_rootfs" echo "Options=${ROOTFLAGS},lowerdir=${OVERLAY_BASE}/rootfsbase,upperdir=${OVERLAY_BASE}/overlayfs/rw,workdir=${OVERLAY_BASE}/overlayfs/work" echo "Type=overlay" _dev=OverlayOS_rootfs } > "$GENERATOR_DIR"/sysroot.mount fi if [ ! -e "$GENERATOR_DIR/initrd-root-fs.target.requires/sysroot.mount" ]; then mkdir -p "$GENERATOR_DIR"/initrd-root-fs.target.requires ln -s "$GENERATOR_DIR"/sysroot.mount \ "$GENERATOR_DIR"/initrd-root-fs.target.requires/sysroot.mount fi mkdir -p "$GENERATOR_DIR/$_dev.device.d" { echo "[Unit]" echo "JobTimeoutSec=3000" } > "$GENERATOR_DIR/$_dev.device.d/timeout.conf" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7387881 kiwi-11.1.8/dracut/modules.d/55kiwi-overlay/kiwi-overlay-root.sh0000755000000000000000000000726615273675667021450 0ustar00#!/bin/bash # root=overlay:* was converted into a root=block:/dev/... node type getOverlayBaseDirectory >/dev/null 2>&1 || . /lib/kiwi-filesystem-lib.sh #====================================== # functions #-------------------------------------- function setupDebugMode { if getargbool 0 rd.kiwi.debug; then local log=/run/initramfs/log mkdir -p ${log} exec > ${log}/boot.kiwi exec 2>> ${log}/boot.kiwi set -x fi } function loadKernelModules { modprobe squashfs } function initGlobalDevices { local nbd_host local nbd_export if [ -z "$1" ]; then die "No root device for operation given" fi write_partition=$(getarg rd.root.overlay.write=) if [[ "${root_cmdline}" =~ "overlay:nbd=" ]];then nbd_host=$(echo "${root_cmdline}" | cut -f2 -d= | cut -f1 -d:) nbd_export=$(echo "${root_cmdline}" | cut -f3 -d:) read_only_partition="/dev/nbd0" if ! nbd-client \ "${nbd_host}" "${read_only_partition}" -name "${nbd_export}" then die "Failed to setup nbd client for ${root_cmdline}" fi elif [[ "${root_cmdline}" =~ "overlay:aoe=" ]];then read_only_partition="/dev/etherd/$(echo "${root_cmdline}"|cut -f2 -d=)" else read_only_partition="$1" fi } function mountReadOnlyRootImage { local overlay_base local unit_name overlay_base=$(getOverlayBaseDirectory) local root_mount_point="${overlay_base}/rootfsbase" mkdir -m 0755 -p "${root_mount_point}" unit_name=$(echo "${root_mount_point}" | cut -c 2- | tr / -) cat >/run/systemd/system/"${unit_name}".mount <<-EOF [Unit] Before=initrd-root-fs.target After=run-overlay.mount DefaultDependencies=no [Mount] Where=$root_mount_point What=$read_only_partition Type=auto DirectoryMode=0755 [Install] WantedBy=multi-user.target EOF if ! systemctl start "${unit_name}".mount;then die "Failed to mount overlay(ro) root filesystem" fi echo "${root_mount_point}" } function prepareTemporaryOverlay { local overlay_base overlay_base=$(getOverlayBaseDirectory) mkdir -m 0755 -p "${overlay_base}/overlayfs/rw" mkdir -m 0755 -p "${overlay_base}/overlayfs/work" } function preparePersistentOverlay { local overlay_base local unit_name overlay_base=$(getOverlayBaseDirectory) local overlay_mount_point="${overlay_base}/overlayfs" mkdir -m 0755 -p "${overlay_mount_point}" unit_name=$(echo "${overlay_mount_point}" | cut -c 2- | tr / -) cat >/run/systemd/system/"${unit_name}".mount <<-EOF [Unit] Before=initrd-root-fs.target After=run-overlay.mount DefaultDependencies=no [Mount] Where=$overlay_mount_point What=$write_partition Type=auto DirectoryMode=0755 [Install] WantedBy=multi-user.target EOF if ! systemctl start "${unit_name}".mount; then die "Failed to mount overlay(rw) filesystem" fi mkdir -m 0755 -p "${overlay_mount_point}/rw" mkdir -m 0755 -p "${overlay_mount_point}/work" } #====================================== # perform root access preparation #-------------------------------------- PATH=/usr/sbin:/usr/bin:/sbin:/bin declare root=${root} declare root_cmdline root_cmdline=$(getarg root=) # only run if overlay is requested if [[ ! "${root_cmdline}" =~ "overlay:" ]];then return 0 fi # init debug log file if wanted setupDebugMode # device nodes and types initGlobalDevices "${root#block:}" # load required kernel modules loadKernelModules # mount readonly root filesystem mountReadOnlyRootImage if [ -z "${write_partition}" ] || getargbool 0 rd.root.overlay.temporary; then prepareTemporaryOverlay else preparePersistentOverlay fi need_shutdown return 0 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7387881 kiwi-11.1.8/dracut/modules.d/55kiwi-overlay/module-setup.sh0000755000000000000000000000141315273675667020454 0ustar00#!/bin/bash # called by dracut check() { return 255 } # called by dracut depends() { echo network rootfs-block dm kiwi-lib return 0 } # called by dracut installkernel() { instmods squashfs loop overlay nbd aoe } # called by dracut install() { declare moddir=${moddir} declare systemdutildir=${systemdutildir} inst_multiple \ lsblk losetup grep cut mount nbd-client inst_hook cmdline 30 "${moddir}/parse-kiwi-overlay.sh" # kiwi-repart priority pre-mount hook is 20 # overlay pre-mount needs to happend after any repartition inst_hook pre-mount 30 "${moddir}/kiwi-overlay-root.sh" inst_script "${moddir}/kiwi-generator.sh" \ "${systemdutildir}/system-generators/dracut-kiwi-generator" dracut_need_initqueue } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7387881 kiwi-11.1.8/dracut/modules.d/55kiwi-overlay/parse-kiwi-overlay.sh0000755000000000000000000000415015273675667021564 0ustar00#!/bin/bash # overlay images are specified with # root=overlay:UUID=uuid # root=overlay:PARTUUID=partuuid # root=overlay:LABEL=label # root=overlay:nbd=ip:exportname # root=overlay:aoe=interface [ -z "${root}" ] && root=$(getarg root=) if [ "${root%%:*}" = "overlay" ] ; then overlayroot=$root fi [ "${overlayroot%%:*}" = "overlay" ] || return 1 modprobe -q loop need_network=0 case "${overlayroot}" in overlay:UUID=*|UUID=*) \ root="${root#overlay:}" root="${root//\//\\x2f}" root="block:/dev/disk/by-uuid/${root#UUID=}" rootok=1 ;; overlay:PARTUUID=*|PARTUUID=*) \ root="${root#overlay:}" root="${root//\//\\x2f}" root="block:/dev/disk/by-partuuid/${root#PARTUUID=}" rootok=1 ;; overlay:PARTLABEL=*|PARTLABEL=*) \ root="${root#overlay:}" root="${root//\//\\x2f}" root="block:/dev/disk/by-partlabel/${root#PARTLABEL=}" rootok=1 ;; overlay:LABEL=*|LABEL=*) \ root="${root#overlay:}" root="${root//\//\\x2f}" root="block:/dev/disk/by-label/${root#LABEL=}" rootok=1 ;; overlay:UNIXNODE=*|UNIXNODE=*) \ root="${root#overlay:}" root="${root//\//\\x2f}" root="block:/dev/${root#UNIXNODE=}" rootok=1 ;; overlay:MAPPER=*|MAPPER=*) \ root="${root#overlay:}" root="${root//\//\\x2f}" root="block:/dev/mapper/${root#MAPPER=}" rootok=1 ;; overlay:nbd=*) \ root="${root#overlay:nbd=}" root="block:/dev/nbd0" need_network=1 rootok=1 ;; overlay:aoe=*) \ root="${root#overlay:aoe=}" root="block:/dev/etherd/${root}" need_network=1 rootok=1 ;; esac if [ "${need_network}" = "1" ];then echo "rd.neednet=1" > /etc/cmdline.d/kiwi-generated.conf if ! getarg "ip="; then echo "ip=dhcp" >> /etc/cmdline.d/kiwi-generated.conf fi fi [ "${rootok}" = "1" ] || return 1 info "root was ${overlayroot}, is now ${root}" # make sure that init doesn't complain [ -z "${root}" ] && root="overlay" wait_for_dev -n "${root#block:}" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7387881 kiwi-11.1.8/dracut/modules.d/55kiwi-repart/Makefile0000644000000000000000000000023215273675667016744 0ustar00buildroot = / install: install -d -m 755 ${buildroot}usr/lib/dracut/modules.d/55kiwi-repart cp -a * ${buildroot}usr/lib/dracut/modules.d/55kiwi-repart ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.738933 kiwi-11.1.8/dracut/modules.d/55kiwi-repart/kiwi-repart-disk.sh0000755000000000000000000002403215273675667021035 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh type lookup_disk_device_from_root >/dev/null 2>&1 || . /lib/kiwi-lib.sh type create_partitions >/dev/null 2>&1 || . /lib/kiwi-partitions-lib.sh type resize_filesystem >/dev/null 2>&1 || . /lib/kiwi-filesystem-lib.sh type activate_volume_group >/dev/null 2>&1 || . /lib/kiwi-lvm-lib.sh type activate_mdraid >/dev/null 2>&1 || . /lib/kiwi-mdraid-lib.sh type luks_system >/dev/null 2>&1 || . /lib/kiwi-luks-lib.sh #====================================== # Functions #-------------------------------------- function initialize { local profile=/.profile if test ! -f ${profile}; then warn "No profile setup found" warn "Settings from the kiwi description will be ignored" fi test -f ${profile} && import_file ${profile} # Optional env TERM setup term=$(getarg "rd.kiwi.term=") [ -n "${term}" ] && export TERM="${term}" # Create dialog profile from current env # Used in the systemd dialog unit env >/dialog_profile # Lookup the partition setup while the device mappings on # top of the partitions are still active. They are looked # up through the root device and get deactivated for the # repartition disk=$(lookup_disk_device_from_root) export disk root_partition=$(lookup_partition_device_from_root) export root_partition raid_device=$(lookup_raid_device_from_root) export raid_device # the bootable flag gets lost if its partition is recreated boot_partition_id=$(get_active_partition_id "${disk}") export boot_partition_id last_device=$(get_last_partition_device "${disk}") export last_device disk_free_mbytes=$(( $(get_free_disk_bytes "${disk}") / 1048576 )) export disk_free_mbytes disk_root_mbytes=$(( $(get_block_device_kbsize "${last_device}") / 1024 )) export disk_root_mbytes } function deactivate_device_mappings { if lvm_system;then deactivate_volume_group fi if mdraid_system "${raid_device}";then deactivate_mdraid "${raid_device}" fi if luks_system "${root_partition}";then deactivate_luks fi } function finalize_disk_repart { local kiwi_ResizePart kiwi_ResizePart=$(get_last_partition_id "${disk}") finalize_partition_table "${disk}" "${boot_partition_id}" set_root_map \ "$(get_partition_node_name "${disk}" "${kiwi_ResizePart}")" } function get_target_rootpart_size { declare kiwi_oemrootMB=${kiwi_oemrootMB} local oemrootMB oemrootMB=$(getarg rd.kiwi.install.install.systemsize=) if [ -n "${oemrootMB}" ]; then if [ "${oemrootMB}" = "all" ];then kiwi_oemrootMB="" else kiwi_oemrootMB="${oemrootMB}" fi fi echo "${kiwi_oemrootMB}" } function repart_standard_disk { # """ # repartition disk with read/write root filesystem # Image partition table layout is: # ===================================== # pX: [ boot ] # pX+1: ( root ) [+luks +raid] # ------------------------------------- # """ local kiwi_oemrootMB local kiwi_ResizePart local command_query local root_part_size local part_name kiwi_oemrootMB=$(get_target_rootpart_size) kiwi_ResizePart=$(get_last_partition_id "${disk}") part_name=$(get_partition_name "${disk}" "${kiwi_ResizePart}") if [ -z "${kiwi_oemrootMB}" ];then local disk_have_root_system_mbytes=$(( disk_root_mbytes + disk_free_mbytes )) local min_additional_mbytes=10 else local disk_have_root_system_mbytes=${kiwi_oemrootMB} local min_additional_mbytes=$(( kiwi_oemrootMB - disk_root_mbytes )) fi if [ "${min_additional_mbytes}" -lt 10 ];then min_additional_mbytes=10 fi # check if we can repart this disk if ! check_repart_possible \ ${disk_root_mbytes} ${disk_free_mbytes} ${min_additional_mbytes} then return 1 fi # deactivate all active device mappings deactivate_device_mappings # repart root partition root_part_size=+${disk_have_root_system_mbytes}M if [ -z "${kiwi_oemrootMB}" ];then # no new parts and no rootsize limit, use rest disk space root_part_size=. fi command_query=" d ${kiwi_ResizePart} n ${part_name} ${kiwi_ResizePart} . ${root_part_size} " if mdraid_system "${raid_device}"; then command_query=" d ${kiwi_ResizePart} n ${part_name} ${kiwi_ResizePart} . ${root_part_size} t ${kiwi_ResizePart} fd " fi if ! create_partitions "${disk}" "${command_query}";then die "Failed to create partition table" fi if mdraid_system "${raid_device}"; then update_devicesize_mdraid "${raid_device}" fi # finalize table changes finalize_disk_repart } function repart_lvm_disk { # """ # repartition disk if LVM partition plus boot partition # is used. Initial partition table layout is: # ===================================== # pX: ( boot ) # pX+1: ( LVM ) [+luks +raid] # ------------------------------------- # """ local kiwi_oemrootMB local kiwi_ResizePart local command_query local lvm_part_size local part_name kiwi_oemrootMB=$(get_target_rootpart_size) kiwi_ResizePart=$(get_last_partition_id "${disk}") part_name=$(get_partition_name "${disk}" "${kiwi_ResizePart}") if [ -z "${kiwi_oemrootMB}" ];then local disk_have_root_system_mbytes=$(( disk_root_mbytes + disk_free_mbytes )) local min_additional_mbytes=10 else local disk_have_root_system_mbytes=$(( kiwi_oemrootMB )) local min_additional_mbytes=$(( kiwi_oemrootMB - disk_root_mbytes )) fi if [ "${min_additional_mbytes}" -lt 10 ];then min_additional_mbytes=10 fi # check if we can repart this disk if ! check_repart_possible \ ${disk_root_mbytes} ${disk_free_mbytes} ${min_additional_mbytes} then return 1 fi # deactivate all active device mappings deactivate_device_mappings # create lvm.conf appropriate for resize setup_lvm_config # repart lvm partition lvm_part_size=+${disk_have_root_system_mbytes}M if [ -z "${kiwi_oemrootMB}" ];then # no rootsize limit, use rest disk space lvm_part_size=. fi command_query=" d ${kiwi_ResizePart} n ${part_name} ${kiwi_ResizePart} . ${lvm_part_size} t ${kiwi_ResizePart} 8e " if ! create_partitions "${disk}" "${command_query}";then die "Failed to create partition table" fi # finalize table changes finalize_disk_repart } function check_repart_possible { local disk_root_mbytes=$1 local disk_free_mbytes=$2 local min_additional_mbytes=$3 local kiwi_oemrootMB kiwi_oemrootMB=$(get_target_rootpart_size) if [ -n "${kiwi_oemrootMB}" ];then if [ "${kiwi_oemrootMB}" -lt "${disk_root_mbytes}" ];then # specified oem-systemsize is smaller than root partition warn "Requested OEM systemsize is smaller than root partition:" warn "Disk won't be re-partitioned !" echo warn "Current Root partition: ${disk_root_mbytes} MB" warn "==> Requested size: ${kiwi_oemrootMB} MB" return 1 fi fi if [ "${min_additional_mbytes}" -gt "${disk_free_mbytes}" ];then if [ "${disk_free_mbytes}" -gt 2 ];then # Requested size for root exceeds free space on disk local requested_size if [ -n "${kiwi_oemrootMB}" ];then requested_size="root:($((kiwi_oemrootMB - disk_root_mbytes)) MB)" else requested_size="root:(keep)" fi warn "Requested OEM systemsize exceeds free space on the disk:" warn "Disk won't be re-partitioned !" echo warn "Requested size(s): ${requested_size}" warn "==> Free Space on disk: ${disk_free_mbytes} MB" else # The free space on disk calculated to a very small number. # This usually indicates that the disk geometry was not # intentionally changed and the rest free space is a # rounding number on the partition alignment. In this case # no warning message is shown because it's the typical # situation on reboot of a machine without disk geometry # changes. : fi return 1 fi return 0 } #====================================== # Perform repart/resize operations #-------------------------------------- PATH=/usr/sbin:/usr/bin:/sbin:/bin setup_debug # abort for iso/live mode declare root=${root} case "${root}" in install:* | live:*) return ;; esac # initialize for disk repartition initialize # reencrypt luks device if luks_system "${root_partition}";then if getargbool 0 rd.kiwi.oem.luks.reencrypt; then reencrypt_luks "${root_partition}" fi fi # wait for the root device to appear wait_for_storage_device "${last_device}" # check if repart/resize is wanted if ! resize_wanted "${last_device}" "${disk}"; then return fi # prepare disk for repartition if [ "$(get_partition_table_type "${disk}")" = 'gpt' ];then relocate_gpt_at_end_of_disk "${disk}" fi # wait for the root device to appear wait_for_storage_device "${last_device}" # resize disk partition table if lvm_system;then repart_lvm_disk || return else repart_standard_disk || return fi # resize luks if present if luks_system "${root_partition}";then activate_luks "$(get_root_map)" resize_luks fi # resize raid if present if mdraid_system "${raid_device}";then activate_mdraid "${raid_device}" resize_mdraid "${raid_device}" fi # resize volumes and filesystems if lvm_system; then resize_pyhiscal_volumes activate_volume_group resize_lvm_volumes_and_filesystems else resize_filesystem "$(get_root_map)" fi # wait for the root device to appear wait_for_storage_device "${last_device}" ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.738933 kiwi-11.1.8/dracut/modules.d/55kiwi-repart/module-setup.sh0000755000000000000000000000062215273675667020271 0ustar00#!/bin/bash # called by dracut check() { return 255 } # called by dracut depends() { echo rootfs-block dm kiwi-lib return 0 } # called by dracut installkernel() { instmods squashfs loop } # called by dracut install() { declare moddir=${moddir} test -f /.profile && inst_simple /.profile inst_hook pre-mount 20 "${moddir}/kiwi-repart-disk.sh" dracut_need_initqueue } ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.738933 kiwi-11.1.8/dracut/modules.d/59kiwi-dump-reboot/Makefile0000644000000000000000000000024415273675667017713 0ustar00buildroot = / install: install -d -m 755 ${buildroot}usr/lib/dracut/modules.d/59kiwi-dump-reboot cp -a * ${buildroot}usr/lib/dracut/modules.d/59kiwi-dump-reboot ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7390528 kiwi-11.1.8/dracut/modules.d/59kiwi-dump-reboot/kiwi-dump-reboot-system.sh0000755000000000000000000000664315273675667023343 0ustar00#!/bin/bash type lib_initialize >/dev/null 2>&1 || . /lib/kiwi-lib.sh type report_and_quit >/dev/null 2>&1 || . /lib/kiwi-dump-image.sh type get_selected_disk >/dev/null 2>&1 || . /lib/kiwi-dump-image.sh type run_dialog >/dev/null 2>&1 || . /lib/kiwi-dialog-lib.sh #====================================== # Functions #-------------------------------------- function boot_installed_system { declare kiwi_oemreboot=${kiwi_oemreboot} declare kiwi_oemrebootinteractive=${kiwi_oemrebootinteractive} declare kiwi_oemshutdown=${kiwi_oemshutdown} declare kiwi_oemshutdowninteractive=${kiwi_oemshutdowninteractive} local ask_reboot_text="Reboot System ?" local ask_shutdown_text="Shutdown System ?" local boot_options kiwi_oemreboot=$(bool "${kiwi_oemreboot}") kiwi_oemrebootinteractive=$(bool "${kiwi_oemrebootinteractive}") kiwi_oemshutdown=$(bool "${kiwi_oemshutdown}") kiwi_oemshutdowninteractive=$(bool "${kiwi_oemshutdowninteractive}") if [ "${kiwi_oemrebootinteractive}" = "true" ];then ask_and_reboot "${ask_reboot_text}" fi if [ "${kiwi_oemreboot}" = "true" ];then reboot -f fi if [ "${kiwi_oemshutdowninteractive}" = "true" ];then ask_and_shutdown "${ask_shutdown_text}" fi if [ "${kiwi_oemshutdown}" = "true" ];then systemctl poweroff fi # if rd.kiwi.install.pass.bootparam is given, pass on most # boot options to the kexec kernel if getargbool 0 rd.kiwi.install.pass.bootparam; then local cmdline local option read -r cmdline < /proc/cmdline for option in ${cmdline}; do case ${option} in rd.kiwi.*) ;; # skip all rd.kiwi options, they might do harm iso-scan/filename=*) ;; # install ISO file, not for the system *) boot_options="${boot_options}${option} ";; esac done fi boot_options="${boot_options}$(cat /config.bootoptions)" if getargbool 0 rd.kiwi.debug; then boot_options="${boot_options} rd.kiwi.debug" fi kexec_options="" if kexec --help | grep -q kexec-syscall-auto;then # try file based syscall first and fall back to kexec_load # syscall if not present. On systems using kexec that does # provide --kexec-syscall-auto the assumption is made that # neither kexec nor the kernel supports file based syscall # and thus no syscall selection is made kexec_options="${kexec_options} --kexec-syscall-auto" fi # shellcheck disable=SC2116,SC2086 kexec_options=$(echo ${kexec_options}) # strip spaces kexec "${kexec_options}" \ --load /run/install/boot/*/loader/linux \ --initrd /run/install/initrd.system_image \ --command-line "${boot_options}" if ! kexec -e; then report_and_quit "Failed to kexec boot system" fi } #====================================== # Reboot into system #-------------------------------------- lib_initialize if getargbool 0 rd.kiwi.ramdisk; then # For ramdisk deployment a kexec boot is not possible as it # will wipe the contents of the ramdisk. Therefore we prepare # the switch_root from this deployment initrd. See # kiwi-mount-ramdisk.sh mount hook for further details. image_target=$(get_selected_disk) kpartx -s -a "${image_target}" else # Standard deployment will use kexec to activate and boot the # deployed system boot_installed_system fi ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7390528 kiwi-11.1.8/dracut/modules.d/59kiwi-dump-reboot/module-setup.sh0000755000000000000000000000052515273675667021237 0ustar00#!/bin/bash # called by dracut check() { return 255 } # called by dracut depends() { echo network rootfs-block dm kiwi-lib kiwi-dump return 0 } # called by dracut installkernel() { return 0 } # called by dracut install() { declare moddir=${moddir} inst_hook pre-mount 40 "${moddir}/kiwi-dump-reboot-system.sh" } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7390528 kiwi-11.1.8/dracut/modules.d/59kiwi-lib/Makefile0000644000000000000000000000022415273675667016222 0ustar00buildroot = / install: install -d -m 755 ${buildroot}usr/lib/dracut/modules.d/59kiwi-lib cp -a * ${buildroot}usr/lib/dracut/modules.d/59kiwi-lib ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7391617 kiwi-11.1.8/dracut/modules.d/59kiwi-lib/kiwi-dialog-lib.sh0000644000000000000000000001204415273675667020065 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh function run_dialog { # """ # Run the dialog program via the systemd service either in a # framebuffer terminal or on the console. The return code of # the function is the return code of the dialog call. The # output of the dialog call is stored in a file and can be # one time read via the get_dialog_result function # """ stop_plymouth local dialog_result=/tmp/dialog_result local dialog_exit_code=/tmp/dialog_code { echo "dialog $* 2>$dialog_result" echo "echo -n \$? >$dialog_exit_code" } >/run/dracut-interactive _run_interactive return "$(cat $dialog_exit_code)" } function setup_progress_fifo { local fifo=$1 export current_progress_fifo="${fifo}" [ -e "${fifo}" ] || mkfifo "${fifo}" } function stop_dialog { _stop_interactive } function run_progress_dialog { # """ # Run the gauge dialog via systemd reading progress # status information from stdin # """ stop_plymouth declare fifo=${current_progress_fifo} local title=$1 local backtitle=$2 local progress_at="${fifo}" if [ ! -e "${progress_at}" ];then return fi { echo -n "cat ${fifo} | dialog --backtitle \"${backtitle}\" " echo -n "--gauge \"${title}\"" 7 65 0 echo } >/run/dracut-interactive _run_interactive } function get_dialog_result { local dialog_result=/tmp/dialog_result [ -e "${dialog_result}" ] && cat ${dialog_result}; rm -f ${dialog_result} } function stop_plymouth { if ! getargbool 0 rd.kiwi.allow_plymouth; then if command -v plymouth &>/dev/null;then plymouth --quit --wait fi fi } #========================================= # Methods considered private #----------------------------------------- function _setup_interactive_service { local service=/run/systemd/system/dracut-run-interactive.service local script=/run/dracut-interactive mkdir -p /run/systemd/system [ -e ${service} ] && return { echo "[Unit]" echo "Description=Dracut Run Interactive" echo "DefaultDependencies=no" echo "After=systemd-vconsole-setup.service" echo "Wants=systemd-vconsole-setup.service" echo "Conflicts=emergency.service emergency.target" echo "[Service]" echo "EnvironmentFile=/dialog_profile" echo "Environment=HOME=/" echo "Environment=DRACUT_SYSTEMD=1" echo "Environment=NEWROOT=/sysroot" echo "WorkingDirectory=/" if _fbiterm_ok; then echo "ExecStart=fbiterm -- /bin/bash ${script} " else echo "ExecStart=/bin/bash ${script}" fi echo "Type=oneshot" echo "StandardInput=tty-force" echo "StandardOutput=inherit" echo "StandardError=inherit" echo "KillMode=process" echo "IgnoreSIGPIPE=no" echo "KillSignal=SIGHUP" } > ${service} } function _run_interactive { _setup_interactive_service systemctl start dracut-run-interactive.service } function _stop_interactive { systemctl stop dracut-run-interactive.service } function _fbiterm_ok { if [ ! -e /dev/fb0 ];then # no framebuffer device found return 1 fi if ! command -v fbiterm &>/dev/null;then # no framebuffer terminal program found return 1 fi if ! fbiterm echo &>/dev/null;then # fbiterm can't be called with echo test cmd return 1 fi return 0 } function dialog_timeout { local timeout=60 custom_timeout=$(getarg "rd.kiwi.dialog.timeout=") [ -n "${custom_timeout}" ] && timeout="${custom_timeout}" echo "${timeout}" } function show_log_and_quit { local text_message="$1" local log_file="$2" local timeout timeout=$(dialog_timeout) if [ "${timeout}" = "off" ];then run_dialog --backtitle "\"${text_message}\"" \ --textbox "${log_file}" 15 80 else run_dialog --timeout "${timeout}" --backtitle "\"${text_message}\"" \ --textbox "${log_file}" 15 80 fi if getargbool 0 rd.debug; then die "${text_message}" else reboot -f fi } function report_and_quit { local text_message="$1" local timeout timeout=$(dialog_timeout) if [ "${timeout}" = "off" ];then run_dialog --msgbox "\"${text_message}\"" 5 80 else run_dialog --timeout "${timeout}" --msgbox "\"${text_message}\"" 5 80 fi if getargbool 0 rd.debug; then die "${text_message}" else reboot -f fi } function ask_and_reboot { local text_message="$1" if ! run_dialog --yesno "\"${text_message}\"" 7 80; then die "${text_message}" else reboot -f fi } function ask_and_shutdown { local text_message="$1" if ! run_dialog --yesno "\"${text_message}\"" 7 80; then die "${text_message}" else systemctl poweroff fi } function ask_for_credentials { local text_message="$1" run_dialog --insecure --passwordbox "\"${text_message}\"" 7 60 } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7391617 kiwi-11.1.8/dracut/modules.d/59kiwi-lib/kiwi-filesystem-lib.sh0000644000000000000000000001071015273675667021010 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh function getOverlayBaseDirectory { # initialize and print overlay base directory below which # the overlayfs based mountpoints are managed local overlay_base=/run/overlay local unit_name local overlay_size mkdir -p "${overlay_base}" if ! mountpoint -q "${overlay_base}";then overlay_size=$(getarg rd.root.overlay.size) [ -z "${overlay_size}" ] && overlay_size="50%" unit_name=$(echo "${overlay_base}" | cut -c 2- | tr / -) cat >/run/systemd/system/"${unit_name}".mount <<-EOF [Unit] Before=initrd-root-fs.target DefaultDependencies=no [Mount] Where=$overlay_base What=tmpfs Type=tmpfs DirectoryMode=0755 [Install] WantedBy=multi-user.target EOF systemctl start "${unit_name}".mount fi echo "${overlay_base}" } function resize_filesystem { local device=$1 test -n "${device}" || return local resize_fs local mpoint=/fs-resize local fstype fstype=$(probe_filesystem "${device}") lock="set_device_lock ${device}" case ${fstype} in ext2|ext3|ext4) resize_fs="${lock} resize2fs -f -p ${device}" ;; btrfs) resize_fs="mkdir -p ${mpoint} && mount ${device} ${mpoint} &&" resize_fs="${resize_fs} ${lock} btrfs filesystem resize max ${mpoint}" resize_fs="${resize_fs};umount ${mpoint} && rmdir ${mpoint}" ;; xfs) resize_fs="mkdir -p ${mpoint} && mount ${device} ${mpoint} &&" resize_fs="${resize_fs} ${lock} xfs_growfs ${mpoint}" resize_fs="${resize_fs};umount ${mpoint} && rmdir ${mpoint}" ;; swap) resize_fs="${lock} mkswap ${device} --label SWAP" ;; *) # don't know how to resize this filesystem warn "Don't know how to resize ${fstype}... skipped" return ;; esac if ! _is_ramdisk_device "${device}"; then if [ ! "${fstype}" = "btrfs" ];then # btrfs reports the free space cache to be outdated/corrupt # after kiwi has resized the partition table. This is an # expected condition prior resize of the filesystem and # should not prevent the following resize. As such the # filesystem check is not applied for btrfs prior resize check_filesystem "${device}" fi fi info "Resizing ${fstype} filesystem on ${device}..." if ! eval "${resize_fs}"; then die "Failed to resize filesystem" fi } function check_filesystem { local device=$1 test -n "${device}" || return local check_fs local check_fs_return_ok local fstype fstype=$(probe_filesystem "${device}") lock="set_device_lock ${device}" case ${fstype} in ext2|ext3|ext4) # The exit code by e2fsck is the sum of the following conditions: # 0 - No errors # 1 - File system errors corrected # 2 - File system errors corrected, system should be rebooted # 4 - File system errors left uncorrected # 8 - Operational error # 16 - Usage or syntax error # 32 - E2fsck canceled by user request # 128 - Shared library error check_fs="${lock} e2fsck -p -f ${device}" check_fs_return_ok="test \$? -le 2" ;; btrfs) # btrfs check returns a zero exit status if it succeeds. # Non zero is returned in case of failure. check_fs="${lock} btrfsck ${device}" check_fs_return_ok="test \$? -eq 0" ;; xfs) # xfs_repair can be used to check the filesystem. However # for subsequent xfs_growfs no check is needed. Thus for # xfs we skip the checking return ;; *) # don't know how to check this filesystem warn "Don't know how to check ${fstype}... skipped" return ;; esac info "Checking ${fstype} filesystem on ${device}..." eval "${check_fs}" if ! eval "${check_fs_return_ok}"; then die "Failed to check filesystem" fi } function probe_filesystem { local device=$1 test -n "${device}" || return local fstype fstype=$(blkid "${device}" -s TYPE -o value) if [ -z "${fstype}" ];then fstype=unknown fi if [ "${fstype}" = "crypto_LUKS" ];then fstype=luks fi echo "${fstype}" } #====================================== # Methods considered private #-------------------------------------- function _is_ramdisk_device { echo "$1" | grep -qi "/dev/ram" } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7391617 kiwi-11.1.8/dracut/modules.d/59kiwi-lib/kiwi-lib.sh0000644000000000000000000002333315273675667016633 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh function setup_debug { if getargbool 0 rd.kiwi.debug; then local log=/run/initramfs/log mkdir -p ${log} exec >> ${log}/boot.kiwi exec 2>> ${log}/boot.kiwi set -x fi } function get_system_id { local disk_device=$1 blkid -s PTUUID -o value "${disk_device}" } function set_device_lock { # """ # Set device lock, preferrable via udevadm or via # flock as fallback if systemd/udev does not provide # the command # """ if udevadm lock --help &>/dev/null;then udevadm lock --device "$@" else flock -x "$@" fi } function disk_matches_system_identifier { local disk_device=$1 local system_identifier=/system_identifier local id_disk local id_image if [ -e "${system_identifier}" ];then id_disk=$(get_system_id "${disk_device}") read -r id_image < "${system_identifier}" if [ "${id_disk}" = "${id_image}" ]; then return 0 fi fi return 1 } function set_root_map { root_map=$1 export root_map } function get_root_map { echo "${root_map}" } function get_mapped_multipath_disk { declare DEVICE_TIMEOUT=${DEVICE_TIMEOUT} local disk_device=$1 local check=0 local limit=30 if [[ "${DEVICE_TIMEOUT}" =~ ^[0-9]+$ ]]; then limit=$(((DEVICE_TIMEOUT + 1)/ 2)) fi udev_pending &>/dev/null while true;do for wwn in $(multipath -l -v1 "${disk_device}");do if [ -e "/dev/mapper/${wwn}" ];then echo "/dev/mapper/${wwn}" return fi done if [ "${check}" -eq "${limit}" ]; then die "Multipath map for ${disk_device} did not show up" fi check=$((check + 1)) sleep 2 done } function get_root_device { # """ # Get unix node of the root device from the root= setup # """ declare root=${root} local root_device=${root#block:} if [ -z "${root_device}" ];then die "No root device found" fi if [ -L "${root_device}" ];then root_device=/dev/$(basename "$(readlink "${root_device}")") fi echo "${root_device}" } function lookup_partition_device_from_root { # """ # Get unix node of the partition which stores the root # filesystem. The root filesystem is either on the partition # itself or on a device mapping on top of it, e.g LUKS, RAID # or LVM. The device mappings are looked up through the # active root device, call this before they get deactivated # """ local root_device local name local type root_device=$(get_root_device) while read -r name type;do if [ "${type}" = "part" ];then echo "${name}" return fi done < <(lsblk -p -n -r -s -o NAME,TYPE "${root_device}") } function lookup_raid_device_from_root { # """ # Get unix node of the md raid device the root filesystem # is stored on, if this raid is created on top of a partition. # This is the raid kiwi creates at build time. A raid created # from whole disks, e.g by a firmware raid controller, holds # the partitions itself and is not provided. The device # mappings are looked up through the active root device, call # this before they get deactivated # """ local root_device local raid_device local name local type root_device=$(get_root_device) while read -r name type;do case "${type}" in raid*) raid_device=${name} ;; part) # first partition below the root device, a raid # found before it is created on top of it if [ -n "${raid_device}" ];then echo "${raid_device}" fi return ;; esac done < <(lsblk -p -n -r -s -o NAME,TYPE "${root_device}") } function lookup_disk_device_from_root { declare kiwi_oemmultipath_scan=${kiwi_oemmultipath_scan} local root_device local disk_device local raid_device local wwn kiwi_oemmultipath_scan=$(bool "${kiwi_oemmultipath_scan}") root_device=$(get_root_device) raid_device=$(lookup_raid_device_from_root) for disk_device in $( lsblk -p -n -r -s -o NAME,TYPE "${root_device}" |\ grep -E "disk|raid" | cut -f1 -d ' ' ); do # If multipath is requested, set the disk_device to the # multipath mapped device if [ "${kiwi_oemmultipath_scan}" = "true" ];then disk_device=$(get_mapped_multipath_disk "${disk_device}") fi # Check if root_device is managed by mdadm and that the md raid # is not created as part of the kiwi image building process. If # this is the case the md raid device comes from a fake raid # controller and we need to prefer the md device over the storage # disks if type mdadm &> /dev/null && [ -z "${raid_device}" ]; then if mdadm --detail -Y "${disk_device}" &>/dev/null; then echo "${disk_device}" return fi fi done echo "${disk_device}" } function shasum_tool { declare kiwi_shasum_suffix=${kiwi_shasum_suffix} if getargbool 0 rd.kiwi.oem.sha512; then echo sha512sum elif [ "${kiwi_shasum_suffix}" = ".sha512" ]; then echo sha512sum else echo sha256sum fi } function shasum_extension { declare kiwi_shasum_suffix=${kiwi_shasum_suffix} if getargbool 0 rd.kiwi.oem.sha512; then echo sha512 elif [ "${kiwi_shasum_suffix}" = ".sha512" ]; then echo sha512 else echo sha256 fi } function udev_pending { declare DEVICE_TIMEOUT=${DEVICE_TIMEOUT} local limit=30 if [[ "${DEVICE_TIMEOUT}" =~ ^[0-9]+$ ]]; then limit=$(((DEVICE_TIMEOUT + 1)/ 2)) fi udevadm settle --timeout=${limit} } function get_persistent_device_from_unix_node { local unix_device=$1 local schema=$2 local node local persistent_name node=$(basename "${unix_device}") udev_pending for persistent_name in /dev/disk/"${schema}"/*; do if [ "$(basename "$(readlink "${persistent_name}")")" = "${node}" ];then echo "${persistent_name}" return fi done warn "Could not find ${schema} representation of ${node}" warn "Using original device ${unix_device}" echo "${unix_device}" } function deactivate_all_device_maps { dmsetup remove_all } function import_file { # """ # import file with key=value format. the function # will export each entry of the file as variable into # the current shell environment # """ local source_format=/tmp/source_file_formatted # create clean input, no empty lines and comments grep -v '^$' "$1" | grep -v '^[ \t]*#' > ${source_format} # remove start/stop quoting from values sed -i -e s"#\(^[a-zA-Z0-9_]\+\)=[\"']\(.*\)[\"']#\1=\2#" ${source_format} # remove backslash quotes if any sed -i -e s"#\\\\\(.\)#\1#g" ${source_format} # quote simple quotation marks sed -i -e s"#'\+#'\\\\''#g" ${source_format} # add '...' quoting to values sed -i -e s"#\(^[a-zA-Z0-9_]\+\)=\(.*\)#\1='\2'#" ${source_format} source ${source_format} &>/dev/null while read -r line;do local key key=$(echo "${line}" | cut -d '=' -f1) eval "export ${key}" &>/dev/null done < ${source_format} } function binsize_to_bytesize { # """ # converts binary sizes (1024k, 2.4G) to bytes # uses awk to handle floating point numbers # """ local sz="$1" local bs=${sz:0:-1} case ${sz} in *K|*k) mult=1024 ;; *M) mult=$((1024*1024)) ;; *G) mult=$((1024*1024*1024)) ;; *T) mult=$((1024*1024*1024*1024)) ;; *) bs=${sz}; mult=1 ;; esac awk "BEGIN {print int(${bs}*${mult})}" } function bool { # """ # provides boolean string true|false for given value. # Only if value matches true return true, in any other # case return false # """ local value=$1 if [ -n "${value}" ] && [ "${value}" = "true" ] ;then echo "true" else echo "false" fi } function lib_initialize { # """ # Source profile variables into runtime environment # The method will exit from the initrd if the profile # file does not exist # """ local term local kiwi_oem_installdevice local profile=/.profile local profile_extra=/.profile.extra # Read and import mandatory image profile to env test -f ${profile} || \ report_and_quit "No profile setup found" import_file ${profile} # Optional env TERM setup term=$(getarg "rd.kiwi.term=") [ -n "${term}" ] && export TERM="${term}" # Source optional profile.extra to env test -f ${profile_extra} && source ${profile_extra} # Create dialog profile from current env # Used in the systemd dialog unit env >/dialog_profile # Handle kiwi specific env overwrites kiwi_oem_installdevice=$(getarg rd.kiwi.oem.installdevice=) if [ -n "${kiwi_oem_installdevice}" ];then # activate unattended mode. In case a user explicitly # provides the device name to deploy the image to via # the kernel commandline, no further questions if this # is wanted should appear message="rd.kiwi.oem.installdevice explicitly set via cmdline." message="${message} The following OEM device settings will be ignored:" message="${message} oem-unattended," message="${message} oem-unattended-id," message="${message} oem-device-filter" export kiwi_oemunattended="true" export kiwi_oemunattended_id="" export kiwi_oemdevicefilter="" info "${message}" >&2 fi } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7391617 kiwi-11.1.8/dracut/modules.d/59kiwi-lib/kiwi-luks-lib.sh0000644000000000000000000001107415273675667017606 0ustar00#!/bin/bash # shellcheck disable=SC1091 type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh type set_root_map >/dev/null 2>&1 || . /lib/kiwi-lib.sh type wait_for_storage_device >/dev/null 2>&1 || . /lib/kiwi-partitions-lib.sh type ask_for_password >/dev/null 2>&1 || . /lib/dracut-crypt-lib.sh type run_progress_dialog >/dev/null 2>&1 || . /lib/kiwi-dialog-lib.sh function luks_system { # """ # Check if the given root partition, see # lookup_partition_device_from_root(), is a LUKS device # """ local device=$1 if cryptsetup isLuks "${device}" &>/dev/null;then return 0 fi return 1 } function deactivate_luks { /usr/lib/systemd/systemd-cryptsetup detach luks } function reencrypt_luks { # """ # Reencrypt the given root partition, see # lookup_partition_device_from_root(), if its LUKS # header is still the one of the image # """ local device=$1 local keyslot=/root/.luks.slot local header_checksum_origin=/root/.luks.header local header_checksum_cur=/root/.luks.header.cur local keyfile=/root/.root.keyfile local new_keyfile=/run/.kiwi_reencrypt.keyfile local passphrase_file=/root/.slotpass local progress=/dev/install_progress local load_text="Reencrypting..." local title_text="LUKS" local shasum read -r header_checksum_origin < "${header_checksum_origin}" read -r keyslot < "${keyslot}" # Checksum test if luks header is still the image origin header shasum=$(shasum_tool) cryptsetup luksHeaderBackup \ "${device}" --header-backup-file "${header_checksum_cur}" header_checksum_cur=$( "${shasum}" "${header_checksum_cur}" |\ cut -f1 -d" "; rm -f "${header_checksum_cur}" ) if [ "${header_checksum_origin}" == "${header_checksum_cur}" ];then if getargbool 0 rd.kiwi.oem.luks.reencrypt_randompass; then # reset insecure built time passphrase with a random # onetime passphrase that will be stored in memory at $new_keyfile # This action require that the boot process uses $new_keyfile # and sets a retrievable keyfile information for subsequent # boot processes of this system (umask 077; touch "${new_keyfile}") tr -dc '[:graph:]' 2>/dev/null < /dev/urandom |\ head -c 32 > "${new_keyfile}" chmod 0400 "${new_keyfile}" cryptsetup \ --key-file "${passphrase_file}" \ --key-slot "${keyslot}" \ luksChangeKey "${device}" "${new_keyfile}" cp "${new_keyfile}" "${passphrase_file}" if [ -e "${keyfile}" ]; then # if there is a keyfile it's referenced in the crypttab # of this initrd instance in memory. Make sure all subsequent # tasks e.g. luks resize have permissions to complete while # inside of this initrd instance cp "${new_keyfile}" "${keyfile}" fi fi # reencrypt setup_progress_fifo ${progress} ( # reencrypt, this will overwrite all key slots set_device_lock "${device}" cryptsetup reencrypt \ --progress-frequency 1 \ --key-file "${passphrase_file}" \ --key-slot "${keyslot}" \ "${device}" 2>&1 | sed -u 's/.* \([0-9]*\)[0-9.]*%.*/\1/' ) >"${progress}" & run_progress_dialog "${load_text}" "${title_text}" if [ -e "${keyfile}" ] && [ ! -e "${new_keyfile}" ];then # re-add keyfile if present and no other keyfile was created cryptsetup --key-file "${passphrase_file}" luksAddKey \ "${device}" "${keyfile}" fi fi } function resize_luks { cryptsetup resize luks } function activate_luks { declare kiwi_luks_empty_passphrase=${kiwi_luks_empty_passphrase} local device=$1 if [ "${kiwi_luks_empty_passphrase}" = "true" ];then # There is no keyfile and kiwi has created the luks pool with # an empty key. Therefore it can be opened without interaction # but this requires to manually call luksOpen since # with systemd-cryptsetup we saw it still asking for # a passphrase set_device_lock "${device}" cryptsetup \ --key-file /dev/zero \ --keyfile-size 32 \ luksOpen "${device}" luks else # There is a keyfile and we need to get prompted to enter the passphrase systemctl start systemd-cryptsetup@luks fi wait_for_storage_device "/dev/mapper/luks" set_root_map "/dev/mapper/luks" } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7391617 kiwi-11.1.8/dracut/modules.d/59kiwi-lib/kiwi-lvm-lib.sh0000644000000000000000000001231215273675667017422 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh type udev_pending >/dev/null 2>&1 || . /lib/kiwi-lib.sh function lvm_system { declare kiwi_lvm=${kiwi_lvm} if [ "${kiwi_lvm}" = "true" ];then return 0 fi return 1 } function setup_lvm_config { mkdir -p /etc/lvm cat > /etc/lvm/lvm.conf <<- EOF global { locking_type = 0 use_lvmetad = 0 } EOF } function activate_volume_group { declare kiwi_lvmgroup=${kiwi_lvmgroup} local vg_count=0 local vg_name if lvm_system;then for vg_name in $(vgs --noheadings -o vg_name 2>/dev/null);do if [ "${vg_name}" = "${kiwi_lvmgroup}" ];then vg_count=$((vg_count + 1)) fi done if [ ${vg_count} -gt 1 ];then die "Duplicate VolumeGroup name ${kiwi_lvmgroup} found !" fi vgchange -a y "${kiwi_lvmgroup}" udev_pending fi } function deactivate_volume_group { declare kiwi_lvmgroup=${kiwi_lvmgroup} vgchange -a n "${kiwi_lvmgroup}" udev_pending } function create_volume { declare kiwi_lvmgroup=${kiwi_lvmgroup} local volume_name=$1 local volume_mb_size=$2 if [ ! -f "$(get_volume_path_for_volume "${volume_name}")" ];then lvcreate --yes --wipesignatures y \ --size "${volume_mb_size}M" -n "${volume_name}" "${kiwi_lvmgroup}" fi } function get_volume_path_for_volume { declare kiwi_lvmgroup=${kiwi_lvmgroup} echo "/dev/${kiwi_lvmgroup}/$1" } function resize_pyhiscal_volumes { local device device=$(get_root_map) set_device_lock "${device}" pvresize "${device}" } function resize_lvm_volumes_and_filesystems { declare kiwi_lvmgroup=${kiwi_lvmgroup} local volume_name local resize_mode local resize_prefix local volume_size local volspec local all_free_volume for volspec in $(read_volume_setup "/.profile" "skip_all_free_volume");do resize_prefix='' volume_name=$(get_volume_name "${volspec}") resize_mode=$(get_volume_size_mode "${volspec}") volume_size=$(get_volume_size "${volspec}") info "Resizing volume ${volume_name}..." if [ ! "${resize_mode}" = "size" ];then resize_prefix=+ fi if lvextend -L "${resize_prefix}${volume_size}M" \ "/dev/${kiwi_lvmgroup}/${volume_name}" then resize_filesystem "/dev/${kiwi_lvmgroup}/${volume_name}" else warn "Warning: requested size cannot be reached !" fi done all_free_volume=$(get_all_free_volume) if [ -n "${all_free_volume}" ];then if lvextend -l +100%FREE "/dev/${kiwi_lvmgroup}/${all_free_volume}";then resize_filesystem "/dev/${kiwi_lvmgroup}/${all_free_volume}" fi fi } function read_volume_setup { # """ # read the volume setup from the profile file and return # a list with the following values: # # volume_name,resize_mode,requested_size,mount_point ... # """ local profile=$1 local skip_all_free_volume=$2 local volume local name local mode local size local mpoint local result local volspec result=$( while read -r volspec;do if ! [[ "${volspec}" =~ "kiwi_Volume_" ]];then continue fi volume=$(echo "${volspec}" | cut -f2 -d= | tr -d \' | tr -d \") size=$(echo "${volume}" | cut -f2 -d\| | cut -f2 -d:) if [ "${size}" = "all" ] && [ -n "${skip_all_free_volume}" ];then continue fi mode=$(echo "${volume}" | cut -f2 -d\| | cut -f1 -d:) name=$(echo "${volume}" | cut -f1 -d\|) mpoint=$(echo "${volume}" | cut -f3 -d\|) if [ -z "${mpoint}" ];then mpoint=noop fi echo "${name},${mode},${size},${mpoint}" done < "${profile}" ) echo "${result}" } function read_volume_setup_all_free { # """ # read the volume setup from the profile file and # lookup the volume that should take the rest space # available in the volume group. # # return a list with the following values: # # volume_name,mount_point # # If no @root volume is configured in the kiwi XML # description the default LVRoot volume will be used # to take the rest space. # """ local profile=$1 local size local volume local name local mpoint while read -r volspec;do if ! [[ "${volspec}" =~ "kiwi_Volume_" ]];then continue fi volume=$(echo "${volspec}" | cut -f2 -d= | tr -d \' | tr -d \") size=$(echo "${volume}" | cut -f2 -d\| | cut -f2 -d:) name=$(echo "${volume}" | cut -f1 -d\|) if [ "${size}" = "all" ];then mpoint=$(echo "${volume}" | cut -f3 -d\|) echo "${name},${mpoint}" return fi done < "${profile}" } function get_all_free_volume { read_volume_setup_all_free "/.profile" | cut -f1 -d, } function get_volume_name { echo "$1" | cut -f1 -d, } function get_volume_mount_point { echo "$1" | cut -f4 -d, } function get_volume_size_mode { echo "$1" | cut -f2 -d, } function get_volume_size { echo "$1" | cut -f3 -d, } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7391617 kiwi-11.1.8/dracut/modules.d/59kiwi-lib/kiwi-mdraid-lib.sh0000644000000000000000000000205215273675667020064 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh type set_root_map >/dev/null 2>&1 || . /lib/kiwi-lib.sh type wait_for_storage_device >/dev/null 2>&1 || . /lib/kiwi-partitions-lib.sh # The functions are called with the md raid device kiwi # created at build time, see lookup_raid_device_from_root() function mdraid_system { local raid_device=$1 if [ -n "${raid_device}" ];then return 0 fi return 1 } function deactivate_mdraid { local raid_device=$1 mdadm --stop "${raid_device}" } function activate_mdraid { local raid_device=$1 mdadm --assemble --scan "${raid_device}" wait_for_storage_device "${raid_device}" set_root_map "${raid_device}" } function update_devicesize_mdraid { local raid_device=$1 mdadm --assemble --scan "${raid_device}" --update=devicesize wait_for_storage_device "${raid_device}" deactivate_mdraid "${raid_device}" } function resize_mdraid { local raid_device=$1 set_device_lock "${raid_device}" \ mdadm --grow --size=max "${raid_device}" } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7391617 kiwi-11.1.8/dracut/modules.d/59kiwi-lib/kiwi-net-lib.sh0000644000000000000000000000464715273675667017426 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh # URI pattern Based on https://tools.ietf.org/html/rfc3986#appendix-B # with additional sub-expressions to split authority into # userinfo, host and port readonly URI_REGEX='^(([^:/?#]+):)?(//((([^:/?#]+)@)?([^:/?#]+)(:([0-9]+))?))?(/([^?#]*))(\?([^#]*))?(#(.*))?' function fetch_file { local source_url=$1 local source_uncompressed_bytes=$2 local fetch_info=/tmp/fetch.info local fetch local curl_options local dolly_options curl_options=$(getarg rd.kiwi.install.pxe.curl_options=) dolly_options=$(getarg rd.kiwi.install.pxe.dolly_options=) if [ -n "${curl_options}" ]; then curl_options=$(str_replace "${curl_options}" "," " ") fetch="curl ${curl_options} -f ${source_url}" else fetch="curl -f ${source_url}" fi if [ -n "${dolly_options}" ]; then dolly_options=$(str_replace "${dolly_options}" "," " ") fetch="dolly ${dolly_options} -f ${source_url}" fi if _is_dolly "${source_url}";then fetch="dolly" fi if _is_xz_compressed "${source_url}";then fetch="${fetch} | xz -d" fi if [ -z "${source_uncompressed_bytes}" ];then eval "${fetch}" 2>${fetch_info} else eval "${fetch}" 2>${fetch_info} |\ pv --size "${source_uncompressed_bytes}" --stop-at-size -n fi return "${PIPESTATUS[0]}" } function uri_scheme { [[ "$*" =~ ${URI_REGEX} ]] && echo "${BASH_REMATCH[2]}" } function uri_authority { [[ "$*" =~ ${URI_REGEX} ]] && echo "${BASH_REMATCH[4]}" } function uri_user { [[ "$*" =~ ${URI_REGEX} ]] && echo "${BASH_REMATCH[6]}" } function uri_host { [[ "$*" =~ ${URI_REGEX} ]] && echo "${BASH_REMATCH[7]}" } function uri_port { [[ "$*" =~ ${URI_REGEX} ]] && echo "${BASH_REMATCH[9]}" } function uri_path { [[ "$*" =~ ${URI_REGEX} ]] && echo "${BASH_REMATCH[10]}" } function uri_relative_path { [[ "$*" =~ ${URI_REGEX} ]] && echo "${BASH_REMATCH[11]}" } function uri_query { [[ "$*" =~ ${URI_REGEX} ]] && echo "${BASH_REMATCH[13]}" } function uri_fragment { [[ "$*" =~ ${URI_REGEX} ]] && echo "${BASH_REMATCH[15]}" } #====================================== # Methods considered private #-------------------------------------- function _is_xz_compressed { local source_url=$1 [[ ${source_url} =~ .xz$ ]] } function _is_dolly { local source_url=$1 [[ ${source_url} =~ ^dolly ]] } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7391617 kiwi-11.1.8/dracut/modules.d/59kiwi-lib/kiwi-partitions-lib.sh0000644000000000000000000004514615273675667021033 0ustar00#!/bin/bash type getarg >/dev/null 2>&1 || . /lib/dracut-lib.sh type udev_pending >/dev/null 2>&1 || . /lib/kiwi-lib.sh #====================================== # Library Methods #-------------------------------------- function create_partitions { local disk_device=$1 local partition_setup=$2 local pt_table_type pt_table_type=$(get_partition_table_type "${disk_device}") case ${pt_table_type} in "dos") create_msdos_partitions "${disk_device}" "${partition_setup}" ;; "gpt") create_gpt_partitions "${disk_device}" "${partition_setup}" ;; "dasd") create_dasd_partitions "${disk_device}" "${partition_setup}" ;; esac # notify the kernel about partition table changes if [ "${pt_table_type}" = "dasd" ];then # partx doesn't work for DASD disk, so on s390 partprobe is used partprobe "${disk_device}" else set_device_lock "${disk_device}" \ partx -u "${disk_device}" fi # the changes cause udev to remove and recreate links in /dev, # wait until that has settled udev_pending } function create_msdos_partitions { # """ # create partitions using sfdisk (msdos table) # """ local disk_device=$1 local partition_setup=$2 local partid local part_size_end local cmd_list local start_sector_from local cmd # put partition setup in a command list(cmd_list) for cmd in ${partition_setup};do # default values in sfdisk are used if - is provided cmd=$(echo "${cmd}" | tr . -) cmd_list[$index]=${cmd} index=$((index + 1)) done # operate on index based cmd_list index=0 for cmd in ${cmd_list[*]};do case ${cmd} in "d") # delete a partition... partid=${cmd_list[$index + 1]} start_sector_from[$partid]=$( _get_msdos_partition_start_sector "${disk_device}" "${partid}" ) set_device_lock "${disk_device}" \ sfdisk --force --delete "${disk_device}" "${partid}" ;; "n") # create a partition... partid=${cmd_list[$index + 2]} part_size_end=${cmd_list[$index + 4]} echo "${start_sector_from[$partid]},${part_size_end}" > /tmp/sfdisk.in set_device_lock "${disk_device}" \ sfdisk --force -N "${partid}" "${disk_device}" < /tmp/sfdisk.in ;; "t") # change a partition type... part_type=${cmd_list[$index + 2]} partid=${cmd_list[$index + 1]} set_device_lock "${disk_device}" \ sfdisk --force --change-id "${disk_device}" "${partid}" "${part_type}" ;; esac index=$((index + 1)) done } function create_gpt_partitions { # """ # create partitions using sgdisk (gpt table) # """ local disk_device=$1 local partition_setup=$2 local partid local part_name local part_size_start local part_size_end local cmd_list local cmd # put partition setup in a command list(cmd_list) for cmd in ${partition_setup};do # default values in sgdisk are used if 0 is provided cmd=$(echo "${cmd}" | tr . 0) cmd_list[$index]=${cmd} index=$((index + 1)) done # operate on index based cmd_list index=0 for cmd in ${cmd_list[*]};do case ${cmd} in "d") # delete a partition... partid=${cmd_list[$index + 1]} set_device_lock "${disk_device}" \ sgdisk --delete "${partid}" "${disk_device}" ;; "n") # create a partition... part_name=$(echo "${cmd_list[$index + 1]}" | tr : .) partid=${cmd_list[$index + 2]} part_size_start=${cmd_list[$index + 3]} part_size_end=${cmd_list[$index + 4]} set_device_lock "${disk_device}" \ sgdisk --new "${partid}:${part_size_start}:${part_size_end}" "${disk_device}" set_device_lock "${disk_device}" \ sgdisk --change-name "${partid}:${part_name}" "${disk_device}" ;; "t") # change a partition type... part_type=${cmd_list[$index + 2]} partid=${cmd_list[$index + 1]} set_device_lock "${disk_device}" \ sgdisk --typecode "${partid}:$(_to_guid "${part_type}")" "${disk_device}" ;; esac index=$((index + 1)) done } function create_dasd_partitions { # """ # create partitions using fdasd (s390) # """ local disk_device=$1 local partition_setup=$2 local partition_setup_file=/run/fdasd.cmds local ignore_cmd=0 local ignore_cmd_once=0 local cmd # We resize first partition to enfore rewrite of the current # partition table updated to the actual disk geometry. This is # to circumvent the fdasd limitation of not being capable to # expand the partition table up to the disk size bsc#1209247 parted --script --machine "${disk_device}" resizepart 1 # Trigger recreation of the VTOC to work around # https://github.com/ibm-s390-linux/s390-tools/issues/166 echo "u" >> ${partition_setup_file} echo "y" >> ${partition_setup_file} for cmd in ${partition_setup};do if [ "${ignore_cmd}" = 1 ] && echo "${cmd}" | grep -qE '[dntwq]';then ignore_cmd=0 elif [ "${ignore_cmd}" = 1 ];then continue fi if [ "${ignore_cmd_once}" = "1" ];then ignore_cmd_once=0 continue fi if [ "${cmd}" = "a" ];then ignore_cmd=1 continue fi if [[ "${cmd}" =~ ^p: ]];then ignore_cmd_once=1 continue fi if [ "${cmd}" = "83" ] || [ "${cmd}" = "8e" ];then cmd=1 fi if [ "${cmd}" = "82" ];then cmd=2 fi if [ "${cmd}" = "." ];then echo >> ${partition_setup_file} continue fi echo "$cmd" >> ${partition_setup_file} done echo "w" >> ${partition_setup_file} echo "q" >> ${partition_setup_file} set_device_lock "${disk_device}" \ fdasd "${disk_device}" < ${partition_setup_file} 1>&2 } function get_partition_node_name { # """ # Get unix node of the partition with the given number. # Partition numbers can have gaps, the number is therefore # not the position of the partition in the table but read # from the partition, see get_partition_number() # """ local disk=$1 local partid=$2 local name local kname local type udev_pending while read -r name kname type;do if [[ "${type}" =~ ^(part|md)$ ]] && \ [ "$(get_partition_number "${kname}")" = "${partid}" ] then echo "${name}" return 0 fi done < <(lsblk -p -l -n -o NAME,KNAME,TYPE "${disk}") return 1 } function get_partition_number { # """ # Get the number of the given partition, by its kernel # device name. The kernel provides the number for its # partitions in sysfs. A device mapper partition, e.g of a # multipath map, has the number in its device mapper uuid, # which is of the form part- # """ local kname local sysfs_device local partition_number local dm_uuid kname=$(basename "$1") sysfs_device=/sys/class/block/${kname} if [ -e "${sysfs_device}/partition" ];then read -r partition_number < "${sysfs_device}/partition" echo "${partition_number}" elif [ -e "${sysfs_device}/dm/uuid" ];then read -r dm_uuid < "${sysfs_device}/dm/uuid" if [[ "${dm_uuid}" =~ ^part([0-9]+)- ]];then echo "${BASH_REMATCH[1]}" fi fi } function get_partition_name { local disk=$1 local part_id=$2 local part_name local table_type table_type=$(get_partition_table_type "${disk}") if [ "${table_type}" = "gpt" ];then part_name=$(sfdisk --part-label "${disk}" "${part_id}") else part_name=p:unsupported fi echo "${part_name}" } function get_last_partition_device { # """ # Get unix node of last partition in table # """ local disk=$1 lsblk -p -n -r -o NAME,TYPE "${disk}" |\ grep -E "part|md$" | tail -n 1 | cut -f1 -d ' ' } function get_last_partition_id { # """ # Get number of the last partition from the current table. # Partition numbers can have gaps, e.g for custom partitions # with a given number, thus the highest number is read from # the table. If partx cannot read the table, e.g dasd on s390, # the partitions are counted instead # """ local disk=$1 local index=0 local partition_id for partition_id in $(partx -g -o NR "${disk}" 2>/dev/null);do if [ "${partition_id}" -gt "${index}" ];then index=${partition_id} fi done if [ "${index}" -gt 0 ];then echo "${index}" return fi lsblk -p -l -o NAME,TYPE "${disk}" | grep -cE "part|md$" } function wait_for_storage_device { # """ # function to check access on a storage device which could be # a whole disk or a partition. The function will wait until # the size of the storage device could be obtained and is # greater than zero or the timeout is reached. Default timeout # is set to 60 seconds, however it can be set to different # value by setting the DEVICE_TIMEOUT variable on the kernel # command line. # """ declare DEVICE_TIMEOUT=${DEVICE_TIMEOUT} local device=$1 local check=0 local limit=30 local storage_size=0 if [[ "${DEVICE_TIMEOUT}" =~ ^[0-9]+$ ]]; then limit=$(((DEVICE_TIMEOUT + 1)/ 2)) fi udev_pending while true;do storage_size=$(get_block_device_kbsize "${device}") if [ "${storage_size}" -gt 0 ]; then sleep 1; return 0 fi if [ "${check}" -eq "${limit}" ]; then die "Storage device ${device} did not appear" fi info "Waiting for storage device ${device} to settle..." check=$((check + 1)) sleep 2 done } function get_block_device_kbsize { local device=$1 if [ ! -e "${device}" ];then echo 0; return 1 fi echo $(($(blockdev --getsize64 "${device}") / 1024)) } function get_free_disk_bytes { local disk=$1 local pt_table_type local disk_bytes local max_dos_disk pt_table_type=$(get_partition_table_type "${disk}") disk_bytes=$(blockdev --getsize64 "${disk}") # max msdos table geometry is at 2TB - 512 max_dos_disk=$((4294967295 * 512)) if \ [ "${pt_table_type}" = "dos" ] && \ [ "${disk_bytes}" -gt "${max_dos_disk}" ] then warn "msdos table allows a max disk size of 2TB" warn "disk expansion will be truncated to 2TB" disk_bytes=${max_dos_disk} fi local rest_bytes rest_bytes=${disk_bytes} local part_bytes=0 local part_count=0 local part_uuids udev_pending for part in $( lsblk -p -l -o NAME,TYPE "${disk}" | grep -E "part|md$" | cut -f1 -d ' ' );do current_part_uuid=$(get_partition_uuid "${part}") for part_uuid in ${part_uuids[*]};do if [ "${current_part_uuid}" = "${part_uuid}" ];then # this partition uuid was already handled. The device # node is pointing to the same physical device and # should only be taken into account once unset part break fi done if [ -n "${part}" ]; then part_bytes=$((part_bytes + $(blockdev --getsize64 "${part}"))) part_uuids[${part_count}]=${current_part_uuid} part_count=$((part_count + 1)) fi done rest_bytes=$((rest_bytes - part_bytes)) echo ${rest_bytes} } function get_partition_table_type { local disk_device="$1" local table_type # blkid doesn't work for dasd partitions, so on s390 fdasd is used # checking if it can read the partition table of the device and if it # can set dasd as table_type. In any other case use blkid # to detect the partition type (bsc#1209247) if [[ "$(uname -m)" =~ s390 ]] && fdasd -p "${disk_device}" &>/dev/null;then table_type="dasd" echo "${table_type}" else blkid -s PTTYPE -o value "$disk_device" fi } function get_partition_uuid { blkid -s PARTUUID -o value "$1" } function relocate_gpt_at_end_of_disk { if ! sfdisk --relocate gpt-bak-std "$1";then die "Failed to write backup GPT at end of disk" fi } function disk_has_unallocated_space { local disk_device=$1 local free_mbytes local pt_table_type local flag="GPT PMBR size mismatch" pt_table_type=$(get_partition_table_type "${disk_device}") if [ "${pt_table_type}" = "gpt" ];then # GPT disks store a backup table at the end of the disk # if the disk geometry changes the backup table is no # longer at the end and this condition can be easily # checked and used to detect that there is space # unallocated due to a geometry change of the underlying # block device layer if sfdisk --list-free "${disk_device}" 2>&1 | grep -q "${flag}"; then return fi fi # lookup if there is free space on disk compared to # the current geometry values in the partition table free_mbytes=$( sfdisk --list-free "${disk_device}" |\ grep -i Unpartitioned | cut -f2 -d, | grep -o -E '[0-9]+' ) if [ "${free_mbytes}" != "0" ];then true else false fi } function activate_boot_partition { local disk_device=$1 local boot_partition_id=$2 local pt_table_type pt_table_type=$(get_partition_table_type "${disk_device}") if [[ "$(uname -m)" =~ i.86|x86_64 ]];then if [ "${pt_table_type}" = "dos" ];then set_device_lock "${disk_device}" \ sfdisk --activate "${disk_device}" "${boot_partition_id}" fi fi } function create_hybrid_gpt { local disk_device=$1 local partition_count udev_pending partition_count=$(lsblk -r -o NAME,TYPE "${disk_device}" | grep -c part) if [ "${partition_count}" -gt 3 ]; then # The max number of partitions to embed is 3 # see man sgdisk for details partition_count=3 fi if ! set_device_lock "${disk_device}" \ sgdisk -h "$(seq -s : 1 "${partition_count}")" "${disk_device}" then die "Failed to create hybrid GPT/MBR !" fi } function get_active_partition_id { # """ # Get number of the partition with the bootable flag # set in an msdos table. Nothing is provided if there is # no such partition or no msdos table. sfdisk names the # partitions it lists by the disk and the partition number # """ local disk_device=$1 local partition_device if [ "$(get_partition_table_type "${disk_device}")" = "dos" ];then partition_device=$( sfdisk --activate "${disk_device}" 2>/dev/null | head -n 1 ) if [[ "${partition_device}" =~ ([0-9]+)$ ]];then echo "${BASH_REMATCH[1]}" fi fi } function finalize_partition_table { # """ # finalize partition table with flags which # could have got lost during repartition. The # given boot partition is the one which was active # prior repartition, see get_active_partition_id() # """ declare kiwi_gpt_hybrid_mbr=${kiwi_gpt_hybrid_mbr} local disk_device=$1 local boot_partition_id=$2 if [ -n "${boot_partition_id}" ];then activate_boot_partition "${disk_device}" "${boot_partition_id}" fi if [ "${kiwi_gpt_hybrid_mbr}" = "true" ];then create_hybrid_gpt "${disk_device}" fi } function resize_wanted { # """ # check if oem-resize-once was requested in the image # description. If not we always try to repart/resize # the image according to the configured constraints. # # If oem-resize-once is set to true we check if the # system has been already resized compared to the # original image PARTUUID and repart/resize the system # only if the PARTUUID is still the original value. # After resize a new PARTUUID will be written by the # partitioner and that will result in the repart/resize # operation to happen only once in the livetime of # the image # # If the resize is wanted the method also checks for # a real change in geometry on the block device layer # and returns accordingly. Please note geometry change # can currently only be detected on GPT disks. In any # other case it is assumed the geometry has changed # such that a resize can at least be tried # """ declare kiwi_oemresizeonce=${kiwi_oemresizeonce} declare kiwi_rootpartuuid=${kiwi_rootpartuuid} local current_rootpart_uuid local root_device=$1 local disk_device=$2 kiwi_oemresizeonce=$(bool "${kiwi_oemresizeonce}") if getargbool 0 rd.kiwi.oem.force_resize; then info "System resize forced via rd.kiwi.oem.force_resize" info "Activating resize operation" return 0 fi if [ "${kiwi_oemresizeonce}" = "true" ];then current_rootpart_uuid=$(get_partition_uuid "${root_device}") if [ "${current_rootpart_uuid}" == "${kiwi_rootpartuuid}" ];then info "System was not yet resized" else info "System was already resized and oem-resize-once is requested" info "Skipping resize operation" return 1 fi else info "System resize is active on every reboot" fi if disk_has_unallocated_space "${disk_device}";then info "Activating resize operation" return 0 else info "Disk geometry did not change" info "Skipping resize operation" return 1 fi } #====================================== # Methods considered private #-------------------------------------- function _get_msdos_partition_start_sector { # """ # read start sector from given partition # """ local disk_device=$1 local partid=$2 sfdisk --dump "${disk_device}" |\ grep "${partid} :" | cut -f1 -d, | cut -f2 -d= | tr -d " " } function _to_guid { # """ # convert two digit partition id to guid id # """ local partid=$1 if [ "${partid}" = "83" ];then # Linux filesystem echo 8300 elif [ "${partid}" = "8e" ];then # Linux LVM echo 8e00 elif [ "${partid}" = "fd" ];then # Linux RAID echo fd00 elif [ "${partid}" = "82" ];then # Linux swap echo 8200 else # Assume Linux filesystem echo 8300 fi } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7391617 kiwi-11.1.8/dracut/modules.d/59kiwi-lib/module-setup.sh0000755000000000000000000000256415273675667017555 0ustar00#!/bin/bash # called by dracut check() { return 255 } # called by dracut depends() { echo udev-rules crypt bash return 0 } # called by dracut install() { declare moddir=${moddir} inst_multiple \ blkid blockdev dd mkdir rmdir env \ grep cut tail head tr bc true false mountpoint \ basename sfdisk sgdisk mkswap readlink lsblk \ btrfs xfs_growfs resize2fs \ e2fsck btrfsck xfs_repair \ vgs vgchange lvextend lvcreate lvresize pvresize \ mdadm cryptsetup dialog \ pv curl xz sha256sum sha512sum sed \ dmsetup touch chmod flock partx inst_multiple -o dolly if [[ "$(uname -m)" =~ s390 ]];then inst_multiple fdasd parted partprobe fi inst_simple \ "${moddir}/kiwi-lib.sh" "/lib/kiwi-lib.sh" inst_simple \ "${moddir}/kiwi-partitions-lib.sh" "/lib/kiwi-partitions-lib.sh" inst_simple \ "${moddir}/kiwi-filesystem-lib.sh" "/lib/kiwi-filesystem-lib.sh" inst_simple \ "${moddir}/kiwi-dialog-lib.sh" "/lib/kiwi-dialog-lib.sh" inst_simple \ "${moddir}/kiwi-mdraid-lib.sh" "/lib/kiwi-mdraid-lib.sh" inst_simple \ "${moddir}/kiwi-lvm-lib.sh" "/lib/kiwi-lvm-lib.sh" inst_simple \ "${moddir}/kiwi-luks-lib.sh" "/lib/kiwi-luks-lib.sh" inst_simple \ "${moddir}/kiwi-net-lib.sh" "/lib/kiwi-net-lib.sh" } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7391617 kiwi-11.1.8/helper/build_status.sh0000755000000000000000000000525715273675667014054 0ustar00#!/bin/bash pushd /run for project in \ Virtualization:Appliances:SelfContained:fedora \ Virtualization:Appliances:SelfContained:tumbleweed \ Virtualization:Appliances:SelfContained:leap \ Virtualization:Appliances:SelfContained:ubuntu \ Virtualization:Appliances:SelfContained:universal \ Virtualization:Appliances:SelfContained:staging \ Virtualization:Appliances:Images:Testing_x86:tumbleweed \ Virtualization:Appliances:Images:Testing_x86:rawhide \ Virtualization:Appliances:Images:Testing_ppc:rawhide \ Virtualization:Appliances:Images:Testing_x86:leap \ Virtualization:Appliances:Images:Testing_x86:slfo \ Virtualization:Appliances:Images:Testing_x86:centos \ Virtualization:Appliances:Images:Testing_x86:fedora \ Virtualization:Appliances:Images:Testing_x86:ubuntu \ Virtualization:Appliances:Images:Testing_arm:ubuntu \ Virtualization:Appliances:Images:Testing_x86:debian \ Virtualization:Appliances:Images:Testing_s390:tumbleweed \ Virtualization:Appliances:Images:Testing_s390:rawhide \ Virtualization:Appliances:Images:Testing_s390:leap \ Virtualization:Appliances:Images:Testing_arm:tumbleweed \ Virtualization:Appliances:Images:Testing_arm:fedora \ Virtualization:Appliances:Images:Testing_ppc:tumbleweed \ Virtualization:Appliances:Images:Testing_x86:archlinux do echo "${project}" if [ ! "$1" = "refresh" ];then while read -r line;do echo -e "$(echo "${line}" |\ sed -e s@F\ @'\\033[31mF \\e[0m'@g |\ sed -e s@U\ @'\\033[33mU \\e[0m'@g |\ sed -e s@D\ @'\\033[36mD\\e[0m'@g |\ sed -e s@\\.@'\\033[32m.\\e[0m'@g |\ sed -e 's@^x\sF@x \\033[31mF\\e[0m'@ |\ sed -e 's@^x\sU@x \\033[33mU\\e[0m'@ |\ sed -e 's@^x\sD@x \\033[36mD\\e[0m'@ |\ sed -e 's@^x\s\.@x \\033[32m.\\e[0m'@)" done < <(osc -A https://api.opensuse.org \ results -V "${project}" | sed -e 's@^\(\s\{1,\}\)@D\1@g' |\ grep -B100 Legend | grep -v Legend ) else for package in $(osc -A https://api.opensuse.org list "${project}");do if [[ "${package}" =~ ^test- ]];then echo -n "[refresh requested for ${package}: ]" osc -A https://api.opensuse.org \ service remoterun "${project}" "${package}" fi done echo fi done if [ ! "$1" = "refresh" ];then cat << EOF Legend: . succeeded D Disabled U unresolvable F failed B broken b blocked % building f finished s scheduled L locked x excluded d dispatching S signing ? buildstatus not available EOF fi popd ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7395945 kiwi-11.1.8/helper/rebuild_changelog_reference.sh0000755000000000000000000000024015273675667017010 0ustar00#!/bin/bash git log --no-merges --format=fuller > package/python-kiwi.changes git commit -S -m 'Update changelog reference' \ package/python-kiwi.changes ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7395945 kiwi-11.1.8/helper/update_changelog.py0000755000000000000000000001366415273675667014662 0ustar00#!/usr/bin/env python3 import typer import os import glob import subprocess import sys from dateutil import parser from dateutil import tz from typing import ( Annotated, Optional ) from pathlib import Path def main( since: Annotated[ Optional[Path], typer.Option( help='changes since the latest entry in the reference file' ) ] = None, file: Annotated[ Optional[Path], typer.Option( help='changes from the given file' ) ] = None, utc: Annotated[ Optional[bool], typer.Option( '--utc', help='print date/time in UTC' ) ] = False, fix: Annotated[ Optional[bool], typer.Option( '--fix', help='lookup .fix files and apply them' ) ] = False ): if not since and not file: print('Either --since or --file must be specified') sys.exit(1) if since and file: print('Only one of --since or --file must be specified') sys.exit(1) # Commandline arguments arguments = { '--since': since, '--file': file, '--utc': utc, '--fix': fix } # Latest date of the given reference file date_reference = None # List of skipped commits older than date_reference skip_list = [] # hash of git history log entries log_data = {} # raw list of log lines from git history or reference file log_lines = [] # Author and Date log_author = None log_date = None # changelog header line log_start = '-' * 67 + os.linesep # date format for rpm changelog date_format = '%a %b %d %T %Z %Y' # commit message commit_message = [] # Open reference log file reference_file = arguments['--since'] or arguments['--file'] # Custom fix files fix_dict = {} if arguments['--fix']: for fix in glob.iglob(f'{os.path.dirname(reference_file)}/*.fix'): sys.stderr.write(f'Reading fix: {fix}{os.linesep}') with open(fix, 'r') as fixlog: commit = fixlog.readline() fix_dict[commit] = fixlog.read() if arguments['--since']: # Read latest date from reference file with open(reference_file, 'r') as gitlog: # read commit and author gitlog.readline() gitlog.readline() # read date latest_date = gitlog.readline().replace('AuthorDate:', '').strip() date_reference = parser.parse(latest_date) # Read git history since latest entry from reference file process = subprocess.Popen( [ 'git', 'log', '--no-merges', '--format=fuller', '--since="{0}"'.format(latest_date) ], stdout=subprocess.PIPE ) from_git_log = True for line in iter(process.stdout.readline, b''): if line.startswith(b'commit'): commit = line.decode() if from_git_log and fix_dict.get(commit): sys.stderr.write(f' Apply fix for: {commit}') from_git_log = False log_lines.append(line) for fix_line in fix_dict.get(commit).split(os.linesep): log_lines.append(fix_line.encode()) elif not from_git_log: from_git_log = True if from_git_log: log_lines.append(line) else: with open(reference_file, 'rb') as gitlog: log_lines = gitlog.readlines() # Iterate over log data and convert to changelog format for line_data in log_lines: line = line_data.decode(encoding='utf-8') if line.startswith('commit'): if commit_message: commit_message.pop(0) message_header = commit_message.pop(0).lstrip() message_body = [] for line in commit_message: message_line = line.lstrip() if not message_line: message_body.append(os.linesep) else: message_body.append( ' {0}{1}'.format(message_line, os.linesep) ) log_data[log_date] = ''.join( [ log_start, '{0} - {1}{2}{2}'.format( log_date.astimezone( tz.UTC if arguments['--utc'] else tz.tzlocal() ).strftime(date_format), log_author, os.linesep ), '- {0}{1}'.format( message_header, os.linesep ) ] + message_body ) commit_message = [] elif line.startswith('Author:'): log_author = line.replace('Author:', '').strip() elif line.startswith('AuthorDate:'): log_date = parser.parse(line.replace('AuthorDate:', '').strip()) elif line.startswith('Commit:'): pass elif line.startswith('CommitDate:'): pass else: commit_message.append(line.strip()) # print in changelog format on stdout for author_date in reversed(sorted(log_data.keys())): if date_reference: if date_reference < author_date: sys.stdout.write(log_data[author_date]) else: skip_list.append(author_date) else: sys.stdout.write(log_data[author_date]) # print inconsistencies if any on stderr if skip_list: sys.stderr.write( 'Reference Date: {0}{1}'.format(date_reference, os.linesep) ) for date in skip_list: sys.stderr.write( ' + Skipped: {0}: past reference{1}'.format( date, os.linesep ) ) if __name__ == "__main__": typer.run(main) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7395945 kiwi-11.1.8/helper/update_obs_services.sh0000755000000000000000000000122215273675667015366 0ustar00#!/bin/bash set -euo pipefail api_target="https://api.opensuse.org/trigger/runservice" api_token=$1 while read -r build_test; do build_test_path=$(dirname "${build_test}") dist=$(echo "${build_test_path}" | cut -f 3 -d/) arch=$(echo "${build_test_path}" | cut -f 2 -d/) project="Virtualization:Appliances:Images:Testing_${arch}:${dist}" package=$(basename "${build_test_path}") curl_target="${api_target}?project=${project}&package=${package}" echo "Updating Test: ${package} for: ${project}" curl -H "Authorization: Token ${api_token}" \ -X POST "${curl_target}" done < <(find build-tests -name "appliance.kiwi") ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7395945 kiwi-11.1.8/helper/xsl_to_v74/convert14to20.xsl0000644000000000000000000000635015273675667016100 0ustar00 Changed attribute schemeversion from 1.4 to 2.0. Copy all attributes, when contents is NOT 'split'. If contents contains 'split' and attribute filesystem contains a comma, then split this attribute and create two new attributes fsreadwrite and fsreadonly. Change attribute value boot to bootstrap. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert20to24.xsl0000644000000000000000000000536415273675667016105 0ustar00 Changed attribute schemeversion from 2.0 to 2.4. Remove attributes memory,disk,HWversion,guestOS_32Bit and guestOS_64Bit from the 2.0 packages type [vmware|xen] version. This information needs to be provided by an additional vmwareconfig or xenconfig element NOTE: You need to setup a vmwareconfig and/or xenconfig section in order to setup an appropriate guest configuration. For details see the 'KIWI image description' chapter of the kiwi cookbook ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert24to35.xsl0000644000000000000000000000354015273675667016105 0ustar00 Changed attribute schemeversion to schemaversion from 2.4 to 3.5. Remove compressed element as it was moved into the type ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert35to37.xsl0000644000000000000000000000711715273675667016115 0ustar00 ]> Changed attribute schemaversion to schemaversion from 3.5 to 3.7. Change possible mixed cases into lowercase and normalize any whitespaces false true true false Wrong value! ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert37to38.xsl0000644000000000000000000000355215273675667016117 0ustar00 Changed attribute schemaversion to schemaversion from 3.7 to 3.8. Change attribute value deploy to pxedeploy. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert38to39.xsl0000644000000000000000000001143315273675667016116 0ustar00 Changed attribute schemaversion to schemaversion from 3.8 to 3.9. Create new oemconfig element to collect all oem-* elements in one place and remove them from the preferences element. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert39to41.xsl0000644000000000000000000002141215273675667016106 0ustar00 Changed attribute schemaversion to schemaversion from 3.9 to 4.1. Adding image attribute to type element and collecting the appropriate *config elements as children of the type element. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert41to42.xsl0000644000000000000000000001056515273675667016107 0ustar00 Changed attribute schemaversion to schemaversion from 4.1 to 4.2. Created new ec2config element to collect ec2* attributes. The ec2config element is a child of the type element. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert42to43.xsl0000644000000000000000000000625615273675667016113 0ustar00 Changed attribute schemaversion to schemaversion from 4.2 to 4.3. Moved the lvmgroup attribute from the type to the lvmvolumes element. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert43to44.xsl0000644000000000000000000000356515273675667016115 0ustar00 Changed attribute schemaversion to schemaversion from 4.3 to 4.4. Remove compressed element as it was moved into the type represented as attribute kernelcmdline ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert44to45.xsl0000644000000000000000000000354215273675667016112 0ustar00 Changed attribute schemaversion to schemaversion from 4.4 to 4.5. Remove patternPackageType attribute, it's no longer used ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert45to46.xsl0000644000000000000000000000363615273675667016120 0ustar00 Changed attribute schemaversion to schemaversion from 4.5 to 4.6. Change attribute value vmware to vmx. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert46to47.xsl0000644000000000000000000001033415273675667016113 0ustar00 Changed attribute schemaversion to schemaversion from 4.6 to 4.7. ide 0 true true ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert47to48.xsl0000644000000000000000000001153615273675667016122 0ustar00 ]> Changed attribute schemaversion to schemaversion from 4.7 to 4.8. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert48to49.xsl0000644000000000000000000000351115273675667016116 0ustar00 ]> Changed attribute schemaversion to schemaversion from 4.8 to 4.9. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert49to50.xsl0000644000000000000000000000711015273675667016106 0ustar00 Changed attribute schemaversion to schemaversion from 4.9 to 5.0. vmx xenk xen domU ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert50to51.xsl0000644000000000000000000000401015273675667016073 0ustar00 Changed attribute schemaversion to schemaversion from 5.0 to 5.1. Remove obsolete baseroot attribute from types Remove defaultbaseroot element from preferences ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert51to52.xsl0000644000000000000000000000354015273675667016104 0ustar00 Changed attribute schemaversion to schemaversion from 5.1 to 5.2. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert52to53.xsl0000644000000000000000000000371115273675667016106 0ustar00 Changed attribute schemaversion to schemaversion from 5.2 to 5.3. AP-Northeast AP-Southeast ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert53to54.xsl0000644000000000000000000000345315273675667016113 0ustar00 Changed attribute schemaversion to schemaversion from 5.3 to 5.4. Remove obsolete type attribute from drivers ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert54to55.xsl0000644000000000000000000000336415273675667016116 0ustar00 Changed attribute schemaversion to schemaversion from 5.4 to 5.5. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert55to56.xsl0000644000000000000000000000573415273675667016123 0ustar00 Changed attribute schemaversion to schemaversion from 5.5 to 5.6. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert56to57.xsl0000644000000000000000000000361415273675667016120 0ustar00 Changed attribute schemaversion to schemaversion from 5.6 to 5.7. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert57to58.xsl0000644000000000000000000000344515273675667016124 0ustar00 Changed attribute schemaversion to schemaversion from 5.7 to 5.8. Remove obsolete syncMBR attribute from type ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert58to59.xsl0000644000000000000000000000472215273675667016125 0ustar00 Changed attribute schemaversion to schemaversion from 5.8 to 5.9. rename controller="scsi" to controller="lsilogic" in vmdisk ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert59to60.xsl0000644000000000000000000000310515273675667016110 0ustar00 Changed attribute schemaversion to schemaversion from 5.9 to 6.0. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert60to61.xsl0000644000000000000000000000340715273675667016106 0ustar00 Changed attribute schemaversion to schemaversion from 6.0 to 6.1. Change section opensuseProduct to product ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert61to62.xsl0000644000000000000000000000371415273675667016111 0ustar00 Changed attribute schemaversion to schemaversion from 6.1 to 6.2. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert62to63.xsl0000644000000000000000000000406015273675667016106 0ustar00 Changed attribute schemaversion to schemaversion from 6.2 to 6.3. Remove obsolete fsreadonly, fsreadwrite and zfsoptions attributes from types Remove obsolete split section ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert63to64.xsl0000644000000000000000000000445315273675667016116 0ustar00 Changed attribute schemaversion to schemaversion from 6.3 to 6.4. Remove obsolete group and id attribute from users Move global group attribute as groups to user section(s) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert64to65.xsl0000644000000000000000000000411215273675667016110 0ustar00 Changed attribute schemaversion to schemaversion from 6.4 to 6.5. Move container attribute from type to containerconfig ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert65to66.xsl0000644000000000000000000000435515273675667016123 0ustar00 Changed attribute schemaversion to schemaversion from 6.5 to 6.6. Add xen_server attribute to type for dom0 configurations Delete domain attribute from machine sections ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert66to67.xsl0000644000000000000000000000772415273675667016130 0ustar00 Changed attribute schemaversion to schemaversion from 6.6 to 6.7. Delete checkprebuilt and fsnocheck attributes from type Delete status and prefer-license attributes from repository Delete replaces attribute from package Delete defaultprebuilt section Delete defaultdestination section Delete defaultroot section Delete partitioner section Delete rpm-force section ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert67to68.xsl0000644000000000000000000000326415273675667016125 0ustar00 Changed attribute schemaversion to schemaversion from 6.7 to 6.8. Delete hwclock section ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert68to69.xsl0000644000000000000000000000365015273675667016126 0ustar00 Changed attribute schemaversion to schemaversion from 6.8 to 6.9. Delete hybrid attribute from type ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert69to70.xsl0000644000000000000000000000310115273675667016106 0ustar00 Changed attribute schemaversion to schemaversion from 6.9 to 7.0. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert70to71.xsl0000644000000000000000000000402215273675667016102 0ustar00 Changed attribute schemaversion to schemaversion from 7.0 to 7.1. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert71to72.xsl0000644000000000000000000000703715273675667016115 0ustar00 Changed attribute schemaversion to schemaversion from 7.1 to 7.2. Move bootloader, bootloader_console, boottimeout and zipl_targettype attributes from types into a new bootloader subsection ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert72to73.xsl0000644000000000000000000000367415273675667016122 0ustar00 Changed attribute schemaversion to schemaversion from 7.2 to 7.3. false ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/convert73to74.xsl0000644000000000000000000000372315273675667016117 0ustar00 Changed attribute schemaversion to schemaversion from 7.3 to 7.4. apt dnf ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/include.xsl0000644000000000000000000000223215273675667015164 0ustar00 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/pretty.xsl0000644000000000000000000000361415273675667015075 0ustar00 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/helper/xsl_to_v74/update.xsl0000644000000000000000000001627015273675667015032 0ustar00 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/kiwi/__init__.py0000644000000000000000000000077315273675667012606 0ustar00""" API Documentation """ import logging from kiwi.logger import Logger # Initialize custom logger class for kiwi logging.setLoggerClass(Logger) # Set the highest log level possible as the default log level # in the main Logger class. This is needed to allow any logfile # handler to log all messages by default and to allow custom log # levels per handler. Our own implementation in Logger::setLogLevel # will then set the log level on a handler basis logging.getLogger('kiwi').setLevel(logging.DEBUG) ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74099 kiwi-11.1.8/kiwi/api_helper.py0000644000000000000000000000506115273675667013152 0ustar00# Copyright (c) 2021 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import warnings from functools import wraps from typing import Any, Callable def obsolete(decommission_at: str, version: str) -> Callable: """ Decorator method to mark an API method as obsolete Methods marked with this decorator are still called. If the provided decommission date is reached it is allowed to decorate the obsoleted method as decommissioned. Example: .. code:: python @obsolete(decommission_at='2025-01-28', version='1.2.3') def method(): print('Method implementation...') :param str decommission_at: decommision date string. :param str version: the first version when this function was deprecated. :return: decorated function which is marked as deprecated """ def decorate_obsolete(func: Callable) -> Callable: @wraps(func) def wrapper(*args: Any, **kwargs: Any) -> Any: warnings.warn( f'Function {func.__name__!r} is marked obsolete ' f'since version {version!r} ' f'and will be decommissioned at: {decommission_at}' ) return func(*args, **kwargs) return wrapper return decorate_obsolete def decommissioned(func: Callable) -> Callable: """ Decorator method to mark an API method as decommissioned Methods marked with this decorator are no longer called and raises DeprecationWarning when used. The method implementation is allowed to be replaced by a simple pass statement to get rid of old code Example: .. code:: python @decommissioned def method(): pass """ @wraps(func) def wrapper(*args: Any, **kwargs: Any) -> None: raise DeprecationWarning( f'Function {func.__name__!r} has been decommissioned' ) return wrapper ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74099 kiwi-11.1.8/kiwi/app.py0000644000000000000000000000234515273675667011624 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # # project from .tasks.base import CliTask class App: """ **Implements creation of task instances** Each task class implements a process method which is called when constructing an instance of App """ def __init__(self) -> None: app = CliTask(should_perform_task_setup=False) action = app.cli.get_command() service = app.cli.get_servicename() task_class_name = service.title() + action.title() + 'Task' task_class = app.task.__dict__[task_class_name] task_class().process() ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74099 kiwi-11.1.8/kiwi/archive/__init__.py0000644000000000000000000000000015273675667014206 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7412367 kiwi-11.1.8/kiwi/archive/cpio.py0000644000000000000000000000474715273675667013427 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import List, Optional # project from kiwi.command import Command class ArchiveCpio: """ **Extraction/Creation of cpio archives** :param string filename: filename to use for archive extraction or creation """ def __init__(self, filename: str) -> None: self.filename = filename def create( self, source_dir: str, exclude: Optional[List[str]] = None ) -> None: """ Create cpio archive :param string source_dir: data source directory :param list exclude: list of excluded items """ find_excludes: List[str] = [] find_command = ['cd', source_dir, '&&', 'find', '.'] cpio_command = [ 'cpio', '--quiet', '-o', '-H', 'newc', '>', self.filename, ] if exclude: for path in exclude: if find_excludes: find_excludes.append('-or') find_excludes.append('-path') find_excludes.append('.' + path) find_excludes.append('-prune') find_excludes.append('-o') find_excludes.append('-print') find_command += find_excludes bash_command = find_command + ['|'] + cpio_command Command.run(['bash', '-c', ' '.join(bash_command)]) def extract(self, dest_dir: str) -> None: """ Extract cpio archive contents :param string dest_dir: target data directory """ bash_command = [ 'cd', dest_dir, '&&', 'cat', self.filename, '|', 'cpio', '-i', '--make-directories', ] Command.run(['bash', '-c', ' '.join(bash_command)]) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7412367 kiwi-11.1.8/kiwi/archive/tar.py0000644000000000000000000001466315273675667013261 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import List, Optional # project from kiwi.command import Command from kiwi.defaults import Defaults from kiwi.utils.command_capabilities import CommandCapabilities class ArchiveTar: """ **Extraction/Creation of tar archives** The tarfile python module is not used by that class, since it does not provide support for some relevant features in comparison to the GNU tar command (e.g. numeric-owner). Moreover tarfile lacks support for xz compression under Python v2.7. :param string filename: filename to use for archive extraction or creation :param bool create_from_file_list: use file list not entire directory to create the archive :param list file_list: list of files and directorie names to archive """ def __init__( self, filename: str, create_from_file_list: bool = True, file_list: Optional[List[str]] = None, ) -> None: self.filename = filename self.create_from_file_list = create_from_file_list self.file_list = file_list if CommandCapabilities.check_version('tar', (1, 27)): self.xattrs_options = ['--xattrs', '--xattrs-include=*'] else: self.xattrs_options = [] def create( self, source_dir: str, exclude: Optional[List[str]] = None, options: Optional[List[str]] = None, ) -> str: """ Create uncompressed tar archive :param string source_dir: data source directory :param list exclude: list of excluded items :param list options: custom creation options """ if not options: options = [] Command.run( ['tar', '-C', source_dir] + options + self.xattrs_options + ['-c', '-f', self.filename] + self._get_archive_items(source_dir, exclude) ) return self.filename def append_files( self, source_dir: str, files_to_append: List[str], options: Optional[List[str]] = None, ) -> str: """ Append files to an already existing uncompressed tar archive :param string source_dir: data source directory :param list files_to_append: list of items to append :param list options: custom options """ if not options: options = [] Command.run( ['tar', '-C', source_dir, '-r', '--file=' + self.filename] + options + self.xattrs_options + files_to_append ) return self.filename def create_xz_compressed( self, source_dir: str, exclude: Optional[List[str]] = None, options: Optional[List[str]] = None, xz_options: Optional[List[str]] = None, ) -> str: """ Create XZ compressed tar archive :param string source_dir: data source directory :param list exclude: list of excluded items :param list options: custom tar creation options :param list xz_options: custom xz compression options """ if not options: options = [] if not xz_options: xz_options = Defaults.get_xz_compression_options() bash_command = ( ['tar', '-C', source_dir] + options + self.xattrs_options + ['-c', '--to-stdout'] + self._get_archive_items(source_dir, exclude) + ['|', 'xz', '-f'] + xz_options + ['>', self.filename + '.xz'] ) Command.run(['bash', '-c', ' '.join(bash_command)]) return self.filename + '.xz' def create_gnu_gzip_compressed( self, source_dir: str, exclude: Optional[List[str]] = None ) -> str: """ Create gzip compressed tar archive :param string source_dir: data source directory :param list exclude: list of excluded items """ Command.run( [ 'tar', '-C', source_dir, '--format=gnu', '-cSz', '-f', self.filename + '.gz', ] + self._get_archive_items(source_dir, exclude) ) return self.filename + '.gz' def extract(self, dest_dir: str) -> None: """ Extract tar archive contents :param string dest_dir: target data directory """ Command.run(['tar', '-C', dest_dir, '-x', '-v', '-f', self.filename]) def _get_archive_items( self, source_dir: str, exclude_list: Optional[List[str]] ) -> List[str]: if self.create_from_file_list: return self._get_archive_content_list( source_dir, exclude_list, self.file_list ) else: return self._get_archive_exclude_list(exclude_list) + ['.'] def _get_archive_content_list( self, source_dir: str, exclude_list: Optional[List[str]] = None, file_list: Optional[List[str]] = None, ) -> List[str]: final_archive_contents = [] archive_contents = file_list if not archive_contents: archive_contents = sorted(os.listdir(source_dir)) for item in archive_contents: if not exclude_list: final_archive_contents.append(item) elif item not in exclude_list: final_archive_contents.append(item) return final_archive_contents def _get_archive_exclude_list( self, exclude_list: Optional[List[str]] ) -> List[str]: archive_items = [] for exclude in exclude_list or []: archive_items.append('--exclude') archive_items.append('./' + exclude) return archive_items ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7412367 kiwi-11.1.8/kiwi/boot/__init__.py0000644000000000000000000000000015273675667013530 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7413633 kiwi-11.1.8/kiwi/boot/image/__init__.py0000644000000000000000000000456215273675667014633 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # # project import importlib from typing import List, Optional from abc import ABCMeta, abstractmethod from kiwi.xml_state import XMLState from kiwi.boot.image.base import BootImageBase from kiwi.exceptions import KiwiBootImageSetupError class BootImage(metaclass=ABCMeta): """ **BootImge Factory** :param object xml_state: Instance of :class:`XMLState` :param string target_dir: target dir to store the initrd :param string root_dir: system image root directory :param list signing_keys: list of package signing keys """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( xml_state: XMLState, target_dir: str, root_dir: Optional[str] = None, signing_keys: Optional[List[str]] = None, ) -> BootImageBase: initrd_system = xml_state.get_initrd_system() name_map = { 'kiwi': {'builtin_kiwi': 'BootImageKiwi'}, 'dracut': {'dracut': 'BootImageDracut'}, 'none': {'base': 'BootImageBase'}, } try: boot_image_namespace, boot_image_name = list( name_map[initrd_system].items() )[0] boot_image = importlib.import_module( 'kiwi.boot.image.{0}'.format(boot_image_namespace) ) return boot_image.__dict__[boot_image_name]( xml_state, target_dir, root_dir, signing_keys ) except Exception as issue: raise KiwiBootImageSetupError( 'Support for {0} initrd system not implemented: {1}'.format( initrd_system, issue ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7414281 kiwi-11.1.8/kiwi/boot/image/base.py0000644000000000000000000005120115273675667013776 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re import os import logging import glob from typing import Optional, List, Dict, NamedTuple # project from kiwi.mount_manager import MountManager from kiwi.defaults import Defaults from kiwi.system.setup import SystemSetup from kiwi.system.identifier import SystemIdentifier from kiwi.xml_description import XMLDescription from kiwi.xml_state import XMLState from kiwi.path import Path from kiwi.utils.sysconfig import SysConfig from kiwi.system.kernel import Kernel from kiwi.utils.command_capabilities import CommandCapabilities from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.exceptions import ( KiwiTargetDirectoryNotFound, KiwiConfigFileNotFound, KiwiDiskBootImageError, ) boot_names_type = NamedTuple( 'boot_names_type', [ ('kernel_name', str), ('initrd_name', str), ('kernel_version', str), ('kernel_filename', str), ], ) log = logging.getLogger('kiwi') class BootImageBase: """ **Base class for boot image(initrd) task** """ def __init__( self, xml_state: XMLState, target_dir: str, root_dir: Optional[str] = None, signing_keys: Optional[List[str]] = None, target_arch: Optional[str] = None, ) -> None: """ Create a base class instance of a BootImage The base class instance only support the common operations for boot images. The actual preparation and creation of an initrd is specific to the used initrd creation toolchain :param XMLState xml_state: Instance of :class:`XMLState` :param str target_dir: target dir to store the initrd :param str root_dir: system image root directory :param List[str] signing_keys: list of package signing keys :param str target_arch: target architecture """ self.xml_state = xml_state self.target_dir = target_dir self.initrd_filename = '' self.boot_xml_state: Optional[XMLState] = None self.setup: Optional[SystemSetup] = None self.signing_keys = signing_keys self.target_arch = target_arch self.boot_root_directory = root_dir or '' if not os.path.exists(target_dir): raise KiwiTargetDirectoryNotFound( f'target directory {target_dir} not found' ) self.initrd_base_name = ''.join( [ self.xml_state.xml_data.get_name(), '.' + Defaults.get_platform_name(), '-' + self.xml_state.get_image_version(), '.initrd', ] ) self.post_init() def post_init(self) -> None: """ Post initialization method Implementation in specialized boot image class """ pass @staticmethod def has_initrd_support() -> bool: """ Indicates if this instance supports actual creation of an initrd The method needs to be overwritten by the subclass implementing preparation and creation of an initrd """ return False def add_argument(self, option: str, value: str = '') -> None: """ Add caller argument to boot image creation tool :param str option: argument name :param str value: optional argument value """ pass def include_file( self, filename: str, install_media: bool = False, delete_after_include: bool = False, ) -> None: """ Include file to boot image For kiwi boot images this is done by adding package or archive definitions with the bootinclude attribute. Thus for kiwi boot images the method is a noop :param str filename: file path name :param bool install_media: include also for installation media initrd :param bool delete_after_include: delete the file from the boot root once it is included """ pass def include_module(self, module: str, install_media: bool = False) -> None: """ Include module to boot image For kiwi boot no modules configuration is required. Thus in such a case this method is a noop. :param str module: module to include :param bool install_media: include the module for install initrds """ pass def omit_module(self, module: str, install_media: bool = False) -> None: """ Omit module to boot image For kiwi boot no modules configuration is required. Thus in such a case this method is a noop. :param str module: module to omit :param bool install_media: omit the module for install initrds """ pass def set_static_modules( self, modules: List[str], install_media: bool = False ) -> None: """ Set static modules list for boot image For kiwi boot no modules configuration is required. Thus in such a case this method is a noop. :param list modules: list of modules to include :param bool install_media: lists the modules for install initrds """ pass def include_driver(self, driver: str, install_media: bool = False) -> None: """ Include driver to the boot image For kiwi boot no drivers configuration is required. Thus in such a case this method is a noop. :param str driver: driver to include :param bool install_media: include the driver for install initrds """ pass def omit_driver(self, driver: str, install_media: bool = False) -> None: """ Omit driver to the boot image For kiwi boot no drivers configuration is required. Thus in such a case this method is a noop. :param str driver: driver to omit :param bool install_media: omit the driver for install initrds """ pass def write_system_config_file( self, config: Dict, config_file: Optional[str] = None ) -> None: """ Writes relevant boot image configuration into configuration file that will be part of the system image. This is used to configure any further boot image rebuilds after deployment. For instance, initrds recreated on kernel update. For kiwi boot no specific configuration is required for initrds recreation, thus this method is a noop in that case. :param dict config: dictonary including configuration parameters :param str config_file: configuration file to write """ pass def get_boot_names(self, flavor: str = '') -> boot_names_type: """ Provides kernel and initrd names for the boot image :param str flavor: names of the latest kernel of this flavor, of the latest kernel if not set, see Kernel.get_kernel() :return: Contains boot_names_type tuple .. code:: python boot_names_type( kernel_name='INSTALLED_KERNEL', initrd_name='DRACUT_OUTPUT_NAME', kernel_version='KERNEL_VERSION', kernel_filename='KERNEL_FILE_NAME' ) :rtype: boot_names_type """ kernel = Kernel(self.boot_root_directory) kernel_info = kernel.get_kernel(flavor=flavor) if not kernel_info: if self.xml_state.get_initrd_system() == 'none': return boot_names_type( kernel_name='none', initrd_name='none', kernel_version='none', kernel_filename='none', ) flavor_info = f' of flavor {flavor}' if flavor else '' raise KiwiDiskBootImageError( f'No kernel{flavor_info} in boot image tree ' f'{self.boot_root_directory} found' ) dracut_output_format = self._get_boot_image_output_file_format( kernel_info.version ) return boot_names_type( kernel_version=kernel_info.version, kernel_name=kernel_info.name, initrd_name=dracut_output_format.format( kernel_version=kernel_info.version ), kernel_filename=kernel_info.filename, ) def prepare(self) -> None: """ Prepare new root system to create initrd from. Implementation is only needed if there is no other root system available Implementation in specialized boot image class """ raise NotImplementedError def create_uki(self, cmdline: str) -> str: """ Create UKI EFI binary Implementation in specialized boot image class """ raise NotImplementedError def create_initrd( self, mbrid: Optional[SystemIdentifier] = None, basename: Optional[str] = None, install_initrd: bool = False, flavor: str = '', delete_included_files: bool = True, ) -> None: """ Implements creation of the initrd :param SystemIdentifier mbrid: instance of SystemIdentifier :param str basename: base initrd file name :param bool install_initrd: installation media initrd :param str flavor: create the initrd for the latest kernel of this flavor, for the latest kernel if not set :param bool delete_included_files: delete the files included with delete_after_include once the initrd is created. Keep them if another initrd which includes them is created afterwards, e.g for the kernel of another flavor Implementation in specialized boot image class """ raise NotImplementedError def is_prepared(self) -> bool: """ Check if initrd system is prepared. :return: True or False :rtype: bool """ return bool(os.listdir(self.boot_root_directory)) def load_boot_xml_description(self) -> None: """ Load the boot image description referenced by the system image description boot attribute """ log.info('Loading Boot XML description') boot_description_directory = self.get_boot_description_directory() if not boot_description_directory: raise KiwiConfigFileNotFound( 'no boot reference specified in XML description' ) boot_config_file = boot_description_directory + '/config.xml' if not os.path.exists(boot_config_file): raise KiwiConfigFileNotFound( f'no Boot XML description found in {boot_description_directory}' ) boot_description = XMLDescription( description=boot_config_file, derived_from=self.xml_state.xml_data.description_dir, ) boot_image_profile = self.xml_state.build_type.get_bootprofile() if not boot_image_profile: boot_image_profile = 'default' boot_kernel_profile = self.xml_state.build_type.get_bootkernel() if not boot_kernel_profile: boot_kernel_profile = 'std' self.boot_xml_state = XMLState( boot_description.load(), [boot_image_profile, boot_kernel_profile] ) log.info('--> loaded %s', boot_config_file) if self.boot_xml_state.build_type: log.info( '--> Selected build type: %s', self.boot_xml_state.get_build_type_name(), ) if self.boot_xml_state.profiles: log.info( '--> Selected boot profiles: image: %s, kernel: %s', boot_image_profile, boot_kernel_profile, ) def import_system_description_elements(self) -> None: """ Copy information from the system image relevant to create the boot image to the boot image state XML description """ self.xml_state.copy_displayname(self.boot_xml_state) self.xml_state.copy_name(self.boot_xml_state) self.xml_state.copy_repository_sections( target_state=self.boot_xml_state, wipe=True ) self.xml_state.copy_drivers_sections(self.boot_xml_state) strip_description = XMLDescription(Defaults.get_boot_image_strip_file()) strip_xml_state = XMLState(strip_description.load()) strip_xml_state.copy_strip_sections(self.boot_xml_state) self.xml_state.copy_strip_sections(self.boot_xml_state) preferences_subsection_names = [ 'bootloader_theme', 'bootsplash_theme', 'locale', 'packagemanager', 'rpm_check_signatures', 'rpm_excludedocs', 'showlicense', ] self.xml_state.copy_preferences_subsections( preferences_subsection_names, self.boot_xml_state ) self.xml_state.copy_bootincluded_packages(self.boot_xml_state) self.xml_state.copy_bootincluded_archives(self.boot_xml_state) self.xml_state.copy_bootdelete_packages(self.boot_xml_state) type_attributes = [ 'bootkernel', 'bootprofile', 'btrfs_root_is_snapper_snapshot', 'gpt_hybrid_mbr', 'devicepersistency', 'filesystem', 'firmware', 'fsmountoptions', 'hybridpersistent', 'hybridpersistent_filesystem', 'initrd_system', 'installboot', 'installprovidefailsafe', 'kernelcmdline', 'ramonly', 'target_removable', 'wwid_wait_timeout', ] self.xml_state.copy_build_type_attributes( type_attributes, self.boot_xml_state ) self.xml_state.copy_bootloader_section(self.boot_xml_state) self.xml_state.copy_systemdisk_section(self.boot_xml_state) self.xml_state.copy_machine_section(self.boot_xml_state) self.xml_state.copy_oemconfig_section(self.boot_xml_state) def get_boot_description_directory(self) -> Optional[str]: """ Provide path to the boot image XML description :return: path name :rtype: str """ boot_description = self.xml_state.build_type.get_boot() if boot_description: if not boot_description[0] == '/': boot_description = ( Defaults.get_boot_image_description_path() + '/' + boot_description ) return boot_description def cleanup(self) -> None: """ Cleanup temporary boot image data if any """ pass def _get_boot_image_output_file_format(self, kernel_version: str) -> str: """ The initrd output file format varies between the different Linux distributions. Tools like lsinitrd, and also grub2 rely on the initrd output file to be in that format. Thus kiwi should use the same file format to stay compatible with the distributions. The format is determined in three stages: a) check for an existing initrd file and use this naming schema b) if no initrd file is found check the dracut binary for its default output file name schema c) if no output file schema could be detected from the dracut binary return a default output file format which is initramfs-{kernel_version}.img Let's hope all this mess can be deleted once all distros just can agree on one initrd file name schema """ if self.xml_state.get_initrd_system() == 'kiwi': # The custom kiwi initrd system is used only on SUSE systems. # The initrd environment does not provide dracut and thus the # outfile format cannot be determined. on SUSE systems the # initrd format is different than on upstream and therefore # it can be explicitly specified. Note that the custom initrd # system will become obsolete in the future. default_outfile_format = 'initrd-{kernel_version}' else: default_outfile_format = 'initramfs-{kernel_version}.img' outfile_format = ( self._get_boot_image_output_file_format_from_existing_file( kernel_version ) ) if not outfile_format: outfile_format = ( self._get_boot_image_output_file_format_from_dracut_code() ) if not outfile_format: outfile_format = ( self._get_boot_image_output_file_format_from_config( kernel_version ) ) if outfile_format: return outfile_format else: log.warning('Could not detect dracut output file format') log.warning( 'Using default initrd file name format {0}'.format( default_outfile_format ) ) return default_outfile_format def _get_boot_image_output_file_format_from_dracut_code( self, ) -> Optional[str]: dracut_tool = Path.which( 'dracut', root_dir=self.boot_root_directory, access_mode=os.X_OK ) if dracut_tool: outfile_expression = r'outfile=".*/boot/(init.*kernel.*)"' with open(dracut_tool) as dracut: matches = re.findall(outfile_expression, dracut.read()) if matches: return ( matches[0] .replace('$kernel', '{kernel_version}') .replace('${kernel}', '{kernel_version}') ) return None def _get_boot_image_output_file_format_from_existing_file( self, kernel_version: str ) -> Optional[str]: """ Derive the initrd file name format from an initrd file which exists in the boot root directory Only a file whose name contains the version of an installed kernel tells the format: the version is replaced by the {kernel_version} placeholder, see Kernel.get_version_in_name(). A file of another name, e.g the initrd of a kernel which is not installed anymore, is skipped, its name would otherwise become the name of the new initrd and not fit to its kernel """ kernel = Kernel(self.boot_root_directory) for initrd_file in sorted( glob.iglob(self.boot_root_directory + '/boot/init*') ): if not os.path.islink(initrd_file): initrd_name = os.path.basename(initrd_file) version = kernel.get_version_in_name(initrd_name) if version: return initrd_name.replace(version, '{kernel_version}') return None def _get_boot_image_output_file_format_from_config( self, kernel_version: str ) -> Optional[str]: if CommandCapabilities.has_option_in_help( 'dracut', '--printconfig', ['--help'], root=self.boot_root_directory, raise_on_error=False, ): with MountManager( device='tmpfs', mountpoint=os.path.join(self.boot_root_directory, 'var/tmp'), ) as var_tmp_mount: var_tmp_mount.tmpfs_mount() dracut_call = Command.run( [ 'chroot', self.boot_root_directory, 'dracut', '--printconfig', ] ) temp_file = Temporary().new_file() with open(temp_file.name, 'w') as config: config.write(dracut_call.output.replace(' ', '')) dracut_config = SysConfig(temp_file.name) initrdname = dracut_config.get('dracutconfig:initrdname') if initrdname: return initrdname.replace( kernel_version, '{kernel_version}' ) return None ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7414281 kiwi-11.1.8/kiwi/boot/image/builtin_kiwi.py0000644000000000000000000001703315273675667015562 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from kiwi.utils.temporary import Temporary from typing import Optional, List # project from kiwi.defaults import Defaults from kiwi.system.identifier import SystemIdentifier from kiwi.utils.sync import DataSync from kiwi.system.prepare import SystemPrepare from kiwi.system.profile import Profile from kiwi.system.setup import SystemSetup from kiwi.archive.cpio import ArchiveCpio from kiwi.utils.compress import Compress from kiwi.path import Path from kiwi.boot.image.base import BootImageBase log = logging.getLogger('kiwi') class BootImageKiwi(BootImageBase): """ **Implements preparation and creation of kiwi boot(initrd) images** The kiwi initrd is a customized first boot initrd which allows to control the first boot an appliance. The kiwi initrd replaces itself after first boot by the result of dracut. """ @staticmethod def has_initrd_support() -> bool: """ This instance supports initrd preparation and creation """ return True def post_init(self) -> None: """ Post initialization method Creates custom directory to prepare the boot image root filesystem which is a separate image to create the initrd from """ # builtin kiwi initrd builds its own root tree to create # an initrd from. Thus there is no pre defined boot root # directory self.boot_root_directory = '' self.temp_directories: List[str] = [] self.load_boot_xml_description() def prepare(self) -> None: """ Prepare new root system suitable to create a kiwi initrd from it """ if self.boot_xml_state: self.boot_root_directory_temporary = Temporary( prefix='kiwi_boot_root.', path=self.target_dir ).new_dir() self.boot_root_directory = self.boot_root_directory_temporary.name self.temp_directories.append(self.boot_root_directory) boot_image_name = self.boot_xml_state.xml_data.get_name() self.import_system_description_elements() log.info('Preparing boot image') with SystemPrepare( xml_state=self.boot_xml_state, root_dir=self.boot_root_directory, allow_existing=True, ) as system: with system.setup_repositories( signing_keys=self.signing_keys, target_arch=self.target_arch ) as manager: system.install_bootstrap(manager) system.install_system(manager) profile = Profile(self.boot_xml_state) profile.add('kiwi_initrdname', boot_image_name) defaults = Defaults() defaults.to_profile(profile) self.setup = SystemSetup( self.boot_xml_state, self.boot_root_directory ) profile.create( Defaults.get_profile_file(self.boot_root_directory) ) self.setup.import_description() self.setup.import_overlay_files(follow_links=True) self.setup.call_config_script() system.pinch_system(manager=manager, force=True) self.setup.call_image_script() self.setup.create_init_link_from_linuxrc() def create_initrd( self, mbrid: Optional[SystemIdentifier] = None, basename: Optional[str] = None, install_initrd: bool = False, flavor: str = '', delete_included_files: bool = True, ) -> None: """ Create initrd from prepared boot system tree and compress the result :param SystemIdentifier mbrid: instance of ImageIdentifier :param str basename: base initrd file name :param bool install_initrd: installation media initrd :param str flavor: unused, kernel flavors are only supported with the dracut initrd system :param bool delete_included_files: unused """ if self.is_prepared(): log.info('Creating initrd cpio archive') # we can't simply exclude boot when building the archive # because the file boot/mbrid must be preserved. Because of # that we create a copy of the boot directory and remove # everything in boot/ except for boot/mbrid. The original # boot directory should not be changed because we rely # on other data in boot/ e.g the kernel to be available # for the entire image building process if basename: kiwi_initrd_basename = basename else: kiwi_initrd_basename = self.initrd_base_name temp_boot_root = Temporary(prefix='kiwi_boot_root_copy.').new_dir() temp_boot_root_directory = temp_boot_root.name os.chmod(temp_boot_root_directory, 0o755) data = DataSync( self.boot_root_directory + '/', temp_boot_root_directory ) data.sync_data(options=Defaults.get_sync_options()) boot_directory = temp_boot_root_directory + '/boot' Path.wipe(boot_directory) if mbrid: log.info('--> Importing mbrid: %s', mbrid.get_id()) Path.create(boot_directory) image_identifier = boot_directory + '/mbrid' mbrid.write(image_identifier) cpio = ArchiveCpio( os.sep.join([self.target_dir, kiwi_initrd_basename]) ) # the following is a list of directories which were needed # during the process of creating an image but not when the # image is actually booting with this initrd exclude_from_archive = [ '/' + Defaults.get_shared_cache_location(), '/image', '/usr/lib/grub*', ] # the following is a list of directories to exclude which # are not needed inside of the initrd exclude_from_archive += [ '/usr/share/doc', '/usr/share/man', '/home', '/media', '/srv', ] cpio.create( source_dir=temp_boot_root_directory, exclude=exclude_from_archive, ) log.info('--> xz compressing archive') compress = Compress( os.sep.join([self.target_dir, kiwi_initrd_basename]) ) self.initrd_filename = compress.xz( ['--check=crc32', '--lzma2=dict=1MiB', '--threads=0'] ) def cleanup(self) -> None: for directory in self.temp_directories: if directory and os.path.exists(directory): Path.wipe(directory) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7414281 kiwi-11.1.8/kiwi/boot/image/dracut.py0000644000000000000000000004243015273675667014352 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from contextlib import ExitStack from typing import List, Optional, Dict # project from kiwi.command import Command from kiwi.system.kernel import Kernel from kiwi.boot.image.base import BootImageBase from kiwi.defaults import Defaults from kiwi.system.profile import Profile from kiwi.system.setup import SystemSetup from kiwi.system.identifier import SystemIdentifier from kiwi.mount_manager import MountManager log = logging.getLogger('kiwi') class BootImageDracut(BootImageBase): """ **Implements creation of dracut boot(initrd) images.** """ @staticmethod def has_initrd_support() -> bool: """ This instance supports initrd preparation and creation """ return True def post_init(self) -> None: """ Post initialization method Initialize empty list of dracut caller options """ # signing keys are only taken into account on install of # packages. As dracut runs from a pre defined root directory, # no signing keys will be used in the process of creating # an initrd with dracut self.signing_keys = None # Initialize empty list of dracut caller options self.dracut_options: List[str] = [] self.included_files: List[str] = [] self.delete_after_include_files: List[str] = [] self.modules: List[str] = [] self.add_modules: List[str] = [] self.omit_modules: List[str] = [] self.available_modules = self._get_modules() self.add_drivers: List[str] = [] self.omit_drivers: List[str] = [] self.available_drivers = self._get_drivers() def include_file( self, filename: str, install_media: bool = False, delete_after_include: bool = False, ) -> None: """ Include file to dracut boot image :param str filename: file path name :param bool install_media: unused :param bool delete_after_include: delete the file from the boot root once the initrd is created """ self.included_files.append('--install') self.included_files.append(filename) if delete_after_include: self.delete_after_include_files.append(filename) def include_module(self, module: str, install_media: bool = False) -> None: """ Include module to dracut boot image :param str module: module to include :param bool install_media: unused """ warn_msg = 'module "{0}" not included in initrd'.format(module) if self._module_available(module): if module not in self.add_modules: self.add_modules.append(module) else: log.warning(warn_msg) def omit_module(self, module: str, install_media: bool = False) -> None: """ Omit module to dracut boot image :param str module: module to omit :param bool install_media: unused """ if module not in self.omit_modules: self.omit_modules.append(module) def set_static_modules( self, modules: List[str], install_media: bool = False ) -> None: """ Set static dracut modules list for boot image :param list modules: list of the modules to include :param bool install_media: unused """ self.modules = modules def include_driver(self, driver: str, install_media: bool = False) -> None: """ Include driver to dracut boot image :param str driver: driver to include :param bool install_media: unused """ warn_msg = 'driver "{0}" not included in initrd'.format(driver) if self._driver_available(driver): if driver not in self.add_drivers: self.add_drivers.append(driver) else: log.warning(warn_msg) def omit_driver(self, driver: str, install_media: bool = False) -> None: """ Omit driver to dracut boot image :param str driver: driver to omit :param bool install_media: unused """ if driver not in self.omit_drivers: self.omit_drivers.append(driver) def write_system_config_file( self, config: Dict, config_file: Optional[str] = None ) -> None: """ Writes modules configuration into a dracut configuration file. :param dict config: a dictionary containing the modules to add and omit :param str conf_file: configuration file to write """ dracut_config = [] if not config_file: config_file = os.path.normpath( self.boot_root_directory + Defaults.get_dracut_conf_name() ) if config.get('modules'): modules = [ module for module in config['modules'] if self._module_available(module) ] dracut_config.append( 'add_dracutmodules+=" {0} "\n'.format(' '.join(modules)) ) if config.get('omit_modules'): dracut_config.append( 'omit_dracutmodules+=" {0} "\n'.format( ' '.join(config['omit_modules']) ) ) if config.get('install_items'): dracut_config.append( 'install_items+=" {0} "\n'.format( ' '.join(config['install_items']) ) ) if config.get('drivers'): drivers = [ driver for driver in config['drivers'] if self._driver_available(driver) ] dracut_config.append( 'add_drivers+=" {0} "\n'.format(' '.join(drivers)) ) if config.get('omit_drivers'): dracut_config.append( 'omit_drivers+=" {0} "\n'.format( ' '.join(config['omit_drivers']) ) ) if dracut_config and config_file: with open(config_file, 'w') as config_handle: config_handle.writelines(dracut_config) def prepare(self) -> None: """ Prepare dracut caller environment * Setup machine_id(s) to be generic and rebuild by dracut on boot """ setup = SystemSetup(self.xml_state, self.boot_root_directory) setup.setup_machine_id() self.dracut_options.append('--install') self.dracut_options.append('/.profile') def add_argument(self, option: str, value: str = '') -> None: """ Add caller argument to boot image creation tool :param str option: argument name :param str value: optional argument value """ self.dracut_options.append(option) if value: self.dracut_options.append(value) def create_uki(self, cmdline: str) -> str: """ Create UKI EFI binary """ if self.is_prepared(): log.info('Creating generic UKI EFI binary') self._create_profile_environment() kernel_info = Kernel(self.boot_root_directory) kernel_details = kernel_info.get_kernel(raise_on_not_found=True) boot_names = self.get_boot_names() uki_base_name = f'{boot_names.initrd_name}.efi' uki_base_name = uki_base_name.replace('initrd-', 'vmlinuz-') included_files = self.included_files modules_args = ( ['--modules', ' {0} '.format(' '.join(self.modules))] if self.modules else [] ) modules_args += ( ['--add', ' {0} '.format(' '.join(self.add_modules))] if self.add_modules else [] ) modules_args += ( ['--omit', ' {0} '.format(' '.join(self.omit_modules))] if self.omit_modules else [] ) drivers_arg = ( ['--drivers', ' {0} '.format(' '.join(self.add_drivers))] if self.add_drivers else [] ) drivers_arg += ( ['--omit-drivers', ' {0} '.format(' '.join(self.omit_drivers))] if self.omit_drivers else [] ) options = ( self.dracut_options + modules_args + drivers_arg + included_files ) if kernel_details: with ExitStack() as stack: device_mount = MountManager( device='/dev', mountpoint=self.boot_root_directory + '/dev', ) stack.push(device_mount) device_mount.bind_mount() proc_mount = MountManager( device='/proc', mountpoint=self.boot_root_directory + '/proc', ) stack.push(proc_mount) proc_mount.bind_mount() dracut_call = Command.run( [ 'chroot', self.boot_root_directory, 'dracut', '--no-hostonly', '--no-hostonly-cmdline', '--force', '--verbose', '--reproducible', '--kver', kernel_details.version, '--uefi', '--kernel-cmdline', cmdline, ] + options + [uki_base_name], stderr_to_stdout=True, ) log.debug(dracut_call.output) Command.run( [ 'mv', os.sep.join([self.boot_root_directory, uki_base_name]), f'{self.target_dir}/kiwi.efi', ] ) for filename in self.delete_after_include_files: os.unlink(f'{self.boot_root_directory}/{filename}') return os.path.normpath(os.sep.join([self.target_dir, 'kiwi.efi'])) return '' def create_initrd( self, mbrid: Optional[SystemIdentifier] = None, basename: Optional[str] = None, install_initrd: bool = False, flavor: str = '', delete_included_files: bool = True, ) -> None: """ Create kiwi .profile environment to be included in dracut initrd. Call dracut as chroot operation to create the initrd and move the result into the image build target directory :param SystemIdentifier mbrid: unused :param str basename: base initrd file name :param bool install_initrd: unused :param str flavor: create the initrd for the latest kernel of this flavor, for the latest kernel if not set :param bool delete_included_files: delete the files included with delete_after_include once the initrd is created. Keep them if another initrd which includes them is created afterwards, e.g for the kernel of another flavor """ if self.is_prepared(): log.info( 'Creating generic dracut initrd archive{0}'.format( f' for kernel flavor {flavor}' if flavor else '' ) ) self._create_profile_environment() kernel_info = Kernel(self.boot_root_directory) kernel_details = kernel_info.get_kernel( raise_on_not_found=True, flavor=flavor ) if basename: dracut_initrd_basename = basename else: dracut_initrd_basename = self.initrd_base_name included_files = self.included_files modules_args = ( ['--modules', ' {0} '.format(' '.join(self.modules))] if self.modules else [] ) modules_args += ( ['--add', ' {0} '.format(' '.join(self.add_modules))] if self.add_modules else [] ) modules_args += ( ['--omit', ' {0} '.format(' '.join(self.omit_modules))] if self.omit_modules else [] ) drivers_arg = ( ['--drivers', ' {0} '.format(' '.join(self.add_drivers))] if self.add_drivers else [] ) drivers_arg += ( ['--omit-drivers', ' {0} '.format(' '.join(self.omit_drivers))] if self.omit_drivers else [] ) options = ( self.dracut_options + modules_args + drivers_arg + included_files ) if kernel_details: with ExitStack() as stack: device_mount = MountManager( device='/dev', mountpoint=self.boot_root_directory + '/dev', ) stack.push(device_mount) device_mount.bind_mount() proc_mount = MountManager( device='/proc', mountpoint=self.boot_root_directory + '/proc', ) stack.push(proc_mount) proc_mount.bind_mount() dracut_call = Command.run( [ 'chroot', self.boot_root_directory, 'dracut', '--verbose', '--reproducible', '--no-hostonly', '--no-hostonly-cmdline', ] + options + [dracut_initrd_basename, kernel_details.version], stderr_to_stdout=True, ) log.debug(dracut_call.output) Command.run( [ 'mv', os.sep.join( [self.boot_root_directory, dracut_initrd_basename] ), self.target_dir, ] ) self.initrd_filename = os.sep.join( [self.target_dir, dracut_initrd_basename] ) Command.run(['chmod', '644', self.initrd_filename]) if delete_included_files: for filename in self.delete_after_include_files: os.unlink(f'{self.boot_root_directory}/{filename}') def _get_modules(self) -> List[str]: cmd = Command.run( [ 'chroot', self.boot_root_directory, 'dracut', '--list-modules', '--no-kernel', ] ) return cmd.output.splitlines() def _get_drivers(self) -> List[str]: try: kernel_info = Kernel(self.boot_root_directory).get_kernel() if not kernel_info: log.warning("No kernel found in boot directory") return [] cmd = Command.run( [ 'chroot', self.boot_root_directory, 'cat', f'/lib/modules/{kernel_info.version}/modules.dep', ] ) drivers = [ os.path.basename(line.split(':')[0].strip()).split('.ko')[0] for line in cmd.output.splitlines() if line.strip() ] return drivers except Exception as e: log.warning(f"Error reading drivers: {str(e)}") return [] def _module_available(self, module: str) -> bool: warn_msg = 'dracut module "{0}" not found in the root tree' if module in self.available_modules: return True log.warning(warn_msg.format(module)) return False def _driver_available(self, driver: str) -> bool: warn_msg = 'dracut driver "{0}" not found in the root tree' if driver in self.available_drivers: return True log.warning(warn_msg.format(driver)) return False def _create_profile_environment(self) -> None: profile = Profile(self.xml_state) defaults = Defaults() defaults.to_profile(profile) profile.create(Defaults.get_profile_file(self.boot_root_directory)) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7414281 kiwi-11.1.8/kiwi/bootloader/__init__.py0000644000000000000000000000000015273675667014717 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7416813 kiwi-11.1.8/kiwi/bootloader/config/__init__.py0000644000000000000000000000725515273675667016207 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import TYPE_CHECKING, Dict, Literal, Optional, Union, overload from kiwi.exceptions import KiwiBootLoaderConfigSetupError if TYPE_CHECKING: # pragma: nocover from kiwi.xml_state import XMLState from kiwi.bootloader.config.grub2 import BootLoaderConfigGrub2 from kiwi.bootloader.config.systemd_boot import BootLoaderSystemdBoot from kiwi.bootloader.config.custom import BootLoaderConfigCustom from kiwi.bootloader.config.zipl import BootLoaderZipl @overload def create_boot_loader_config( *, name: Literal["grub2"], xml_state: "XMLState", root_dir: str, boot_dir: Optional[str] = None, custom_args: Optional[Dict] = None, ) -> "BootLoaderConfigGrub2": ... # pragma: nocover @overload def create_boot_loader_config( *, name: Literal["grub2_s390x_emu"], xml_state: "XMLState", root_dir: str, boot_dir: Optional[str] = None, custom_args: Optional[Dict] = None, ) -> "BootLoaderConfigGrub2": ... # pragma: nocover @overload def create_boot_loader_config( *, name: Literal["systemd_boot"], xml_state: "XMLState", root_dir: str, boot_dir: Optional[str] = None, custom_args: Optional[Dict] = None, ) -> "BootLoaderSystemdBoot": ... # pragma: nocover @overload def create_boot_loader_config( *, name: Literal["zipl"], xml_state: "XMLState", root_dir: str, boot_dir: Optional[str] = None, custom_args: Optional[Dict] = None, ) -> "BootLoaderZipl": ... # pragma: nocover @overload def create_boot_loader_config( *, name: str, xml_state: "XMLState", root_dir: str, boot_dir: Optional[str] = None, custom_args: Optional[Dict] = None, ) -> ( "Union[BootLoaderConfigGrub2, BootLoaderSystemdBoot, BootLoaderZipl]" ): ... # pragma: nocover def create_boot_loader_config( *, name: str, xml_state: "XMLState", root_dir: str, boot_dir: Optional[str] = None, custom_args: Optional[Dict] = None, ) -> "Union[BootLoaderConfigGrub2, BootLoaderSystemdBoot, BootLoaderZipl, BootLoaderConfigCustom]": # the loaders read their custom arguments from a dict if custom_args is None: custom_args = {} if name in ("grub2", "grub2_s390x_emu"): from kiwi.bootloader.config.grub2 import BootLoaderConfigGrub2 return BootLoaderConfigGrub2(xml_state, root_dir, boot_dir, custom_args) if name == "systemd_boot": from kiwi.bootloader.config.systemd_boot import BootLoaderSystemdBoot return BootLoaderSystemdBoot(xml_state, root_dir, boot_dir, custom_args) if name == "zipl": from kiwi.bootloader.config.zipl import BootLoaderZipl return BootLoaderZipl(xml_state, root_dir, boot_dir, custom_args) if name == "custom": from kiwi.bootloader.config.custom import BootLoaderConfigCustom return BootLoaderConfigCustom( xml_state, root_dir, boot_dir, custom_args ) raise KiwiBootLoaderConfigSetupError( f'Support for {name} bootloader config not implemented' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7417269 kiwi-11.1.8/kiwi/bootloader/config/base.py0000644000000000000000000006522615273675667015364 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from abc import ABC, abstractmethod import os import re import logging from collections import namedtuple from types import TracebackType from typing import Dict, List, Optional, Type, TypeVar # project from kiwi.mount_manager import MountManager from kiwi.storage.setup import DiskSetup from kiwi.path import Path from kiwi.defaults import Defaults, KERNEL_FLAVOR_NONE from kiwi.utils.block import BlockID from kiwi.system.setup import SystemSetup from kiwi.system.identifier import SystemIdentifier from kiwi.storage.disk import ptable_entry_type from kiwi.xml_state import XMLState from kiwi.exceptions import KiwiBootLoaderTargetError log = logging.getLogger('kiwi') # the type of the bootloader config instance used as context manager BootLoaderConfigT = TypeVar('BootLoaderConfigT', bound='BootLoaderConfigBase') class BootLoaderConfigBase(ABC): """ **Base class for bootloader configuration** :param object xml_state: instance of :class:`XMLState` :param string root_dir: root directory path name :param dict custom_args: custom bootloader arguments dictionary """ def __init__( self, xml_state: XMLState, root_dir: str, boot_dir: Optional[str] = None, custom_args: Dict = {}, ) -> None: self.root_dir = root_dir self.boot_dir = boot_dir or root_dir self.xml_state = xml_state self.bootloader = xml_state.get_build_type_bootloader_name() self.arch = Defaults.get_platform_name() self.system_is_mounted = False self.volumes_mount: List[MountManager] = [] self.partitions_mount: List[MountManager] = [] self.root_mount: Optional[MountManager] = None self.boot_mount: Optional[MountManager] = None self.efi_mount: Optional[MountManager] = None self.device_mount: Optional[MountManager] = None self.proc_mount: Optional[MountManager] = None self.sys_mount: Optional[MountManager] = None self.tmp_mount: Optional[MountManager] = None self.etc_kernel_mount: Optional[MountManager] = None self.root_filesystem_is_overlay = xml_state.build_type.get_overlayroot() self.post_init(custom_args) def __enter__(self: BootLoaderConfigT) -> BootLoaderConfigT: return self def post_init(self, custom_args: Dict) -> None: """ Post initialization method Store custom arguments by default :param dict custom_args: custom bootloader arguments """ self.custom_args = custom_args @abstractmethod def write(self) -> None: """ Write config data to config file. Implementation in specialized bootloader class required """ def write_meta_data( self, root_device: Optional[str] = None, write_device: Optional[str] = None, boot_options: str = '', ) -> None: """ Write bootloader setup meta data files :param string root_device: root device node :param string write_device: overlay root write device node :param string boot_options: kernel options as string Implementation in specialized bootloader class optional """ pass @abstractmethod def setup_disk_image_config( self, boot_uuid: Optional[str] = None, root_uuid: Optional[str] = None, hypervisor: Optional[str] = None, kernel: Optional[str] = None, initrd: Optional[str] = None, boot_options: Dict = {}, ) -> None: """ Create boot config file to boot from disk. :param string boot_uuid: boot device UUID :param string root_uuid: root device UUID :param string hypervisor: hypervisor name :param string kernel: kernel name :param string initrd: initrd name :param dict boot_options: custom options dictionary required to setup the bootloader. The scope of the options covers all information needed to setup and configure the bootloader and gets effective in the individual implementation. boot_options should not be mixed up with commandline options used at boot time. This information is provided from the get_*_cmdline methods. The contents of the dictionary can vary between bootloaders or even not be needed Implementation in specialized bootloader class required """ @abstractmethod def setup_install_image_config( self, mbrid: SystemIdentifier, hypervisor: str, kernel: str, initrd: str ) -> None: """ Create boot config file to boot from install media in EFI mode. :param string mbrid: mbrid file name on boot device :param string hypervisor: hypervisor name :param string kernel: kernel name :param string initrd: initrd name Implementation in specialized bootloader class required """ @abstractmethod def setup_live_image_config( self, mbrid: SystemIdentifier, hypervisor: str, kernel: str, initrd: str ) -> None: """ Create boot config file to boot live ISO image in EFI mode. :param string mbrid: mbrid file name on boot device :param string hypervisor: hypervisor name :param string kernel: kernel name :param string initrd: initrd name Implementation in specialized bootloader class required """ @abstractmethod def setup_disk_boot_images( self, boot_uuid: str, efi_uuid: Optional[str] = None, lookup_path: Optional[str] = None, ) -> None: """ Create bootloader images for disk boot Some bootloaders requires to build a boot image the bootloader can load from a specific offset address or from a standardized path on a filesystem. :param string boot_uuid: boot device UUID :param string efi_uuid: EFI device UUID :param string lookup_path: custom module lookup path Implementation in specialized bootloader class required """ @abstractmethod def setup_install_boot_images( self, mbrid: SystemIdentifier, lookup_path: Optional[str] = None ) -> None: """ Create bootloader images for ISO boot an install media :param string mbrid: mbrid file name on boot device :param string lookup_path: custom module lookup path Implementation in specialized bootloader class required """ @abstractmethod def setup_live_boot_images( self, mbrid: SystemIdentifier, lookup_path: Optional[str] = None ) -> None: """ Create bootloader images for ISO boot a live ISO image :param string mbrid: mbrid file name on boot device :param string lookup_path: custom module lookup path Implementation in specialized bootloader class required """ @abstractmethod def setup_sysconfig_bootloader(self) -> None: """ Create or update etc/sysconfig/bootloader by parameters required according to the bootloader setup Implementation in specialized bootloader class required """ def create_efi_path(self, in_sub_dir: str = 'boot/efi') -> str: """ Create standard EFI boot directory structure :param string in_sub_dir: toplevel directory :return: Full qualified EFI boot path :rtype: str """ efi_boot_path = os.path.normpath( os.sep.join([self.boot_dir, in_sub_dir, 'EFI/BOOT']) ) Path.create(efi_boot_path) return efi_boot_path def get_boot_theme(self) -> Optional[str]: """ Bootloader Theme name :return: theme name :rtype: str """ theme = None for preferences in self.xml_state.get_preferences_sections(): section_content = preferences.get_bootloader_theme() if section_content: theme = section_content[0] return theme def get_boot_timeout_seconds(self) -> int: """ Bootloader timeout in seconds If no timeout is specified the default timeout applies :return: timeout seconds :rtype: int """ timeout_seconds = self.xml_state.get_build_type_bootloader_timeout() if timeout_seconds is None: timeout_seconds = Defaults.get_default_boot_timeout_seconds() return timeout_seconds def get_continue_on_timeout(self) -> bool: """ Check if the boot should continue after boot timeout or not :return: True or False :rtype: bool """ continue_on_timeout = ( self.xml_state.build_type.get_install_continue_on_timeout() ) if continue_on_timeout is None: continue_on_timeout = True return continue_on_timeout def failsafe_boot_entry_requested(self) -> bool: """ Check if a failsafe boot entry is requested :return: True or False :rtype: bool """ if self.xml_state.build_type.get_installprovidefailsafe() is False: return False return True def get_boot_cmdline( self, boot_device: Optional[str], write_device: Optional[str] = None ) -> str: """ Boot commandline arguments passed to the kernel :param string boot_device: boot device node. If no extra boot device exists then boot device equals root device. In case of an overlay setup the boot device equals the readonly root device :param string write_device: optional overlay write device node :return: kernel boot arguments :rtype: str """ cmdline = '' custom_cmdline = self.xml_state.build_type.get_kernelcmdline() if custom_cmdline: cmdline += ' ' + custom_cmdline overlay_cmdline = self._get_root_overlay_cmdline_parameter( boot_device, write_device ) if overlay_cmdline: cmdline += ' ' + overlay_cmdline custom_root = self._get_root_cmdline_parameter(boot_device) if custom_root and custom_root not in cmdline: cmdline += ' ' + custom_root return cmdline.strip() def get_install_image_boot_default( self, loader: Optional[str] = None ) -> str: """ Provide the default boot menu entry identifier for install images The install image can be configured to provide more than one boot menu entry. Menu entries configured are: * [0] Boot From Hard Disk * [1] Install * [2] Failsafe Install With kernel flavors there is one install entry per flavor, the failsafe install entry follows the last one. The install entry of the first flavor is the one selected by install The installboot attribute controlls which of these are used by default. If not specified the boot from hard disk entry will be the default. Depending on the specified loader type either an entry number or name will be returned. :param string loader: bootloader name :return: menu name or id :rtype: str """ menu_entry_title = self.get_menu_entry_title(plain=True) failsafe_install_id = format(1 + len(self.get_kernel_flavors())) menu_type = namedtuple('menu_type', ['name', 'menu_id']) menu_list = [ menu_type(name='Boot_from_Hard_Disk', menu_id='0'), menu_type(name='Install_' + menu_entry_title, menu_id='1'), menu_type( name='Failsafe_--_Install_' + menu_entry_title, menu_id=failsafe_install_id, ), ] boot_id = 0 install_boot_name = self.xml_state.build_type.get_installboot() if install_boot_name == 'failsafe-install': boot_id = 2 elif install_boot_name == 'install': boot_id = 1 if not self.failsafe_boot_entry_requested() and boot_id == 2: log.warning( 'Failsafe install requested but failsafe menu entry is disabled' ) log.warning('Switching to standard install') boot_id = 1 return menu_list[boot_id].menu_id def get_boot_path(self, target: str = 'disk') -> str: """ Bootloader lookup path on boot device If the bootloader reads the data it needs to boot, it does that from the configured boot device. Depending if that device is an extra boot partition or the root partition or or based on a non standard filesystem like a btrfs snapshot, the path name varies :param string target: target name: disk|iso :return: path name :rtype: str """ if target != 'disk' and target != 'iso': raise KiwiBootLoaderTargetError( f'Invalid boot loader target {target}' ) bootpath = '/boot' need_boot_partition = False if target == 'disk': disk_setup = DiskSetup(self.xml_state, self.boot_dir) need_boot_partition = disk_setup.need_boot_partition() if need_boot_partition: if self.bootloader != 'zipl': # if an extra boot partition is used we will find the # data directly in the root of this partition and not # below the boot/ directory. An exception to this case # is the zipl bootloader which finds its target # according to the mount path. bootpath = '/' if target == 'iso': bootpath = '/boot/' + self.arch + '/loader' return bootpath def quote_title(self, name: str) -> str: """ Quote special characters in the title name Not all characters can be displayed correctly in the bootloader environment. Therefore a quoting is required :param string name: title name :return: quoted text :rtype: str """ name = name.replace(' ', '_') name = name.replace('[', '(') name = name.replace(']', ')') return name def get_menu_entry_title(self, plain: bool = False) -> str: """ Prefixed menu entry title If no displayname is specified in the image description, the menu title is constructed from the image name and build type :param bool plain: indicate to add built type into title text :return: title text :rtype: str """ title = self.xml_state.xml_data.get_displayname() if not title: title = self.xml_state.xml_data.get_name() else: # if the title is set via the displayname attribute no custom # kiwi prefix or other style changes to that text should # be made plain = True type_name = self.xml_state.build_type.get_image() if plain: return title return title + ' [ ' + type_name.upper() + ' ]' def get_kernel_flavors(self) -> List[str]: """ Kernel flavors to create a boot menu entry for, in the order of the menu entries. The first flavor provides the default menu entry. If no kernel flavor is configured, the empty flavor stands for the latest kernel, see Kernel.get_kernel() :return: list of kernel flavor names :rtype: list """ return self.xml_state.get_build_type_bootloader_kernel_flavors() or [''] def get_kernel_flavor_title(self, title: str, flavor: str) -> str: """ Menu entry title for the kernel of the given flavor :param str title: menu entry title :param str flavor: kernel flavor name, the title is used as it is for the empty flavor and for the kernels without flavor, see Kernel.is_flavor() :return: title text :rtype: str """ if flavor and flavor != KERNEL_FLAVOR_NONE: return f'{title} ({flavor})' return title def get_menu_entry_install_title(self) -> str: """ Prefixed menu entry title for install images If no displayname is specified in the image description, the menu title is constructed from the image name :return: title text :rtype: str """ title = self.xml_state.xml_data.get_displayname() if not title: title = self.xml_state.xml_data.get_name() return title def _mount_system( self, device_map: Optional[Dict], root_device: str, boot_device: str, efi_device: Optional[str] = None, volumes: Optional[Dict] = None, root_volume_name: Optional[str] = None, partitions: Optional[Dict[str, ptable_entry_type]] = None, ) -> None: self.root_mount = MountManager(device=root_device) if 's390' in self.arch and self.bootloader == 'grub2_s390x_emu': self.boot_mount = MountManager( device=boot_device, mountpoint=self.root_mount.mountpoint + '/boot/zipl', ) else: self.boot_mount = MountManager( device=boot_device, mountpoint=self.root_mount.mountpoint + '/boot', ) if efi_device: self.efi_mount = MountManager( device=efi_device, mountpoint=self.root_mount.mountpoint + '/boot/efi', ) custom_root_mount_args = [] if root_volume_name and root_volume_name != '/': custom_root_mount_args += [f'subvol={root_volume_name}'] readonly_device = (device_map or {}).get('readonly') if readonly_device and root_device == readonly_device.get_device(): # The overlayroot readonly partition holds a read-only # filesystem (squashfs/erofs), mount it as such custom_root_mount_args += ['ro'] self.root_mount.mount(options=custom_root_mount_args) if not self.root_mount.device == self.boot_mount.device: self.boot_mount.mount() if volumes: for volume_path in Path.sort_by_hierarchy(sorted(volumes.keys())): volume_mount = MountManager( device=volumes[volume_path]['volume_device'], mountpoint=self.root_mount.mountpoint + '/' + volume_path, ) self.volumes_mount.append(volume_mount) volume_mount.mount( options=[volumes[volume_path]['volume_options']] ) if partitions: # the partitions are mounted from the given device map assert device_map is not None for map_name in sorted(partitions.keys()): if map_name in device_map: partition_mount = MountManager( device=device_map[map_name].get_device(), mountpoint=os.path.join( self.root_mount.mountpoint, partitions[map_name].mountpoint.lstrip(os.sep), ), ) self.partitions_mount.append(partition_mount) partition_mount.mount() if efi_device: assert self.efi_mount is not None self.efi_mount.mount() if self.root_filesystem_is_overlay: # In case of an overlay root system all parts of the rootfs # are read-only. However tools like grub's mkconfig creates # temporary files at call time and therefore /tmp needs to # be writable during the call time of the tools self.tmp_mount = MountManager( device='/tmp', mountpoint=self.root_mount.mountpoint + '/tmp' ) self.tmp_mount.bind_mount() # There are also tools that writes to /etc/kernel, e.g # systemd-boot. If it exists we map it to the ESP etc_kernel = f'{self.root_mount.mountpoint}/etc/kernel' if efi_device and os.path.exists(etc_kernel): self.etc_kernel_mount = MountManager( device=efi_device, mountpoint=etc_kernel ) self.etc_kernel_mount.mount() self.device_mount = MountManager( device='/dev', mountpoint=self.root_mount.mountpoint + '/dev' ) self.proc_mount = MountManager( device='/proc', mountpoint=self.root_mount.mountpoint + '/proc' ) self.sys_mount = MountManager( device='/sys', mountpoint=self.root_mount.mountpoint + '/sys' ) self.device_mount.bind_mount() self.proc_mount.bind_mount() self.sys_mount.bind_mount() self.system_is_mounted = True def _umount_system(self) -> None: if self.system_is_mounted: assert self.root_mount is not None # Rebuild security context setup = SystemSetup(self.xml_state, self.root_mount.mountpoint) setup.setup_selinux_file_contexts() # Umount system if self.efi_mount: self.efi_mount.umount() if self.boot_mount: self.boot_mount.umount() for volume_mount in reversed(self.volumes_mount): volume_mount.umount() for partition_mount in reversed(self.partitions_mount): partition_mount.umount() if self.device_mount: self.device_mount.umount() if self.proc_mount: self.proc_mount.umount() if self.sys_mount: self.sys_mount.umount() if self.tmp_mount: self.tmp_mount.umount() if self.etc_kernel_mount: self.etc_kernel_mount.umount() if self.root_mount: self.root_mount.umount() self.system_is_mounted = False def _get_root_cmdline_parameter( self, boot_device: Optional[str] ) -> Optional[str]: """ root= argument passed to the kernel :param string boot_device: boot device node. If no extra boot device exists then boot device equals root device. In case of an overlay setup the boot device equals the readonly root device """ cmdline = self.xml_state.build_type.get_kernelcmdline() if cmdline and 'root=' in cmdline: log.warning('Kernel root device explicitly set via kernelcmdline') root_search = re.search(r'(root=(.*)[ ]+|root=(.*)$)', cmdline) if root_search: return root_search.group(1) if boot_device: if self.xml_state.build_type.get_overlayroot(): # In case of an overlay setup the root partition is read-only # In this case the root location will be specified by the # partition uuid because not all read-only filesystems have one. # Exception to this is if the overlay is also encrypted # Exception to this is if the overlay is on verity verity = self.xml_state.build_type.get_verity_blocks() luks = self.xml_state.get_luks_credentials() if luks is not None: return 'root=overlay:MAPPER=luks' elif verity: return 'root=overlay:MAPPER=verityroot' else: root_location = self._get_location( boot_device, 'by-partuuid' ) return 'root=overlay:{0}={1}'.format( root_location['type'], root_location['name'] ) else: root_location = self._get_location(boot_device) return 'root={0}={1}'.format( root_location['type'], root_location['name'] ) else: log.warning('No explicit root= cmdline provided') return None def _get_root_overlay_cmdline_parameter( self, boot_device: Optional[str], write_device: Optional[str] ) -> str: """ rd.root.overlay.write= argument passed to the kernel :param string boot_device: boot device node. If no extra boot device exists then boot device equals root device. In case of an overlay setup the boot device equals the readonly root device :param string write_device: overlay write device """ root_overlay_parameter = '' cmdline = self.xml_state.build_type.get_kernelcmdline() if self.xml_state.build_type.get_overlayroot(): if cmdline and 'rd.root.overlay.write=' in cmdline: log.warning( 'Overlay write device explicitly set via kernelcmdline' ) elif write_device and write_device != boot_device: write_location = self._get_location(write_device) root_overlay_parameter = 'rd.root.overlay.write={0}'.format( write_location['node'] ) return root_overlay_parameter def _get_location( self, device: str, persistency_type: str = '' ) -> Dict[str, str]: if not persistency_type: persistency_type = self.xml_state.build_type.get_devicepersistency() block_operation = BlockID(device) if persistency_type == 'by-label': blkid_type = 'LABEL' elif persistency_type == 'by-partuuid': blkid_type = 'PARTUUID' else: persistency_type = 'by-uuid' blkid_type = 'UUID' location = block_operation.get_blkid(blkid_type) return { 'type': blkid_type, 'name': location, 'node': f'/dev/disk/{persistency_type}/{location}', } def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: self._umount_system() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7417269 kiwi-11.1.8/kiwi/bootloader/config/bootloader_spec_base.py0000644000000000000000000002336415273675667020605 0ustar00# Copyright (c) 2022 Marcus Schäfer # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import glob from typing import Dict, NamedTuple, Optional # project from kiwi.firmware import FirmWare from kiwi.bootloader.config.base import BootLoaderConfigBase from kiwi.system.identifier import SystemIdentifier from kiwi.defaults import Defaults from kiwi.utils.os_release import OsRelease from kiwi.system.kernel import Kernel target_type = NamedTuple( 'target_type', [('disk', str), ('install', str), ('live', str)] ) class BootLoaderSpecBase(BootLoaderConfigBase): """ **Base class for Boot Loader Specification** This base class follows the bootloader specifications as described in: * https://uapi-group.org/specifications/specs/boot_loader_specification All supported bootloaders which follows this specification are derived from this base class :param object xml_state: instance of :class:`XMLState` :param str root_dir: root directory path name :param str boot_dir: boot directory path name :param dict custom_args: custom bootloader configuration parameters """ def post_init(self, custom_args: Dict = {}) -> None: """ Post init for all bootloader spec loaders Store custom arguments in an instance dict and initialize target identifiers """ self.entries_dir = Defaults.get_bls_loader_entries_dir() self.target = target_type( disk='disk', install='install(iso)', live='live(iso)' ) self.custom_args = custom_args self.timeout = self.get_boot_timeout_seconds() self.disk_type = self.xml_state.get_build_type_bootloader_targettype() self.disk_blocksize = self.xml_state.build_type.get_target_blocksize() self.firmware = FirmWare(self.xml_state) self.cmdline = '' def write(self) -> None: """ For bootloaders following the bootloader spec no collective write will happen """ pass def setup_sysconfig_bootloader(self) -> None: """ For bootloaders following the bootloader spec no setting to sysconfig/bootloader will be made """ pass def write_meta_data( self, root_device: Optional[str] = None, write_device: Optional[str] = None, boot_options: str = '', ) -> None: """ For bootloaders following the bootloader spec take over the cmdline options and store them for later use :param string root_device: unused :param string write_device: unused :param string boot_options: kernel options as string """ self.cmdline = f'{self.cmdline} {boot_options}'.strip() def setup_disk_image_config( self, boot_uuid: Optional[str] = '', root_uuid: Optional[str] = '', hypervisor: Optional[str] = '', kernel: Optional[str] = '', initrd: Optional[str] = '', boot_options: Dict = {}, ) -> None: """ Create boot config file to boot from disk :param str boot_uuid: boot device UUID :param str root_uuid: root device UUID :param str hypervisor: unused :param str kernel: kernel name :param str initrd: initrd name :param dict boot_options: custom options dictionary required to setup the bootloader. Targeted to bootloader spec interface """ self.custom_args['boot_uuid'] = boot_uuid self.custom_args['root_uuid'] = root_uuid self.custom_args['kernel'] = kernel self.custom_args['initrd'] = initrd self.custom_args['boot_options'] = boot_options plus_cmdline = ' '.join( [ self.get_boot_cmdline( boot_options.get('root_device'), boot_options.get('write_device'), ) ] ) self.cmdline = f'{self.cmdline} {plus_cmdline}'.strip() self.setup_loader(self.target.disk) def setup_install_image_config( self, mbrid: SystemIdentifier, hypervisor: str = '', kernel: str = '', initrd: str = '', ) -> None: """ Create boot config file to boot install ISO image :param str mbrid: mbrid file name on boot device :param str hypervisor: unused :param str kernel: kernel name :param str initrd: initrd name Targeted to bootloader spec interface """ pass def setup_live_image_config( self, mbrid: SystemIdentifier, hypervisor: str = '', kernel: str = '', initrd: str = '', ) -> None: """ Create boot config file to boot live ISO image :param str mbrid: mbrid file name on boot device :param str hypervisor: unused :param str kernel: kernel name :param str initrd: initrd name Targeted to bootloader spec interface """ pass def setup_disk_boot_images( self, boot_uuid: str, efi_uuid: Optional[str] = '', lookup_path: Optional[str] = '', ) -> None: """ Create bootloader image(s) for disk boot :param string boot_uuid: unused :param string efi_uuid: unused :param str lookup_path: unused Targeted to bootloader spec interface """ self.create_loader_image(self.target.disk) def setup_install_boot_images( self, mbrid: SystemIdentifier, lookup_path: Optional[str] = '' ) -> None: """ Create bootloader image(s) for install ISO boot :param string mbrid: unused :param str lookup_path: unused Targeted to bootloader spec interface """ self.create_loader_image(self.target.install) def setup_live_boot_images( self, mbrid: SystemIdentifier, lookup_path: Optional[str] = '' ) -> None: """ Create bootloader image(s) for live ISO boot :param string mbrid: unused :param str lookup_path: unused Targeted to bootloader spec interface """ self.create_loader_image(self.target.live) def create_loader_image(self, target: str) -> None: """ Create on demand bootloader image(s) For bootloaders following the bootloader spec we expect that the creation of a custom boot image is not needed. However, if needed this entry point exists :param str target: target identifier, one of disk, live(iso) or install(iso) Implementation in specialized loader class """ raise NotImplementedError def setup_loader(self, target: str) -> None: """ Setup main bootloader configuration boot/loader.conf :param str target: target identifier, one of disk, live(iso) or install(iso) Implementation in specialized loader class """ raise NotImplementedError def set_loader_entry(self, root_dir: str, target: str) -> None: """ Setup bootloader menu entry boot/loader/entries/X.conf :param str root_dir: path to root directory tree :param str target: target identifier, one of disk, live(iso) or install(iso) Implementation in specialized loader class """ raise NotImplementedError def get_entry_name(self, flavor: str = '') -> str: """ Construct entry filename of the form [OS_release_ID]-[kernel-version].conf or use the naming policy of an existing entries file The entry belongs to the kernel of the latest version, the one kiwi creates the initrd for, optionally of the given kernel flavor only, see Kernel.get_kernel(). An entry file produced by the distribution logic/policy is preferred over the kiwi naming policy: the entry of that kernel if there is one, otherwise the name of the entry of another installed kernel with the version replaced. An entry name without a kernel version is used as it is if no entry refers to a kernel :param str flavor: kernel flavor name :return: file basename :rtype: str """ os_release = OsRelease(self.root_dir) kernel = Kernel(self.root_dir) kernel_info = kernel.get_kernel(raise_on_not_found=True, flavor=flavor) kernel_name = kernel_info.version if kernel_info else '' entry_filename = f'{os_release.get("ID")}-{kernel_name}.conf' other_kernel_entry = '' versionless_entry = '' for dist_entry in sorted( glob.iglob(f'{self.root_dir}/{self.entries_dir}/*') ): dist_entry_name = os.path.basename(dist_entry) version = kernel.get_version_in_name(dist_entry_name) if version == kernel_name: return dist_entry_name if version and not other_kernel_entry: other_kernel_entry = dist_entry_name.replace( version, kernel_name ) if not version and not versionless_entry: versionless_entry = dist_entry_name return other_kernel_entry or versionless_entry or entry_filename ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7417269 kiwi-11.1.8/kiwi/bootloader/config/custom.py0000644000000000000000000000454215273675667015756 0ustar00# Copyright (c) 2024 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Dict, Optional # project from kiwi.system.identifier import SystemIdentifier from kiwi.bootloader.config.base import BootLoaderConfigBase class BootLoaderConfigCustom(BootLoaderConfigBase): """ **custom bootloader configuration.** """ def setup_disk_boot_images( self, boot_uuid: str, efi_uuid: Optional[str] = None, lookup_path: Optional[str] = None, ) -> None: raise NotImplementedError def setup_disk_image_config( self, boot_uuid: Optional[str] = '', root_uuid: Optional[str] = '', hypervisor: Optional[str] = '', kernel: Optional[str] = '', initrd: Optional[str] = '', boot_options: Dict = {}, ) -> None: raise NotImplementedError def setup_install_boot_images( self, mbrid: SystemIdentifier, lookup_path: Optional[str] = '' ) -> None: raise NotImplementedError def setup_install_image_config( self, mbrid: SystemIdentifier, hypervisor: str = '', kernel: str = '', initrd: str = '', ) -> None: raise NotImplementedError def setup_live_boot_images( self, mbrid: SystemIdentifier, lookup_path: Optional[str] = '' ) -> None: raise NotImplementedError def setup_live_image_config( self, mbrid: SystemIdentifier, hypervisor: str = '', kernel: str = '', initrd: str = '', ) -> None: raise NotImplementedError def setup_sysconfig_bootloader(self) -> None: raise NotImplementedError def write(self) -> None: raise NotImplementedError ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7417269 kiwi-11.1.8/kiwi/bootloader/config/grub2.py0000644000000000000000000023562715273675667015477 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from string import Template from textwrap import dedent import re import sys import os import logging import glob import shutil from collections import OrderedDict from typing import Dict, List, Optional, Union # project from kiwi.xml_state import HostKeyCertificateT from kiwi.bootloader.config.base import BootLoaderConfigBase from kiwi.bootloader.template.grub2 import BootLoaderTemplateGrub2 from kiwi.command import Command from kiwi.defaults import Defaults from kiwi.exceptions import KiwiFileNotFound from kiwi.firmware import FirmWare from kiwi.path import Path from kiwi.system.identifier import SystemIdentifier from kiwi.system.kernel import Kernel from kiwi.utils.sparse import SparseFile from kiwi.utils.sync import DataSync from kiwi.utils.sysconfig import SysConfig from kiwi.utils.temporary import Temporary from kiwi.exceptions import ( KiwiTemplateError, KiwiBootLoaderGrubPlatformError, KiwiBootLoaderGrubModulesError, KiwiBootLoaderGrubSecureBootError, KiwiBootLoaderGrubFontError, KiwiBootLoaderGrubMenuEntryError, KiwiDiskGeometryError, KiwiCommandNotFound, ) import kiwi.defaults as defaults log = logging.getLogger('kiwi') def func_name() -> str: """ helper method to return name of caller """ return sys._getframe(1).f_code.co_name class BootLoaderConfigGrub2(BootLoaderConfigBase): """ **grub2 bootloader configuration.** """ def post_init(self, custom_args: Dict) -> None: """ grub2 post initialization method :param dict custom_args: Contains grub config arguments .. code:: python {'grub_directory_name': 'grub|grub2'} """ self.host_key_certificates: List[HostKeyCertificateT] = ( self.xml_state.get_host_key_certificates() ) self.efi_csm = ( True if self.xml_state.build_type.get_eficsm() is None else self.xml_state.build_type.get_eficsm() ) self.custom_args = custom_args self.config_options: List[str] = [] arch = Defaults.get_platform_name() if arch == 'x86_64': # grub2 support for bios and efi systems self.arch = arch elif arch == 'loongarch64': # grub2 support for efi systems self.arch = arch elif arch.startswith('ppc64'): # grub2 support for ofw and opal systems self.arch = arch elif arch == 'ix86': # grub2 support for bios systems self.arch = arch elif arch == 'aarch64' or arch.startswith('arm'): # grub2 support for efi systems self.arch = arch elif arch.startswith('s390'): # grub2 support for s390x systems self.arch = arch elif arch == 'riscv64': # grub2 support for efi systems self.arch = arch else: raise KiwiBootLoaderGrubPlatformError( f'host architecture {arch} not supported for grub2 setup' ) if self.custom_args and 'grub_directory_name' in self.custom_args: self.boot_directory_name = self.custom_args['grub_directory_name'] else: self.boot_directory_name = 'grub' if self.custom_args and 'grub_load_command' in self.custom_args: self.grub_load = self.custom_args['grub_load_command'] else: self.grub_load = 'source' if self.custom_args and 'config_options' in self.custom_args: self.config_options = self.custom_args['config_options'] self.terminal_output = ( self.xml_state.get_build_type_bootloader_console()[0] or 'console' ) self.terminal_input = ( self.xml_state.get_build_type_bootloader_console()[1] or 'console' ) self.gfxmode = self.xml_state.get_build_type_bootloader_video_mode() self.theme = self.get_boot_theme() self.timeout = self.get_boot_timeout_seconds() self.bootpartition = self.xml_state.build_type.get_bootpartition() self.timeout_style = ( self.xml_state.get_build_type_bootloader_timeout_style() ) self.displayname = self.xml_state.xml_data.get_displayname() self.bls = self.xml_state.get_build_type_bootloader_bls() self.serial_line_setup = ( self.xml_state.get_build_type_bootloader_serial_line_setup() ) self.continue_on_timeout = self.get_continue_on_timeout() self.failsafe_boot = self.failsafe_boot_entry_requested() self.mediacheck_boot = self.xml_state.build_type.get_mediacheck() self.xen_guest = self.xml_state.is_xen_guest() self.persistency_type = ( self.xml_state.build_type.get_devicepersistency() ) self.firmware = FirmWare(self.xml_state) self.target_table_type = self.firmware.get_partition_table_type() self.live_type = self.xml_state.build_type.get_flags() if not self.live_type: self.live_type = Defaults.get_default_live_iso_type() self.volume_id = ( self.xml_state.build_type.get_volid() or Defaults.get_volume_id() ) self.install_volid = ( self.xml_state.build_type.get_volid() or Defaults.get_install_volume_id() ) self.use_disk_password = ( self.xml_state.get_build_type_bootloader_use_disk_password() ) self.live_boot_options = [ 'root=live:CDLABEL={0}'.format(self.volume_id), 'rd.live.image', ] self.install_boot_options = ['loglevel=0'] if self.xml_state.get_initrd_system() == 'dracut': self.install_boot_options.append( 'root=install:CDLABEL={0}'.format(self.install_volid) ) if self.xml_state.build_type.get_hybridpersistent(): self.live_boot_options += ( Defaults.get_live_iso_persistent_boot_options( self.xml_state.build_type.get_hybridpersistent_filesystem() ) ) if self.xml_state.is_xen_server(): self.multiboot = True elif self.xen_guest: self.multiboot = False else: self.multiboot = False self.grub2 = BootLoaderTemplateGrub2() self.config: Optional[str] = None self.efi_boot_path: Optional[str] = None self.cmdline_failsafe: Optional[str] = None self.root_reference: Optional[str] = None self.cmdline: Optional[str] = None self.iso_boot = False self.early_boot_script_efi: Optional[str] = None def write(self) -> None: """ Write bootloader configuration * writes grub.cfg template by KIWI if template system is used * creates an embedded fat efi image for EFI ISO boot """ if self.config: log.info('Writing KIWI template grub.cfg file') config_dir = self._get_grub2_boot_path() config_file = config_dir + '/grub.cfg' Path.create(config_dir) with open(config_file, 'w') as config: config.write(self.config) def setup_sysconfig_bootloader(self) -> None: raise NotImplementedError def write_meta_data( self, root_device: Optional[str] = None, write_device: Optional[str] = None, boot_options: str = '', ) -> None: """ Write bootloader setup meta data files * cmdline arguments initialization * etc/default/grub setup file * etc/default/zipl2grub.conf.in (s390 only) * etc/sysconfig/bootloader :param string root_device: root device node :param string write_device: overlay root write device node :param string boot_options: kernel options as string :param bool iso_boot: indicate target is an ISO """ self.cmdline = ' '.join( [self.get_boot_cmdline(root_device, write_device), boot_options] ) self.cmdline_failsafe = ' '.join( [self.cmdline, Defaults.get_failsafe_kernel_options(), boot_options] ) self.root_reference = self._get_root_cmdline_parameter(root_device) self._setup_default_grub() if self.arch.startswith('s390'): self._setup_zipl2grub_conf() def setup_disk_image_config( self, boot_uuid: Optional[str] = None, root_uuid: Optional[str] = None, hypervisor: Optional[str] = None, kernel: Optional[str] = None, initrd: Optional[str] = None, boot_options: Dict = {}, ) -> None: """ Create grub2 config file to boot from disk using grub2-mkconfig :param string boot_uuid: unused :param string root_uuid: unused :param string hypervisor: unused :param string kernel: unused :param string initrd: unused :param dict boot_options: options dictionary that has to contain the root and boot device and optional volume configuration. KIWI has to mount the system prior to run grub2-mkconfig. .. code:: python { 'root_device': string, 'boot_device': string, 'efi_device': string, 'system_volumes': volume_manager_instance.get_volumes(), 'system_root_volume': volume_manager_instance.get_root_volume_name(), 'system_partitions': xml_state.get_partitions() } """ self._mount_system( boot_options.get('device_map'), boot_options['root_device'], boot_options['boot_device'], boot_options.get('efi_device'), boot_options.get('system_volumes'), boot_options.get('system_root_volume'), boot_options.get('system_partitions'), ) assert self.root_mount is not None config_file = os.sep.join( [ self.root_mount.mountpoint, 'boot', self.boot_directory_name, 'grub.cfg', ] ) # Setup/Update loader environment self._setup_loader_variables( self.xml_state.get_build_type_bootloader_environment_variables() ) # Disable os-prober, it takes information from the host it # runs on which is not necessarily matching with the image os.environ.update({'GRUB_DISABLE_OS_PROBER': 'true'}) Command.run( [ 'chroot', self.root_mount.mountpoint, os.path.basename(self._get_grub2_mkconfig_tool()), '-o', config_file.replace(self.root_mount.mountpoint, ''), ], os.environ, ) if boot_options.get('root_device') != boot_options.get('boot_device'): # Create a boot -> . link on the boot partition. # The link is useful if the grub mkconfig command # references all boot files from /boot/... even if # an extra boot partition should cause it to read the # data from the toplevel bash_command = [ 'cd', os.sep.join([self.root_mount.mountpoint, 'boot']), '&&', 'rm', '-f', 'boot', '&&', 'ln', '-s', '.', 'boot', ] # not every filesystem supports symlinks, and the link is optional # therefore don't fail in case the link cannot be created Command.run( ['bash', '-c', ' '.join(bash_command)], raise_on_error=False ) # Create UKI image if requested dracut_setup = self.xml_state.get_dracut_config('setup') if dracut_setup.uefi: boot_image = boot_options.get('boot_image') if boot_image: efi_uki_path = ( f'{self.root_mount.mountpoint}/boot/efi/EFI/Linux/' ) Path.create(efi_uki_path) uki_image = boot_image.create_uki(self.cmdline) Command.run(['mv', uki_image, efi_uki_path]) # Patch the written grub config file to actually work: # Unfortunately the grub tooling has several bugs and issues # which prevents it to work in image build environments. # More details can be found in the individual methods. # One fine day the following fix methods can hopefully # be deleted... self._fix_grub_root_device_reference(config_file, boot_options) self._fix_grub_loader_entries_boot_cmdline() self._fix_grub_loader_entries_linux_and_initrd_paths() # Select the menu entry of the first kernel flavor as default self._setup_kernel_flavor_default_entry(config_file) if self.firmware.efi_mode() and self.early_boot_script_efi: # in EFI mode the ESP is mounted by _mount_system() assert self.efi_mount is not None self._copy_grub_config_to_efi_path( self.efi_mount.mountpoint, self.early_boot_script_efi ) self._umount_system() def setup_install_image_config( self, mbrid: SystemIdentifier, hypervisor: str = 'xen.gz', kernel: str = 'linux', initrd: str = 'initrd', ) -> None: """ Create grub2 config file to boot from an ISO install image :param string mbrid: mbrid file name on boot device :param string hypervisor: hypervisor name :param string kernel: kernel name :param string initrd: initrd name """ log.info('Creating grub2 install config file from template') self.iso_boot = True has_graphics = False has_serial = False if 'gfxterm' in self.terminal_output: has_graphics = True if 'serial' in self.terminal_output or 'serial' in self.terminal_input: has_serial = True assert self.cmdline is not None assert self.cmdline_failsafe is not None # the identifier is calculated by the image builder mbrid_id = mbrid.get_id() assert mbrid_id is not None parameters = { 'search_params': '--file --set=root /boot/' + mbrid_id, 'default_boot': self.get_install_image_boot_default(), 'kernel_file': kernel, 'initrd_file': initrd, 'boot_options': ' '.join( [self.cmdline] + self.install_boot_options ), 'failsafe_boot_options': ' '.join( [self.cmdline_failsafe] + self.install_boot_options ), 'gfxmode': self.gfxmode, 'theme': self.theme, 'boot_timeout': self.timeout, 'boot_timeout_style': self.timeout_style or 'menu', 'serial_line_setup': self.serial_line_setup or '', 'bootpath': self.get_boot_path('iso'), 'boot_directory_name': self.boot_directory_name, 'efi_image_name': Defaults.get_efi_image_name(self.arch), 'terminal_input': self.terminal_input, 'terminal_output': self.terminal_output, } parameters.update( self._get_kernel_flavor_parameters( self.get_menu_entry_install_title(), kernel, initrd ) ) kernel_count = len(self.get_kernel_flavors()) custom_template_path = self._get_custom_template() if custom_template_path: log.info('--> Using custom boot template') with open(custom_template_path) as custom_template_file: template = Template(custom_template_file.read()) elif self.multiboot: log.info('--> Using multiboot install template') parameters['hypervisor'] = hypervisor template = self.grub2.get_multiboot_install_template( self.failsafe_boot, has_graphics, has_serial, self.continue_on_timeout, self._has_btrfs_relative_path(), kernel_count=kernel_count, ) else: log.info('--> Using standard boot install template') template = self.grub2.get_install_template( self.failsafe_boot, has_graphics, has_serial, self.continue_on_timeout, self._has_btrfs_relative_path(), kernel_count=kernel_count, ) try: self.config = template.substitute(parameters) except Exception as e: raise KiwiTemplateError(f'{type(e).__name__}: {format(e)}') if self.firmware.efi_mode() and self.early_boot_script_efi: self._copy_grub_config_to_efi_path( self.boot_dir, self.early_boot_script_efi, 'iso' ) def setup_live_image_config( self, mbrid: SystemIdentifier, hypervisor: str = 'xen.gz', kernel: str = 'linux', initrd: str = 'initrd', ) -> None: """ Create grub2 config file to boot a live media ISO image :param string mbrid: mbrid file name on boot device :param string hypervisor: hypervisor name :param string kernel: kernel name :param string initrd: initrd name """ log.info('Creating grub2 live ISO config file from template') self.iso_boot = True has_graphics = False has_serial = False if 'gfxterm' in self.terminal_output: has_graphics = True if 'serial' in self.terminal_output or 'serial' in self.terminal_input: has_serial = True assert self.cmdline is not None assert self.cmdline_failsafe is not None # the identifier is calculated by the image builder mbrid_id = mbrid.get_id() assert mbrid_id is not None parameters = { 'search_params': '--file --set=root /boot/' + mbrid_id, 'default_boot': '0', 'kernel_file': kernel, 'initrd_file': initrd, 'boot_options': ' '.join([self.cmdline] + self.live_boot_options), 'failsafe_boot_options': ' '.join( [self.cmdline_failsafe] + self.live_boot_options ), 'gfxmode': self.gfxmode, 'theme': self.theme, 'boot_timeout': self.timeout, 'boot_timeout_style': self.timeout_style or 'menu', 'serial_line_setup': self.serial_line_setup or '', 'bootpath': self.get_boot_path('iso'), 'boot_directory_name': self.boot_directory_name, 'efi_image_name': Defaults.get_efi_image_name(self.arch), 'terminal_input': self.terminal_input, 'terminal_output': self.terminal_output, } parameters.update( self._get_kernel_flavor_parameters( self.get_menu_entry_title(plain=True), kernel, initrd ) ) kernel_count = len(self.get_kernel_flavors()) custom_template_path = self._get_custom_template() if custom_template_path: log.info('--> Using custom boot template') with open(custom_template_path) as custom_template_file: template = Template(custom_template_file.read()) elif self.multiboot: log.info('--> Using multiboot template') parameters['hypervisor'] = hypervisor template = self.grub2.get_multiboot_iso_template( self.failsafe_boot, has_graphics, has_serial, self.mediacheck_boot, self._has_btrfs_relative_path(), kernel_count=kernel_count, ) else: log.info('--> Using standard boot template') template = self.grub2.get_iso_template( self.failsafe_boot, has_graphics, has_serial, self.mediacheck_boot, self._has_btrfs_relative_path(), kernel_count=kernel_count, ) try: self.config = template.substitute(parameters) except Exception as e: raise KiwiTemplateError(f'{type(e).__name__}: {format(e)}') if self.firmware.efi_mode() and self.early_boot_script_efi: self._copy_grub_config_to_efi_path( self.boot_dir, self.early_boot_script_efi, 'iso' ) def _get_kernel_flavor_parameters( self, title: str, kernel: str, initrd: str ) -> Dict[str, str]: """ Template parameters of the boot menu entry of the kernel of each kernel flavor, see get_kernel_flavors() The parameters of the first flavor are title, kernel_file and initrd_file, those of each further flavor have the index of the flavor appended, see BootLoaderTemplateGrub2. The file names of a flavor are provided by Defaults.get_iso_kernel_flavor_file_name() :param str title: menu entry title :param str kernel: kernel file name :param str initrd: initrd file name :return: template parameters :rtype: dict """ parameters = {} for index, flavor in enumerate(self.get_kernel_flavors()): suffix = f'_{index}' if index else '' parameters[f'title{suffix}'] = self.get_kernel_flavor_title( title, flavor ) parameters[f'kernel_file{suffix}'] = ( Defaults.get_iso_kernel_flavor_file_name(kernel, index, flavor) ) parameters[f'initrd_file{suffix}'] = ( Defaults.get_iso_kernel_flavor_file_name(initrd, index, flavor) ) return parameters def setup_install_boot_images( self, mbrid: SystemIdentifier, lookup_path: Optional[str] = None ) -> None: """ Create/Provide grub2 boot images and metadata In order to boot from the ISO grub2 modules, images and theme data needs to be created and provided at the correct place on the iso filesystem :param string mbrid: mbrid file name on boot device :param string lookup_path: custom module lookup path """ log.info('Creating grub2 bootloader images') if self.firmware.efi_mode(): self.efi_boot_path = self.create_efi_path(in_sub_dir='') # the identifier is calculated by the image builder mbrid_id = mbrid.get_id() assert mbrid_id is not None log.info('--> Creating identifier file %s', mbrid_id) grub_boot_path = self._get_grub2_boot_path() Path.create(grub_boot_path) mbrid.write(self.boot_dir + '/boot/' + mbrid_id) mbrid.write(self.boot_dir + '/boot/mbrid') if self.theme: self._copy_theme_data_to_boot_directory(lookup_path, 'iso') if self._supports_platform_modules(): self._copy_bios_modules_to_boot_directory(lookup_path) self._setup_platform_image(mbrid=mbrid, lookup_path=lookup_path) if self.firmware.efi_mode(): self._setup_EFI_path(lookup_path) if self.firmware.efi_mode() == 'efi': self._setup_efi_image( mbrid=mbrid, lookup_path=lookup_path, target_type='iso' ) self._copy_efi_modules_to_boot_directory(lookup_path) elif self.firmware.efi_mode() == 'uefi': self._setup_secure_boot_efi_image( lookup_path=lookup_path, mbrid=mbrid, target_type='iso' ) log.info('--> Creating loopback config') loopback_file = os.path.normpath( os.sep.join([grub_boot_path, 'loopback.cfg']) ) self._create_loopback_config(loopback_file) def setup_live_boot_images( self, mbrid: SystemIdentifier, lookup_path: Optional[str] = None ) -> None: """ Create/Provide grub2 boot images and metadata Calls setup_install_boot_images because no different action required """ self.setup_install_boot_images(mbrid, lookup_path) def setup_disk_boot_images( self, boot_uuid: str, efi_uuid: Optional[str] = None, lookup_path: Optional[str] = None, ) -> None: """ Create/Provide grub2 boot images and metadata In order to boot from the disk grub2 modules, images and theme data needs to be created and provided at the correct place in the filesystem :param string boot_uuid: boot device UUID :param string lookup_path: custom module lookup path """ log.info('Creating grub2 bootloader images') if self.firmware.efi_mode(): self.efi_boot_path = self.create_efi_path() if self.theme: self._copy_theme_data_to_boot_directory(lookup_path, 'disk') if not self.xen_guest and self._supports_platform_modules(): self._copy_bios_modules_to_boot_directory(lookup_path) if self.firmware.efi_mode() == 'efi': self._setup_efi_image( uuid=boot_uuid, efi_uuid=efi_uuid, lookup_path=lookup_path ) self._copy_efi_modules_to_boot_directory(lookup_path) elif self.firmware.efi_mode() == 'uefi': if not self._get_shim_install(): self._setup_secure_boot_efi_image( lookup_path=lookup_path, uuid=boot_uuid, efi_uuid=efi_uuid ) if self.xen_guest: self._copy_xen_modules_to_boot_directory(lookup_path) def _copy_grub_config_to_efi_path( self, root_path: str, config_file: str, target_type: str = 'disk' ) -> None: efi_boot_paths = Defaults.get_shim_vendor_directories(root_path) if not efi_boot_paths: # not all distributors installs a vendor directory but # have them in their encoded early boot script. Thus # the following code tries to look up the vendor string # from the signed grub binary grub_images = Defaults.get_signed_grub_loader( self.root_dir, target_type ) for grub_image in grub_images: if grub_image and grub_image.filename: strings_abspath = Path.which('strings', access_mode=os.X_OK) if not strings_abspath: raise KiwiCommandNotFound( 'strings command not found on buildhost' ) bash_command = [ strings_abspath, grub_image.filename, '|', 'grep', r'EFI\/', ] vendor_paths = Command.run( ['bash', '-c', ' '.join(bash_command)], raise_on_error=False, raise_on_command_not_found=True, ) if vendor_paths and vendor_paths.output: for path in vendor_paths.output.strip().split( os.linesep ): efi_boot_paths.append( os.path.normpath( os.sep.join([root_path, path.strip()]) ) ) if not efi_boot_paths: efi_boot_paths = [ os.path.normpath(os.sep.join([root_path, 'EFI/BOOT'])) ] for efi_boot_path in efi_boot_paths: Path.create(efi_boot_path) grub_config_file_for_efi_boot = os.sep.join( [efi_boot_path, 'grub.cfg'] ) if config_file != grub_config_file_for_efi_boot: log.info( 'Copying {0} -> {1} to be found by EFI'.format( config_file, grub_config_file_for_efi_boot ) ) shutil.copy2(config_file, grub_config_file_for_efi_boot) def _supports_platform_modules(self) -> bool: if self.efi_csm and ( self.arch == 'ix86' or self.arch == 'x86_64' or Defaults.is_ppc64_arch(self.arch) ): return True return False def _setup_zipl2grub_conf(self) -> None: zipl2grub_config_file = ''.join( [self.root_dir, '/etc/default/zipl2grub.conf.in'] ) zipl2grub_config_file_orig = ''.join( [self.root_dir, '/etc/default/zipl2grub.conf.in.orig'] ) target_type = self.xml_state.get_build_type_bootloader_targettype() target_blocksize = self.xml_state.build_type.get_target_blocksize() if target_type and os.path.exists(zipl2grub_config_file): if os.path.exists(zipl2grub_config_file_orig): # reset the original template file first shutil.copy2(zipl2grub_config_file_orig, zipl2grub_config_file) else: # no copy of the original template, create it shutil.copy2(zipl2grub_config_file, zipl2grub_config_file_orig) with open(zipl2grub_config_file) as zipl_config_file: zipl_config = zipl_config_file.read() zipl_config = re.sub( r'(:menu)', ':menu\n' ' targettype = {0}\n' ' targetbase = {1}\n' ' targetblocksize = {2}\n' ' targetoffset = {3}\n' ' {4}'.format( target_type if target_type != 'GPT' else 'SCSI', self.custom_args['targetbase'], target_blocksize or 512, self._get_partition_start( self.custom_args['targetbase'] ), self._get_disk_geometry(self.custom_args['targetbase']), ), zipl_config, ) log.debug('Updated zipl template as follows') with open(zipl2grub_config_file, 'w') as zipl_config_file: log.debug(zipl_config) zipl_config_file.write(zipl_config) def _setup_default_grub(self) -> None: """ Create or update etc/default/grub by parameters required according to the root filesystem setup * GRUB_DEFAULT * GRUB_TIMEOUT * GRUB_TIMEOUT_STYLE * SUSE_BTRFS_SNAPSHOT_BOOTING * SUSE_REMOVE_LINUX_ROOT_PARAM * GRUB_BACKGROUND * GRUB_THEME * GRUB_SERIAL_COMMAND * GRUB_CMDLINE_LINUX * GRUB_CMDLINE_LINUX_DEFAULT * GRUB_GFXMODE * GRUB_TERMINAL_INPUT * GRUB_TERMINAL_OUTPUT * GRUB_DISTRIBUTOR * GRUB_DISABLE_LINUX_UUID * GRUB_DISABLE_LINUX_PARTUUID * GRUB_ENABLE_LINUX_LABEL """ assert self.cmdline is not None # elements to set only if not already in etc/default/grub grub_default_if_not_set_entries = {'GRUB_DEFAULT': 'saved'} # elements to set in any case grub_default_entries: Dict[str, Union[str, int]] = { 'GRUB_TIMEOUT': self.timeout, 'GRUB_GFXMODE': self.gfxmode, } if self.terminal_input: grub_default_entries['GRUB_TERMINAL_INPUT'] = '"{0}"'.format( self.terminal_input ) if self.terminal_output: grub_default_entries['GRUB_TERMINAL_OUTPUT'] = '"{0}"'.format( self.terminal_output ) grub_final_cmdline = re.sub( r'(^root=[^\s]+)|( root=[^\s]+)', '', self.cmdline ).strip() if self.persistency_type == 'by-label': label = re.search(r'(^root=[^\s]+)|( root=[^\s]+)', self.cmdline) if label: for match in label.groups(): if match and 'LABEL' in match: grub_default_entries['GRUB_CMDLINE_LINUX'] = ( '"{0}"'.format(match.strip()) ) grub_default_entries['SUSE_REMOVE_LINUX_ROOT_PARAM'] = ( 'true' ) grub_default_entries['GRUB_ENABLE_LINUX_LABEL'] = 'true' grub_default_entries['GRUB_DISABLE_LINUX_UUID'] = 'true' elif self.persistency_type == 'by-partuuid': grub_default_entries['GRUB_DISABLE_LINUX_UUID'] = 'true' grub_default_entries['GRUB_DISABLE_LINUX_PARTUUID'] = 'false' if self.displayname: grub_default_entries['GRUB_DISTRIBUTOR'] = '"{0}"'.format( self.displayname ) if self.timeout_style: grub_default_entries['GRUB_TIMEOUT_STYLE'] = self.timeout_style if grub_final_cmdline: grub_default_entries['GRUB_CMDLINE_LINUX_DEFAULT'] = '"{0}"'.format( grub_final_cmdline ) if self.serial_line_setup and ( 'serial' in self.terminal_input or 'serial' in self.terminal_output ): grub_default_entries['GRUB_SERIAL_COMMAND'] = '"{0}"'.format( self.serial_line_setup ) if self.theme: theme_setup = '{0}/{1}/theme.txt' grub_default_entries['GRUB_THEME'] = theme_setup.format( ''.join(['/boot/', self.boot_directory_name, '/themes']), self.theme, ) theme_background = '{0}/{1}/background.png'.format( ''.join(['/boot/', self.boot_directory_name, '/themes']), self.theme, ) if os.path.exists(os.sep.join([self.root_dir, theme_background])): grub_default_entries['GRUB_BACKGROUND'] = theme_background if self.xml_state.build_type.get_btrfs_root_is_snapper_snapshot(): grub_default_entries['SUSE_BTRFS_SNAPSHOT_BOOTING'] = 'true' if self.custom_args.get('crypto_disk'): grub_default_entries['GRUB_ENABLE_CRYPTODISK'] = 'y' enable_blscfg_implemented = Command.run( [ 'grep', '-q', 'GRUB_ENABLE_BLSCFG', self._get_grub2_mkconfig_tool(), ], raise_on_error=False, ) if self.bls and enable_blscfg_implemented.returncode == 0: grub_default_entries['GRUB_ENABLE_BLSCFG'] = 'true' if self.arch.startswith('s390') and self.host_key_certificates: # At the moment no generic enabler for secure execution # on s390 exists in grub upstream. Thus the following # variable setup is distribution specific: # Enable Secure Execution: SUSE specific variables host_key_list: List[str] = [] signing_key_list: List[str] = [] revocation_key_list: List[str] = [] grub_default_entries['SUSE_S390_SE_ENABLE'] = 'true' grub_default_entries['SUSE_S390_SE_CA_CERT'] = ( self.host_key_certificates[0]['hkd_ca_cert'] ) for host_key_certificate in self.host_key_certificates: signing_key_list.append(host_key_certificate['hkd_sign_cert']) host_key_list += host_key_certificate['hkd_cert'] if host_key_certificate.get('hkd_revocation_list'): revocation_key_list += host_key_certificate[ 'hkd_revocation_list' ] grub_default_entries['SUSE_S390_SE_HOST_KEY'] = ','.join( host_key_list ) grub_default_entries['SUSE_S390_SE_HOST_KEY_SIGNING_KEY'] = ( ','.join(signing_key_list) ) if revocation_key_list: grub_default_entries['SUSE_S390_SE_REVOCATION_LIST'] = ','.join( revocation_key_list ) if grub_default_entries: log.info('Writing grub2 defaults file') grub_default_location = ''.join([self.root_dir, '/etc/default/']) if os.path.exists(grub_default_location): grub_default_file = ''.join([grub_default_location, 'grub']) grub_default = SysConfig(grub_default_file) grub_default_entries_sorted = OrderedDict( sorted(grub_default_entries.items()) ) for key, value in list(grub_default_entries_sorted.items()): log.info('--> {0}:{1}'.format(key, value)) grub_default[key] = value grub_default_if_not_set_entries_sorted = OrderedDict( sorted(grub_default_if_not_set_entries.items()) ) for key, value in list( grub_default_if_not_set_entries_sorted.items() ): if not grub_default.get(key): log.info('--> {0}:{1}'.format(key, value)) grub_default[key] = value grub_default.write() def _setup_secure_boot_efi_image( self, lookup_path: Optional[str], uuid: Optional[str] = None, efi_uuid: Optional[str] = None, mbrid: Optional[SystemIdentifier] = None, target_type: str = 'disk', ) -> None: """ Provide the shim loader and the shim signed grub2 loader in the required boot path. Normally this task is done by the shim-install tool. However, shim-install does not exist on all distributions and the script does not operate well in e.g CD environments from which we generate live and/or install media. Thus shim-install is used if possible at install time of the bootloader because it requires access to the target block device. In any other case this setup code should act as the fallback solution """ log.warning('Running fallback setup for shim secure boot efi image') if not lookup_path: lookup_path = self.boot_dir grub_images = Defaults.get_signed_grub_loader(lookup_path, target_type) shim_images = Defaults.get_shim_loader(lookup_path) if not grub_images: raise KiwiBootLoaderGrubSecureBootError( 'Signed grub2 efi loader not found' ) assert self.efi_boot_path is not None # The shim concept is based on a two step system including a # grub image(shim) that got signed by Microsoft followed by # a grub image that got signed by the shim. The shim image # is the one that gets loaded by the firmware which itself # loads the second stage grub image for grub_image in grub_images: if grub_image.binaryname: if shim_images: target_grub_image_name = os.sep.join( [self.efi_boot_path, grub_image.binaryname] ) else: # Without shim a self signed grub image is used that # gets loaded by the firmware target_grub_image_name = os.sep.join( [self.efi_boot_path, grub_image.targetname] ) if not os.path.isfile(target_grub_image_name): log.info(f'--> Using grub image: {grub_image.filename}') Command.run( ['cp', grub_image.filename, target_grub_image_name] ) for shim_image in shim_images: if shim_image.filename: target_efi_image_name = os.sep.join( [self.efi_boot_path, shim_image.binaryname] ) if not os.path.isfile(target_efi_image_name): log.info(f'--> Using shim image: {shim_image.filename}') Command.run( ['cp', shim_image.filename, target_efi_image_name] ) # mok manager mok_managers = Defaults.get_mok_manager(lookup_path) if mok_managers and shim_images: for mok_manager in mok_managers: target_mok_manager = os.sep.join( [self.efi_boot_path, os.path.basename(mok_manager)] ) if not os.path.isfile(target_mok_manager): log.info(f'--> Using mok image: {mok_manager}') Command.run(['cp', mok_manager, self.efi_boot_path]) self._create_efi_config_search(uuid, efi_uuid, mbrid) def _setup_efi_image( self, uuid: Optional[str] = None, efi_uuid: Optional[str] = None, mbrid: Optional[SystemIdentifier] = None, lookup_path: Optional[str] = None, target_type: str = 'disk', ) -> None: """ Provide the unsigned grub2 efi image in the required boot path If a prebuilt efi image as provided by the distribution could be found, this image will be used. If no such image could be found we create a custom image with a pre defined set of grub modules """ if not lookup_path: lookup_path = self.boot_dir grub_images = Defaults.get_unsigned_grub_loader( lookup_path, target_type ) can_write = self.xml_state.build_type.get_overlayroot_write_partition() if grub_images and can_write is not False: assert self.efi_boot_path is not None for grub_image in grub_images: log.info(f'--> Using prebuilt unsigned efi image: {grub_image}') target_grub_image_name = os.sep.join( [self.efi_boot_path, grub_image.targetname] ) Command.run(['cp', grub_image.filename, target_grub_image_name]) self._create_efi_config_search(uuid, efi_uuid, mbrid) else: log.info('--> Creating unsigned efi image') self._create_efi_image(uuid, efi_uuid, mbrid, lookup_path) def _setup_chrp_config(self, mbrid: SystemIdentifier) -> None: early_boot_script = os.path.normpath( os.sep.join( [self._get_grub2_boot_path(), 'powerpc-ieee1275', 'grub.cfg'] ) ) self._create_early_boot_script_for_mbrid_search( early_boot_script, mbrid ) chrp_dir = os.path.normpath(os.sep.join([self.boot_dir, 'ppc'])) Path.create(chrp_dir) chrp_bootinfo_file = os.sep.join([chrp_dir, 'bootinfo.txt']) chrp_config = ( dedent( ''' {os_name} {os_name} boot &device;:1,\\boot\\grub2\\powerpc-ieee1275\\{chrp_loader} ''' ).strip() + os.linesep ) with open(chrp_bootinfo_file, 'w') as chrp_bootinfo: chrp_bootinfo.write( chrp_config.format( os_name=self.get_menu_entry_install_title(), chrp_loader=Defaults.get_grub_chrp_loader(self.boot_dir), ) ) def _setup_platform_image( self, mbrid: SystemIdentifier, lookup_path: Optional[str] = None ) -> None: """ Provide bios grub image """ if not lookup_path: lookup_path = self.boot_dir grub_image = Defaults.get_grub_platform_core_loader(lookup_path) if grub_image: log.info(f'--> Using prebuilt bios image: {grub_image}') else: log.info('--> Creating bios image') self._create_platform_image(mbrid, lookup_path) if Defaults.is_ppc64_arch(Defaults.get_platform_name()): self._setup_chrp_config(mbrid) return bash_command = ' '.join( [ 'cat', self._get_grub_platform_modules_path(lookup_path) + '/cdboot.img', grub_image or self._get_grub_platform_image_name(lookup_path), '>', os.sep.join( [ self._get_grub_platform_modules_path(lookup_path), Defaults.get_iso_grub_loader(), ] ), ] ) Command.run(['bash', '-c', bash_command]) def _create_embedded_fat_efi_image(self, path: str) -> None: """ Creates a EFI system partition image at the given path. Must be called after setup_install_boot_images and write. """ fat_image_mbsize = int( self.xml_state.build_type.get_efifatimagesize() or defaults.EFI_FAT_IMAGE_SIZE ) efi_folder = Temporary(prefix='efi_folder').new_dir() efi_data = DataSync(self.boot_dir + '/EFI/', efi_folder.name) efi_data.sync_data( options=Defaults.get_sync_options(), exclude=Defaults.get_exclude_list_from_custom_exclude_files_for_efifatimage( self.root_dir ), ) SparseFile.create(path, f'{fat_image_mbsize}M') Command.run(['mkdosfs', '-n', 'BOOT', path]) Command.run( ['mcopy', '-Do', '-s', '-i', path, efi_folder.name, '::EFI'] ) def _create_efi_image( self, uuid: Optional[str] = None, efi_uuid: Optional[str] = None, mbrid: Optional[SystemIdentifier] = None, lookup_path: Optional[str] = None, ) -> None: assert self.efi_boot_path is not None dracut_setup = self.xml_state.get_dracut_config('setup') early_boot_script = os.path.normpath( os.sep.join([self.efi_boot_path, 'earlyboot.cfg']) ) self.early_boot_script_efi = early_boot_script if dracut_setup.uefi and efi_uuid: self._create_early_boot_script_for_uki_chainload( early_boot_script, efi_uuid ) elif uuid: self._create_early_boot_script_for_uuid_search( early_boot_script, uuid ) else: self._create_early_boot_script_for_mbrid_search( early_boot_script, mbrid ) # EFI images are only created on architectures with EFI support efi_image_name = Defaults.get_efi_image_name(self.arch) efi_module_directory_name = Defaults.get_efi_module_directory_name( self.arch ) assert efi_image_name and efi_module_directory_name root_efi_path = '/boot/efi/EFI/BOOT/' root_efi_image = root_efi_path + efi_image_name Path.create(self.root_dir + root_efi_path) module_list = Defaults.get_grub_efi_modules(multiboot=self.xen_guest) module_path = self._get_efi_modules_path(self.root_dir) if os.path.exists(module_path + '/linuxefi.mod'): module_list.append('linuxefi') early_boot_script_on_media = ( self.root_dir + root_efi_path + 'earlyboot.cfg' ) if early_boot_script != early_boot_script_on_media: log.debug( f'Copy earlyboot to media path: {early_boot_script_on_media}' ) shutil.copy2(early_boot_script, early_boot_script_on_media) mkimage_call = Command.run( [ 'chroot', self.root_dir, os.path.basename(self._get_grub2_mkimage_tool()) or 'grub2-mkimage', '-O', efi_module_directory_name, '-o', root_efi_image, '-c', root_efi_path + 'earlyboot.cfg', '-p', os.path.join(self.get_boot_path(), self.boot_directory_name), '-d', module_path.replace(self.root_dir, ''), ] + module_list ) log.debug(mkimage_call.output) # Copy generated EFI image to the media directory if this # is different from the system root directory, e.g the case # for live image builds or when using a custom kiwi initrd efi_image_root_file = self.root_dir + root_efi_image efi_image_media_file = os.sep.join( [self.efi_boot_path, os.path.basename(efi_image_root_file)] ) if efi_image_root_file != efi_image_media_file: log.debug(f'Copy grub image to media path: {efi_image_media_file}') Path.create(os.path.dirname(efi_image_media_file)) shutil.copy2(efi_image_root_file, efi_image_media_file) def _create_efi_config_search( self, uuid: Optional[str] = None, efi_uuid: Optional[str] = None, mbrid: Optional[SystemIdentifier] = None, ) -> None: assert self.efi_boot_path is not None dracut_setup = self.xml_state.get_dracut_config('setup') efi_boot_config = self.efi_boot_path + '/grub.cfg' self.early_boot_script_efi = efi_boot_config if dracut_setup.uefi and efi_uuid: self._create_early_boot_script_for_uki_chainload( efi_boot_config, efi_uuid ) elif uuid: self._create_early_boot_script_for_uuid_search( efi_boot_config, uuid ) else: self._create_early_boot_script_for_mbrid_search( efi_boot_config, mbrid ) def _create_platform_image( self, mbrid: SystemIdentifier, lookup_path: Optional[str] = None ) -> None: early_boot_script = os.path.normpath( os.sep.join([self._get_grub2_boot_path(), 'earlyboot.cfg']) ) self._create_early_boot_script_for_mbrid_search( early_boot_script, mbrid ) early_boot_script_on_media = os.sep.join( [self.root_dir, 'boot', self.boot_directory_name, 'earlyboot.cfg'] ) if early_boot_script != early_boot_script_on_media: log.debug( f'Copy earlyboot to media path: {early_boot_script_on_media}' ) Path.create(os.path.dirname(early_boot_script_on_media)) shutil.copy2(early_boot_script, early_boot_script_on_media) mkimage_call = Command.run( [ 'chroot', self.root_dir, os.path.basename(self._get_grub2_mkimage_tool()) or 'grub2-mkimage', '-O', Defaults.get_grub_platform_module_directory_name(), '-o', self._get_grub_platform_image_name(self.root_dir).replace( self.root_dir, '' ), '-c', early_boot_script.replace(self.boot_dir, ''), '-p', os.sep.join([self.get_boot_path(), self.boot_directory_name]), '-d', self._get_grub_platform_modules_path(self.root_dir).replace( self.root_dir, '' ), ] + Defaults.get_grub_platform_modules(multiboot=self.xen_guest) ) log.debug(mkimage_call.output) # Copy generated EFI image to the media directory if this # is different from the system root directory, e.g the case # for live image builds or when using a custom kiwi initrd bios_image_root_file = self._get_grub_platform_image_name(self.root_dir) # without a lookup path the boot directory is used, the # same as for the lookup of the grub modules bios_image_media_file = bios_image_root_file.replace( self.root_dir, lookup_path or self.boot_dir ) if bios_image_root_file != bios_image_media_file: log.debug(f'Copy grub image to media path: {bios_image_media_file}') Path.create(os.path.dirname(bios_image_media_file)) shutil.copy2(bios_image_root_file, bios_image_media_file) def _create_early_boot_script_for_uki_chainload( self, filename: str, uuid: str ) -> None: with open(filename, 'w') as early_boot: early_boot.write( f'search --no-floppy --set=root --fs-uuid {uuid}{os.linesep}' ) early_boot.write( f'chainloader ($root)/EFI/Linux/kiwi.efi{os.linesep}' ) early_boot.write(f'boot{os.linesep}') def _create_early_boot_script_for_uuid_search( self, filename: str, uuid: str ) -> None: with open(filename, 'w') as early_boot: if self._has_btrfs_relative_path(): early_boot.write( 'set btrfs_relative_path="yes"{0}'.format(os.linesep) ) if self.custom_args.get('boot_is_crypto'): early_boot.write('insmod cryptodisk{0}'.format(os.linesep)) early_boot.write('insmod luks{0}'.format(os.linesep)) early_boot.write( 'cryptomount -u {0}{1}'.format( uuid.replace('-', ''), os.linesep ) ) early_boot.write( 'set root="cryptouuid/{0}"{1}'.format( uuid.replace('-', ''), os.linesep ) ) early_boot.write( 'search --fs-uuid --set=root {0}{1}'.format(uuid, os.linesep) ) early_boot.write( 'set prefix=($root){0}{1}'.format( os.path.join( self.get_boot_path(), self.boot_directory_name ), os.linesep, ) ) early_boot.write( '{0} ($root){1}/grub.cfg{2}'.format( self.grub_load, os.path.join( self.get_boot_path(), self.boot_directory_name ), os.linesep, ) ) def _create_early_boot_script_for_mbrid_search( self, filename: str, mbrid: Optional[SystemIdentifier] ) -> None: with open(filename, 'w') as early_boot: if self._has_btrfs_relative_path(): early_boot.write( 'set btrfs_relative_path="yes"{0}'.format(os.linesep) ) if mbrid: early_boot.write( f'search --file --set=root /boot/{mbrid.get_id()}{os.linesep}' ) else: # Fallback search for /boot/mbrid early_boot.write( f'search --file --set=root /boot/mbrid{os.linesep}' ) early_boot.write( 'set prefix=($root)/boot/{0}{1}'.format( self.boot_directory_name, os.linesep ) ) early_boot.write( '{0} ($root)/boot/{1}/grub.cfg{2}'.format( self.grub_load, self.boot_directory_name, os.linesep ) ) def _get_grub2_mkimage_tool(self) -> str: grub_mkimage_file_path = '' for grub_mkimage_tool in ['grub2-mkimage', 'grub-mkimage']: grub_mkimage_file_path = ( Path.which(grub_mkimage_tool, root_dir=self.root_dir) or '' ) if grub_mkimage_file_path: break return grub_mkimage_file_path def _get_grub2_mkconfig_tool(self) -> str: grub_mkconfig_file_path = '' for grub_mkconfig_tool in ['grub2-mkconfig', 'grub-mkconfig']: grub_mkconfig_file_path = ( Path.which(grub_mkconfig_tool, root_dir=self.root_dir) or '' ) if grub_mkconfig_file_path: break return grub_mkconfig_file_path def _get_grub2_boot_path(self) -> str: return self.boot_dir + '/boot/' + self.boot_directory_name def _get_grub_platform_image_name(self, lookup_path: Optional[str]) -> str: return os.sep.join( [ self._get_grub_platform_modules_path(lookup_path), Defaults.get_grub_platform_image_name(), ] ) def _get_efi_modules_path( self, lookup_path: Optional[str] = '', arch: str = '', raise_on_error: bool = True, ) -> str: # EFI modules are only used on architectures with EFI support efi_module_directory_name = Defaults.get_efi_module_directory_name( arch or self.arch ) assert efi_module_directory_name return self._get_module_path( efi_module_directory_name, lookup_path, raise_on_error ) def _get_grub_platform_modules_path( self, lookup_path: Optional[str] = None ) -> str: return self._get_module_path( Defaults.get_grub_platform_module_directory_name(), lookup_path ) def _get_xen_modules_path(self, lookup_path: Optional[str] = None) -> str: xen_module_directory_name = Defaults.get_efi_module_directory_name( 'x86_64_xen' ) assert xen_module_directory_name return self._get_module_path( xen_module_directory_name, lookup_path, ) def _get_module_path( self, format_name: str, lookup_path: Optional[str] = '', raise_on_error: bool = True, ) -> str: if not lookup_path: lookup_path = self.boot_dir return Defaults.get_grub_path(lookup_path, format_name, raise_on_error) def _find_theme_background_file(self, lookup_path: str) -> Optional[str]: background_pattern = os.sep.join( [ lookup_path, 'boot', self.boot_directory_name, 'themes', '*', 'background.png', ] ) for background_file in glob.iglob(background_pattern): return background_file return None def _copy_theme_data_to_boot_directory( self, lookup_path: Optional[str], target: str ) -> None: if not lookup_path: lookup_path = self.boot_dir font_name = 'unicode.pf2' efi_font_dir = Defaults.get_grub_efi_font_directory(lookup_path) boot_fonts_dir = os.path.normpath( os.sep.join( [ self.boot_dir, self.get_boot_path(target), self.boot_directory_name, 'fonts', ] ) ) try: unicode_font = Defaults.get_grub_path(lookup_path, font_name) if not os.path.exists(os.sep.join([boot_fonts_dir, font_name])): Path.create(boot_fonts_dir) Command.run(['cp', unicode_font, boot_fonts_dir]) if efi_font_dir: Command.run(['cp', unicode_font, efi_font_dir]) except Exception as issue: raise KiwiBootLoaderGrubFontError( 'Setting up unicode font failed with {0}'.format(issue) ) boot_theme_dir = os.sep.join( [self.boot_dir, 'boot', self.boot_directory_name, 'themes'] ) Path.create(boot_theme_dir) assert self.theme is not None theme_dir = Defaults.get_grub_path( lookup_path, 'themes/' + self.theme, raise_on_error=False ) boot_theme_background_file = self._find_theme_background_file( lookup_path ) if theme_dir and os.path.exists(theme_dir): if boot_theme_background_file: # A background file was found. Preserve a copy of the # file which was created at install time of the theme # package by the activate-theme script boot_theme_background_backup_file = os.sep.join( [self.boot_dir, 'background.png'] ) Command.run( [ 'cp', boot_theme_background_file, boot_theme_background_backup_file, ] ) # sync theme data from install path to boot path data = DataSync(theme_dir, boot_theme_dir) data.sync_data(options=['-a']) if boot_theme_background_file: # Install preserved background file to the theme Command.run( [ 'mv', boot_theme_background_backup_file, os.sep.join([boot_theme_dir, self.theme]), ] ) elif boot_theme_background_file: # assume all theme data is in the directory of the # background file and just sync that directory to the # boot path data = DataSync( os.path.dirname(boot_theme_background_file), boot_theme_dir ) data.sync_data(options=['-a']) self._check_boot_theme_exists() def _check_boot_theme_exists(self) -> None: if self.theme: theme_dir = os.sep.join( [ self.boot_dir, 'boot', self.boot_directory_name, 'themes', self.theme, ] ) if not os.path.exists(theme_dir): log.warning('Theme %s not found', theme_dir) log.warning('Set bootloader terminal to console mode') self.terminal_input = 'console' self.terminal_output = 'console' def _setup_EFI_path(self, lookup_path: Optional[str]) -> None: """ Copy efi boot data from lookup_path to the root directory """ if not lookup_path: lookup_path = self.boot_dir efi_path = lookup_path + '/boot/efi/' if os.path.exists(efi_path): efi_data = DataSync(efi_path, self.boot_dir) efi_data.sync_data(options=['-a']) def _copy_efi_modules_to_boot_directory( self, lookup_path: Optional[str] ) -> None: self._copy_modules_to_boot_directory_from( self._get_efi_modules_path(lookup_path) ) if self.arch == 'x86_64': # Also copy the 32bit EFI modules if present efi32_module_path = self._get_efi_modules_path( lookup_path, 'i386', raise_on_error=False ) if os.path.exists(efi32_module_path): self._copy_modules_to_boot_directory_from(efi32_module_path) def _copy_bios_modules_to_boot_directory( self, lookup_path: Optional[str] ) -> None: self._copy_modules_to_boot_directory_from( self._get_grub_platform_modules_path(lookup_path) ) def _copy_xen_modules_to_boot_directory( self, lookup_path: Optional[str] ) -> None: self._copy_modules_to_boot_directory_from( self._get_xen_modules_path(lookup_path) ) def _copy_modules_to_boot_directory_from(self, module_path: str) -> None: boot_module_path = ( self._get_grub2_boot_path() + '/' + os.path.basename(module_path) ) try: Path.create(boot_module_path) data = DataSync(module_path + '/', boot_module_path) data.sync_data(options=['-a'], exclude=['*.module']) except Exception as e: raise KiwiBootLoaderGrubModulesError( f'Module synchronisation failed with: {format(e)}' ) def _get_shim_install(self) -> Optional[str]: return Path.which(filename='shim-install', root_dir=self.boot_dir) def _fix_grub_root_device_reference( self, config_file: str, boot_options: Dict ) -> None: if self.root_reference: # grub2-mkconfig has no idea how the correct root= setup is # for disk images created with overlayroot enabled or in a # buildservice worker environment. Because of that the mkconfig # tool just finds the raw partition loop device and includes it # which is wrong. In this particular case we have to patch the # written config file and replace the wrong root= reference with # the correct value. with open(config_file) as grub_config_file: grub_config = grub_config_file.read() # The following expression matches any of the following # grub mkconfig root= settings and replaces it with a # correct value # 1. root=LOCAL-KIWI-MAPPED-DEVICE # 2. root=[a-zA-Z]=ANY-LINUX-BY-ID-VALUE grub_config = re.sub( r'(root=[a-zA-Z]+=[a-zA-Z0-9:\.-]+)|(root={0})'.format( boot_options.get('root_device') ), '{0}'.format(self.root_reference), grub_config, ) try: with open(config_file, 'w') as grub_config_file: grub_config_file.write(grub_config) except OSError as issue: log.warning(f'{func_name()} skipped: {issue}') return if self.firmware.efi_mode(): # in EFI mode the ESP is mounted by _mount_system() assert self.efi_mount is not None vendor_grubenv_file = Defaults.get_vendor_grubenv( self.efi_mount.mountpoint ) if vendor_grubenv_file: self._setup_loader_variables([self.root_reference]) def _fix_grub_loader_entries_boot_cmdline(self) -> None: if self.cmdline: # For distributions that follows the bootloader spec here: # https://www.freedesktop.org/wiki/Specifications/BootLoaderSpec # the menu entries are managed in extra files written to # boot/loader/entries. The grub2-mkconfig tool imports the # information from there and has no own menu entries data # in grub.cfg anymore. Unfortunately the system that writes # those new boot/loader/entries has several issues. It produces # a complete mess when used in chroot environments. In such # an environment it takes the proc/cmdline data from the host # that built the image and completely ignores the setup of # the image description. Overall for image building the # tooling is completely broken and we are forced to patch the # entire cmdline for the menuentries on such systems. assert self.root_mount is not None loader_entries_pattern = os.sep.join( [ self.root_mount.mountpoint, 'boot', 'loader', 'entries', '*.conf', ] ) for menu_entry_file in glob.iglob(loader_entries_pattern): with open(menu_entry_file) as grub_menu_entry_file: menu_entry = grub_menu_entry_file.read() menu_entry = re.sub( r'options (.*)', r'options {0}'.format(self.cmdline), menu_entry, ) try: with open(menu_entry_file, 'w') as grub_menu_entry_file: grub_menu_entry_file.write(menu_entry) except OSError as issue: log.warning(f'{func_name()} skipped: {issue}') return def _fix_grub_loader_entries_linux_and_initrd_paths(self) -> None: # For the same reasons encoded in _fix_grub_loader_entries_boot_cmdline # this method exists. In this method the wrong paths to the linux # kernel and initrd gets fixed assert self.root_mount is not None loader_entries_pattern = os.sep.join( [self.root_mount.mountpoint, 'boot', 'loader', 'entries', '*.conf'] ) for menu_entry_file in glob.iglob(loader_entries_pattern): with open(menu_entry_file) as grub_menu_entry_file: menu_entry_lines = grub_menu_entry_file.read().split(os.linesep) for line_number, menu_entry_line in enumerate(menu_entry_lines): if bool(re.match(r'^(linux|initrd) .*', menu_entry_line)): log.debug(f'Existing loader entry: {menu_entry_line}') config_path = menu_entry_line.split(' ', 1)[0] basename = os.path.basename(menu_entry_line) if self.bootpartition: config_path = f'{config_path} /{basename}' else: config_path = f'{config_path} /boot/{basename}' menu_entry_lines[line_number] = config_path log.debug(f'Updated loader entry: {config_path}') menu_entry = os.linesep.join(menu_entry_lines) try: with open(menu_entry_file, 'w') as grub_menu_entry_file: grub_menu_entry_file.write(menu_entry) except OSError as issue: log.warning(f'{func_name()} skipped: {issue}') def _get_partition_start(self, disk_device: str) -> str: if self.target_table_type == 'dasd': blocks = self._get_dasd_disk_geometry_element( disk_device, 'blocks per track' ) bash_command: Union[List[str], str] = [ 'fdasd', '-f', '-s', '-p', disk_device, '|', 'grep', '"^ "', '|', 'head', '-n', '1', '|', 'tr', '-s', '" "', ] fdasd_call = Command.run(['bash', '-c', ' '.join(bash_command)]) fdasd_output = fdasd_call.output try: start_track = int(fdasd_output.split(' ')[2].lstrip()) except Exception: raise KiwiDiskGeometryError( f'unknown partition format: {fdasd_output}' ) return '{0}'.format(start_track * blocks) else: bash_command = ' '.join( [ 'sfdisk', '--dump', disk_device, '|', 'grep', '"1 :"', '|', 'cut', '-f1', '-d,', '|', 'cut', '-f2', '-d=', ] ) return Command.run(['bash', '-c', bash_command]).output.strip() def _get_disk_geometry(self, disk_device: str) -> str: disk_geometry = '' if self.target_table_type == 'dasd': disk_geometry = 'targetgeometry = {0},{1},{2}'.format( self._get_dasd_disk_geometry_element(disk_device, 'cylinders'), self._get_dasd_disk_geometry_element( disk_device, 'tracks per cylinder' ), self._get_dasd_disk_geometry_element( disk_device, 'blocks per track' ), ) return disk_geometry def _get_dasd_disk_geometry_element( self, disk_device: str, search: str ) -> int: fdasd = ['fdasd', '-f', '-p', disk_device] bash_command = fdasd + ['|', 'grep', '"' + search + '"'] fdasd_call = Command.run(['bash', '-c', ' '.join(bash_command)]) fdasd_output = fdasd_call.output try: return int(fdasd_output.split(':')[1].lstrip()) except Exception: raise KiwiDiskGeometryError( f'unknown format for disk geometry: {fdasd_output}' ) def _create_loopback_config(self, filename: str) -> None: with open(filename, 'w') as loopback_cfg: loopback_cfg.write( 'source /boot/{0}/grub.cfg{1}'.format( self.boot_directory_name, os.linesep ) ) def _get_custom_template(self) -> str: if not self.xml_state.build_type.bootloader: return '' template_file = self.xml_state.build_type.bootloader[ 0 ].get_grub_template() if not template_file: return '' template_path = os.path.join( os.path.abspath(self.xml_state.xml_data.description_dir), self.xml_state.build_type.bootloader[0].get_grub_template(), ) if not os.path.exists(template_path): raise KiwiFileNotFound( f'failed to locate custom GRUB template {template_file}' ) return template_path def _has_btrfs_relative_path(self) -> bool: if ( self.xml_state.build_type.get_btrfs_set_default_volume() or self.xml_state.build_type.get_btrfs_root_is_snapper_snapshot() ): return True return False def _setup_kernel_flavor_default_entry(self, config_file: str) -> None: """ Select the menu entry of the latest kernel of the first kernel flavor as the default menu entry, see get_kernel_flavors() grub2-mkconfig creates the menu entries for all installed kernels in its own order. The default entry is selected by the saved_entry variable of the grub environment, which is taken into account with GRUB_DEFAULT=saved, the default kiwi sets up, see _setup_default_grub() :param str config_file: path of the grub config file :raises KiwiBootLoaderGrubMenuEntryError: if no menu entry of the kernel was found """ kernel_flavors = ( self.xml_state.get_build_type_bootloader_kernel_flavors() ) if not kernel_flavors: return assert self.root_mount is not None kernel_info = Kernel(self.root_mount.mountpoint).get_kernel( raise_on_not_found=True, flavor=kernel_flavors[0] ) kernel_version = kernel_info.version if kernel_info else '' menu_entry_id = self._get_menu_entry_id( config_file, kernel_version ) or self._get_loader_entry_id(kernel_version) if not menu_entry_id: raise KiwiBootLoaderGrubMenuEntryError( f'No menu entry for kernel {kernel_version} of flavor ' f'{kernel_flavors[0]} found in {config_file}' ) grub_default_file = f'{self.root_mount.mountpoint}/etc/default/grub' if os.path.exists(grub_default_file): grub_default = SysConfig(grub_default_file).get('GRUB_DEFAULT') if grub_default and grub_default.strip('"\'') != 'saved': log.warning( f'GRUB_DEFAULT={grub_default} is set, the default ' f'entry of kernel flavor {kernel_flavors[0]} is only ' 'selected with GRUB_DEFAULT=saved' ) self._setup_loader_variables([f'saved_entry={menu_entry_id}']) @staticmethod def _get_menu_entry_id(config_file: str, kernel_version: str) -> str: """ Provide the id of the menu entry of the given kernel version in the given grub config file The id of an entry in a submenu is prefixed by the id of the submenu, separated by >. An entry in a submenu, which belongs to the kernel version only, is preferred over a top level entry, which grub2-mkconfig creates for the latest kernel no matter its version. Recovery entries are not taken into account :param str config_file: path of the grub config file :param str kernel_version: kernel version :return: menu entry id or empty string if not found :rtype: str """ menu_ids: List[str] = [] top_level_entry_id = '' with open(config_file) as config: for line in config: line = line.strip() if line == '}': if menu_ids: menu_ids.pop() elif line.endswith('{'): menu_id = re.search( r'^(?:menuentry|submenu)\s.*' r'\$menuentry_id_option\s+\'([^\']+)\'', line, ) menu_ids.append(menu_id.group(1) if menu_id else '') elif re.match(r'(linux|linuxefi|linux16)\s', line): entry_ids = [menu_id for menu_id in menu_ids if menu_id] kernel_name = os.path.basename(line.split()[1]) if ( entry_ids and 'recovery' not in entry_ids[-1] and re.fullmatch( rf'[^-]+-{re.escape(kernel_version)}', kernel_name ) ): if len(entry_ids) > 1: return '>'.join(entry_ids) top_level_entry_id = top_level_entry_id or entry_ids[0] return top_level_entry_id def _get_loader_entry_id(self, kernel_version: str) -> str: """ Provide the id of the boot loader specification entry of the given kernel version, which is the entry file name without its extension. Such entries are used by grub if the menu entries are not part of the grub config file :param str kernel_version: kernel version :return: loader entry id or empty string if not found :rtype: str """ assert self.root_mount is not None kernel = Kernel(self.root_mount.mountpoint) for loader_entry in sorted( glob.iglob( f'{self.root_mount.mountpoint}/boot/loader/entries/*.conf' ) ): loader_entry_name = os.path.basename(loader_entry) if kernel.get_version_in_name(loader_entry_name) == kernel_version: return loader_entry_name[: -len('.conf')] return '' def _setup_loader_variables(self, variable_list: List[str]) -> None: """ Run grub2-editenv for writing an updated environment blob """ if self.root_mount and variable_list: log.info(f'Set grub environment variables: {variable_list}') Command.run( [ 'chroot', self.root_mount.mountpoint, 'grub2-editenv', '-', 'set', ] + variable_list ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7417269 kiwi-11.1.8/kiwi/bootloader/config/systemd_boot.py0000644000000000000000000002614115273675667017156 0ustar00# Copyright (c) 2022 Marcus Schäfer # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from string import Template from contextlib import ExitStack from typing import Dict, Tuple, Union # project from kiwi.path import Path from kiwi.bootloader.template.systemd_boot import BootLoaderTemplateSystemdBoot from kiwi.bootloader.config.bootloader_spec_base import BootLoaderSpecBase from kiwi.boot.image.base import BootImageBase from kiwi.mount_manager import MountManager from kiwi.storage.loop_device import LoopDevice from kiwi.storage.disk import Disk from kiwi.command import Command from kiwi.utils.os_release import OsRelease from kiwi.utils.sparse import SparseFile from kiwi.system.kernel import Kernel from kiwi.exceptions import KiwiTemplateError, KiwiBootLoaderTargetError import kiwi.defaults as defaults log = logging.getLogger('kiwi') class BootLoaderSystemdBoot(BootLoaderSpecBase): def post_init(self, custom_args: Dict = {}) -> None: """ Post init for systemd-boot In addition to the bootloader spec setup, initialize the record of the kernel and initrd files on the ESP :param dict custom_args: custom bootloader arguments """ super().post_init(custom_args) # kernel and initrd file on the ESP per kernel flavor self.boot_files: Dict[str, Tuple[str, str]] = {} def create_loader_image(self, target: str) -> None: """ Handle EFI images For systemd boot EFI images are provided along with systemd. Thus the only action taken care of is the creation of the ESP path :param str target: target identifier, one of disk, live(iso) or install(iso) """ self.efi_boot_path = self.create_efi_path() def setup_loader(self, target: str) -> None: """ Setup ESP for systemd-boot using bootctl For disk images only, setup the ESP layout for systemd boot using bootctl. All data will be loaded from the ESP. :param str target: target identifier, one of disk, live(iso) or install(iso) Currently only the disk identifier is supported """ if target != self.target.disk: raise KiwiBootLoaderTargetError( 'systemd-boot is only supported with the EFI disk image target' ) boot_options = self.custom_args['boot_options'] self._mount_system( boot_options.get('device_map'), boot_options.get('root_device'), boot_options.get('boot_device'), boot_options.get('efi_device'), boot_options.get('system_volumes'), boot_options.get('system_root_volume'), boot_options.get('system_partitions'), ) assert self.root_mount is not None dracut_setup = self.xml_state.get_dracut_config('setup') self._run_bootctl(self.root_mount.mountpoint) if dracut_setup.uefi: boot_image = boot_options.get('boot_image') if boot_image: log.info('Creating UKI EFI binary') Command.run( [ 'mv', boot_image.create_uki(self.cmdline), f'{self.root_mount.mountpoint}/boot/efi/EFI/Linux/', ] ) else: log.info('Creating loader entry') self.set_loader_entry(self.root_mount.mountpoint, self.target.disk) def set_loader_entry(self, root_dir: str, target: str) -> None: """ Setup/update loader entries, one entry for the kernel of each kernel flavor, see get_kernel_flavors() :param str target: target identifier, one of disk, live(iso) or install(iso) """ for flavor in self.get_kernel_flavors(): entry_name = self._get_entry_name(root_dir, flavor) BootLoaderSystemdBoot._write_config_file( BootLoaderTemplateSystemdBoot().get_entry_template(), root_dir + f'/boot/efi/loader/entries/{entry_name}', self._get_template_parameters(entry_name, flavor), ) def _create_embedded_fat_efi_image(self, path: str) -> None: """ Creates a EFI system partition image at the given path. Installs systemd-boot required EFI layout into the image """ fat_image_mbsize = int( self.xml_state.build_type.get_efifatimagesize() or defaults.EFI_FAT_IMAGE_SIZE ) SparseFile.create(path, f'{fat_image_mbsize}M') Command.run(['sgdisk', '-n', ':1.0', '-t', '1:EF00', path]) with LoopDevice(path) as loop_provider: loop_provider.create(overwrite=False) with Disk('gpt', loop_provider) as disk: disk.map_partitions() disk.partitioner.partition_id = 1 disk._add_to_map('efi') Command.run( ['mkdosfs', '-n', 'BOOT', disk.partition_map['efi']] ) Path.create(f'{self.root_dir}/boot/efi') with ExitStack() as stack: efi_mount = MountManager( device=disk.partition_map['efi'], mountpoint=f'{self.root_dir}/boot/efi', ) stack.push(efi_mount) device_mount = MountManager( device='/dev', mountpoint=f'{self.root_dir}/dev' ) stack.push(device_mount) proc_mount = MountManager( device='/proc', mountpoint=f'{self.root_dir}/proc' ) stack.push(proc_mount) sys_mount = MountManager( device='/sys', mountpoint=f'{self.root_dir}/sys' ) stack.push(sys_mount) efi_mount.mount() device_mount.bind_mount() proc_mount.bind_mount() sys_mount.bind_mount() self._run_bootctl(self.root_dir) self.set_loader_entry(self.root_dir, self.target.live) Command.run( ['dd', f'if={disk.partition_map["efi"]}', f'of={path}.img'] ) Command.run(['mv', f'{path}.img', path]) def _run_bootctl(self, root_dir: str) -> None: """ Setup ESP for systemd-boot using bootctl """ Command.run( [ 'chroot', root_dir, 'bootctl', 'install', '--esp-path=/boot/efi', '--no-variables', '--entry-token', 'os-id', ] ) self._write_kernel_cmdline_file(root_dir) # copy kernel and initrd of each kernel flavor dracut_setup = self.xml_state.get_dracut_config('setup') if not dracut_setup.uefi: entry_dir = f'{root_dir}/boot/efi/loader/entries' os_dir = f'{root_dir}/boot/efi/os' Path.create(entry_dir) Path.create(os_dir) for flavor in self.get_kernel_flavors(): kernel_info = BootImageBase( self.xml_state, root_dir, root_dir ).get_boot_names(flavor) self.boot_files[flavor] = ( f'os/{os.path.basename(kernel_info.kernel_filename)}', f'os/{kernel_info.initrd_name}', ) Command.run(['cp', kernel_info.kernel_filename, os_dir]) Command.run( ['cp', f'{root_dir}/boot/{kernel_info.initrd_name}', os_dir] ) # create loader.conf, the entry of the first kernel flavor # is the default entry kernel_flavors = ( self.xml_state.get_build_type_bootloader_kernel_flavors() ) default_entry = 'main.conf' if kernel_flavors: default_entry = self._get_entry_name(root_dir, kernel_flavors[0]) BootLoaderSystemdBoot._write_config_file( BootLoaderTemplateSystemdBoot().get_loader_template( with_default_entry=bool(kernel_flavors) ), root_dir + '/boot/efi/loader/loader.conf', self._get_template_parameters(default_entry), ) def _get_entry_name(self, root_dir: str, flavor: str = '') -> str: """ Name of the loader entry of the kernel of the given flavor The entry belongs to the kernel of the latest version of the flavor, the one kiwi creates the initrd for :param str root_dir: path to root directory tree :param str flavor: kernel flavor, see Kernel.get_kernel() :return: entry file basename :rtype: str """ os_release = OsRelease(root_dir) kernel_info = Kernel(root_dir).get_kernel( raise_on_not_found=True, flavor=flavor ) kernel_name = kernel_info.version if kernel_info else '' return f'{os_release.get("ID")}-{kernel_name}.conf' def _get_template_parameters( self, default_entry: str = 'main.conf', flavor: str = '' ) -> Dict[str, Union[str, int]]: kernel_file, initrd_file = self.boot_files.get( flavor, (self.custom_args['kernel'], self.custom_args['initrd']) ) return { 'kernel_file': kernel_file or 'vmlinuz', 'initrd_file': initrd_file or 'initrd', 'boot_options': self.cmdline, 'boot_timeout': self.timeout, 'bootpath': self.get_boot_path(), 'title': self.get_kernel_flavor_title( self.get_menu_entry_title(), flavor ), 'default_entry': default_entry, } @staticmethod def _write_config_file( template: Template, filename: str, parameters: Dict[str, Union[str, int]], ) -> None: try: config_data = template.substitute(parameters) Path.create(os.path.dirname(filename)) with open(filename, 'w') as config: config.write(config_data) except Exception as issue: raise KiwiTemplateError( '{0}: {1}'.format(type(issue).__name__, issue) ) def _write_kernel_cmdline_file(self, root_dir: str) -> None: kernel_cmdline = f'{root_dir}/etc/kernel/cmdline' Path.create(os.path.dirname(kernel_cmdline)) with open(kernel_cmdline, 'w') as cmdline: cmdline.write(self.cmdline) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7417269 kiwi-11.1.8/kiwi/bootloader/config/zipl.py0000644000000000000000000004207215273675667015422 0ustar00# Copyright (c) 2024 SUSE Software Solutions Germany GmbH # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import copy import logging import shutil from string import Template from typing import Dict, List, Union # project from kiwi.xml_state import HostKeyCertificateT from kiwi.path import Path from kiwi.boot.image.base import BootImageBase from kiwi.bootloader.template.zipl import BootLoaderTemplateZipl from kiwi.bootloader.config.bootloader_spec_base import BootLoaderSpecBase from kiwi.command import Command from kiwi.utils.temporary import Temporary from kiwi.exceptions import ( KiwiTemplateError, KiwiBootLoaderTargetError, KiwiDiskGeometryError, ) log = logging.getLogger('kiwi') class BootLoaderZipl(BootLoaderSpecBase): def create_loader_image(self, target: str) -> None: """ Nothing to be done here for zipl :param str target: unused """ pass # pragma: nocover def setup_loader(self, target: str) -> None: """ Setup temporary zipl config and install zipl for supported targets. Please note we are not touching the main zipl.conf file provided by the distributors :param str target: target identifier, one of disk, live(iso) or install(iso) Currently only the disk identifier is supported """ if target != self.target.disk: raise KiwiBootLoaderTargetError( 'zipl is only supported with the disk image target' ) boot_options = self.custom_args['boot_options'] self._mount_system( boot_options.get('device_map'), boot_options.get('root_device'), boot_options.get('boot_device'), boot_options.get('efi_device'), boot_options.get('system_volumes'), boot_options.get('system_root_volume'), boot_options.get('system_partitions'), ) assert self.root_mount is not None root_dir = self.root_mount.mountpoint self.custom_args['secure_linux'] = False host_key_certificates: List[HostKeyCertificateT] = ( self.xml_state.get_host_key_certificates() ) if host_key_certificates: # The secure execution image is created from the kernel and # initrd of the latest kernel. Kernel flavors are not # supported in this setup, see RuntimeChecker self._set_boot_files(root_dir) cc_boot_image = f'{self.custom_args["kernel"]}.cc' with Temporary( path=self.root_mount.mountpoint, prefix='kiwi_zipl_parmfile_' ).new_file() as hkd_parm_file: with open(hkd_parm_file.name, 'w') as parm_file: parm_file.write(f'{self.cmdline}{os.linesep}') genprotimg_init = [ 'chroot', root_dir, 'genprotimg', '--offline', '--verbose', '-o', cc_boot_image, '-i', self.custom_args['kernel'], '-r', self.custom_args['initrd'], '-p', hkd_parm_file.name.replace(root_dir, ''), ] # verify all host key documents individually and call # genprotimg with --no-verify afterwards. This is done # because genprotimg does not support verification with # multiple signing keys for host_key_certificate in host_key_certificates: genprotimg_host_key_check = copy.deepcopy(genprotimg_init) genprotimg_host_key_check.append('--cert') genprotimg_host_key_check.append( host_key_certificates[0]['hkd_ca_cert'] ) genprotimg_host_key_check.append('--cert') genprotimg_host_key_check.append( host_key_certificate['hkd_sign_cert'] ) for host_key in host_key_certificate['hkd_cert']: genprotimg_host_key_check.append('-k') genprotimg_host_key_check.append(host_key) for host_crl in host_key_certificate['hkd_revocation_list']: genprotimg_host_key_check.append('--crl') genprotimg_host_key_check.append(host_crl) log.info( 'Checking HKDs for signing cert: {}'.format( host_key_certificate['hkd_sign_cert'] ) ) Command.run(genprotimg_host_key_check) os.unlink(f'{root_dir}/{cc_boot_image}') # generate secure execution image genprotimg = genprotimg_init genprotimg.append('--no-verify') for host_key_certificate in host_key_certificates: for host_key in host_key_certificate['hkd_cert']: genprotimg.append('-k') genprotimg.append(host_key) for host_crl in host_key_certificate['hkd_revocation_list']: genprotimg.append('--crl') genprotimg.append(host_crl) Command.run(genprotimg) # extract secure execution header secure_execution_header = 'secure_execution_header.bin' Command.run( [ 'chroot', root_dir, 'pvextract-hdr', '-o', secure_execution_header, cc_boot_image, ] ) shutil.move( os.sep.join([root_dir, secure_execution_header]), os.sep.join( [ self.custom_args['target_dir'], '{0}.{1}-{2}.{3}'.format( self.xml_state.xml_data.get_name(), self.arch, self.xml_state.get_image_version(), secure_execution_header, ), ] ), ) # generate attestation request binary and response key attestation_request = 'attestation_request.bin' attestation_response_key = 'attestation_response.key' pvattest = [ 'chroot', root_dir, 'pvattest', 'create', '--no-verify', '--verbose', '-o', attestation_request, '--arpk', attestation_response_key, ] for host_key_certificate in host_key_certificates: for host_key in host_key_certificate['hkd_cert']: pvattest.append('-k') pvattest.append(host_key) Command.run(pvattest) shutil.move( os.sep.join([root_dir, attestation_request]), os.sep.join( [ self.custom_args['target_dir'], '{0}.{1}-{2}.{3}'.format( self.xml_state.xml_data.get_name(), self.arch, self.xml_state.get_image_version(), attestation_request, ), ] ), ) shutil.move( os.sep.join([root_dir, attestation_response_key]), os.sep.join( [ self.custom_args['target_dir'], '{0}.{1}-{2}.{3}'.format( self.xml_state.xml_data.get_name(), self.arch, self.xml_state.get_image_version(), attestation_response_key, ), ] ), ) self.custom_args['secure_linux'] = True self.custom_args['secure_image_file'] = cc_boot_image os.unlink(f'{root_dir}/{self.custom_args["kernel"]}') os.unlink(f'{root_dir}/{self.custom_args["initrd"]}') self.custom_args['kernel'] = '' self.custom_args['initrd'] = '' # The entry of the first kernel flavor is the default entry. # zipl names the section of an entry by its title kernel_flavors = ( self.xml_state.get_build_type_bootloader_kernel_flavors() ) default_entry = '' if kernel_flavors: default_entry = self.get_kernel_flavor_title( self.get_menu_entry_title(), kernel_flavors[0] ) with Temporary( path=self.root_mount.mountpoint, prefix='kiwi_zipl.conf_' ).new_file() as runtime_zipl_config_file: BootLoaderZipl._write_config_file( BootLoaderTemplateZipl().get_loader_template( with_default_entry=bool(kernel_flavors) ), runtime_zipl_config_file.name, self._get_template_parameters(default_entry), ) self.set_loader_entry(self.root_mount.mountpoint, self.target.disk) self._install_zipl(root_dir, runtime_zipl_config_file.name) def set_loader_entry(self, root_dir: str, target: str) -> None: """ Setup/update loader entries of the form {boot_path}/loader/entries/{get_entry_name}, one entry for the kernel of each kernel flavor, see get_kernel_flavors() :param str target: target identifier, one of disk, live(iso) or install(iso) """ for flavor in self.get_kernel_flavors(): if not self.custom_args['secure_linux']: self._set_boot_files(root_dir, flavor) entry_name = self.get_entry_name(flavor) BootLoaderZipl._write_config_file( BootLoaderTemplateZipl().get_entry_template( self.custom_args['secure_linux'] ), root_dir + f'{self.entries_dir}/{entry_name}', self._get_template_parameters(entry_name, flavor), ) def _set_boot_files(self, root_dir: str, flavor: str = '') -> None: """ Set the kernel and initrd file of the kernel of the given flavor as the files of the loader entry :param str root_dir: path to root directory tree :param str flavor: kernel flavor, see Kernel.get_kernel() """ boot_path = self.get_boot_path() kernel_info = BootImageBase( self.xml_state, root_dir, root_dir ).get_boot_names(flavor) self.custom_args['kernel'] = ( f'{boot_path}/{os.path.basename(kernel_info.kernel_filename)}' ) self.custom_args['initrd'] = f'{boot_path}/{kernel_info.initrd_name}' def _install_zipl(self, root_dir: str, zipl_config: str) -> None: """ Install zipl on target """ zipl = [ 'chroot', root_dir, 'zipl', '--noninteractive', '--config', zipl_config.replace(root_dir, ''), '--blsdir', self.entries_dir, '--verbose', ] assert self.sys_mount is not None self.sys_mount.umount() Command.run(zipl) def _get_template_parameters( self, default_entry: str = '', flavor: str = '' ) -> Dict[str, Union[str, int]]: disk_type = self.disk_type or 'SCSI' disk_type = disk_type if disk_type != 'GPT' else 'SCSI' blocksize = self.disk_blocksize or 512 unsupported_for_target_geometry = ['FBA', 'SCSI'] targetbase = f'targetbase={self.custom_args.get("targetbase")}' geometry = '' if disk_type not in unsupported_for_target_geometry: geometry = f'targetgeometry={self._get_disk_geometry()}' return { 'secure_image_file': self.custom_args.get('secure_image_file') or '', 'kernel_file': self.custom_args['kernel'] or 'vmlinuz', 'initrd_file': self.custom_args['initrd'] or 'initrd', 'boot_options': self.cmdline, 'boot_timeout': self.timeout, 'bootpath': self.get_boot_path(), 'targetbase': targetbase, 'targettype': disk_type, 'targetblocksize': format(blocksize), 'targetoffset': self._get_partition_start(), 'targetgeometry': geometry, 'title': self.get_kernel_flavor_title( self.get_menu_entry_title(), flavor ), 'default_entry': default_entry, } def _get_disk_geometry(self) -> str: target_table_type = self.firmware.get_partition_table_type() disk_device = self.custom_args['targetbase'] disk_geometry = '' if target_table_type == 'dasd': disk_geometry = '{0},{1},{2}'.format( self._get_dasd_disk_geometry_element(disk_device, 'cylinders'), self._get_dasd_disk_geometry_element( disk_device, 'tracks per cylinder' ), self._get_dasd_disk_geometry_element( disk_device, 'blocks per track' ), ) return disk_geometry def _get_partition_start(self) -> str: target_table_type = self.firmware.get_partition_table_type() disk_device = self.custom_args['targetbase'] if target_table_type == 'dasd': blocks = self._get_dasd_disk_geometry_element( disk_device, 'blocks per track' ) fdasd_command = [ 'fdasd', '-f', '-s', '-p', disk_device, '|', 'grep', '"^ "', '|', 'head', '-n', '1', '|', 'tr', '-s', '" "', ] fdasd_call = Command.run(['bash', '-c', ' '.join(fdasd_command)]) fdasd_output = fdasd_call.output try: start_track = int(fdasd_output.split(' ')[2].lstrip()) except Exception: raise KiwiDiskGeometryError( f'unknown partition format: {fdasd_output}' ) return '{0}'.format(start_track * blocks) else: sfdisk_command = ' '.join( [ 'sfdisk', '--dump', disk_device, '|', 'grep', '"1 :"', '|', 'cut', '-f1', '-d,', '|', 'cut', '-f2', '-d=', ] ) return Command.run(['bash', '-c', sfdisk_command]).output.strip() def _get_dasd_disk_geometry_element( self, disk_device: str, search: str ) -> int: fdasd = ['fdasd', '-f', '-p', disk_device] bash_command = fdasd + ['|', 'grep', '"' + search + '"'] fdasd_call = Command.run(['bash', '-c', ' '.join(bash_command)]) fdasd_output = fdasd_call.output try: return int(fdasd_output.split(':')[1].lstrip()) except Exception: raise KiwiDiskGeometryError( f'unknown format for disk geometry: {fdasd_output}' ) @staticmethod def _write_config_file( template: Template, filename: str, parameters: Dict[str, Union[str, int]], ) -> None: try: config_data = template.substitute(parameters) Path.create(os.path.dirname(filename)) with open(filename, 'w') as config: config.write(config_data) except Exception as issue: raise KiwiTemplateError( '{0}: {1}'.format(type(issue).__name__, issue) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7417269 kiwi-11.1.8/kiwi/bootloader/install/__init__.py0000644000000000000000000000462515273675667016406 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from typing import Dict, Optional from kiwi.xml_state import XMLState from kiwi.bootloader.install.base import BootLoaderInstallBase from abc import ABCMeta, abstractmethod from ...exceptions import KiwiBootLoaderInstallSetupError class BootLoaderInstall(metaclass=ABCMeta): """ **BootLoaderInstall Factory** :param string name: bootloader name :param string root_dir: root directory path name :param object device_provider: instance of :class:`DeviceProvider` :param dict custom_args: custom arguments dictionary """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( name: str, xml_state: XMLState, root_dir: str, device_provider: object, custom_args: Optional[Dict] = None, ) -> BootLoaderInstallBase: name_map = { 'grub2': {'grub2': 'BootLoaderInstallGrub2'}, 'grub2_s390x_emu': {'grub2': 'BootLoaderInstallGrub2'}, 'systemd_boot': {'systemd_boot': 'BootLoaderInstallSystemdBoot'}, 'zipl': {'zipl': 'BootLoaderInstallZipl'}, } try: bootloader_namespace, bootloader_name = list( name_map[name].items() )[0] bootloader_install = importlib.import_module( 'kiwi.bootloader.install.{}'.format(bootloader_namespace) ) return bootloader_install.__dict__[bootloader_name]( xml_state, root_dir, device_provider, custom_args ) except Exception: raise KiwiBootLoaderInstallSetupError( f'Support for {name} bootloader installation not implemented' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7423341 kiwi-11.1.8/kiwi/bootloader/install/base.py0000644000000000000000000000513615273675667015557 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Dict, Optional # project from kiwi.xml_state import XMLState from kiwi.storage.device_provider import DeviceProvider class BootLoaderInstallBase: """ **Base class for bootloader installation on device** :param string root_dir: root directory path name :param object device_provider: instance of :class:`DeviceProvider` :param dict custom_args: custom arguments dictionary """ def __init__( self, xml_state: XMLState, root_dir: str, device_provider: DeviceProvider, custom_args: Optional[Dict] = None, ) -> None: self.xml_state = xml_state self.root_dir = root_dir self.device_provider = device_provider self.device = self.device_provider.get_device() self.post_init(custom_args) def post_init(self, custom_args: Optional[Dict]) -> None: """ Post initialization method Store custom arguments by default :param dict custom_args: custom bootloader arguments """ self.custom_args = custom_args def install_required(self) -> bool: """ Check if bootloader needs to be installed Implementation in specialized bootloader install class required """ raise NotImplementedError def install(self) -> None: """ Install bootloader on self.device Implementation in specialized bootloader install class required """ raise NotImplementedError def secure_boot_install(self) -> None: """ Run shim-install in self.device for secure boots Implementation in specialized bootloader install class required """ raise NotImplementedError def set_disk_password(self, password: str) -> None: """ Include crypto mount credentials Implementation in specialized bootloader install class optional """ pass ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7423341 kiwi-11.1.8/kiwi/bootloader/install/grub2.py0000644000000000000000000005020115273675667015657 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import re import shutil import logging from contextlib import ExitStack from typing import Dict, List, Literal, Optional, overload # project from kiwi.bootloader.install.base import BootLoaderInstallBase from kiwi.command import Command from kiwi.defaults import Defaults from kiwi.firmware import FirmWare from kiwi.mount_manager import MountManager from kiwi.system.setup import SystemSetup from kiwi.path import Path from kiwi.storage.disk import ptable_entry_type from kiwi.exceptions import ( KiwiBootLoaderGrubInstallError, KiwiBootLoaderGrubPlatformError, KiwiBootLoaderGrubDataError, KiwiBootLoaderDiskPasswordError, ) log = logging.getLogger('kiwi') class BootLoaderInstallGrub2(BootLoaderInstallBase): """ **grub2 bootloader installation** """ def post_init(self, custom_args: Optional[Dict]) -> None: """ grub2 post initialization method :param dict custom_args: Contains custom grub2 bootloader arguments .. code:: python { 'target_removable': bool, 'system_volumes': list_of_volumes, 'system_root_volume': root volume name if required 'firmware': FirmWare_instance, 'efi_device': string, 'boot_device': string, 'root_device': string } """ self.arch = Defaults.get_platform_name() self.custom_args = custom_args self.install_arguments: List[str] = [] self.shim_install_arguments: List[str] = [] self.firmware: Optional[FirmWare] = None self.root_mount: Optional[MountManager] = None self.sysfs_mount: Optional[MountManager] = None self.volumes: Optional[Dict] = None self.partitions: Optional[Dict[str, ptable_entry_type]] = None self.root_volume_name: Optional[str] = None self.target_removable: Optional[bool] = None self.device_map: Optional[Dict] = None if custom_args and 'target_removable' in custom_args: self.target_removable = custom_args['target_removable'] if custom_args and 'system_volumes' in custom_args: self.volumes = custom_args['system_volumes'] if custom_args and 'system_partitions' in custom_args: self.partitions = custom_args['system_partitions'] if custom_args and 'device_map' in custom_args: self.device_map = custom_args['device_map'] if custom_args and 'system_root_volume' in custom_args: self.root_volume_name = custom_args['system_root_volume'] if custom_args and 'firmware' in custom_args: self.firmware = custom_args['firmware'] if custom_args and 'install_options' in custom_args: self.install_arguments = custom_args['install_options'] if custom_args and 'shim_options' in custom_args: self.shim_install_arguments = custom_args['shim_options'] if self.firmware and self.firmware.efi_mode(): if not custom_args or 'efi_device' not in custom_args: raise KiwiBootLoaderGrubInstallError( 'EFI device name required for shim installation' ) if not custom_args or 'boot_device' not in custom_args: raise KiwiBootLoaderGrubInstallError( 'boot device name required for grub2 installation' ) if not custom_args or 'root_device' not in custom_args: raise KiwiBootLoaderGrubInstallError( 'root device name required for grub2 installation' ) def install_required(self) -> bool: """ Check if grub2 has to be installed Take architecture and firmware setup into account to check if bootloader code in a boot record is required :return: True or False :rtype: bool """ # the firmware is passed along by the disk builder assert self.firmware is not None if 'ppc64' in self.arch and self.firmware.opal_mode(): # OPAL doesn't need a grub2 stage1, just a config file. # The machine will be setup to kexec grub2 in user space log.info( 'No grub boot code installation in opal mode on %s', self.arch ) return False elif 'arm' in self.arch or self.arch == 'aarch64': # On arm grub2 is used for EFI setup only, no install # of grub2 boot code makes sense log.info('No grub boot code installation on %s', self.arch) return False elif self.arch == 'riscv64': # On riscv grub2 is used for EFI setup only, no install # of grub2 boot code makes sense log.info('No grub boot code installation on %s', self.arch) return False elif self.firmware.efi_mode() and not self.firmware.legacy_bios_mode(): # In EFI mode without CSM, no install # of grub2 boot code makes sense log.info('No grub boot code installation in EFI only mode') return False return True def install(self) -> None: """ Install bootloader on disk device """ log.info('Installing grub2 on disk %s', self.device) if self.target_removable: self.install_arguments.append('--removable') if Defaults.is_x86_arch(self.arch): self.target = 'i386-pc' self.install_device = self.device self.modules = ' '.join( Defaults.get_grub_platform_modules(multiboot=True) ) self.install_arguments.append('--skip-fs-probe') elif self.arch.startswith('ppc64'): if not self.custom_args or 'prep_device' not in self.custom_args: raise KiwiBootLoaderGrubInstallError( 'prep device name required for grub2 installation on ppc' ) self.target = 'powerpc-ieee1275' self.install_device = self.custom_args['prep_device'] self.modules = ' '.join(Defaults.get_grub_ofw_modules()) self.install_arguments.append('--skip-fs-probe') self.install_arguments.append('--no-nvram') elif self.arch.startswith('s390'): self.target = 's390x-emu' self.install_device = self.device self.modules = ' '.join(Defaults.get_grub_s390_modules()) self.install_arguments.append('--skip-fs-probe') self.install_arguments.append('--no-nvram') else: raise KiwiBootLoaderGrubPlatformError( f'host architecture {self.arch} not supported for grub2 installation' ) with ExitStack() as stack: self._mount_device_and_volumes(stack) assert self.root_mount is not None assert self.sysfs_mount is not None # check if a grub installation could be found in the image system module_directory = Defaults.get_grub_path( self.root_mount.mountpoint, self.target, raise_on_error=False ) if not module_directory: raise KiwiBootLoaderGrubDataError( 'No grub2 installation found in {0} for target {1}'.format( self.root_mount.mountpoint, self.target ) ) module_directory = module_directory.replace( self.root_mount.mountpoint, '' ) boot_directory = '/boot' # install grub2 boot code, the firmware is passed # along by the disk builder assert self.firmware is not None if self.firmware.get_partition_table_type() == 'dasd': # On s390 and in CDL mode (4k DASD) the call of grub2-install # does not work because grub2-install is not able to identify # a 4k fdasd partitioned device as a grub supported device # and fails. As grub2-install is only used to invoke # grub2-zipl-setup and has no other job to do we can # circumvent this problem by directly calling grub2-zipl-setup # instead. self.sysfs_mount.umount() Command.run( [ 'chroot', self.root_mount.mountpoint, 'grub2-zipl-setup', '--keep', ] ) else: Command.run( [ 'chroot', self.root_mount.mountpoint, self._get_grub2_install_tool_name( self.root_mount.mountpoint ), ] + self.install_arguments + [ '--directory', module_directory, '--boot-directory', boot_directory, '--target', self.target, '--modules', self.modules, self.install_device, ] ) # Cleanup temporary modified zipl template and config files # back to its original state or lave a .kiwi copy for # reference in the system zipl_config_file = ''.join( [self.root_mount.mountpoint, '/boot/zipl/config'] ) zipl2grub_config_file_orig = ''.join( [ self.root_mount.mountpoint, '/etc/default/zipl2grub.conf.in.orig', ] ) if os.path.exists(zipl2grub_config_file_orig): Command.run( [ 'mv', zipl2grub_config_file_orig, zipl2grub_config_file_orig.replace('.orig', ''), ] ) if os.path.exists(zipl_config_file): Command.run( ['mv', zipl_config_file, zipl_config_file + '.kiwi'] ) # Rebuild security context setup = SystemSetup(self.xml_state, self.root_mount.mountpoint) setup.setup_selinux_file_contexts() def secure_boot_install(self) -> None: if ( self.firmware and self.firmware.efi_mode() == 'uefi' and ( Defaults.is_x86_arch(self.arch) or 'arm' in self.arch or self.arch == 'aarch64' # noqa: W503 ) ): with ExitStack() as stack: self._mount_device_and_volumes(stack) assert self.root_mount is not None shim_install = self._get_shim_install_tool_name( self.root_mount.mountpoint ) # if shim-install does _not_ exist the fallback mechanism # has applied at the bootloader/config level and we expect # no further tool calls to be required if shim_install: # Before we call shim-install, the grub installer binary is # replaced by a noop. Actually there is no reason for # shim-install to call the grub installer because it should # only setup the system for EFI secure boot which does not # require any bootloader code in the master boot record. # In addition kiwi has called the grub installer right # before try: self._disable_grub2_install(self.root_mount.mountpoint) Command.run( [ 'chroot', self.root_mount.mountpoint, 'shim-install', '--removable', ] + self.shim_install_arguments + [self.device] ) finally: # restore the grub installer noop self._enable_grub2_install(self.root_mount.mountpoint) def set_disk_password(self, password: str) -> None: with ExitStack() as stack: self._mount_device_and_volumes(stack) if self.root_mount and password is not None: log.debug('Include cryptomount credentials...') config_file = ( f'{self.root_mount.mountpoint}/boot/efi/EFI/BOOT/grub.cfg' ) try: with open(config_file) as config: grub_config = config.read() grub_config = re.sub( r'cryptomount', f'cryptomount -p "{password}"', grub_config, ) with open(config_file, 'w') as grub_config_file: grub_config_file.write(grub_config) log.debug(f'<<< {grub_config} >>>') except IOError as issue: raise KiwiBootLoaderDiskPasswordError( f'Failed to open {config_file}: {issue}' ) def _mount_device_and_volumes(self, stack: ExitStack) -> None: assert self.custom_args is not None self.root_mount = MountManager(device=self.custom_args['root_device']) stack.push(self.root_mount) custom_root_mount_args = [] if self.root_volume_name and self.root_volume_name != '/': custom_root_mount_args += [f'subvol={self.root_volume_name}'] readonly_device = (self.device_map or {}).get('readonly') if ( readonly_device and self.custom_args['root_device'] == readonly_device.get_device() ): # The overlayroot readonly partition holds a read-only # filesystem (squashfs/erofs), mount it as such custom_root_mount_args += ['ro'] self.root_mount.mount(options=custom_root_mount_args) if 's390' in self.arch: boot_mount = MountManager( device=self.custom_args['boot_device'], mountpoint=self.root_mount.mountpoint + '/boot/zipl', ) else: boot_mount = MountManager( device=self.custom_args['boot_device'], mountpoint=self.root_mount.mountpoint + '/boot', ) stack.push(boot_mount) if not self.root_mount.device == boot_mount.device: boot_mount.mount() if self.custom_args.get('efi_device'): efi_mount = MountManager( device=self.custom_args['efi_device'], mountpoint=self.root_mount.mountpoint + '/boot/efi', ) stack.push(efi_mount) efi_mount.mount() if self.volumes: for volume_path in Path.sort_by_hierarchy( sorted(self.volumes.keys()) ): volume_mount = MountManager( device=self.volumes[volume_path]['volume_device'], mountpoint=self.root_mount.mountpoint + '/' + volume_path, ) stack.push(volume_mount) volume_mount.mount( options=[self.volumes[volume_path]['volume_options']] ) if self.partitions: # the partitions are mounted from the given device map assert self.device_map is not None for map_name in sorted(self.partitions.keys()): if map_name in self.device_map: partition_mount = MountManager( device=self.device_map[map_name].get_device(), mountpoint=os.path.join( self.root_mount.mountpoint, self.partitions[map_name].mountpoint.lstrip(os.sep), ), ) stack.push(partition_mount) partition_mount.mount() device_mount = MountManager( device='/dev', mountpoint=self.root_mount.mountpoint + '/dev' ) stack.push(device_mount) device_mount.bind_mount() proc_mount = MountManager( device='/proc', mountpoint=self.root_mount.mountpoint + '/proc' ) stack.push(proc_mount) proc_mount.bind_mount() self.sysfs_mount = MountManager( device='/sys', mountpoint=self.root_mount.mountpoint + '/sys' ) stack.push(self.sysfs_mount) self.sysfs_mount.bind_mount() def _disable_grub2_install(self, root_path: str) -> None: if os.access(root_path, os.W_OK): grub2_install = ''.join( ['/usr/sbin/', self._get_grub2_install_tool_name(root_path)] ) grub2_install_backup = ''.join([grub2_install, '.orig']) grub2_install_noop = '/bin/true' shutil.copy2( os.path.normpath(f'{root_path}/{grub2_install}'), os.path.normpath(f'{root_path}/{grub2_install_backup}'), ) shutil.copy2( os.path.normpath(f'{root_path}/{grub2_install_noop}'), os.path.normpath(f'{root_path}/{grub2_install}'), ) def _enable_grub2_install(self, root_path: str) -> None: if os.access(root_path, os.W_OK): grub2_install = ''.join( ['/usr/sbin/', self._get_grub2_install_tool_name(root_path)] ) grub2_install_backup = ''.join([grub2_install, '.orig']) if os.path.exists(''.join([root_path, grub2_install_backup])): Command.run( [ 'chroot', root_path, 'mv', grub2_install_backup, grub2_install, ] ) def _get_grub2_install_tool_name(self, root_path: str) -> str: return self._get_tool_name( root_path, lookup_list=['grub2-install', 'grub-install'] ) def _get_shim_install_tool_name(self, root_path: str) -> Optional[str]: return self._get_tool_name( root_path, lookup_list=['shim-install'], fallback_on_not_found=False ) @overload def _get_tool_name( self, root_path: str, lookup_list: List[str], fallback_on_not_found: Literal[True] = True, ) -> str: ... # pragma: nocover @overload def _get_tool_name( self, root_path: str, lookup_list: List[str], fallback_on_not_found: Literal[False], ) -> Optional[str]: ... # pragma: nocover def _get_tool_name( self, root_path: str, lookup_list: List[str], fallback_on_not_found: bool = True, ) -> Optional[str]: for tool in lookup_list: if Path.which(filename=tool, root_dir=root_path): return tool if fallback_on_not_found: # no tool from the list was found, we intentionally don't # raise here but return the default tool name and raise # an exception at invocation time in order to log the # expected call and its arguments return lookup_list[0] return None ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7423341 kiwi-11.1.8/kiwi/bootloader/install/systemd_boot.py0000644000000000000000000000350415273675667017355 0ustar00# Copyright (c) 2022 Marcus Schäfer. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging from typing import Dict, Optional # project from kiwi.bootloader.install.base import BootLoaderInstallBase log = logging.getLogger('kiwi') class BootLoaderInstallSystemdBoot(BootLoaderInstallBase): """ **systemd-boot bootloader installation** """ def post_init(self, custom_args: Optional[Dict]) -> None: """ systemd-boot post initialization method :param dict custom_args: Contains custom systemd-boot bootloader arguments """ self.custom_args = custom_args def install_required(self) -> bool: """ Check if systemd-boot needs to install boot code systemd-boot supports EFI boot only and does not need to install boot code since it's expected that the firmware can read from the EFI partition :return: True or False :rtype: bool """ return False def secure_boot_install(self) -> None: """ Run shim installation for secure boot setup For systemd-boot this is currently skipped since details for secure boot are not yet clear """ pass ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7423341 kiwi-11.1.8/kiwi/bootloader/install/zipl.py0000644000000000000000000000336415273675667015624 0ustar00# Copyright (c) 2024 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging from typing import Dict, Optional # project from kiwi.bootloader.install.base import BootLoaderInstallBase log = logging.getLogger('kiwi') class BootLoaderInstallZipl(BootLoaderInstallBase): """ **zipl bootloader installation** """ def post_init(self, custom_args: Optional[Dict]) -> None: """ zipl post initialization method :param dict custom_args: unused """ self.custom_args = custom_args def install_required(self) -> bool: """ Check if zipl needs to install boot code zipl requires boot code installation, but it is done as part of the BLS implementation in bootloader/config/zipl.py Thus this method always returns: False :return: False :rtype: bool """ return False def secure_boot_install(self) -> None: """ Run shim installation for secure boot setup For zipl this is skipped since details for secure boot are not yet clear. """ pass ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7423341 kiwi-11.1.8/kiwi/bootloader/template/__init__.py0000644000000000000000000000000015273675667016532 0ustar00././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.742636 kiwi-11.1.8/kiwi/bootloader/template/grub2.py0000644000000000000000000004671115273675667016037 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import re from string import Template from textwrap import dedent class BootLoaderTemplateGrub2: """ **grub2 configuraton file templates** """ def __init__(self) -> None: self.header = ( dedent( ''' # kiwi generated one time grub2 config file search ${search_params} set default=${default_boot} if [ -n "$$extra_cmdline" ]; then submenu "Bootable snapshot $$snapshot_num" { menuentry "If OK, run snapper rollback and reboot." { true; } } fi if [ -n "$${iso_path}" ]; then isoboot="iso-scan/filename=$${iso_path}" fi ''' ).strip() + os.linesep ) self.header_btrfs_relative_path = ( dedent( ''' set btrfs_relative_path="y" export btrfs_relative_path ''' ).strip() + os.linesep ) self.timeout = ( dedent( ''' set timeout=${boot_timeout} ''' ).strip() + os.linesep ) self.timeout_style = ( dedent( ''' set timeout_style=${boot_timeout_style} ''' ).strip() + os.linesep ) self.header_gfxmode = ( dedent( ''' if [ "$${grub_platform}" = "efi" ]; then echo "Please press 't' to show the boot menu on this console" fi set gfxmode=${gfxmode} ''' ).strip() + os.linesep ) self.header_serial = ( dedent( ''' ${serial_line_setup} ''' ).strip() + os.linesep ) self.header_terminal_setup = ( dedent( ''' terminal_input ${terminal_input} terminal_output ${terminal_output} ''' ).strip() + os.linesep ) self.fonts = ( dedent( ''' set font=($$root)${bootpath}/${boot_directory_name}/fonts/unicode.pf2 set ascii_font=${boot_directory_name}/themes/${theme}/ascii.pf2 set sans_bold_14_font=${boot_directory_name}/themes/${theme}/DejaVuSans-Bold14.pf2 set sans_10_font=${boot_directory_name}/themes/${theme}/DejaVuSans10.pf2 set sans_12_font=${boot_directory_name}/themes/${theme}/DejaVuSans12.pf2 ''' ).strip() + os.linesep ) self.header_theme = ( self.fonts + dedent( ''' if [ -f $${font} ];then loadfont $${font} fi if [ -f ($$root)${bootpath}/$${ascii_font} ];then loadfont ($$root)${bootpath}/$${ascii_font} fi if [ -f ($$root)${bootpath}/$${sans_bold_14_font} ];then loadfont ($$root)${bootpath}/$${sans_bold_14_font} fi if [ -f ($$root)${bootpath}/$${sans_10_font} ];then loadfont ($$root)${bootpath}/$${sans_10_font} fi if [ -f ($$root)${bootpath}/$${sans_12_font} ];then loadfont ($$root)${bootpath}/$${sans_12_font} fi if [ -f ($$root)${bootpath}/${boot_directory_name}/themes/${theme}/theme.txt ];then set theme=($$root)${bootpath}/${boot_directory_name}/themes/${theme}/theme.txt export theme fi ''' ).strip() + os.linesep ) self.header_theme_iso = ( self.fonts + dedent( ''' if [ -f $${font} ];then loadfont $${font} fi if [ -f ($$root)/boot/$${ascii_font} ];then loadfont ($$root)/boot/$${ascii_font} fi if [ -f ($$root)/boot/$${sans_bold_14_font} ];then loadfont ($$root)/boot/$${sans_bold_14_font} fi if [ -f ($$root)/boot/$${sans_10_font} ];then loadfont ($$root)/boot/$${sans_10_font} fi if [ -f ($$root)/boot/$${sans_12_font} ];then loadfont ($$root)/boot/$${sans_12_font} fi if [ -f ($$root)/boot/${boot_directory_name}/themes/${theme}/theme.txt ];then set theme=($$root)/boot/${boot_directory_name}/themes/${theme}/theme.txt fi ''' ).strip() + os.linesep ) self.menu_entry_boot_snapshots = ( dedent( ''' if [ -f "/.snapshots/grub-snapshot.cfg" ]; then source "/.snapshots/grub-snapshot.cfg" fi ''' ).strip() + os.linesep ) self.menu_entry_console_switch = ( dedent( ''' if [ "$${grub_platform}" = "efi" ]; then hiddenentry "Text mode" --hotkey "t" { set textmode=true terminal_output console } fi ''' ).strip() + os.linesep ) self.menu_entry_multiboot = ( dedent( ''' menuentry "${title}" --class os --unrestricted { set gfxpayload=keep echo Loading hypervisor... multiboot ${bootpath}/${hypervisor} dummy echo Loading kernel... module ${bootpath}/${kernel_file} dummy ${boot_options} echo Loading initrd... module ${bootpath}/${initrd_file} dummy } ''' ).strip() + os.linesep ) self.menu_entry = ( dedent( ''' menuentry "${title}" --class os --unrestricted { set gfxpayload=keep echo Loading kernel... linux ($$root)${bootpath}/${kernel_file} $${extra_cmdline} $${isoboot} ${boot_options} echo Loading initrd... initrd ($$root)${bootpath}/${initrd_file} } ''' ).strip() + os.linesep ) self.menu_entry_failsafe_multiboot = ( dedent( ''' menuentry "Failsafe -- ${title}" --class os --unrestricted { set gfxpayload=keep echo Loading hypervisor... multiboot ${bootpath}/${hypervisor} dummy echo Loading kernel... module ${bootpath}/${kernel_file} dummy ${failsafe_boot_options} echo Loading initrd... module ${bootpath}/${initrd_file} dummy } ''' ).strip() + os.linesep ) self.menu_entry_failsafe = ( dedent( ''' menuentry "Failsafe -- ${title}" --class os --unrestricted { set gfxpayload=keep echo Loading kernel... linux ($$root)${bootpath}/${kernel_file} $${extra_cmdline} $${isoboot} ${failsafe_boot_options} echo Loading initrd... initrd ($$root)${bootpath}/${initrd_file} } ''' ).strip() + os.linesep ) self.menu_install_entry_multiboot = ( dedent( ''' menuentry "Install -- ${title}" --class os --unrestricted { set gfxpayload=keep echo Loading hypervisor... multiboot ${bootpath}/${hypervisor} dummy echo Loading kernel... module ${bootpath}/${kernel_file} dummy cdinst=1 ${failsafe_boot_options} echo Loading initrd... module ${bootpath}/${initrd_file} dummy } ''' ).strip() + os.linesep ) self.menu_install_entry = ( dedent( ''' menuentry "Install ${title}" --class os --unrestricted { set gfxpayload=keep echo Loading kernel... linux ($$root)${bootpath}/${kernel_file} cdinst=1 $${isoboot} ${boot_options} echo Loading initrd... initrd ($$root)${bootpath}/${initrd_file} } ''' ).strip() + os.linesep ) self.menu_mediacheck_entry_multiboot = ( dedent( ''' menuentry "Mediacheck" --class os --unrestricted { set gfxpayload=keep echo Loading hypervisor... multiboot ${bootpath}/${hypervisor} dummy echo Loading kernel... module ${bootpath}/${kernel_file} dummy mediacheck=1 plymouth.enable=0 ${failsafe_boot_options} echo Loading initrd... module ${bootpath}/${initrd_file} dummy } ''' ).strip() + os.linesep ) self.menu_mediacheck_entry = ( dedent( ''' menuentry "Mediacheck" --class os --unrestricted { set gfxpayload=keep echo Loading kernel... linux ($$root)${bootpath}/${kernel_file} mediacheck=1 plymouth.enable=0 $${isoboot} ${boot_options} echo Loading initrd... initrd ($$root)${bootpath}/${initrd_file} } ''' ).strip() + os.linesep ) self.menu_install_entry_failsafe_multiboot = ( dedent( ''' menuentry "Failsafe -- Install ${title}" --class os --unrestricted { set gfxpayload=keep echo Loading hypervisor... multiboot ${bootpath}/${hypervisor} dummy echo Loading kernel... module ${bootpath}/${kernel_file} dummy cdinst=1 ${failsafe_boot_options} echo Loading initrd... module ${bootpath}/${initrd_file} dummy } ''' ).strip() + os.linesep ) self.menu_install_entry_failsafe = ( dedent( ''' menuentry "Failsafe -- Install ${title}" --class os --unrestricted { set gfxpayload=keep echo Loading kernel... linux ($$root)${bootpath}/${kernel_file} cdinst=1 $${isoboot} ${failsafe_boot_options} echo Loading initrd... initrd ($$root)${bootpath}/${initrd_file} } ''' ).strip() + os.linesep ) self.menu_iso_harddisk_entry = ( dedent( ''' menuentry "Boot from Hard Disk" --class os --unrestricted { exit } ''' ).strip() + os.linesep ) def get_iso_template( self, failsafe: bool = True, has_graphics: bool = True, has_serial: bool = False, checkiso: bool = False, has_btrfs_relative_path: bool = False, kernel_count: int = 1, ) -> Template: """ Bootloader configuration template for live ISO media :param bool failsafe: with failsafe true|false :param bool has_graphics: supports graphics terminal :param bool has_serial: supports serial terminal :param int kernel_count: number of kernels to create a boot menu entry for, see _get_kernel_menu_entries() :return: instance of :class:`Template` :rtype: Template """ if has_btrfs_relative_path: template_data = self.header_btrfs_relative_path template_data += self.header else: template_data = self.header template_data += self.timeout template_data += self.timeout_style if has_graphics: template_data += self.header_gfxmode template_data += self.header_theme_iso if has_serial: template_data += self.header_serial template_data += self.header_terminal_setup template_data += self._get_kernel_menu_entries( self.menu_entry, kernel_count ) if failsafe: template_data += self.menu_entry_failsafe if checkiso: template_data += self.menu_mediacheck_entry template_data += self.menu_iso_harddisk_entry template_data += self.menu_entry_boot_snapshots if has_graphics: template_data += self.menu_entry_console_switch return Template(template_data) def get_multiboot_iso_template( self, failsafe: bool = True, has_graphics: bool = True, has_serial: bool = False, checkiso: bool = False, has_btrfs_relative_path: bool = False, kernel_count: int = 1, ) -> Template: """ Bootloader configuration template for live ISO media with hypervisor, e.g Xen dom0 :param bool failsafe: with failsafe true|false :param bool has_graphics: supports graphics terminal :param bool has_serial: supports serial terminal :param int kernel_count: number of kernels to create a boot menu entry for, see _get_kernel_menu_entries() :return: instance of :class:`Template` :rtype: Template """ if has_btrfs_relative_path: template_data = self.header_btrfs_relative_path template_data += self.header else: template_data = self.header template_data += self.timeout template_data += self.timeout_style if has_graphics: template_data += self.header_gfxmode template_data += self.header_theme_iso if has_serial: template_data += self.header_serial template_data += self.header_terminal_setup template_data += self._get_kernel_menu_entries( self.menu_entry_multiboot, kernel_count ) if failsafe: template_data += self.menu_entry_failsafe_multiboot if checkiso: template_data += self.menu_mediacheck_entry_multiboot template_data += self.menu_iso_harddisk_entry template_data += self.menu_entry_boot_snapshots if has_graphics: template_data += self.menu_entry_console_switch return Template(template_data) def get_install_template( self, failsafe: bool = True, has_graphics: bool = True, has_serial: bool = False, with_timeout: bool = True, has_btrfs_relative_path: bool = False, kernel_count: int = 1, ) -> Template: """ Bootloader configuration template for install media :param bool failsafe: with failsafe true|false :param bool has_graphics: supports graphics terminal :param bool has_serial: supports serial terminal :param int kernel_count: number of kernels to create a boot menu entry for, see _get_kernel_menu_entries() :return: instance of :class:`Template` :rtype: Template """ if has_btrfs_relative_path: template_data = self.header_btrfs_relative_path template_data += self.header else: template_data = self.header if with_timeout: template_data += self.timeout template_data += self.timeout_style if has_graphics: template_data += self.header_gfxmode template_data += self.header_theme_iso if has_serial: template_data += self.header_serial template_data += self.header_terminal_setup template_data += self.menu_iso_harddisk_entry template_data += self._get_kernel_menu_entries( self.menu_install_entry, kernel_count ) if failsafe: template_data += self.menu_install_entry_failsafe template_data += self.menu_entry_boot_snapshots if has_graphics: template_data += self.menu_entry_console_switch return Template(template_data) def get_multiboot_install_template( self, failsafe: bool = True, has_graphics: bool = True, has_serial: bool = False, with_timeout: bool = True, has_btrfs_relative_path: bool = False, kernel_count: int = 1, ) -> Template: """ Bootloader configuration template for install media with hypervisor, e.g Xen dom0 :param bool failsafe: with failsafe true|false :param bool has_graphics: supports graphics terminal :param bool has_serial: supports serial terminal :param int kernel_count: number of kernels to create a boot menu entry for, see _get_kernel_menu_entries() :return: instance of :class:`Template` :rtype: Template """ if has_btrfs_relative_path: template_data = self.header_btrfs_relative_path template_data += self.header else: template_data = self.header if with_timeout: template_data += self.timeout template_data += self.timeout_style if has_graphics: template_data += self.header_gfxmode template_data += self.header_theme_iso if has_serial: template_data += self.header_serial template_data += self.header_terminal_setup template_data += self.menu_iso_harddisk_entry template_data += self._get_kernel_menu_entries( self.menu_install_entry_multiboot, kernel_count ) if failsafe: template_data += self.menu_install_entry_failsafe_multiboot template_data += self.menu_entry_boot_snapshots if has_graphics: template_data += self.menu_entry_console_switch return Template(template_data) @staticmethod def _get_kernel_menu_entries(menu_entry: str, kernel_count: int) -> str: """ Provide the given menu entry once for each kernel The entry of the first kernel uses the title, kernel_file and initrd_file parameters. The entry of each further kernel uses the parameters of the same name with the index of the kernel appended, e.g title_1, kernel_file_1 and initrd_file_1 :param str menu_entry: menu entry template :param int kernel_count: number of kernels :return: menu entries template data :rtype: str """ menu_entries = menu_entry for index in range(1, kernel_count): menu_entries += re.sub( r'\$\{(title|kernel_file|initrd_file)\}', rf'${{\g<1>_{index}}}', menu_entry, ) return menu_entries ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.742636 kiwi-11.1.8/kiwi/bootloader/template/systemd_boot.py0000644000000000000000000000475115273675667017527 0ustar00# Copyright (c) 2022 Marcus Schäfer. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from string import Template from textwrap import dedent class BootLoaderTemplateSystemdBoot: """ **systemd-boot configuraton file templates** """ def __init__(self) -> None: self.cr = '\n' self.loader = ( dedent( ''' # kiwi generated loader config file console-mode max editor no ''' ).strip() + self.cr ) self.timeout = ( dedent( ''' timeout ${boot_timeout} ''' ).strip() + self.cr ) self.default = ( dedent( ''' default ${default_entry} ''' ).strip() + self.cr ) self.entry = ( dedent( ''' title ${title} options ${boot_options} linux ${kernel_file} initrd ${initrd_file} ''' ).strip() + self.cr ) def get_loader_template(self, with_default_entry: bool = False) -> Template: """ Bootloader main configuration template :param bool with_default_entry: select the default entry by the default_entry parameter :return: instance of :class:`Template` :rtype: Template """ template_data = self.loader template_data += self.timeout if with_default_entry: template_data += self.default return Template(template_data) def get_entry_template(self) -> Template: """ Bootloader entry configuration template :return: instance of :class:`Template` :rtype: Template """ template_data = self.entry return Template(template_data) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.742636 kiwi-11.1.8/kiwi/bootloader/template/zipl.py0000644000000000000000000000573515273675667015775 0ustar00# Copyright (c) 2024 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from string import Template from textwrap import dedent class BootLoaderTemplateZipl: """ **zipl configuraton file templates** """ def __init__(self) -> None: self.cr = '\n' self.main_conf = ( dedent( ''' [defaultboot] defaultauto prompt=1 target=${bootpath} ${targetbase} targettype=${targettype} targetblocksize=${targetblocksize} targetoffset=${targetoffset} ${targetgeometry} timeout=${boot_timeout} secure=auto ''' ).strip() + self.cr ) self.default = ( dedent( ''' default=${default_entry} ''' ).strip() + self.cr ) self.entry_secure = ( dedent( ''' title ${title} options ${boot_options} linux ${secure_image_file} ''' ).strip() + self.cr ) self.entry_standard = ( dedent( ''' title ${title} options ${boot_options} linux ${kernel_file} initrd ${initrd_file} ''' ).strip() + self.cr ) def get_loader_template(self, with_default_entry: bool = False) -> Template: """ Bootloader main configuration template :param bool with_default_entry: select the default entry by the default_entry parameter, which is the name of a section, e.g the title of a loader entry :return: instance of :class:`Template` :rtype: Template """ template_data = self.main_conf if with_default_entry: template_data += self.default return Template(template_data) def get_entry_template(self, secure: bool = False) -> Template: """ Bootloader entry configuration template :return: instance of :class:`Template` :rtype: Template """ if secure: template_data = self.entry_secure else: template_data = self.entry_standard return Template(template_data) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.742636 kiwi-11.1.8/kiwi/boxbuild/__init__.py0000644000000000000000000000132515273675667014410 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7427986 kiwi-11.1.8/kiwi/boxbuild/box_build.py0000644000000000000000000002774115273675667014632 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import pwd import time import logging import platform from threading import Thread from typing import List, Optional # project from kiwi.path import Path from kiwi.command import Command from kiwi.boxbuild.box_download import BoxDownload from kiwi.boxbuild.defaults import BoxBuildDefaults import kiwi.boxbuild.defaults as runtime from kiwi.exceptions import ( KiwiBoxDownloadError, KiwiBoxQEMUBinaryNotFound, KiwiBoxSSHPortInvalid, KiwiBoxSSHKeyNotFound, KiwiBoxBuildError, ) log = logging.getLogger('kiwi') class BoxBuild: """ **Implements boxbuild command** Implements an interface to run a kiwi build box using the KVM virtualization platform :param str boxname: name of the box from kiwi_boxed_plugin.yml :param str ram: amount of main memory to use for the box :param str console: console name for the box kernel :param str smp: number of CPUs to use in the SMP setup for the box :param str arch: arch name for box :param str machine: machine emulaton type for the box :param str cpu: CPU emulation type :param str sharing_backend: guest/host sharing backend type :param str ssh_key: name of the ssh key to authorize for sshfs sharing :param str ssh_port: host port number to use to forward the guest's SSH port :param bool accel: use KVM hardware acceleration True|False """ def __init__( self, boxname: str, ram: Optional[str] = None, console: Optional[str] = None, smp: Optional[str] = None, arch: str = '', machine: Optional[str] = None, cpu: str = 'host', sharing_backend: str = '9p', ssh_key: str = 'id_rsa', ssh_port: str = '', accel: bool = True, ) -> None: self.ram = ram self.console = console self.smp = smp self.cpu = cpu self.machine = machine self.arch = arch or platform.machine() self.box = BoxDownload(boxname, arch) self.sharing_backend = sharing_backend self.ssh_key = ssh_key self.ssh_port = ssh_port self.kiwi_exit: Optional[int] = None self.accel = accel def run( self, kiwi_build_command: List[str], update_check: bool = True, snapshot: bool = True, keep_open: bool = False, kiwi_version: Optional[str] = None, custom_shared_path: Optional[str] = None, ) -> None: """ Start the build process in a box VM using KVM :param list kiwi_build_command: kiwi build command line Example: .. code:: python [ '--type', 'oem', 'system', 'build', '--description', 'some/description', '--target-dir', 'some/target-dir' ] :param bool update_check: check for box updates True|False :param bool snapshot: run box in snapshot mode True|False :param bool keep_open: keep VM running True|False :param str kiwi_version: pip install this kiwi version :param str custom_shared_path: make this path available in the box """ self.kiwi_build_command = kiwi_build_command desc = self._pop_arg_param('--description') target_dir = self._pop_arg_param('--target-dir') BoxBuildDefaults.create_build_target_dir(target_dir) try: vm_setup = self.box.fetch(update_check, snapshot) except Exception as issue: raise KiwiBoxDownloadError(f'Failed to fetch box file(s): {issue}') vm_append = [ vm_setup.append, 'kiwi=\\"{0}\\"'.format(' '.join(self.kiwi_build_command)), ] if self.console: vm_append[0] = vm_append[0].replace( f'console={vm_setup.console}', f'console={self.console}' ) if keep_open: vm_append.append('kiwi-no-halt') if kiwi_version: vm_append.append('kiwi_version=_{0}_'.format(kiwi_version)) if custom_shared_path: vm_append.append('custom_mount=_{0}_'.format(custom_shared_path)) if self.sharing_backend == 'sshfs': ssh_key_file = os.sep.join( [os.environ.get('HOME') or '~', '.ssh', f'{self.ssh_key}.pub'] ) if not os.path.isfile(ssh_key_file): raise KiwiBoxSSHKeyNotFound( f'SSH pkey file {ssh_key_file} not found, use --ssh-key' ) with open(ssh_key_file) as key_fd: ssh_key = key_fd.read().split() key_type = ssh_key[0] key_value = ssh_key[1] vm_append.append(f'ssh_key=_{key_value}_') vm_append.append(f'ssh_key_type=_{key_type}_') user = pwd.getpwuid(os.geteuid()).pw_name vm_append.append( 'host_kiwidescription=_{0}_'.format(f'{user}@localhost:{desc}') ) vm_append.append( 'host_kiwibundle=_{0}_'.format(f'{user}@localhost:{target_dir}') ) if custom_shared_path: vm_append.append( 'host_custompath=_{0}_'.format( f'{user}@localhost:{custom_shared_path}' ) ) vm_append.append('sharing_backend=_{0}_'.format(self.sharing_backend)) vm_machine = [] if self.machine: vm_machine.append('-machine') vm_machine.append(self.machine) if self.accel: vm_machine.append('-accel') vm_machine.append('accel=kvm') if len(self.ssh_port) > 0: if not self.ssh_port.isdigit(): raise KiwiBoxSSHPortInvalid( f'Invalid SSH port: {self.ssh_port} ' '(must be a positive integer)' ) BoxBuildDefaults.box_ssh_port_forwarded_to_host = int(self.ssh_port) vm_machine.append('-cpu') vm_machine.append(self.cpu) vm_memory = format(self.ram or vm_setup.ram) qemu_binary = self._find_qemu_call_binary() if not qemu_binary: raise KiwiBoxQEMUBinaryNotFound( f'No QEMU binary for {self.arch} found' ) vm_run = ( [qemu_binary, '-m', vm_memory] + vm_machine + [] + BoxBuildDefaults.get_qemu_generic_setup() + [ '-kernel', vm_setup.kernel, '-append', '"{0}"'.format(' '.join(vm_append)), ] + BoxBuildDefaults.get_qemu_storage_setup(vm_setup.system, snapshot) + BoxBuildDefaults.get_qemu_network_setup() + BoxBuildDefaults.get_qemu_console_setup() + BoxBuildDefaults.get_qemu_shared_path_setup( 0, desc, 'kiwidescription', self.sharing_backend ) + BoxBuildDefaults.get_qemu_shared_path_setup( 1, target_dir, 'kiwibundle', self.sharing_backend ) ) if custom_shared_path: vm_run += BoxBuildDefaults.get_qemu_shared_path_setup( 2, custom_shared_path, 'custompath', self.sharing_backend ) if self.sharing_backend == 'virtiofs': vm_run += [ '-object', '{0},id=mem,size={1},mem-path={2},share=on'.format( 'memory-backend-file', vm_memory, '/dev/shm' ), '-numa', 'node,memdev=mem', ] if vm_setup.initrd: vm_run += ['-initrd', vm_setup.initrd] if vm_setup.smp: vm_run += ['-smp', format(self.smp or vm_setup.smp)] os.environ['TMPDIR'] = BoxBuildDefaults.get_local_box_cache_dir() log.debug('Set TMPDIR: {0}'.format(os.environ['TMPDIR'])) if self.sharing_backend == 'sshfs': log.debug('Initiating port forwarding') # delete eventual existing host key for localhost on # the kvm forwared box ssh port box_ssh_port_forwarded_to_host # this is required because the host ssh key changes # with every kvm box run. ssh identifies this as # a potential man-in-the-middle attack and will disable # port forwarding which is required though. Command.run( [ 'ssh-keygen', '-R', '[localhost]:{0}'.format( runtime.BoxBuildDefaults.box_ssh_port_forwarded_to_host ), ], raise_on_error=False, ) # remote forward the host ssh port(22) into the box # at port HOST_SSH_PORT_FORWARDED_TO_BOX using the kvm forwarded # box ssh port box_ssh_port_forwarded_to_host. This action only # completes successfully when the box has started up and is # ready to operate through ssh ssh_forward_thread = Thread( target=self._forward_host_ssh_to_guest, args=() ) ssh_forward_thread.start() log.debug('Calling Qemu: {0}'.format(vm_run)) os.system(' '.join(vm_run)) for virtiofsd_process in runtime.VIRTIOFSD_PROCESS_LIST: virtiofsd_process.terminate() exit_code_file = os.sep.join( [target_dir, BoxBuildDefaults.result_exitcode_name] ) build_log_file = os.sep.join( [target_dir, BoxBuildDefaults.result_log_name] ) self.kiwi_exit = 0 if os.path.exists(exit_code_file): with open(exit_code_file) as exit_code: self.kiwi_exit = int(exit_code.readline()) if self.kiwi_exit != 0: raise KiwiBoxBuildError( f'Box build failed. Find build log at: {build_log_file!r}' ) log.info(f'Box build done. Find build log at: {build_log_file!r}') def _pop_arg_param(self, arg: str) -> str: arg_index = self.kiwi_build_command.index(arg) arg_value = '' if arg_index: arg_value = self.kiwi_build_command[arg_index + 1] del self.kiwi_build_command[arg_index + 1] del self.kiwi_build_command[arg_index] return arg_value def _find_qemu_call_binary(self) -> str: qemu_by_system = Path.which(f'qemu-system-{self.arch}') if qemu_by_system: return qemu_by_system if self.arch == 'x86_64': return Path.which('qemu-kvm') or '' return '' def _forward_host_ssh_to_guest(self) -> None: while self.kiwi_exit is None: try: Command.run( [ 'ssh', '-NT', '-o', 'StrictHostKeyChecking=no', 'root@localhost', '-p', format( runtime.BoxBuildDefaults.box_ssh_port_forwarded_to_host ), '-R', '{0}:localhost:22'.format( runtime.HOST_SSH_PORT_FORWARDED_TO_BOX ), ] ) except Exception as issue: log.debug(issue) time.sleep(2) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7427986 kiwi-11.1.8/kiwi/boxbuild/box_config.py0000644000000000000000000000652215273675667014772 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import platform from typing import List, Dict # project from kiwi.boxbuild.boxes_config import BoxesConfig from kiwi.exceptions import KiwiBoxNameError, KiwiBoxArchNotFoundError class BoxConfig: """ **Implements reading of box configuration:** :param str boxname: name of the box from kiwi_boxed_plugin.yml :param str arch: arch name for box """ def __init__(self, boxname: str, arch: str = '') -> None: self.arch = arch or platform.machine() boxes_config = BoxesConfig() self.box_config = self._get_box_config( boxes_config.get_config(), boxname ) if not self.box_config: raise KiwiBoxNameError('Box: {0} not found'.format(boxname)) self.box_arch_config = self._get_box_arch_config( self.box_config, self.arch ) def get_box_arch(self) -> str: return self.arch def get_box_memory_mbytes(self) -> str: return self.box_config.get('mem_mb') or '' def get_box_processors(self) -> str: return self.box_config.get('processors') or '' def get_box_console(self) -> str: return self.box_config.get('console') or '' def get_box_kernel_cmdline(self) -> str: return ' '.join(self.box_arch_config.get('cmdline') or '') def get_box_source(self) -> str: return self.box_arch_config.get('source') or '' def get_box_container(self) -> str: return self.box_arch_config.get('container') or '' def get_box_packages_file(self) -> str: return self.box_arch_config.get('packages_file') or '' def get_box_packages_shasum_file(self) -> str: packages_file = self.box_arch_config.get('packages_file') or '' if packages_file: packages_file += '.sha256' return packages_file def get_box_files(self) -> List[str]: source_files = [] for vm_file in self.box_arch_config.get('boxfiles') or []: source_files.append(vm_file) source_files.append(f'{vm_file}.sha256') return source_files def use_initrd(self) -> bool: return bool(self.box_arch_config.get('use_initrd')) def _get_box_config(self, boxes_config: List[Dict], name: str) -> Dict: for box in boxes_config: if box.get('name') == name: return box return {} def _get_box_arch_config(self, box_config: Dict, arch: str) -> Dict: for box_arch in box_config.get('arch') or []: if box_arch.get('name') == arch: return box_arch raise KiwiBoxArchNotFoundError( f'No box configuration found for architecture: {arch}' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7427986 kiwi-11.1.8/kiwi/boxbuild/box_container_build.py0000644000000000000000000001346015273675667016665 0ustar00# Copyright (c) 2025 SUSE LLC. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging import platform from tempfile import NamedTemporaryFile from typing import List, Optional # project from kiwi.command import Command from kiwi.defaults import Defaults from kiwi.boxbuild.defaults import BoxBuildDefaults from kiwi.boxbuild.box_download import BoxDownload from kiwi.exceptions import KiwiBoxBuildError log = logging.getLogger('kiwi') class BoxContainerBuild: """ **Implements boxbuild command for container based build** Implements an interface to run a kiwi build box using the podman container engine :param str boxname: name of the box from kiwi_boxed_plugin.yml :param str arch: arch name for box """ def __init__(self, boxname: str, arch: str = '') -> None: self.kiwi_cache = f'/{Defaults.get_shared_cache_location()}' self.arch = arch or platform.machine() self.box = BoxDownload(boxname, arch) self.kiwi_exit: Optional[int] = None def run( self, kiwi_build_command: List[str], keep_open: bool = False, kiwi_version: Optional[str] = None, custom_shared_path: Optional[str] = None, ) -> None: """ Start the build process in a container :param list kiwi_build_command: kiwi build command line Example: .. code:: python [ '--type', 'oem', 'system', 'build', '--description', 'some/description', '--target-dir', 'some/target-dir' ] :param bool keep_open: keep container running True|False :param str kiwi_version: pip install this kiwi version :param str custom_shared_path: make this path available in the container """ self.kiwi_build_command = kiwi_build_command desc = os.path.abspath(self._pop_arg_param('--description')) target_dir = os.path.abspath(self._pop_arg_param('--target-dir')) BoxBuildDefaults.create_build_target_dir(target_dir) container_name = self.box.fetch_container() container_cmdline = [ 'kiwi="{0}"'.format(' '.join(self.kiwi_build_command)) ] if keep_open: container_cmdline.append('kiwi-no-halt') if kiwi_version: container_cmdline.append('kiwi_version=_{0}_'.format(kiwi_version)) if custom_shared_path: custom_shared_path = os.path.abspath(custom_shared_path) if not os.path.exists(custom_shared_path): raise KiwiBoxBuildError( f'Custom share path {custom_shared_path} does not exist' ) container_cmdline.append( 'custom_mount=_{0}_'.format(custom_shared_path) ) if not os.path.exists(desc): raise KiwiBoxBuildError(f'Image description {desc} does not exist') self.cmdline = NamedTemporaryFile(prefix='cmdline') with open(self.cmdline.name, 'w') as cmdline: cmdline.write('{0}'.format(' '.join(container_cmdline))) cmdline.write(os.linesep) if not os.path.isdir(self.kiwi_cache): Command.run(['sudo', 'mkdir', '-p', self.kiwi_cache]) container_run = [ 'sudo', 'podman', 'run', '--rm', '-ti', '--privileged', '--net', 'host', '--cap-add', 'AUDIT_WRITE', '--cap-add', 'AUDIT_CONTROL', '--cap-add', 'CAP_MKNOD', '--cap-add', 'CAP_SYS_ADMIN', '--volume', '/var/cache/kiwi:/var/cache/kiwi', '--volume', f'{self.cmdline.name}:/container.cmdline', '--volume', f'{target_dir}:/bundle', '--volume', f'{desc}:/description', '--volume', '/dev:/dev', ] if custom_shared_path: container_run.append('--volume') container_run.append(f'{custom_shared_path}:{custom_shared_path}') container_run.append(container_name) log.debug('Calling podman: {0}'.format(container_run)) os.system(' '.join(container_run)) exit_code_file = os.sep.join( [target_dir, BoxBuildDefaults.result_exitcode_name] ) build_log_file = os.sep.join( [target_dir, BoxBuildDefaults.result_log_name] ) self.kiwi_exit = 0 if os.path.exists(exit_code_file): with open(exit_code_file) as exit_code: self.kiwi_exit = int(exit_code.readline()) if self.kiwi_exit != 0: raise KiwiBoxBuildError( f'Box build failed. Find build log at: {build_log_file!r}' ) log.info(f'Box build done. Find build log at: {build_log_file!r}') def _pop_arg_param(self, arg: str) -> str: arg_index = self.kiwi_build_command.index(arg) arg_value = '' if arg_index: arg_value = self.kiwi_build_command[arg_index + 1] del self.kiwi_build_command[arg_index + 1] del self.kiwi_build_command[arg_index] return arg_value ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7427986 kiwi-11.1.8/kiwi/boxbuild/box_download.py0000644000000000000000000001764015273675667015337 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import platform import logging from typing import NamedTuple # project from kiwi.command import Command from kiwi.utils.checksum import Checksum from kiwi.utils.dir_files import DirFiles from kiwi.utils.fetch_files import FetchFiles from kiwi.solver.repository import SolverRepository from kiwi.system.uri import Uri from kiwi.path import Path from kiwi.boxbuild.box_config import BoxConfig from kiwi.boxbuild.defaults import BoxBuildDefaults from kiwi.exceptions import KiwiBoxChecksumError vm_setup_type = NamedTuple( 'vm_setup_type', [ ('system', str), ('kernel', str), ('initrd', str), ('append', str), ('console', str), ('ram', str), ('smp', str), ], ) log = logging.getLogger('kiwi') class BoxDownload: """ **Implements download of box file(s)** Reads the box configuration file and provides an interface to download the box files according to the configuration :param string boxname: name of the box from kiwi_boxed_plugin.yml :param string arch: arch name for box """ def __init__(self, boxname: str, arch: str = '') -> None: self.arch = arch or platform.machine() self.box_config = BoxConfig(boxname, arch) self.box_dir = os.sep.join( [BoxBuildDefaults.get_local_box_cache_dir(), boxname] ) self.box_stage = DirFiles(self.box_dir) self.system = '' self.kernel = '' self.initrd = '' Path.create(self.box_dir) def fetch_container(self) -> str: """ Download container box from the open build service """ container_source = self.box_config.get_box_container() if container_source: container_pull = ['sudo', 'podman', 'pull', container_source] os.system(' '.join(container_pull)) return container_source def fetch( self, update_check: bool = True, snapshot: bool = True ) -> vm_setup_type: """ Download box from the open build service :param bool update_check: check for box updates True|False :param bool snapshot: box is used in snapshot mode True|False """ fetcher = FetchFiles() download = update_check repo_source = self.box_config.get_box_source() if repo_source: repo = SolverRepository.new(Uri(repo_source, 'rpm-md')) packages_file = self.box_config.get_box_packages_file() packages_shasum_file = ( self.box_config.get_box_packages_shasum_file() ) if update_check and packages_file and packages_shasum_file: local_packages_file = os.sep.join([self.box_dir, packages_file]) local_packages_shasum_file = os.sep.join( [self.box_dir, packages_shasum_file] ) local_packages_file_tmp = self.box_stage.register( local_packages_file ) local_packages_shasum_file_tmp = self.box_stage.register( local_packages_shasum_file ) repo.download_from_repository( packages_file, local_packages_file_tmp ) checksum = Checksum(local_packages_file_tmp) shasum = checksum.sha256() if checksum.matches(shasum, local_packages_shasum_file): download = False self.box_stage.deregister(local_packages_shasum_file) else: self._create_packages_checksum( local_packages_shasum_file_tmp, shasum ) for box_file in self.box_config.get_box_files(): local_box_file = os.sep.join([self.box_dir, box_file]) if not os.path.exists(local_box_file): download = True if download: log.info('Downloading {0}'.format(box_file)) local_box_file_tmp = self.box_stage.register(local_box_file) box_file_link = os.sep.join( [repo._get_mime_typed_uri(), box_file] ) fetcher.wget(url=box_file_link, filename=local_box_file_tmp) if download: self.box_stage.commit() for box_file in self.box_config.get_box_files(): local_box_file = os.sep.join([self.box_dir, box_file]) if box_file.endswith('.qcow2'): if ( update_check and snapshot and not self._checksum_ok(local_box_file) ): raise KiwiBoxChecksumError( f'Checksum failed for {local_box_file}' ) self.system = local_box_file if box_file.endswith('.tar.xz'): if update_check and not self._checksum_ok(local_box_file): raise KiwiBoxChecksumError( f'Checksum failed for {local_box_file}' ) self.kernel = self._extract_kernel_from_tarball( local_box_file ) if self.box_config.use_initrd(): self.initrd = self._extract_initrd_from_tarball( local_box_file ) return vm_setup_type( system=self.system, kernel=self.kernel, initrd=self.initrd, append='console={0} {1}'.format( self.box_config.get_box_console(), self.box_config.get_box_kernel_cmdline(), ), console=self.box_config.get_box_console(), ram=self.box_config.get_box_memory_mbytes(), smp=self.box_config.get_box_processors(), ) def _checksum_ok(self, filename: str) -> bool: checksum = Checksum(filename) shasum = checksum.sha256() sumfile = f'{filename}.sha256' log.info('Checksum test {0} -> {1}'.format(filename, sumfile)) return checksum.matches(shasum, sumfile) def _create_packages_checksum(self, filename: str, shasum: str) -> None: with open(filename, 'w') as sha_file: sha_file.write(shasum) def _extract_kernel_from_tarball(self, tarfile: str) -> str: Command.run( [ 'tar', '-C', self.box_dir, '--transform', f's/.*/kernel.{self.arch}/', '--wildcards', '-xf', tarfile, '*.kernel', ] ) return os.sep.join([self.box_dir, f'kernel.{self.arch}']) def _extract_initrd_from_tarball(self, tarfile: str) -> str: Command.run( [ 'tar', '-C', self.box_dir, '--transform', f's/.*/initrd.{self.arch}/', '--wildcards', '-xf', tarfile, '*.initrd', ] ) return os.sep.join([self.box_dir, f'initrd.{self.arch}']) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7427986 kiwi-11.1.8/kiwi/boxbuild/boxes_config.py0000644000000000000000000000457215273675667015325 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging import yaml from cerberus import Validator from typing import List, Dict # project from kiwi.boxbuild.boxes_config_schema import schema from kiwi.boxbuild.defaults import BoxBuildDefaults from kiwi.exceptions import KiwiBoxConfigError log = logging.getLogger('kiwi') class BoxesConfig: """ **Implements reading of the boxes config file:** kiwi_boxed_plugin.yml The KIWI box configuration file is a yaml formatted file containing information about available virtual disk images and containers usable as build boxes """ def __init__(self) -> None: self.config_data = {} config_file = BoxBuildDefaults.get_box_config_file() log.info('Reading boxes config file: {0}'.format(config_file)) try: with open(config_file, 'r') as config: self.config_data = yaml.safe_load(config) except Exception as issue: raise KiwiBoxConfigError(issue) validator = Validator(schema) validator.validate(self.config_data, schema) if validator.errors: raise KiwiBoxConfigError( 'Failed to validate {0}: {1}'.format( config_file, validator.errors ) ) def get_config(self) -> List[Dict]: """ Return config data dictionary """ return self.config_data.get('box') or [] def dump_config(self) -> str: """ Return config dump as pretty string for the console """ config_dump = '' box_dict = self.config_data.get('box') or {} if box_dict: config_dump = yaml.dump(box_dict) return config_dump ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7427986 kiwi-11.1.8/kiwi/boxbuild/boxes_config_schema.py0000644000000000000000000000635215273675667016643 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # schema = { 'box': { 'required': True, 'type': 'list', 'schema': { 'type': 'dict', 'schema': { 'name': {'type': 'string', 'required': True, 'empty': False}, 'mem_mb': {'type': 'string', 'required': True, 'empty': False}, 'processors': { 'type': 'number', 'required': False, 'empty': False, }, 'console': {'type': 'string', 'required': True, 'empty': False}, 'arch': { 'required': True, 'type': 'list', 'schema': { 'type': 'dict', 'schema': { 'name': { 'type': 'string', 'allowed': [ 'x86_64', 's390x', 'aarch64', 'ppc64', 'ppc64le', ], 'required': True, 'empty': False, }, 'cmdline': { 'type': 'list', 'required': True, 'nullable': False, }, 'source': { 'type': 'string', 'required': True, 'empty': False, }, 'packages_file': { 'type': 'string', 'required': True, 'empty': False, }, 'boxfiles': { 'type': 'list', 'required': True, 'nullable': False, }, 'container': { 'type': 'string', 'required': True, 'nullable': False, }, 'use_initrd': {'type': 'boolean', 'required': True}, }, }, }, }, }, } } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7427986 kiwi-11.1.8/kiwi/boxbuild/defaults.py0000644000000000000000000001552115273675667014463 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import pathlib import subprocess from subprocess import Popen from typing import List, Optional # project from kiwi.path import Path from kiwi.defaults import Defaults from kiwi.exceptions import KiwiBoxVirtioFsError, KiwiBoxTargetPathError VIRTIOFSD_PROCESS_LIST: List[Popen[bytes]] = [] HOST_SSH_PORT_FORWARDED_TO_BOX = 10000 class BoxBuildDefaults: """ **Implements default values for the boxbuild command** Provides static methods for default values and state information """ box_ssh_port_forwarded_to_host = 10022 result_log_name = 'result.log' result_exitcode_name = 'result.code' @staticmethod def get_box_config_file() -> str: """ Config file name: `kiwi_boxed_plugin.yml` Locations are searched in this order: 1. ENV variable: $KIWI_BOXED_PLUGIN_CFG full path to file, name is freely selectable 2. $PWD/kiwi_boxed_plugin.yml 3. $HOME/.config/kiwi/kiwi_boxed_plugin.yml 4. /etc/kiwi_boxed_plugin.yml 5. Resource (default config, coming with kiwi) """ config_name = 'kiwi_boxed_plugin.yml' # 1. config_path_env: str = os.environ.get('KIWI_BOXED_PLUGIN_CFG') or '' if config_path_env and os.path.exists(config_path_env): return config_path_env # 2. config_path_pwd = os.path.abspath(config_name) if os.path.exists(config_path_pwd): return config_path_pwd # 3. config_path_home: pathlib.Path = pathlib.Path.home().joinpath( f'.config/kiwi/{config_name}' ) if config_path_home.exists(): return config_path_home.as_posix() # 4. config_path_system = f'/etc/{config_name}' if os.path.exists(config_path_system): return config_path_system # 5. return Defaults.project_file(f'config/{config_name}') @staticmethod def get_local_box_cache_dir() -> str: local_box_cache_dir_env: Optional[str] = os.environ.get( 'KIWI_BOXED_CACHE_DIR' ) if local_box_cache_dir_env and os.path.isdir(local_box_cache_dir_env): return local_box_cache_dir_env return f'{os.environ.get("HOME")}/.kiwi_boxes' @staticmethod def get_qemu_generic_setup() -> List[str]: return ['-nographic', '-nodefaults', '-snapshot'] @staticmethod def get_qemu_network_setup() -> List[str]: return [ '-nic', 'user,model=virtio,hostfwd=tcp::{0}-:22'.format( BoxBuildDefaults.box_ssh_port_forwarded_to_host ), ] @staticmethod def get_qemu_shared_path_setup( index: int, path: str, mount_tag: str, sharing_backend: str = '9p' ) -> List[str]: shared_setup: List[str] = [] if sharing_backend == '9p': shared_setup = BoxBuildDefaults.get_qemu_shared_path_setup_9p( index, path, mount_tag ) if sharing_backend == 'virtiofs': shared_setup = BoxBuildDefaults.get_qemu_shared_path_setup_virtiofs( index, path, mount_tag ) return shared_setup @staticmethod def get_qemu_shared_path_setup_9p( index: int, path: str, mount_tag: str ) -> List[str]: return [ '-fsdev', 'local,security_model=mapped,id=fsdev{0},path={1}'.format( index, path ), '-device', 'virtio-9p-pci,id=fs{0},fsdev=fsdev{0},mount_tag={1}'.format( index, mount_tag ), ] @staticmethod def get_qemu_shared_path_setup_virtiofs( index: int, path: str, mount_tag: str ) -> List[str]: virtiofsd_lookup_paths = { 'PATH': '/usr/libexec:/usr/lib/virtiofsd:/usr/lib/qemu/virtiofsd' } virtiofsd = Path.which('virtiofsd', virtiofsd_lookup_paths) if not virtiofsd: raise KiwiBoxVirtioFsError( 'virtiofsd not found in: {0}'.format(virtiofsd_lookup_paths) ) try: virtiofsd_process = subprocess.Popen( [ virtiofsd, '--socket-path=/tmp/vhostqemu_{0}'.format(index), '--shared-dir', os.path.abspath(path), '--sandbox', 'namespace', '--cache', 'always', '--allow-direct-io', '--posix-acl', '--xattr', ], close_fds=True, ) except Exception as issue: raise KiwiBoxVirtioFsError( 'Failed to start virtiofsd: {0}'.format(issue) ) VIRTIOFSD_PROCESS_LIST.append(virtiofsd_process) return [ '-chardev', 'socket,id=char{0},path=/tmp/vhostqemu_{0}'.format(index), '-device', 'vhost-user-fs-pci,queue-size=1024,chardev=char{0},tag={1}'.format( index, mount_tag ), ] @staticmethod def get_qemu_console_setup() -> List[str]: return [ '-device', 'virtio-serial', '-chardev', 'stdio,id=virtiocon0', '-device', 'virtconsole,chardev=virtiocon0', ] @staticmethod def get_qemu_storage_setup( image_file: str, snapshot: bool = True ) -> List[str]: return [ '-drive', 'file={0},if=virtio,driver=qcow2,cache=off,snapshot={1}'.format( image_file, 'on' if snapshot else 'off' ), ] @staticmethod def create_build_target_dir(target_dir: str) -> None: try: pathlib.Path(target_dir).mkdir(parents=True, exist_ok=True) build_log_file = os.path.join( target_dir, BoxBuildDefaults.result_log_name ) pathlib.Path(build_log_file).touch() except Exception as issue: raise KiwiBoxTargetPathError( f'Failed to create/setup target path {target_dir}: {issue}' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7427986 kiwi-11.1.8/kiwi/builder/__init__.py0000644000000000000000000000633215273675667014231 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # # project import importlib from typing import TYPE_CHECKING, Dict, Optional, Union from abc import ABCMeta, abstractmethod from kiwi.defaults import Defaults from kiwi.xml_state import XMLState from kiwi.exceptions import KiwiRequestedTypeError if TYPE_CHECKING: # pragma: nocover from kiwi.builder.archive import ArchiveBuilder from kiwi.builder.container import ContainerBuilder from kiwi.builder.disk import DiskBuilder from kiwi.builder.enclave import EnclaveBuilder from kiwi.builder.filesystem import FileSystemBuilder from kiwi.builder.kis import KisBuilder from kiwi.builder.live import LiveImageBuilder class ImageBuilder(metaclass=ABCMeta): """ Image builder factory """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( xml_state: XMLState, target_dir: str, root_dir: str, custom_args: Optional[Dict] = None, ) -> Union[ 'FileSystemBuilder', 'DiskBuilder', 'LiveImageBuilder', 'KisBuilder', 'EnclaveBuilder', 'ArchiveBuilder', 'ContainerBuilder', ]: image_type = xml_state.get_build_type_name() if image_type in Defaults.get_filesystem_image_types(): name_token = ('filesystem', 'FileSystemBuilder') elif image_type in Defaults.get_disk_image_types(): name_token = ('disk', 'DiskBuilder') elif image_type in Defaults.get_live_image_types(): name_token = ('live', 'LiveImageBuilder') elif image_type in Defaults.get_kis_image_types(): name_token = ('kis', 'KisBuilder') elif image_type in Defaults.get_enclaves_image_types(): name_token = ('enclave', 'EnclaveBuilder') elif image_type in Defaults.get_archive_image_types(): name_token = ('archive', 'ArchiveBuilder') elif image_type in Defaults.get_container_image_types(): name_token = ('container', 'ContainerBuilder') else: name_token = ('None', 'None') try: builder_namespace, builder_name = name_token builder = importlib.import_module( 'kiwi.builder.{0}'.format(builder_namespace) ) return builder.__dict__[builder_name]( xml_state, target_dir, root_dir, custom_args ) except Exception as issue: raise KiwiRequestedTypeError( f'Requested image type {image_type} not supported: {issue}' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7431872 kiwi-11.1.8/kiwi/builder/archive.py0000644000000000000000000001273515273675667014117 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging from typing import Dict, Optional # project from kiwi.defaults import Defaults from kiwi.archive.tar import ArchiveTar from kiwi.archive.cpio import ArchiveCpio from kiwi.system.setup import SystemSetup from kiwi.system.result import Result from kiwi.runtime_config import RuntimeConfig from kiwi.xml_state import XMLState from kiwi.exceptions import KiwiArchiveSetupError log = logging.getLogger('kiwi') class ArchiveBuilder: """ **Root archive image builder** :param object xml_state: Instance of :class:`XMLState` :param str target_dir: target directory path name :param str root_dir: root directory path name :param dict custom_args: Custom processing arguments defined as hash keys: * xz_options: string of XZ compression parameters """ def __init__( self, xml_state: XMLState, target_dir: str, root_dir: str, custom_args: Optional[Dict] = None, ): self.root_dir = root_dir self.target_dir = target_dir self.xml_state = xml_state self.requested_archive_type = xml_state.get_build_type_name() self.bundle_format = xml_state.get_build_type_bundle_format() self.result = Result(xml_state) self.system_setup = SystemSetup( xml_state=xml_state, root_dir=self.root_dir ) self.filename = '' self.xz_options = ( custom_args['xz_options'] if custom_args and 'xz_options' in custom_args else None ) self.runtime_config = RuntimeConfig() def create(self) -> Result: """ Create a root archive tarball Build a simple XZ compressed root tarball from the image root tree Image types which triggers this builder are: * image="tbz" * image="cpio" :return: result :rtype: instance of :class:`Result` """ supported_archives = Defaults.get_archive_image_types() if self.requested_archive_type not in supported_archives: raise KiwiArchiveSetupError( f'Unknown archive type: {self.requested_archive_type}' ) if self.requested_archive_type == 'tbz': log.info('Creating XZ compressed tar archive') self.filename = self._target_file_for('tar.xz') ArchiveTar(self._target_file_for('tar')).create_xz_compressed( self.root_dir, xz_options=self.xz_options, exclude=Defaults.get_exclude_list_for_root_data_sync() + Defaults.get_exclude_list_from_custom_exclude_files( self.root_dir ), ) if self.requested_archive_type == 'cpio': log.info('Creating CPIO archive') self.filename = self._target_file_for('cpio') ArchiveCpio(self.filename).create( self.root_dir, exclude=Defaults.get_exclude_list_for_root_data_sync() + Defaults.get_exclude_list_from_custom_exclude_files( self.root_dir ), ) if self.filename: Result.verify_image_size( self.runtime_config.get_max_size_constraint(), self.filename ) if self.bundle_format: self.result.add_bundle_format(self.bundle_format) self.result.add( key='root_archive', filename=self.filename, use_for_bundle=True, compress=False, shasum=True, ) self.result.add( key='image_packages', filename=self.system_setup.export_package_list(self.target_dir), use_for_bundle=True, compress=False, shasum=False, ) self.result.add( key='image_changes', filename=self.system_setup.export_package_changes( self.target_dir ), use_for_bundle=True, compress=True, shasum=False, ) self.result.add( key='image_verified', filename=self.system_setup.export_package_verification( self.target_dir ), use_for_bundle=True, compress=False, shasum=False, ) return self.result def _target_file_for(self, suffix: str) -> str: return ''.join( [ self.target_dir, '/', self.xml_state.xml_data.get_name(), '.' + Defaults.get_platform_name(), '-' + self.xml_state.get_image_version(), '.', suffix, ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7431872 kiwi-11.1.8/kiwi/builder/container.py0000644000000000000000000001672315273675667014461 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging import os from typing import Dict, Optional # project from kiwi.container import ContainerImage from kiwi.container.setup import ContainerSetup from kiwi.system.setup import SystemSetup from kiwi.system.result import Result from kiwi.utils.checksum import Checksum from kiwi.defaults import Defaults from kiwi.exceptions import KiwiContainerBuilderError from kiwi.runtime_config import RuntimeConfig from kiwi.xml_state import XMLState log = logging.getLogger('kiwi') class ContainerBuilder: """ **Container image builder** :param object xml_state: Instance of :class:`XMLState` :param str target_dir: target directory path name :param str root_dir: root directory path name :param dict custom_args: Custom processing arguments defined as hash keys: * xz_options: string of XZ compression parameters """ def __init__( self, xml_state: XMLState, target_dir: str, root_dir: str, custom_args: Optional[Dict] = None, ): self.runtime_config = RuntimeConfig() self.custom_args = custom_args or {} self.root_dir = root_dir self.target_dir = target_dir self.bundle_format = xml_state.get_build_type_bundle_format() self.container_config = xml_state.get_container_config() self.requested_container_type = xml_state.get_build_type_name() self.delta_root = xml_state.build_type.get_delta_root() self.base_image = None self.base_image_sha = None self.ensure_empty_tmpdirs = True self.container_config['xz_options'] = self.custom_args.get('xz_options') self.container_config['metadata_path'] = ( xml_state.build_type.get_metadata_path() ) if xml_state.get_derived_from_image_uri() and not self.delta_root: # The base image(all derived imports) is expected to be unpacked # by the kiwi prepare step and stored inside of the root_dir/image # directory. In addition a sha file of the image is expected too self.base_image = Defaults.get_imported_root_image(self.root_dir) self.base_image_sha = '{}{}'.format( self.base_image, self.runtime_config.get_checksum_handler( self.base_image ).suffix, ) if not os.path.exists(self.base_image): raise KiwiContainerBuilderError( 'Unpacked Base image {0} not found'.format(self.base_image) ) if not os.path.exists(self.base_image_sha): raise KiwiContainerBuilderError( 'Base image shasum file {0} not found'.format( self.base_image_sha ) ) if xml_state.build_type.get_ensure_empty_tmpdirs() is False: self.ensure_empty_tmpdirs = False self.system_setup = SystemSetup( xml_state=xml_state, root_dir=self.root_dir ) self.special_needs = ['appx', 'wsl'] self.filename = ''.join( [ target_dir, '/', xml_state.xml_data.get_name(), '.' + Defaults.get_platform_name(), '-' + xml_state.get_image_version(), '.', self.requested_container_type, ( '.tar' if self.requested_container_type not in self.special_needs else '' ), ] ) self.result = Result(xml_state) def create(self) -> Result: """ Builds a container image which is usually a data archive including container specific metadata. Image types which triggers this builder are: * image="docker" * image="oci" * image="appx" * image="wsl" :return: result :rtype: instance of :class:`Result` """ if not self.base_image: log.info('Setting up %s container', self.requested_container_type) container_setup = ContainerSetup.new( self.requested_container_type, self.root_dir, self.container_config, ) container_setup.setup() else: shasum = self.runtime_config.get_checksum_handler( source_filename=self.base_image ) checksum = Checksum(self.base_image) # the sha file is set along with the base image assert self.base_image_sha is not None if not checksum.matches(shasum.digest(), self.base_image_sha): raise KiwiContainerBuilderError( 'base image file {0} checksum validation failed'.format( self.base_image ) ) log.info('--> Creating container image') container_image = ContainerImage.new( self.requested_container_type, self.root_dir, self.container_config ) self.filename = container_image.create( self.filename, self.base_image or '', self.ensure_empty_tmpdirs, ( self.runtime_config.get_container_compression() # appx containers already contains a compressed root # wsl containers recommends gzip and we default to it if self.requested_container_type not in self.special_needs else False ), ) Result.verify_image_size( self.runtime_config.get_max_size_constraint(), self.filename ) if self.bundle_format: self.result.add_bundle_format(self.bundle_format) self.result.add( key='container', filename=self.filename, use_for_bundle=True, compress=False, shasum=True, ) if not self.delta_root: self.result.add( key='image_packages', filename=self.system_setup.export_package_list(self.target_dir), use_for_bundle=True, compress=False, shasum=False, ) self.result.add( key='image_changes', filename=self.system_setup.export_package_changes( self.target_dir ), use_for_bundle=True, compress=True, shasum=False, ) self.result.add( key='image_verified', filename=self.system_setup.export_package_verification( self.target_dir ), use_for_bundle=True, compress=False, shasum=False, ) return self.result ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7431872 kiwi-11.1.8/kiwi/builder/disk.py0000644000000000000000000025754715273675667013444 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from contextlib import ExitStack import os import logging from typing import Dict, List, Optional, Tuple, TypedDict, Union # project import kiwi.defaults as defaults from kiwi.path import Path from kiwi.mount_manager import MountManager from kiwi.utils.veritysetup import VeritySetup from kiwi.utils.temporary import Temporary from kiwi.system.mount import ImageSystem from kiwi.storage.disk import ptable_entry_type from kiwi.defaults import Defaults from kiwi.filesystem.base import FileSystemBase from kiwi.bootloader.config import create_boot_loader_config from kiwi.bootloader.config.base import BootLoaderConfigBase from kiwi.bootloader.install import BootLoaderInstall from kiwi.system.identifier import SystemIdentifier from kiwi.boot.image import BootImage from kiwi.boot.image.base import BootImageBase from kiwi.storage.setup import DiskSetup from kiwi.storage.loop_device import LoopDevice from kiwi.storage.clone_device import CloneDevice from kiwi.firmware import FirmWare from kiwi.storage.disk import Disk from kiwi.storage.raid_device import RaidDevice from kiwi.storage.luks_device import LuksDevice from kiwi.storage.integrity_device import ( IntegrityDevice, integrity_credentials_type, ) from kiwi.storage.device_provider import DeviceProvider from kiwi.filesystem import FileSystem from kiwi.volume_manager import VolumeManager from kiwi.volume_manager.base import VolumeManagerBase from kiwi.command import Command from kiwi.system.setup import SystemSetup from kiwi.builder.install import InstallImageBuilder from kiwi.system.kernel import Kernel from kiwi.storage.subformat import DiskFormat from kiwi.system.result import Result from kiwi.utils.block import BlockID from kiwi.utils.fstab import Fstab from kiwi.runtime_config import RuntimeConfig from kiwi.partitioner import Partitioner from kiwi.xml_state import XMLState from kiwi.exceptions import ( KiwiDiskBootImageError, KiwiInstallMediaError, KiwiVolumeManagerSetupError, ) log = logging.getLogger('kiwi') class StorageMap(TypedDict): system: Optional[Union[FileSystemBase, VolumeManagerBase]] system_boot: Optional[FileSystemBase] system_efi: Optional[FileSystemBase] system_spare: Optional[FileSystemBase] system_custom_parts: Dict[str, FileSystemBase] luks_root: Optional[LuksDevice] raid_root: Optional[RaidDevice] integrity_root: Optional[IntegrityDevice] class DiskBuilder: """ **Disk image builder** :param object xml_state: Instance of :class:`XMLState` :param str target_dir: Target directory path name :param str root_dir: Root directory path name :param dict custom_args: Custom processing arguments defined as hash keys: * signing_keys: list of package signing keys * xz_options: string of XZ compression parameters """ def __init__( self, xml_state: XMLState, target_dir: str, root_dir: str, custom_args: Optional[Dict] = None, ): self.arch = Defaults.get_platform_name() self.root_dir = root_dir self.target_dir = target_dir self.xml_state = xml_state self.cmdline = xml_state.build_type.get_kernelcmdline() or '' self.spare_part_mbsize = xml_state.get_build_type_spare_part_size() self.spare_part_fs = xml_state.build_type.get_spare_part_fs() self.spare_part_is_last = xml_state.build_type.get_spare_part_is_last() self.spare_part_mountpoint = ( xml_state.build_type.get_spare_part_mountpoint() ) self.persistency_type = xml_state.build_type.get_devicepersistency() self.root_filesystem_is_overlay = xml_state.build_type.get_overlayroot() self.root_filesystem_read_only_type = ( xml_state.build_type.get_overlayroot_readonly_filesystem() ) self.root_filesystem_has_write_partition = ( xml_state.build_type.get_overlayroot_write_partition() ) self.root_filesystem_read_only_partsize = ( xml_state.build_type.get_overlayroot_readonly_partsize() ) self.veritysetup: Optional[VeritySetup] = None self.root_filesystem_verity_blocks = ( xml_state.build_type.get_verity_blocks() ) self.root_filesystem_embed_verity_metadata = ( xml_state.build_type.get_embed_verity_metadata() ) self.dosparttable_extended_layout = ( xml_state.build_type.get_dosparttable_extended_layout() ) self.apply_dps_codes = xml_state.build_type.get_apply_dps_codes() self.boot_clone_count = ( int(xml_state.build_type.get_boot_clone()) if xml_state.build_type.get_boot_clone() else 0 ) self.root_clone_count = ( int(xml_state.build_type.get_root_clone()) if xml_state.build_type.get_root_clone() else 0 ) self.custom_root_mount_args = xml_state.get_fs_mount_option_list() self.custom_efi_mount_args = xml_state.get_efi_mount_option_list() self.custom_root_creation_args = xml_state.get_fs_create_option_list() self.custom_root_readonly_creation_args = ( xml_state.get_fs_readonly_create_option_list() ) self.build_type_name = xml_state.get_build_type_name() self.image_format = xml_state.build_type.get_format() self.install_iso = xml_state.build_type.get_installiso() self.install_stick = xml_state.build_type.get_installstick() self.install_pxe = xml_state.build_type.get_installpxe() self.blocksize = xml_state.build_type.get_target_blocksize() self.volume_manager_name = xml_state.get_volume_management() self.volumes = xml_state.get_volumes() self.custom_partitions = xml_state.get_partitions() self.volume_group_name = xml_state.get_volume_group_name() self.dracut_setup = xml_state.get_dracut_config('setup') self.dracut_add_modules = xml_state.get_dracut_config('add').modules self.dracut_omit_modules = xml_state.get_dracut_config('omit').modules self.dracut_add_drivers = xml_state.get_dracut_config('add').drivers self.dracut_omit_drivers = xml_state.get_dracut_config('omit').drivers # an initrd is created for the kernel of each flavor, the # empty flavor stands for the latest kernel self.kernel_flavors = ( xml_state.get_build_type_bootloader_kernel_flavors() or [''] ) self.mdraid = xml_state.build_type.get_mdraid() self.hybrid_mbr = xml_state.build_type.get_gpt_hybrid_mbr() self.force_mbr = xml_state.build_type.get_force_mbr() self.luks = xml_state.get_luks_credentials() self.use_disk_password = ( xml_state.get_build_type_bootloader_use_disk_password() ) self.host_key_certificates = xml_state.get_host_key_certificates() self.integrity = xml_state.build_type.get_standalone_integrity() self.integrity_legacy_hmac = ( xml_state.build_type.get_integrity_legacy_hmac() ) self.integrity_keyfile = xml_state.build_type.get_integrity_keyfile() self.integrity_key_description = ( xml_state.build_type.get_integrity_metadata_key_description() ) self.root_filesystem_embed_integrity_metadata = ( xml_state.build_type.get_embed_integrity_metadata() ) self.luks_format_options = xml_state.get_luks_format_options() self.luks_randomize = ( xml_state.build_type.get_luks_randomize() if xml_state.build_type.get_luks_randomize() is not None else True ) self.luks_os = xml_state.build_type.get_luksOS() self.xen_server = xml_state.is_xen_server() self.requested_filesystem = xml_state.build_type.get_filesystem() self.requested_boot_filesystem = ( xml_state.build_type.get_bootfilesystem() ) self.bootloader = xml_state.get_build_type_bootloader_name() self.initrd_system = xml_state.get_initrd_system() self.target_removable = xml_state.build_type.get_target_removable() self.root_filesystem_is_multipath = ( xml_state.get_oemconfig_oem_multipath_scan() ) self.btrfs_default_volume_requested = ( xml_state.btrfs_default_volume_requested() ) self.oem_systemsize = xml_state.get_oemconfig_oem_systemsize() self.oem_resize = xml_state.get_oemconfig_oem_resize() self.disk_resize_requested = xml_state.get_oemconfig_oem_resize() self.swap_mbytes = xml_state.get_oemconfig_swap_mbytes() self.disk_start_sector = xml_state.get_disk_start_sector() self.disk_setup = DiskSetup(xml_state, root_dir) self.unpartitioned_bytes = ( xml_state.get_build_type_unpartitioned_bytes() ) self.custom_args = custom_args self.signing_keys = None if custom_args and 'signing_keys' in custom_args: self.signing_keys = custom_args['signing_keys'] self.boot_image = BootImage.new( xml_state, target_dir, root_dir, signing_keys=self.signing_keys ) self.firmware = FirmWare(xml_state) self.system_setup = SystemSetup( xml_state=xml_state, root_dir=self.root_dir ) self.bundle_format = xml_state.get_build_type_bundle_format() self.diskname = ''.join( [ target_dir, '/', xml_state.xml_data.get_name(), '.' + self.arch, '-' + xml_state.get_image_version(), '.raw', ] ) self.boot_is_crypto = ( True if self.luks and not self.disk_setup.need_boot_partition() else False ) self.install_media = self._install_image_requested() self.fstab = Fstab() self.volume_manager_custom_parameters = { 'fs_mount_options': self.custom_root_mount_args, 'fs_create_options': self.custom_root_creation_args, 'root_label': self.disk_setup.get_root_label(), 'root_is_snapper_snapshot': self.xml_state.build_type.get_btrfs_root_is_snapper_snapshot(), 'root_is_readonly_snapshot': self.xml_state.build_type.get_btrfs_root_is_readonly_snapshot(), 'root_is_subvolume': self.xml_state.build_type.get_btrfs_root_is_subvolume(), 'btrfs_default_volume_requested': self.btrfs_default_volume_requested, 'quota_groups': self.xml_state.build_type.get_btrfs_quota_groups(), 'resize_on_boot': self.disk_resize_requested, } self.filesystem_custom_parameters = { 'mount_options': self.custom_root_mount_args, 'create_options': self.custom_root_creation_args, } self.need_root_filesystem = False if ( not self.root_filesystem_is_overlay or self.root_filesystem_has_write_partition is not False ): self.need_root_filesystem = True # result store self.result = Result(xml_state) self.runtime_config = RuntimeConfig() if not self.boot_image.has_initrd_support(): log.warning('Building without initrd support !') def create(self) -> Result: """ Build a bootable disk image and optional installation image The installation image is a bootable hybrid ISO image which embeds the disk image and an image installer Image types which triggers this builder are: * image="oem" :return: result :rtype: instance of :class:`Result` """ result = self.create_disk() result = self.create_install_media(result) self.append_unpartitioned_space() return self.create_disk_format(result) def _get_root_readonly_compression(self) -> Optional[str]: """ Compression setting for the overlay read-only root filesystem The read-only root filesystem type of an overlayroot image is selectable via the overlayroot_readonly_filesystem attribute (squashfs or erofs). Return the compression value that matches that type, so that both squashfscompression and erofscompression are honored. Before this, the overlay code path always read squashfscompression, which silently ignored erofscompression for an erofs overlay root. """ if self.root_filesystem_read_only_type == 'erofs': return self.xml_state.build_type.get_erofscompression() return self.xml_state.build_type.get_squashfscompression() def create_disk(self) -> Result: """ Build a bootable raw disk image :raises KiwiInstallMediaError: if install media is required and image type is not oem :raises KiwiVolumeManagerSetupError: root overlay at the same time volumes are defined is not supported :return: result :rtype: instance of :class:`Result` """ # initialize device dict self.storage_map: StorageMap = { 'system': None, 'system_boot': None, 'system_efi': None, 'system_spare': None, 'system_custom_parts': {}, 'luks_root': None, 'raid_root': None, 'integrity_root': None, } if self.install_media and self.build_type_name != 'oem': raise KiwiInstallMediaError( 'Install media requires oem type setup, got {0}'.format( self.build_type_name ) ) if self.root_filesystem_is_overlay and self.volume_manager_name: raise KiwiVolumeManagerSetupError( 'Volume management together with root overlay is not supported' ) # setup recovery archive, cleanup and create archive if requested self.system_setup.create_recovery_archive() # prepare initrd if self.boot_image.has_initrd_support(): log.info('Preparing boot system') self.boot_image.prepare() # precalculate needed disk size disksize_mbytes = self.disk_setup.get_disksize_mbytes( root_clone=self.root_clone_count, boot_clone=self.boot_clone_count ) # create the disk log.info('Creating raw disk image %s', self.diskname) with LoopDevice( self.diskname, disksize_mbytes, self.blocksize ) as loop_provider: loop_provider.create() # create the disk partitioner, still unmapped with self._disk_instance(loop_provider) as disk: # create disk partitions and instance device map device_map = self._build_and_map_disk_partitions( disk, disksize_mbytes ) # update device and disk id map if no root write partition if ( self.root_filesystem_is_overlay and self.root_filesystem_has_write_partition is False ): device_map['root'] = device_map['readonly'] disk.public_partition_id_map['kiwi_RootPart'] = ( disk.public_partition_id_map['kiwi_ROPart'] ) with ExitStack() as stack: if self.mdraid: # create raid on current root device raid_root = self._raid_instance(device_map) stack.push(raid_root) device_map = self._map_raid(device_map, disk, raid_root) if self.integrity: # create integrity on current root device integrity_root = self._integrity_instance(device_map) stack.push(integrity_root) device_map = self._map_integrity( device_map, integrity_root ) if self.luks is not None: # create luks on current root device luks_root = self._luks_instance(device_map) stack.push(luks_root) device_map = self._map_luks(device_map, luks_root) # create system layout for root system device_map = self._create_system_instance(device_map, stack) # build bootable disk self._build_main_system( stack, device_map, disk, self.storage_map['system'], self.storage_map['system_boot'], self.storage_map['system_efi'], self.storage_map['system_spare'], self.storage_map['system_custom_parts'] or {}, self.storage_map['luks_root'], self.storage_map['raid_root'], self.storage_map['integrity_root'], ) # store image bundle_format in result if self.bundle_format: self.result.add_bundle_format(self.bundle_format) # store image file name in result compression = self.runtime_config.get_bundle_compression(default=True) if self.luks is not None and self.luks_randomize: compression = False self.result.add( key='disk_image', filename=self.diskname, use_for_bundle=True if not self.image_format else False, compress=compression, shasum=True, ) if self.host_key_certificates and 's390' in self.arch: self.result.add( key='secure_execution_header', filename=os.path.normpath( os.sep.join( [ self.target_dir, '{0}.{1}-{2}.{3}'.format( self.xml_state.xml_data.get_name(), self.arch, self.xml_state.get_image_version(), 'secure_execution_header.bin', ), ] ) ), use_for_bundle=True, compress=False, shasum=False, ) self.result.add( key='attestation_response_key', filename=os.path.normpath( os.sep.join( [ self.target_dir, '{0}.{1}-{2}.{3}'.format( self.xml_state.xml_data.get_name(), self.arch, self.xml_state.get_image_version(), 'attestation_response.key', ), ] ) ), use_for_bundle=True, compress=False, shasum=False, ) self.result.add( key='attestation_request', filename=os.path.normpath( os.sep.join( [ self.target_dir, '{0}.{1}-{2}.{3}'.format( self.xml_state.xml_data.get_name(), self.arch, self.xml_state.get_image_version(), 'attestation_request.bin', ), ] ) ), use_for_bundle=True, compress=False, shasum=False, ) # create image root metadata self.result.add( key='image_packages', filename=self.system_setup.export_package_list(self.target_dir), use_for_bundle=True, compress=False, shasum=False, ) self.result.add( key='image_changes', filename=self.system_setup.export_package_changes(self.target_dir), use_for_bundle=True, compress=True, shasum=False, ) self.result.add( key='image_verified', filename=self.system_setup.export_package_verification( self.target_dir ), use_for_bundle=True, compress=False, shasum=False, ) return self.result def create_disk_format(self, result_instance: Result) -> Result: """ Create a bootable disk format from a previously created raw disk image :param object result_instance: instance of :class:`Result` :return: updated result_instance :rtype: instance of :class:`Result` """ if self.image_format: log.info('Creating %s Disk Format', self.image_format) with DiskFormat.new( self.image_format, self.xml_state, self.root_dir, self.target_dir, ) as disk_format: disk_format.create_image_format() disk_format.store_to_result(result_instance) return result_instance def append_unpartitioned_space(self) -> None: """ Extends the raw disk if an unpartitioned area is specified """ if self.unpartitioned_bytes: log.info( 'Expanding disk with %d bytes of unpartitioned space', self.unpartitioned_bytes, ) with DiskFormat.new( 'raw', self.xml_state, self.root_dir, self.target_dir ) as disk_format: disk_format.resize_raw_disk( self.unpartitioned_bytes, append=True ) firmware = FirmWare(self.xml_state) with LoopDevice(disk_format.diskname) as loop_provider: loop_provider.create(overwrite=False) partitioner = Partitioner.new( firmware.get_partition_table_type(), loop_provider ) partitioner.resize_table() def create_install_media(self, result_instance: Result) -> Result: """ Build an installation image. The installation image is a bootable hybrid ISO image which embeds the raw disk image and an image installer :param object result_instance: instance of :class:`Result` :return: updated result_instance with installation media :rtype: instance of :class:`Result` """ if self.install_media: boot_image = None if self.initrd_system == 'kiwi': boot_image = self.boot_image install_image = InstallImageBuilder( self.xml_state, self.root_dir, self.target_dir, boot_image, self.custom_args, ) if self.install_iso or self.install_stick: log.info('Creating hybrid ISO installation image') install_image.create_install_iso() result_instance.add( key='installation_image', filename=install_image.isoname, use_for_bundle=True, compress=False, shasum=True, ) if self.install_pxe: log.info('Creating PXE installation archive') install_image.create_install_pxe_archive() result_instance.add( key='installation_pxe_archive', filename=install_image.pxetarball, use_for_bundle=True, compress=False, shasum=True, ) return result_instance def _disk_instance(self, loop_provider: LoopDevice) -> Disk: return Disk( self.firmware.get_partition_table_type(), loop_provider, self.disk_start_sector, extended_layout=bool(self.dosparttable_extended_layout), apply_dps_codes=bool(self.apply_dps_codes), ) def _bootloader_instance(self, disk: Disk) -> BootLoaderConfigBase: custom_args = { 'targetbase': disk.storage_provider.get_device(), 'crypto_disk': True if self.luks is not None else False, 'boot_is_crypto': self.boot_is_crypto, 'config_options': self.xml_state.get_bootloader_config_options(), 'target_dir': self.target_dir, } if self.bootloader.startswith('grub'): custom_args.update( Defaults.get_grub_custom_arguments(self.root_dir) ) return create_boot_loader_config( name=self.bootloader, xml_state=self.xml_state, root_dir=self.root_dir, boot_dir=self.root_dir, custom_args=custom_args, ) def _raid_instance(self, device_map: Dict) -> RaidDevice: return RaidDevice(device_map['root']) def _luks_instance(self, device_map: Dict) -> LuksDevice: return LuksDevice(device_map['root']) def _integrity_instance(self, device_map: Dict) -> IntegrityDevice: return IntegrityDevice( device_map['root'], defaults.INTEGRITY_ALGORITHM, integrity_credentials_type( keydescription=self.integrity_key_description, keyfile=self.integrity_keyfile, keyfile_algorithm=defaults.INTEGRITY_KEY_ALGORITHM, options=['legacy_hmac'] if self.integrity_legacy_hmac else [], ), ) def _create_system_instance( self, device_map: Dict, stack: ExitStack ) -> Dict: # create spare filesystem on spare partition if present self.storage_map['system_spare'] = self._build_spare_filesystem( device_map ) # create custom partitions and filesystems self.storage_map['system_custom_parts'] = ( self._build_custom_parts_filesystem( device_map, self.custom_partitions ) ) # create filesystems on boot partition(s) if any self.storage_map['system_boot'], self.storage_map['system_efi'] = ( self._build_boot_filesystems(device_map) ) if self.volume_manager_name: volume_manager = VolumeManager.new( self.volume_manager_name, device_map, self.root_dir + '/', self.volumes, self.volume_manager_custom_parameters, ) stack.push(volume_manager) device_map = self._map_root_volume_manager( device_map, volume_manager ) elif self.need_root_filesystem: filesystem = FileSystem.new( self.requested_filesystem, device_map['root'], self.root_dir + '/', self.filesystem_custom_parameters, ) stack.push(filesystem) self._map_root_filesystem(device_map, filesystem) return device_map def _map_raid( self, device_map: Dict, disk: Disk, raid_root: RaidDevice ) -> Dict: # build the raid device raid_root.create_degraded_raid(raid_level=self.mdraid) device_map['root'] = raid_root.get_device() disk.public_partition_id_map['kiwi_RaidPart'] = ( disk.public_partition_id_map['kiwi_RootPart'] ) disk.public_partition_id_map['kiwi_RaidDev'] = device_map[ 'root' ].get_device() self.storage_map['raid_root'] = raid_root return device_map def _map_integrity( self, device_map: Dict, integrity_root: IntegrityDevice ) -> Dict: # build the integrity device integrity_root.create_dm_integrity() device_map['integrity_root'] = device_map['root'] device_map['root'] = integrity_root.get_device() if ( self.root_filesystem_is_overlay and self.root_filesystem_has_write_partition is False ): device_map['readonly'] = device_map['root'] self.storage_map['integrity_root'] = integrity_root return device_map def _map_luks(self, device_map: Dict, luks_root: LuksDevice) -> Dict: # build the luks self.luks_boot_keyname = '/root/.root.keyfile' self.luks_boot_keyfile = ''.join( [self.root_dir, self.luks_boot_keyname] ) # use LUKS key file for the following conditions: # 1. /boot is encrypted # In this case grub needs to read from LUKS via the # cryptodisk module which at the moment always asks # for the passphrase even when empty. The keyfile # setup makes sure only one interaction on the grub # stage is needed # 2. LUKS passphrase is configured as empty string # In this case the keyfile allows to open the # LUKS pool without asking # luks_need_keyfile = ( True if self.boot_is_crypto or self.luks == '' or self.luks == 'random' else False ) luks_root.create_crypto_luks( passphrase=self.luks or '', osname=self.luks_os, options=self.luks_format_options, keyfile=self.luks_boot_keyname if luks_need_keyfile else '', randomize=self.luks_randomize, root_dir=self.root_dir, ) if luks_need_keyfile: self.luks_boot_keyfile_setup = ''.join( [self.root_dir, '/etc/dracut.conf.d/99-luks-boot.conf'] ) self.boot_image.write_system_config_file( config={'install_items': [self.luks_boot_keyname]}, config_file=self.luks_boot_keyfile_setup, ) self.boot_image.include_file( '/root/' + os.path.basename(self.luks_boot_keyfile) ) device_map['luks_root'] = device_map['root'] device_map['root'] = luks_root.get_device() if ( self.root_filesystem_is_overlay and self.root_filesystem_has_write_partition is False ): device_map['readonly'] = device_map['root'] self.storage_map['luks_root'] = luks_root return device_map def _map_root_volume_manager( self, device_map: Dict, volume_manager: VolumeManagerBase ) -> Dict: # build system root volumes and filesystems volume_manager.setup(self.volume_group_name) volume_manager.create_volumes(self.requested_filesystem) volume_manager.mount_volumes() device_map['root'] = volume_manager.get_device().get('root') device_map['swap'] = volume_manager.get_device().get('swap') self.storage_map['system'] = volume_manager return device_map def _map_root_filesystem( self, device_map: Dict, filesystem: FileSystemBase ) -> None: # build system root filesystem log.info( 'Creating root({0}) filesystem on {1}'.format( self.requested_filesystem, device_map['root'].get_device() ) ) if self.root_filesystem_embed_integrity_metadata: filesystem.create_on_device( label=self.disk_setup.get_root_label(), size=-defaults.DM_METADATA_OFFSET, unit=defaults.UNIT.byte, ) else: filesystem.create_on_device( label=self.disk_setup.get_root_label(), ) self.storage_map['system'] = filesystem def _build_main_system( self, stack: ExitStack, device_map: Dict, disk: Disk, system: Optional[Union[FileSystemBase, VolumeManagerBase]], system_boot: Optional[FileSystemBase], system_efi: Optional[FileSystemBase], system_spare: Optional[FileSystemBase], system_custom_parts: Dict[str, FileSystemBase], luks_root: Optional[LuksDevice] = None, raid_root: Optional[RaidDevice] = None, integrity_root: Optional[IntegrityDevice] = None, ) -> None: # create swap on current root device if requested if self.swap_mbytes: with FileSystem.new('swap', device_map['swap']) as swap: swap.create_on_device(label='SWAP') # store root partition/filesystem uuid for profile self._preserve_root_partition_uuid(device_map) self._preserve_root_filesystem_uuid(device_map) # create a random image identifier self.mbrid = SystemIdentifier() self.mbrid.calculate_id() # create first stage metadata to boot image self._write_partition_id_config_to_boot_image(disk) self._write_recovery_metadata_to_boot_image() self._write_raid_config_to_boot_image(raid_root) self._write_generic_fstab_to_boot_image(device_map, system) self.system_setup.export_modprobe_setup( self.boot_image.boot_root_directory ) # create first stage metadata to system image self._write_image_identifier_to_system_image() self._write_crypttab_to_system_image(luks_root) if 'rd.kiwi.oem.luks.reencrypt' in self.cmdline: self._write_luks_header_checksum_to_boot_image(luks_root) self._write_integritytab_to_system_image(integrity_root) self._write_generic_fstab_to_system_image(device_map, system) if self.initrd_system == 'dracut': for module in self.dracut_add_modules: self.boot_image.include_module(module) for module in self.dracut_omit_modules: self.boot_image.omit_module(module) for driver in self.dracut_add_drivers: self.boot_image.include_driver(driver) for driver in self.dracut_omit_drivers: self.boot_image.omit_driver(driver) if self.root_filesystem_is_multipath is False: self.boot_image.omit_module('multipath') if self.root_filesystem_is_overlay: self.boot_image.include_module('kiwi-overlay') self.boot_image.write_system_config_file( config={'modules': ['kiwi-overlay']} ) if self.disk_resize_requested: self.boot_image.include_module('kiwi-repart') # create initrd(s) and second stage metadata to system image self._create_boot_files() with self._bootloader_instance(disk) as bootloader_config: # write bootloader meta data to system image if self.bootloader != 'custom': self._write_bootloader_meta_data_to_system_image( device_map, disk, system, bootloader_config ) # call edit_boot_config script partition_id_map = disk.get_public_partition_id_map() boot_partition_id = partition_id_map['kiwi_RootPart'] if 'kiwi_BootPart' in partition_id_map: boot_partition_id = partition_id_map['kiwi_BootPart'] self.system_setup.call_edit_boot_config_script( self.requested_filesystem, int(boot_partition_id) ) # write MBR id self.mbrid.write_to_disk(disk.storage_provider) # run pre sync script hook if self.system_setup.script_exists(defaults.PRE_DISK_SYNC_SCRIPT): disk_system = SystemSetup(self.xml_state, self.root_dir) disk_system.call_pre_disk_script() # syncing system data to disk image system = self._sync_system_to_image( stack, device_map, system, system_boot, system_efi, system_spare, system_custom_parts, integrity_root, ) # run post sync actions... if self.veritysetup: self._write_veritytab_to_boot_image( device_map, self.veritysetup ) if system: with ImageSystem( device_map, self.root_dir, system if self.volume_manager_name else None, self.custom_partitions if self.custom_partitions else {}, ) as image_system: image_system.mount() root = image_system.mountpoint() # rebuild initrd with veritytab included if ( self.veritysetup and self.boot_image.has_initrd_support() and not self.dracut_setup.uefi ): self._update_boot_files(root) disk_system = SystemSetup( self.xml_state, image_system.mountpoint() ) if self.system_setup.script_exists( defaults.POST_DISK_SYNC_SCRIPT ): # run post sync script hook and security context disk_system.call_disk_script() elif not self.root_filesystem_is_overlay: # setup security context disk_system.setup_selinux_file_contexts() # install boot loader if self.bootloader != 'custom': self._install_bootloader( device_map, disk, system, bootloader_config, self.boot_image, ) # initrd update on the ESP for systemd for read-only boot/ if ( self.veritysetup and self.boot_image.has_initrd_support() and not self.dracut_setup.uefi and not os.access(f'{root}/boot/', os.W_OK) and self.bootloader == 'systemd_boot' ): for flavor in self.kernel_flavors: boot_names = self.boot_image.get_boot_names(flavor) Command.run( [ 'cp', f'{self.root_dir}/boot/{boot_names.initrd_name}', f'{root}/boot/efi/os/{boot_names.initrd_name}', ] ) # cleanup build metadata if os.access(f'{root}/', os.W_OK): disk_system.cleanup() # set root filesystem properties if system: self._setup_property_root_is_readonly_snapshot(system) # set btrfs seed if ( self._install_image_requested() and self._partition_based_install_requested() and self.volume_manager_name == 'btrfs' ): Command.run( ['btrfstune', '-S', '1', device_map['root'].get_device()] ) # call edit_boot_install script boot_device = device_map['root'] if 'boot' in device_map: boot_device = device_map['boot'] self.system_setup.call_edit_boot_install_script( self.diskname, boot_device.get_device() ) def _install_image_requested(self) -> bool: return bool(self.install_iso or self.install_stick or self.install_pxe) def _partition_based_install_requested(self) -> bool: # follow the dracut getargbool semantics, the last # occurrence of the option wins requested = False for option in self.cmdline.split(): name, _, value = option.partition('=') if name == 'rd.kiwi.install.partition_based': requested = value not in ('0', 'no', 'off') return requested def _get_exclude_list_for_root_data_sync(self, device_map: Dict) -> list: exclude_list = ( Defaults.get_exclude_list_for_root_data_sync() + Defaults.get_exclude_list_from_custom_exclude_files(self.root_dir) ) if 'spare' in device_map and self.spare_part_mountpoint: exclude_list.append( '{0}/*'.format(self.spare_part_mountpoint.lstrip(os.sep)) ) exclude_list.append( '{0}/.*'.format(self.spare_part_mountpoint.lstrip(os.sep)) ) if ( 'boot' in device_map and 's390' in self.arch and self.bootloader == 'grub2_s390x_emu' ): exclude_list.append('boot/zipl/*') exclude_list.append('boot/zipl/.*') elif 'boot' in device_map: exclude_list.append('boot/*') exclude_list.append('boot/.*') if 'efi' in device_map: exclude_list.append('boot/efi/*') exclude_list.append('boot/efi/.*') if self.custom_partitions: for map_name in sorted(self.custom_partitions.keys()): if ( map_name in device_map and self.custom_partitions[map_name].mountpoint ): mountpoint = os.path.normpath( self.custom_partitions[map_name].mountpoint ).lstrip(os.sep) exclude_list.append(f'{mountpoint}/*') exclude_list.append(f'{mountpoint}/.*') return exclude_list @staticmethod def _get_exclude_list_for_boot_data_sync() -> list: return ['efi/*'] def _build_custom_parts_filesystem( self, device_map: Dict, custom_partitions: Dict['str', ptable_entry_type], ) -> Dict[str, FileSystemBase]: filesystem_dict = {} partitions = custom_partitions or {} for map_name in sorted(partitions.keys()): if map_name in device_map: ptable_entry = partitions[map_name] if ptable_entry.filesystem: with FileSystem.new( ptable_entry.filesystem, device_map[map_name], f'{self.root_dir}{ptable_entry.mountpoint}/', ) as filesystem: if ptable_entry.filesystem == 'squashfs': squashed_root_file = Temporary().new_file() filesystem.create_on_file( filename=squashed_root_file.name, label=ptable_entry.label, exclude=[Defaults.get_shared_cache_location()], ) readonly_target = device_map[map_name].get_device() readonly_target_bytesize = device_map[ map_name ].get_byte_size(readonly_target) log.info( '--> {} {!r} file({} {}) -> {}({} {})'.format( 'Dumping', map_name, os.path.getsize(squashed_root_file.name), 'bytes', readonly_target, readonly_target_bytesize, 'bytes', ) ) Command.run( [ 'dd', f'if={squashed_root_file.name}', f'of={readonly_target}', ] ) else: filesystem.create_on_device( label=ptable_entry.label or map_name.upper() ) filesystem_dict[map_name] = filesystem return filesystem_dict def _build_spare_filesystem( self, device_map: Dict ) -> Optional[FileSystemBase]: if 'spare' in device_map and self.spare_part_fs: spare_part_data_path = None spare_part_custom_parameters = { 'fs_attributes': self.xml_state.get_build_type_spare_part_fs_attributes() } if self.spare_part_mountpoint: spare_part_data_path = self.root_dir + '{0}/'.format( self.spare_part_mountpoint ) with FileSystem.new( self.spare_part_fs, device_map['spare'], spare_part_data_path, spare_part_custom_parameters, ) as filesystem: filesystem.create_on_device(label='SPARE') return filesystem return None def _build_boot_filesystems( self, device_map: Dict ) -> Tuple[Optional[FileSystemBase], Optional[FileSystemBase]]: system_boot = None system_efi = None if 'efi' in device_map: log.info( 'Creating EFI(fat16) filesystem on %s', device_map['efi'].get_device(), ) with FileSystem.new( 'fat16', device_map['efi'], self.root_dir + '/boot/efi/' ) as filesystem: filesystem.create_on_device( label=self.disk_setup.get_efi_label() ) system_efi = filesystem if 'boot' in device_map: boot_filesystem = self.requested_boot_filesystem if not boot_filesystem: boot_filesystem = self.requested_filesystem boot_directory = self.root_dir + '/boot/' if 's390' in self.arch and self.bootloader == 'grub2_s390x_emu': boot_directory = self.root_dir + '/boot/zipl/' log.info( 'Creating boot(%s) filesystem on %s', boot_filesystem, device_map['boot'].get_device(), ) with FileSystem.new( boot_filesystem, device_map['boot'], boot_directory ) as filesystem: filesystem.create_on_device( label=self.disk_setup.get_boot_label() ) system_boot = filesystem return system_boot, system_efi @staticmethod def _custom_partition_id(part_id: Optional[str]) -> Optional[int]: """ Convert a custom partition number from the image description into the integer the partitioner expects The schema declares the *part_id attributes as a number type, but the attribute value arrives from the XML parser as a string. The partitioner stores the given value as the last used partition number and derives the next one from it by adding one, so passing the string on makes the first partition without an explicit number fail with TypeError: can only concatenate str (not "int") to str :param str part_id: partition number from the image description :return: partition number, or None if the description sets none :rtype: int """ return int(part_id) if part_id else None def _build_and_map_disk_partitions( self, disk: Disk, disksize_mbytes: int ) -> Dict: disk.wipe() disksize_used_mbytes = 0 if self.firmware.get_legacy_bios_partition_size(): log.info('--> creating EFI CSM(legacy bios) partition') partition_mbsize = self.firmware.get_legacy_bios_partition_size() disk.create_efi_csm_partition( partition_mbsize, self._custom_partition_id( self.xml_state.build_type.get_eficsmpart_id() ), ) disksize_used_mbytes += partition_mbsize if self.firmware.efi_mode(): log.info('--> creating EFI partition') partition_mbsize = self.firmware.get_efi_partition_size() disk.create_efi_partition( partition_mbsize, self._custom_partition_id( self.xml_state.build_type.get_efipart_id() ), ) disksize_used_mbytes += partition_mbsize if self.firmware.ofw_mode(): log.info('--> creating PReP partition') partition_mbsize = self.firmware.get_prep_partition_size() disk.create_prep_partition(partition_mbsize) disksize_used_mbytes += partition_mbsize if self.disk_setup.need_boot_partition(): log.info( '--> creating boot partition [with {0} clone(s)]'.format( self.boot_clone_count ) ) partition_mbsize = self.disk_setup.boot_partition_size() disk.create_boot_partition( format(partition_mbsize), self.boot_clone_count, self._custom_partition_id( self.xml_state.build_type.get_bootpart_id() ), ) disksize_used_mbytes += ( (self.boot_clone_count + 1) * partition_mbsize if self.boot_clone_count else partition_mbsize ) if self.swap_mbytes: if ( not self.volume_manager_name or self.volume_manager_name != 'lvm' ): log.info('--> creating SWAP partition') disk.create_swap_partition(f'{self.swap_mbytes}') disksize_used_mbytes += self.swap_mbytes if self.custom_partitions: log.info( '--> creating custom partition(s): {0}'.format( sorted(self.custom_partitions.keys()) ) ) disk.create_custom_partitions(self.custom_partitions) if self.spare_part_mbsize and not self.spare_part_is_last: log.info('--> creating spare partition') disk.create_spare_partition(f'{self.spare_part_mbsize}') if self.root_filesystem_is_overlay: log.info('--> creating readonly root partition') squashed_rootfs_mbsize = self.root_filesystem_read_only_partsize if not self.root_filesystem_read_only_partsize: squashed_root_file = Temporary().new_file() with FileSystem.new( self.root_filesystem_read_only_type or 'squashfs', device_provider=DeviceProvider(), root_dir=self.root_dir, custom_args={ 'compression': self._get_root_readonly_compression(), 'create_options': self.custom_root_readonly_creation_args, }, ) as squashed_root: squashed_root.create_on_file( filename=squashed_root_file.name, exclude=[Defaults.get_shared_cache_location()], ) squashed_rootfs_mbsize = ( int(os.path.getsize(squashed_root_file.name) / 1048576) + Defaults.get_min_partition_mbytes() ) disk.create_root_readonly_partition( squashed_rootfs_mbsize, self.root_clone_count ) disksize_used_mbytes += ( (self.root_clone_count + 1) * squashed_rootfs_mbsize if self.root_clone_count else squashed_rootfs_mbsize ) root_clone_count = self.root_clone_count if self.root_filesystem_is_overlay: # in overlay mode an eventual root clone is created from # the root readonly partition and not from the root (rw) # partition. Thus no further action needed here in this # case root_clone_count = 0 rootfs_mbsize: Union[int, str] if self.spare_part_mbsize and self.spare_part_is_last: rootfs_mbsize = ( disksize_mbytes - disksize_used_mbytes - self.spare_part_mbsize - Defaults.get_min_partition_mbytes() ) if root_clone_count: rootfs_mbsize = int(rootfs_mbsize / (root_clone_count + 1)) else: if self.oem_systemsize and ( not self.oem_resize or self.spare_part_is_last ): # if resize on boot is switched off, we have to take # the given size into account at build time. # if resize is active but the rootfs is not the last # partition we also have to take the given size into # account, because only the last can resize rootfs_mbsize = self.oem_systemsize else: rootfs_mbsize = 'all_free' log.info( '--> Using {0}MB for the root(rw) partition if present'.format( rootfs_mbsize ) ) if ( self.root_filesystem_is_overlay and self.root_filesystem_has_write_partition is False ): log.warning( '--> overlayroot explicitly requested no write partition' ) else: if root_clone_count: if rootfs_mbsize == 'all_free': clone_rootfs_mbsize = ( disksize_mbytes - disksize_used_mbytes - Defaults.get_min_partition_mbytes() ) clone_rootfs_mbsize = int( clone_rootfs_mbsize / (root_clone_count + 1) ) rootfs_mbsize = ( f'clone:{clone_rootfs_mbsize}:{clone_rootfs_mbsize}' ) else: rootfs_mbsize = f'clone:{rootfs_mbsize}:{rootfs_mbsize}' rootpart_id = self._custom_partition_id( self.xml_state.build_type.get_rootpart_id() ) if self.volume_manager_name and self.volume_manager_name == 'lvm': log.info( '--> creating {0} partition [with {1} clone(s)]'.format( 'root(LVM)', root_clone_count ) ) disk.create_root_lvm_partition( rootfs_mbsize, root_clone_count, rootpart_id ) elif self.mdraid: log.info( '--> creating {0} partition [with {1} clone(s)]'.format( f'root(mdraid={self.mdraid})', root_clone_count ) ) disk.create_root_raid_partition( rootfs_mbsize, root_clone_count, rootpart_id ) else: log.info( '--> creating root partition [with {0} clone(s)]'.format( root_clone_count ) ) disk.create_root_partition( rootfs_mbsize, root_clone_count, rootpart_id ) if self.spare_part_is_last: log.info('--> creating spare partition') disk.create_spare_partition('all_free') if self.firmware.bios_mode(): log.info('--> setting active flag to primary boot partition') disk.activate_boot_partition() if self.firmware.ofw_mode(): log.info('--> setting active flag to primary PReP partition') disk.activate_boot_partition() if ( self.firmware.get_partition_table_type() == 'msdos' and self.disk_start_sector ): log.info(f'--> setting start sector to: {self.disk_start_sector}') disk.set_start_sector(self.disk_start_sector) if self.firmware.efi_mode(): if self.force_mbr: log.info('--> converting partition table to MBR') disk.create_mbr() elif self.hybrid_mbr: log.info('--> converting partition table to hybrid GPT/MBR') disk.create_hybrid_mbr() disk.map_partitions() device_map = disk.get_device() device_map['origin_root'] = ( device_map.get('readonly') or device_map['root'] ) return device_map def _write_partition_id_config_to_boot_image(self, disk: Disk) -> None: """ Write the partition name to partition number map to config.partids in the boot system. With dracut the boot system is the system image, applications can use the file there, e.g for partition clones. The dracut initrd code looks up the partitions at boot time and does not use the file, it is only included into the kiwi initrd """ log.info('Creating config.partids in boot system') filename = ''.join( [self.boot_image.boot_root_directory, '/config.partids'] ) partition_id_map = disk.get_public_partition_id_map() with open(filename, 'w') as partids: for id_name, id_value in list(partition_id_map.items()): partids.write( '{0}="{1}"{2}'.format(id_name, id_value, os.linesep) ) if self.initrd_system == 'kiwi': self.boot_image.include_file(os.sep + os.path.basename(filename)) def _write_raid_config_to_boot_image( self, raid_root: Optional[RaidDevice] ) -> None: if raid_root is not None: log.info('Creating etc/mdadm.conf in boot system') filename = ''.join( [self.boot_image.boot_root_directory, '/etc/mdadm.conf'] ) raid_root.create_raid_config(filename) self.boot_image.include_file( os.sep + os.sep.join(['etc', os.path.basename(filename)]) ) def _write_integritytab_to_system_image( self, integrity_root: Optional[IntegrityDevice] ) -> None: if integrity_root: log.info('Creating etc/integritytab') filename = ''.join([self.root_dir, '/etc/integritytab']) integrity_root.create_integritytab(filename) self.boot_image.include_file( os.sep + os.sep.join(['etc', os.path.basename(filename)]) ) def _write_crypttab_to_system_image( self, luks_root: Optional[LuksDevice] ) -> None: if luks_root is not None: log.info('Creating etc/crypttab') filename = ''.join([self.root_dir, '/etc/crypttab']) luks_root.create_crypttab(filename) self.boot_image.include_file( os.sep + os.sep.join(['etc', os.path.basename(filename)]) ) def _write_luks_header_checksum_to_boot_image( self, luks_root: Optional[LuksDevice] ) -> None: if luks_root is not None: log.info( 'Including origin LUKS header checksum and key slot number' ) filenames = [ ''.join([self.root_dir, '/root/.luks.header']), ''.join([self.root_dir, '/root/.luks.slot']), ''.join([self.root_dir, '/root/.slotpass']), ] for filename in filenames: self.boot_image.include_file( filename=os.sep + os.sep.join(['root', os.path.basename(filename)]), delete_after_include=True, ) def _write_generic_fstab_to_system_image( self, device_map: Dict, system: Optional[Union[FileSystemBase, VolumeManagerBase]], ) -> None: log.info('Creating generic system etc/fstab') self._write_generic_fstab(device_map, self.system_setup, system) def _write_veritytab_to_boot_image( self, device_map: Dict, veritysetup: VeritySetup ) -> None: log.info('Creating generic boot image etc/veritytab') veritytab_filename = ''.join([self.root_dir, '/etc/veritytab']) block_operation = BlockID( device_map['readonly'].get_device() if device_map.get('readonly') else device_map['root'].get_device() ) filesystem = block_operation.get_filesystem() if filesystem == 'squashfs': # squashfs does not provide a label or uuid # veritytab does not support PARTUUID=... syntax device_id = '/dev/disk/by-partuuid/{}'.format( block_operation.get_blkid('PARTUUID') ) else: device_id = 'UUID={}'.format(block_operation.get_blkid('UUID')) with open(veritytab_filename, 'w') as veritytab: veritytab.write( 'verityroot {0} {0} {1} {2},{3}{4}'.format( device_id, veritysetup.verity_dict.get('Roothash'), f'hash-offset={veritysetup.verity_hash_offset}', f'hash-block-size={defaults.VERITY_HASH_BLOCKSIZE}', os.linesep, ) ) self.boot_image.include_file( filename=os.sep + os.sep.join(['etc', os.path.basename(veritytab_filename)]), delete_after_include=True, ) def _write_generic_fstab_to_boot_image( self, device_map: Dict, system: Optional[Union[FileSystemBase, VolumeManagerBase]], ) -> None: if self.initrd_system == 'kiwi': log.info('Creating generic boot image etc/fstab') # the kiwi boot image is prepared at this point assert self.boot_image.setup is not None self._write_generic_fstab(device_map, self.boot_image.setup, system) def _write_generic_fstab( self, device_map: Dict, setup: SystemSetup, system: Optional[Union[FileSystemBase, VolumeManagerBase]], ) -> None: root_is_snapper_snapshot = ( self.xml_state.build_type.get_btrfs_root_is_snapper_snapshot() ) root_is_readonly_snapshot = ( self.xml_state.build_type.get_btrfs_root_is_readonly_snapshot() ) fs_check_interval = '0 1' custom_root_mount_args = list(self.custom_root_mount_args) if root_is_snapper_snapshot and root_is_readonly_snapshot: custom_root_mount_args += ['ro'] fs_check_interval = '0 0' if ( system and self.volume_manager_name and self.volume_manager_name == 'btrfs' and not self.btrfs_default_volume_requested ): root_volume_name = system.get_root_volume_name() if root_volume_name != '/': custom_root_mount_args += [ f'defaults,subvol={root_volume_name}' ] self._add_fstab_entry( device_map['root'].get_device(), '/', custom_root_mount_args, fs_check_interval, ) if device_map.get('boot'): if 's390' in self.arch and self.bootloader == 'grub2_s390x_emu': boot_mount_point = '/boot/zipl' else: boot_mount_point = '/boot' self._add_fstab_entry( device_map['boot'].get_device(), boot_mount_point ) if device_map.get('efi'): self._add_fstab_entry( device_map['efi'].get_device(), '/boot/efi', self.custom_efi_mount_args, ) if system and self.volume_manager_name: volume_fstab_entries = system.get_fstab( self.persistency_type, self.requested_filesystem ) for volume_fstab_entry in volume_fstab_entries: self.fstab.add_entry(volume_fstab_entry) if ( device_map.get('spare') and self.spare_part_fs and self.spare_part_mountpoint ): self._add_fstab_entry( device_map['spare'].get_device(), self.spare_part_mountpoint ) if device_map.get('swap'): self._add_fstab_entry(device_map['swap'].get_device(), 'swap') if self.custom_partitions: for map_name in sorted(self.custom_partitions.keys()): if ( device_map.get(map_name) and self.custom_partitions[map_name].mountpoint ): self._add_fstab_entry( device_map[map_name].get_device(), self.custom_partitions[map_name].mountpoint, ) setup.create_fstab(self.fstab) def _add_fstab_entry( self, device: str, mount_point: str, options: Optional[List] = None, check: str = '0 0', ) -> None: if not options: options = ['defaults'] block_operation = BlockID(device) filesystem = block_operation.get_filesystem() if ( self.volume_manager_name and self.volume_manager_name == 'lvm' and (mount_point == '/' or mount_point == 'swap') ): fstab_entry = ' '.join( [device, mount_point, filesystem, ','.join(options), check] ) else: if filesystem == 'squashfs': # squashfs does not provide a label or uuid blkid_type = 'PARTUUID' elif self.persistency_type == 'by-label': blkid_type = 'LABEL' elif self.persistency_type == 'by-partuuid': blkid_type = 'PARTUUID' else: blkid_type = 'UUID' device_id = block_operation.get_blkid(blkid_type) fstab_entry = ' '.join( [ blkid_type + '=' + device_id, mount_point, filesystem, ','.join(options), check, ] ) self.fstab.add_entry(fstab_entry) def _preserve_root_partition_uuid(self, device_map: Dict) -> None: root_part_device = ( device_map.get('raid_root') or device_map.get('luks_root') or device_map.get('integrity_root') or device_map['root'] ) block_operation = BlockID(root_part_device.get_device()) partition_uuid = block_operation.get_blkid('PARTUUID') if partition_uuid: self.xml_state.set_root_partition_uuid(partition_uuid) def _preserve_root_filesystem_uuid(self, device_map: Dict) -> None: block_operation = BlockID(device_map['root'].get_device()) rootfs_uuid = block_operation.get_blkid('UUID') if rootfs_uuid: self.xml_state.set_root_filesystem_uuid(rootfs_uuid) def _write_image_identifier_to_system_image(self) -> None: log.info('Creating image identifier: %s', self.mbrid.get_id()) self.mbrid.write(self.root_dir + '/boot/mbrid') def _write_recovery_metadata_to_boot_image(self) -> None: if os.path.exists(self.root_dir + '/recovery.partition.size'): log.info('Copying recovery metadata to boot image') recovery_metadata = ''.join( [self.root_dir, '/recovery.partition.size'] ) Command.run( ['cp', recovery_metadata, self.boot_image.boot_root_directory] ) self.boot_image.include_file( os.sep + os.path.basename(recovery_metadata) ) def _write_bootloader_meta_data_to_system_image( self, device_map: Dict, disk: Disk, system: Optional[Union[FileSystemBase, VolumeManagerBase]], bootloader_config: BootLoaderConfigBase, ) -> None: log.info('Creating %s bootloader configuration', self.bootloader) boot_options = [] if self.mdraid: boot_options.append('rd.auto') if ( system and self.volume_manager_name and self.volume_manager_name == 'btrfs' and not self.btrfs_default_volume_requested and system.get_root_volume_name() != '/' ): boot_options.append( f'rootflags=subvol={system.get_root_volume_name()}' ) ro_device = device_map.get('readonly') root_device = device_map['root'] boot_device = root_device if 'boot' in device_map: boot_device = device_map['boot'] efi_uuid = ( disk.get_uuid(device_map['efi'].get_device()) if device_map.get('efi') else None ) boot_uuid = disk.get_uuid(boot_device.get_device()) boot_uuid_unmapped = ( disk.get_uuid(device_map['luks_root'].get_device()) if self.luks and self.boot_is_crypto else boot_uuid ) bootloader_config.setup_disk_boot_images(boot_uuid_unmapped, efi_uuid) bootloader_config.write_meta_data( root_device=( ro_device.get_device() if ro_device else root_device.get_device() ), write_device=root_device.get_device(), boot_options=' '.join(boot_options), ) log.info('Creating config.bootoptions') filename = ''.join( [self.boot_image.boot_root_directory, '/config.bootoptions'] ) kexec_boot_options = ' '.join( [ bootloader_config.get_boot_cmdline( ( ro_device.get_device() if ro_device else root_device.get_device() ), device_map['root'].get_device(), ) ] + boot_options ) with open(filename, 'w') as boot_optionsfp: boot_optionsfp.write( '{0}{1}'.format(kexec_boot_options, os.linesep) ) def _sync_system_to_image( self, stack: ExitStack, device_map: Dict, system: Optional[Union[FileSystemBase, VolumeManagerBase]], system_boot: Optional[FileSystemBase], system_efi: Optional[FileSystemBase], system_spare: Optional[FileSystemBase], system_custom_parts: Dict[str, FileSystemBase], integrity_root: Optional[IntegrityDevice], ) -> Optional[Union[FileSystemBase, VolumeManagerBase]]: log.info('Syncing system to image') if system_spare: log.info('--> Syncing spare partition data') stack.push(system_spare.sync_data()) for map_name in sorted(system_custom_parts.keys()): system_custom_part = system_custom_parts[map_name] log.info('--> Syncing custom partition(s) data') if not system_custom_part.filename: stack.push(system_custom_part.sync_data()) if device_map.get(f'{map_name}clone1'): log.info( f'--> Dumping {map_name!r} clone data at extra partition' ) system_custom_part.umount() system_custom_part_clone = CloneDevice( system_custom_part.device_provider, self.root_dir ) system_custom_part_clone.clone( self._get_clone_devices(f'{map_name}clone', device_map) ) system_custom_part.mount() if system_efi: log.info('--> Syncing EFI boot data to EFI partition') stack.push(system_efi.sync_data()) if system_boot: log.info('--> Syncing boot data at extra partition') stack.push( system_boot.sync_data( self._get_exclude_list_for_boot_data_sync() ) ) if device_map.get('bootclone1'): log.info('--> Dumping boot clone data at extra partition') system_boot.umount() CloneDevice(system_boot.device_provider, self.root_dir).clone( self._get_clone_devices('bootclone', device_map) ) system_boot.mount() log.info('--> Syncing root filesystem data') if self.root_filesystem_is_overlay: squashed_root_file = Temporary().new_file() with FileSystem.new( self.root_filesystem_read_only_type or 'squashfs', device_provider=DeviceProvider(), root_dir=self.root_dir, custom_args={ 'compression': self._get_root_readonly_compression(), 'create_options': self.custom_root_readonly_creation_args, }, ) as squashed_root: exclude_list = self._get_exclude_list_for_root_data_sync( device_map ) # To allow running custom scripts in a read-only root # it's required to keep the /image mountpoint directory # such that it can be bind mounted from the unpacked # root tree exclude_list.remove('image') exclude_list.append('image/*') with MountManager( device='tmpfs', mountpoint=os.path.join(self.root_dir, 'boot'), ) as overlay_boot: if system_boot: overlay_boot.tmpfs_mount() # make sure to keep boot/efi mountpoints # as they can't be created later Path.create(f'{self.root_dir}/boot/efi') for entry in [ 'boot/*', 'boot/.*', 'boot/efi/*', 'boot/efi/.*', ]: if entry in exclude_list: exclude_list.remove(entry) squashed_root.create_on_file( filename=squashed_root_file.name, exclude=exclude_list ) self.storage_map['system'] = squashed_root if self.root_filesystem_verity_blocks: squashed_root.create_verity_layer( self.root_filesystem_verity_blocks if self.root_filesystem_verity_blocks != 'all' else None ) self.veritysetup = squashed_root.veritysetup readonly_target = device_map['readonly'].get_device() readonly_target_bytesize = device_map['readonly'].get_byte_size( readonly_target ) log.info( '--> Dumping rootfs file({0} {1}) -> {2}({3} {1})'.format( os.path.getsize(squashed_root_file.name), 'bytes', readonly_target, readonly_target_bytesize, ) ) Command.run( [ 'dd', f'if={squashed_root_file.name}', f'of={readonly_target}', ] ) if self.root_filesystem_embed_verity_metadata: squashed_root.create_verification_metadata(readonly_target) if device_map.get('rootclone1'): log.info( '--> Dumping readonly root clone data at extra partition' ) CloneDevice(device_map['origin_root'], self.root_dir).clone( self._get_clone_devices('rootclone', device_map) ) elif self.root_filesystem_verity_blocks: root_target = device_map['root'].get_device() root_target_bytesize = device_map['root'].get_byte_size(root_target) verity_root_file_bytes = ( root_target_bytesize - VeritySetup( device_map['root'].get_device(), ( self.root_filesystem_verity_blocks if self.root_filesystem_verity_blocks != 'all' else None ), ).get_hash_byte_size() ) if self.root_filesystem_embed_verity_metadata: verity_root_file_bytes -= defaults.DM_METADATA_OFFSET verity_root_file = Temporary().new_file() with LoopDevice( verity_root_file.name, int(verity_root_file_bytes / 1048576) ) as loop_provider: loop_provider.create() filesystem_custom_parameters = { 'mount_options': self.custom_root_mount_args, 'create_options': self.custom_root_creation_args, } with FileSystem.new( self.requested_filesystem, loop_provider, self.root_dir + '/', filesystem_custom_parameters, ) as filesystem: filesystem.create_on_device( label=self.disk_setup.get_root_label(), uuid=BlockID(root_target).get_uuid(), ) self.storage_map['system'] = filesystem filesystem.sync_data( self._get_exclude_list_for_root_data_sync(device_map) ) filesystem.create_verity_layer( ( self.root_filesystem_verity_blocks if self.root_filesystem_verity_blocks != 'all' else None ), verity_root_file.name, ) self.veritysetup = filesystem.veritysetup log.info( '--> Dumping rootfs file({0} bytes) -> {1}({2} bytes)'.format( os.path.getsize(verity_root_file.name), root_target, root_target_bytesize, ) ) Command.run( ['dd', f'if={verity_root_file.name}', f'of={root_target}'] ) if self.root_filesystem_embed_verity_metadata: filesystem.create_verification_metadata(root_target) if device_map.get('rootclone1'): log.info('--> Dumping root clone data at extra partition') CloneDevice(device_map['origin_root'], self.root_dir).clone( self._get_clone_devices('rootclone', device_map) ) elif system: system_mount = system.sync_data( self._get_exclude_list_for_root_data_sync(device_map) ) if system_mount: stack.push(system_mount) if device_map.get('rootclone1'): log.info('--> Dumping root clone data at extra partition') if self.volume_manager_name: system.umount_volumes() else: system.umount() CloneDevice(device_map['origin_root'], self.root_dir).clone( self._get_clone_devices('rootclone', device_map) ) if self.volume_manager_name: system.mount_volumes() else: system.mount() if integrity_root and self.root_filesystem_embed_integrity_metadata: log.info('--> Creating integrity metadata...') integrity_root.create_integrity_metadata() log.info('--> Signing integrity metadata...') integrity_root.sign_integrity_metadata() integrity_root.write_integrity_metadata() return self.storage_map['system'] def _install_bootloader( self, device_map: Dict, disk: Disk, system: Optional[Union[FileSystemBase, VolumeManagerBase]], bootloader_config: BootLoaderConfigBase, boot_image: BootImageBase, ) -> None: root_device = device_map['root'] boot_device = root_device readonly_device = None if 'readonly' in device_map: readonly_device = device_map['readonly'] boot_device = readonly_device if 'boot' in device_map: boot_device = device_map['boot'] custom_install_arguments = { 'device_map': device_map, 'boot_image': boot_image, 'boot_device': boot_device.get_device(), 'root_device': ( readonly_device.get_device() if readonly_device else root_device.get_device() ), 'write_device': root_device.get_device(), 'firmware': self.firmware, 'target_removable': self.target_removable, 'install_options': self.xml_state.get_bootloader_install_options(), 'shim_options': self.xml_state.get_bootloader_shim_options(), } if 'efi' in device_map: efi_device = device_map['efi'] custom_install_arguments.update( {'efi_device': efi_device.get_device()} ) if 'prep' in device_map: prep_device = device_map['prep'] custom_install_arguments.update( {'prep_device': prep_device.get_device()} ) if system and self.volume_manager_name: custom_install_arguments.update( { 'system_volumes': system.get_volumes(), 'system_root_volume': ( system.get_root_volume_name() if self.volume_manager_name == 'btrfs' else None ), } ) if system and self.custom_partitions: custom_install_arguments.update( {'system_partitions': self.custom_partitions} ) # create bootloader config prior bootloader installation try: bootloader_config.setup_disk_image_config( boot_options=custom_install_arguments ) if 's390' in self.arch: bootloader_config.write() finally: # cleanup bootloader config resources taken prior to next steps del bootloader_config if self.root_filesystem_has_write_partition is not False: log.debug( "custom arguments for bootloader installation %s", custom_install_arguments, ) bootloader = BootLoaderInstall.new( self.bootloader, self.xml_state, self.root_dir, disk.storage_provider, custom_install_arguments, ) if bootloader.install_required(): bootloader.install() bootloader.secure_boot_install() if self.use_disk_password and self.storage_map['luks_root']: bootloader.set_disk_password( self.storage_map['luks_root'].passphrase ) else: log.warning('No install of bootcode on read-only root possible') def _setup_property_root_is_readonly_snapshot( self, system: Union[FileSystemBase, VolumeManagerBase] ) -> None: if self.volume_manager_name: root_is_snapper_snapshot = ( self.xml_state.build_type.get_btrfs_root_is_snapper_snapshot() ) root_is_readonly_snapshot = ( self.xml_state.build_type.get_btrfs_root_is_readonly_snapshot() ) if root_is_snapper_snapshot and root_is_readonly_snapshot: log.info('Setting root filesystem into read-only mode') system.set_property_readonly_root() def _create_boot_files(self) -> None: """ Create the initrd for the kernel of each kernel flavor and copy the boot files to the system image. Files included into the initrd with delete_after_include are deleted once the initrd of the last flavor is created """ for flavor in self.kernel_flavors: if ( self.boot_image.has_initrd_support() and not self.dracut_setup.uefi ): self.boot_image.create_initrd( self.mbrid, flavor=flavor, delete_included_files=flavor == self.kernel_flavors[-1], ) self._copy_first_boot_files_to_system_image(flavor) def _update_boot_files(self, root: str) -> None: """ Create the initrd for the kernel of each kernel flavor again and update it in the system image and, if writable, in the given mounted disk image system. Files included into the initrd with delete_after_include are deleted once the initrd of the last flavor is created :param str root: mountpoint of the disk image system """ for flavor in self.kernel_flavors: self.boot_image.create_initrd( self.mbrid, flavor=flavor, delete_included_files=flavor == self.kernel_flavors[-1], ) self._copy_first_boot_files_to_system_image(flavor) boot_names = self.boot_image.get_boot_names(flavor) if os.access(f'{root}/boot/', os.W_OK): Command.run( [ 'cp', f'{self.root_dir}/boot/{boot_names.initrd_name}', f'{root}/boot/{boot_names.initrd_name}', ] ) def _copy_first_boot_files_to_system_image(self, flavor: str = '') -> None: boot_names = self.boot_image.get_boot_names(flavor) if self.initrd_system == 'kiwi': log.info('Copy boot files to system image') kernel = Kernel(self.boot_image.boot_root_directory) log.info('--> boot image kernel as %s', boot_names.kernel_name) kernel.copy_kernel( self.root_dir, ''.join(['/boot/', boot_names.kernel_name]) ) if self.xen_server: if kernel.get_xen_hypervisor(): log.info('--> boot image Xen hypervisor as xen.gz') kernel.copy_xen_hypervisor(self.root_dir, '/boot/xen.gz') else: raise KiwiDiskBootImageError( 'No hypervisor in boot image tree %s found' % self.boot_image.boot_root_directory ) if self.boot_image.initrd_filename: log.info('--> initrd archive as %s', boot_names.initrd_name) Command.run( [ 'mv', self.boot_image.initrd_filename, self.root_dir + ''.join(['/boot/', boot_names.initrd_name]), ] ) def _get_clone_devices( self, match: str, device_map: Dict[str, DeviceProvider] ) -> List[DeviceProvider]: result = [] for map_name in sorted(device_map.keys()): if map_name.startswith(match): result.append(device_map[map_name]) return result ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7431872 kiwi-11.1.8/kiwi/builder/enclave.py0000644000000000000000000001441715273675667014112 0ustar00# Copyright (c) 2024 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from typing import Dict, Optional # project from kiwi.defaults import Defaults from kiwi.boot.image import BootImage from kiwi.system.setup import SystemSetup from kiwi.system.kernel import Kernel from kiwi.system.result import Result from kiwi.runtime_config import RuntimeConfig from kiwi.xml_state import XMLState from kiwi.command import Command from kiwi.exceptions import KiwiEnclaveFormatError, KiwiEnclaveBootImageError log = logging.getLogger('kiwi') class EnclaveBuilder: """ **Enclave Builder** Enclaves defines initrd-only image types. :param object xml_state: instance of :class:`XMLState` :param str target_dir: target directory path name :param str root_dir: system image root directory :param dict custom_args: Custom processing arguments defined as hash keys: * signing_keys: list of package signing keys * xz_options: string of XZ compression parameters """ def __init__( self, xml_state: XMLState, target_dir: str, root_dir: str, custom_args: Optional[Dict] = None, ): self.target_dir = target_dir self.custom_cmdline = xml_state.build_type.get_kernelcmdline() self.format = xml_state.build_type.get_enclave_format() self.system_setup = SystemSetup(xml_state=xml_state, root_dir=root_dir) xml_state.build_type.set_initrd_system('kiwi') xml_state.build_type.set_boot(f'{root_dir}/image') self.boot_signing_keys = ( custom_args['signing_keys'] if custom_args and 'signing_keys' in custom_args else None ) self.xz_options = ( custom_args['xz_options'] if custom_args and 'xz_options' in custom_args else None ) self.boot_image_task = BootImage.new( xml_state, target_dir, root_dir, signing_keys=self.boot_signing_keys ) # Force BootImageKiwi instance to use existing root_dir self.boot_image_task.boot_root_directory = root_dir self.bundle_format = xml_state.get_build_type_bundle_format() self.image_name = ''.join( [ target_dir, '/', xml_state.xml_data.get_name(), '.' + Defaults.get_platform_name(), '-' + xml_state.get_image_version(), ] ) self.image: str = '' self.initrd: str = '' self.kernel_filename: str = '' self.enclave: str = '' self.result = Result(xml_state) self.runtime_config = RuntimeConfig() def create(self) -> Result: """ Build an eif image using the eif-cli Image types which triggers this builder are: * image="enclave" :return: result :rtype: instance of :class:`Result` """ if not self.format: raise KiwiEnclaveFormatError( 'No enclave_format= specified in build type' ) # Create initrd self.boot_image_task.create_initrd() # extract kernel from boot system kernel = Kernel(self.boot_image_task.boot_root_directory) kernel_data = kernel.get_kernel() if kernel_data: self.kernel_filename = ''.join( [ os.path.basename(self.image_name), '-', kernel_data.version, '.kernel', ] ) kernel.copy_kernel(self.target_dir, self.kernel_filename) else: raise KiwiEnclaveBootImageError( 'No kernel in boot image tree %s found' % self.boot_image_task.boot_root_directory ) self.initrd = os.path.basename(self.boot_image_task.initrd_filename) if self.format == 'aws-nitro': self.enclave = self.image_name + ".eif" Command.run( [ 'eif_build', '--kernel', '/'.join([self.target_dir, self.kernel_filename]), '--ramdisk', '/'.join([self.target_dir, self.initrd]), '--cmdline', self.custom_cmdline, '--output', self.enclave, ] ) Result.verify_image_size( self.runtime_config.get_max_size_constraint(), self.initrd ) # store image bundle_format in result if self.bundle_format: self.result.add_bundle_format(self.bundle_format) self.result.add( key='enclave', filename=self.enclave, use_for_bundle=True, compress=self.runtime_config.get_bundle_compression(default=False), shasum=True, ) # create image root metadata self.result.add( key='image_packages', filename=self.system_setup.export_package_list(self.target_dir), use_for_bundle=True, compress=False, shasum=False, ) self.result.add( key='image_changes', filename=self.system_setup.export_package_changes(self.target_dir), use_for_bundle=True, compress=True, shasum=False, ) self.result.add( key='image_verified', filename=self.system_setup.export_package_verification( self.target_dir ), use_for_bundle=True, compress=False, shasum=False, ) return self.result ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7431872 kiwi-11.1.8/kiwi/builder/filesystem.py0000644000000000000000000001666015273675667014663 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging import os from typing import Dict, Optional # project from kiwi.filesystem import FileSystem from kiwi.filesystem.setup import FileSystemSetup from kiwi.storage.loop_device import LoopDevice from kiwi.storage.device_provider import DeviceProvider from kiwi.system.setup import SystemSetup from kiwi.defaults import Defaults from kiwi.system.result import Result from kiwi.runtime_config import RuntimeConfig from kiwi.xml_state import XMLState from kiwi.exceptions import KiwiFileSystemSetupError log = logging.getLogger('kiwi') class FileSystemBuilder: """ **Filesystem image builder** :param obsject xml_state: Instance of :class:`XMLState` :param str target_dir: target directory path name :param str root_dir: root directory path name :param dict custom_args: Custom processing arguments defined as hash keys: * None """ def __init__( self, xml_state: XMLState, target_dir: str, root_dir: str, custom_args: Optional[Dict] = None, ): self.label = None self.root_uuid = '' self.root_dir = root_dir self.target_dir = target_dir self.bundle_format = xml_state.get_build_type_bundle_format() self.requested_image_type = xml_state.get_build_type_name() if self.requested_image_type in Defaults.get_kis_image_types(): self.requested_filesystem = xml_state.build_type.get_filesystem() else: self.requested_filesystem = self.requested_image_type if not self.requested_filesystem: raise KiwiFileSystemSetupError( f'No filesystem configured in {self.requested_image_type} type' ) self.filesystem_custom_parameters = { 'mount_options': xml_state.get_fs_mount_option_list(), 'create_options': xml_state.get_fs_create_option_list(), } if self.requested_filesystem == 'squashfs': self.filesystem_custom_parameters['compression'] = ( xml_state.build_type.get_squashfscompression() ) elif self.requested_filesystem == 'erofs': self.filesystem_custom_parameters['compression'] = ( xml_state.build_type.get_erofscompression() ) self.system_setup = SystemSetup( xml_state=xml_state, root_dir=self.root_dir ) self.filename = ''.join( [ target_dir, '/', xml_state.xml_data.get_name(), '.' + Defaults.get_platform_name(), '-' + xml_state.get_image_version(), '.', self.requested_filesystem, ] ) self.blocksize = xml_state.build_type.get_target_blocksize() self.filesystem_setup = FileSystemSetup(xml_state, root_dir) self.filesystems_no_device_node = ['squashfs', 'erofs'] self.luks = xml_state.get_luks_credentials() self.result = Result(xml_state) self.runtime_config = RuntimeConfig() def create(self) -> Result: """ Build a mountable filesystem image Image types which triggers this builder are: * image="ext2" * image="ext3" * image="ext4" * image="btrfs" * image="xfs" :return: result :rtype: instance of :class:`Result` """ log.info('Creating %s filesystem', self.requested_filesystem) supported_filesystems = Defaults.get_filesystem_image_types() if self.requested_filesystem not in supported_filesystems: raise KiwiFileSystemSetupError( f'Unknown filesystem: {self.requested_filesystem}' ) if self.requested_filesystem not in self.filesystems_no_device_node: self._operate_on_loop() else: self._operate_on_file() Result.verify_image_size( self.runtime_config.get_max_size_constraint(), self.filename ) if self.bundle_format: self.result.add_bundle_format(self.bundle_format) compression = self.runtime_config.get_bundle_compression(default=True) if self.luks is not None: compression = False self.result.add( key='filesystem_image', filename=self.filename, use_for_bundle=True, compress=compression, shasum=True, ) self.result.add( key='image_packages', filename=self.system_setup.export_package_list(self.target_dir), use_for_bundle=True, compress=False, shasum=False, ) self.result.add( key='image_changes', filename=self.system_setup.export_package_changes(self.target_dir), use_for_bundle=True, compress=True, shasum=False, ) self.result.add( key='image_verified', filename=self.system_setup.export_package_verification( self.target_dir ), use_for_bundle=True, compress=False, shasum=False, ) return self.result def _operate_on_loop(self) -> None: with LoopDevice( self.filename, self.filesystem_setup.get_size_mbytes(), self.blocksize, ) as loop_provider: loop_provider.create() with FileSystem.new( self.requested_filesystem, loop_provider, self.root_dir + os.sep, self.filesystem_custom_parameters, ) as filesystem: filesystem.create_on_device(self.label) self.root_uuid = loop_provider.get_uuid( loop_provider.get_device() ) log.info( '--> Syncing data to filesystem on {0}'.format( loop_provider.get_device() ) ) filesystem.sync_data( Defaults.get_exclude_list_for_root_data_sync() + Defaults.get_exclude_list_from_custom_exclude_files( self.root_dir ) ) def _operate_on_file(self) -> None: default_provider = DeviceProvider() with FileSystem.new( self.requested_filesystem, default_provider, self.root_dir, self.filesystem_custom_parameters, ) as filesystem: filesystem.create_on_file( self.filename, self.label, Defaults.get_exclude_list_for_root_data_sync() + Defaults.get_exclude_list_from_custom_exclude_files( self.root_dir ), ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7431872 kiwi-11.1.8/kiwi/builder/install.py0000644000000000000000000005332715273675667014146 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from typing import Dict, Optional, Union, cast import shutil # project from kiwi.runtime_config import RuntimeConfig from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.storage.device_provider import DeviceProvider from kiwi.boot.image.base import BootImageBase from kiwi.boot.image import BootImage from kiwi.bootloader.config import create_boot_loader_config from kiwi.bootloader.config.grub2 import BootLoaderConfigGrub2 from kiwi.bootloader.config.systemd_boot import BootLoaderSystemdBoot from kiwi.filesystem.squashfs import FileSystemSquashFs from kiwi.filesystem.isofs import FileSystemIsoFs from kiwi.firmware import FirmWare from kiwi.system.identifier import SystemIdentifier from kiwi.path import Path from kiwi.utils.block import BlockID from kiwi.defaults import Defaults from kiwi.system.kernel import Kernel from kiwi.utils.compress import Compress from kiwi.archive.tar import ArchiveTar from kiwi.system.setup import SystemSetup from kiwi.iso_tools.base import IsoToolsBase from kiwi.xml_state import XMLState from kiwi.exceptions import KiwiInstallBootImageError log = logging.getLogger('kiwi') class InstallImageBuilder: """ **Installation image builder** :param object xml_state: instance of :class:`XMLState` :param str root_dir: system image root directory :param str target_dir: target directory path name :param object boot_image_task: instance of :class:`BootImage` :param dict custom_args: Custom processing arguments defined as hash keys: * xz_options: string of XZ compression parameters """ def __init__( self, xml_state: XMLState, root_dir: str, target_dir: str, boot_image_task: Optional[BootImageBase], custom_args: Optional[Dict] = None, ) -> None: self.runtime_config = RuntimeConfig() self.arch = Defaults.get_platform_name() self.bootloader = xml_state.get_build_type_bootloader_name() if self.bootloader != 'systemd_boot': self.bootloader = 'grub2' self.root_dir = root_dir self.target_dir = target_dir self.xml_state = xml_state self.root_filesystem_is_multipath = ( xml_state.get_oemconfig_oem_multipath_scan() ) self.initrd_system = xml_state.get_initrd_system() # an install boot menu entry and initrd is created for the # kernel of each flavor, the empty flavor stands for the # latest kernel. The first flavor is the one of the default # menu entry and of the system booted after the installation self.kernel_flavors = ( xml_state.get_build_type_bootloader_kernel_flavors() or [''] ) self.firmware = FirmWare(xml_state) self.setup = SystemSetup(self.xml_state, self.root_dir) self.iso_volume_id = ( self.xml_state.build_type.get_volid() or Defaults.get_install_volume_id() ) self.diskname = ''.join( [ target_dir, '/', xml_state.xml_data.get_name(), '.' + self.arch, '-' + xml_state.get_image_version(), '.raw', ] ) self.isoname = ''.join( [ target_dir, '/', xml_state.xml_data.get_name(), '.' + self.arch, '-' + xml_state.get_image_version(), '.install.iso', ] ) self.pxename = ''.join( [ xml_state.xml_data.get_name(), '.' + self.arch, '-' + xml_state.get_image_version(), ] ) self.pxetarball = ''.join( [target_dir, '/', self.pxename, '.install.tar'] ) self.dracut_config_file = ''.join( [self.root_dir, Defaults.get_dracut_conf_name()] ) self.squashed_diskname = ''.join( [xml_state.xml_data.get_name(), '.raw'] ) self.xz_options = ( custom_args['xz_options'] if custom_args and 'xz_options' in custom_args else None ) self.mbrid = SystemIdentifier() self.mbrid.calculate_id() self.custom_iso_args: Dict = {} if not boot_image_task: self.boot_image_task = BootImage.new( xml_state, target_dir, root_dir ) self.boot_image_task.prepare() else: self.boot_image_task = boot_image_task def create_install_iso(self) -> None: """ Create an install ISO from the disk_image as hybrid ISO bootable via legacy BIOS, EFI and as disk from Stick Image types which triggers this builder are: * installiso="true|false" * installstick="true|false" """ self.media_dir = Temporary( prefix='kiwi_install_media.', path=self.target_dir ).new_dir() # unpack cdroot user files to media dir self.setup.import_cdroot_files(self.media_dir.name) # custom iso metadata self.custom_iso_args = { 'meta_data': { 'volume_id': self.iso_volume_id, 'mbr_id': self.mbrid.get_id(), 'application_id': self.xml_state.build_type.get_application_id(), 'efi_mode': self.firmware.efi_mode(), 'efi_partition_table': self.firmware.get_partition_table_type(), 'gpt_hybrid_mbr': self.firmware.gpt_hybrid_mbr, 'ofw_mode': self.firmware.ofw_mode(), 'legacy_bios_mode': self.firmware.legacy_bios_mode(), } } # the system image transfer is checked against a checksum self.squashed_contents = Temporary( prefix='kiwi_install_squashfs.', path=self.target_dir ).new_dir() shasum = self.runtime_config.get_checksum_handler( source_filename=self.diskname, target_filename='{}/{}{}'.format( self.squashed_contents.name, self.xml_state.xml_data.get_name(), self.runtime_config.get_checksum_handler(self.diskname).suffix, ), ) log.info(f'Creating disk image {shasum.suffix} checksum') shasum.digest() # the system image name is stored in a config file self._write_install_image_info_to_iso_image() if self.initrd_system == 'kiwi': self._write_install_image_info_to_boot_image() # the system image is stored as squashfs embedded file log.info('Creating squashfs embedded disk image') Command.run( [ 'cp', '-l', self.diskname, self.squashed_contents.name + '/' + self.squashed_diskname, ] ) squashed_image_file = ''.join( [self.target_dir, '/', self.squashed_diskname, '.squashfs'] ) with FileSystemSquashFs( device_provider=DeviceProvider(), root_dir=self.squashed_contents.name, custom_args={ 'compression': self.xml_state.build_type.get_squashfscompression() }, ) as squashed_image: squashed_image.create_on_file(squashed_image_file) Command.run(['mv', squashed_image_file, self.media_dir.name]) log.info('Setting up install image bootloader configuration') with self._create_bootloader_instance() as bootloader_config: bootloader_config.setup_install_boot_images( mbrid=self.mbrid, lookup_path=self.boot_image_task.boot_root_directory, ) IsoToolsBase.setup_media_loader_directory( self.boot_image_task.boot_root_directory, self.media_dir.name, bootloader_config.get_boot_theme(), ) bootloader_config.write_meta_data() bootloader_config.setup_install_image_config(mbrid=self.mbrid) bootloader_config.write() # create initrd for install image log.info('Creating install image boot image') self._create_iso_install_kernel_and_initrd() # the system image initrd is stored to allow kexec self._copy_system_image_initrd_to_iso_image() if self.firmware.efi_mode(): efi_loader = Temporary( prefix='efi-loader.', path=self.target_dir ).new_file() bootloader_config._create_embedded_fat_efi_image( efi_loader.name ) self.custom_iso_args['meta_data'][ 'efi_loader' ] = efi_loader.name # create iso filesystem from media_dir log.info('Creating ISO filesystem') with FileSystemIsoFs( device_provider=DeviceProvider(), root_dir=self.media_dir.name, custom_args=self.custom_iso_args, ) as iso_image: iso_image.create_on_file(self.isoname) self.boot_image_task.cleanup() def create_install_pxe_archive(self) -> None: """ Create an oem install tar archive suitable for installing a disk image via the network using the PXE boot protocol. The archive contains: * The raw system image xz compressed * The raw system image checksum metadata file * The append file template for the boot server * The system image initrd for kexec * The install initrd * The kernel Image types which triggers this builder are: * installpxe="true|false" """ self.pxe_dir = Temporary( prefix='kiwi_pxe_install_media.', path=self.target_dir ).new_dir() # the system image is transfered as xz compressed variant log.info('xz compressing disk image') pxe_image_filename = ''.join( [self.pxe_dir.name, '/', self.pxename, '.xz'] ) compress = Compress( source_filename=self.diskname, keep_source_on_compress=True ) xz_archive = compress.xz(self.xz_options) Command.run(['mv', xz_archive, pxe_image_filename]) # the system image transfer is checked against a checksum shasum = self.runtime_config.get_checksum_handler( source_filename=self.diskname, target_filename='{}/{}{}'.format( self.pxe_dir.name, self.pxename, self.runtime_config.get_checksum_handler(self.diskname).suffix, ), ) log.info(f'Creating disk image {shasum.suffix} checksum') shasum.digest() # the install image name is stored in a config file if self.initrd_system == 'kiwi': self._write_install_image_info_to_boot_image() # the kexec required system image initrd is stored for dracut kiwi-dump if self.initrd_system == 'dracut': boot_names = self.boot_image_task.get_boot_names( self.kernel_flavors[0] ) system_image_initrd = os.sep.join( [self.root_dir, 'boot', boot_names.initrd_name] ) target_initrd_name = '{0}/{1}.initrd'.format( self.pxe_dir.name, self.pxename ) shutil.copy(system_image_initrd, target_initrd_name) os.chmod(target_initrd_name, 420) # create pxe config append information # this information helps to configure the boot server correctly append_filename = ''.join( [self.pxe_dir.name, '/', self.pxename, '.append'] ) if self.initrd_system == 'kiwi': cmdline = 'pxe=1' else: cmdline = ' '.join( [ 'rd.kiwi.install.pxe', 'rd.kiwi.install.image=http://example.com/image.xz', ] ) custom_cmdline = self.xml_state.build_type.get_kernelcmdline() if custom_cmdline: cmdline += ' ' + custom_cmdline with open(append_filename, 'w') as append: append.write(f'{cmdline}\n') # create initrd for pxe install log.info('Creating pxe install boot image') self._create_pxe_install_kernel_and_initrd() # create pxe image bound boot config file, contents can be # changed but presence is required. log.info('Creating pxe install boot options file') configname = '{0}.config.bootoptions'.format(self.pxename) shutil.copy( os.sep.join([self.root_dir, 'config.bootoptions']), os.sep.join([self.pxe_dir.name, configname]), ) # create pxe install tarball log.info('Creating pxe install archive') archive = ArchiveTar(self.pxetarball) archive.create(self.pxe_dir.name) self.boot_image_task.cleanup() def _create_bootloader_instance( self, ) -> Union[BootLoaderConfigGrub2, BootLoaderSystemdBoot]: # ISO images boot with grub2 or systemd-boot only, any other # bootloader name is turned into grub2, see __init__ return cast( Union[BootLoaderConfigGrub2, BootLoaderSystemdBoot], create_boot_loader_config( name=self.bootloader, xml_state=self.xml_state, root_dir=self.root_dir, boot_dir=self.media_dir.name, custom_args=( Defaults.get_grub_custom_arguments(self.root_dir) if self.bootloader.startswith('grub') else {} ), ), ) def _create_pxe_install_kernel_and_initrd(self) -> None: # The pxe boot uses the kernel of the first flavor flavor = self.kernel_flavors[0] kernelname = 'pxeboot.{0}.kernel'.format(self.pxename) initrdname = 'pxeboot.{0}.initrd'.format(self.pxename) kernel = Kernel(self.boot_image_task.boot_root_directory) if kernel.get_kernel(flavor=flavor): kernel.copy_kernel(self.pxe_dir.name, kernelname, flavor=flavor) os.symlink( kernelname, ''.join([self.pxe_dir.name, '/', self.pxename, '.kernel']), ) else: raise KiwiInstallBootImageError( 'No kernel in boot image tree %s found' % self.boot_image_task.boot_root_directory ) if self.xml_state.is_xen_server(): if kernel.get_xen_hypervisor(): kernel.copy_xen_hypervisor( self.pxe_dir.name, '/pxeboot.{0}.xen.gz'.format(self.pxename), ) else: raise KiwiInstallBootImageError( 'No hypervisor in boot image tree %s found' % self.boot_image_task.boot_root_directory ) if self.initrd_system == 'dracut': self.boot_image_task.include_module('kiwi-dump') self.boot_image_task.include_module('kiwi-dump-reboot') self.boot_image_task.omit_module('kiwi-repart') if self.root_filesystem_is_multipath is False: self.boot_image_task.omit_module('multipath') for mod in self.xml_state.get_installmedia_initrd_modules('add'): self.boot_image_task.include_module(mod) for mod in self.xml_state.get_installmedia_initrd_modules('omit'): self.boot_image_task.omit_module(mod) self.boot_image_task.set_static_modules( self.xml_state.get_installmedia_initrd_modules('set') ) for drv in self.xml_state.get_installmedia_initrd_drivers('add'): self.boot_image_task.include_driver(drv) for drv in self.xml_state.get_installmedia_initrd_drivers('omit'): self.boot_image_task.omit_driver(drv) self.boot_image_task.create_initrd( self.mbrid, 'initrd_kiwi_install', install_initrd=True, flavor=flavor, ) Command.run( [ 'mv', self.boot_image_task.initrd_filename, self.pxe_dir.name + '/{0}'.format(initrdname), ] ) os.chmod(self.pxe_dir.name + '/{0}'.format(initrdname), 420) def _create_iso_install_kernel_and_initrd(self) -> None: boot_path = self.media_dir.name + '/boot/' + self.arch + '/loader' Path.create(boot_path) # see Defaults.get_iso_kernel_flavor_file_name() for the # names of the kernel and initrd files of each flavor kernel = Kernel(self.boot_image_task.boot_root_directory) for index, flavor in enumerate(self.kernel_flavors): if kernel.get_kernel(flavor=flavor): kernel.copy_kernel( boot_path, '/' + Defaults.get_iso_kernel_flavor_file_name( 'linux', index, flavor ), flavor=flavor, ) else: raise KiwiInstallBootImageError( 'No kernel{0} in boot image tree {1} found'.format( f' of flavor {flavor}' if flavor else '', self.boot_image_task.boot_root_directory, ) ) if self.xml_state.is_xen_server(): if kernel.get_xen_hypervisor(): kernel.copy_xen_hypervisor(boot_path, '/xen.gz') else: raise KiwiInstallBootImageError( 'No hypervisor in boot image tree %s found' % self.boot_image_task.boot_root_directory ) if self.initrd_system == 'dracut': self.boot_image_task.include_module('kiwi-dump') self.boot_image_task.include_module('kiwi-dump-reboot') self.boot_image_task.omit_module('kiwi-repart') if self.root_filesystem_is_multipath is False: self.boot_image_task.omit_module('multipath') for mod in self.xml_state.get_installmedia_initrd_modules('add'): self.boot_image_task.include_module(mod) for mod in self.xml_state.get_installmedia_initrd_modules('omit'): self.boot_image_task.omit_module(mod) self.boot_image_task.set_static_modules( self.xml_state.get_installmedia_initrd_modules('set') ) for drv in self.xml_state.get_installmedia_initrd_drivers('add'): self.boot_image_task.include_driver(drv) for drv in self.xml_state.get_installmedia_initrd_drivers('omit'): self.boot_image_task.omit_driver(drv) self._add_system_image_boot_options_to_boot_image() self._add_system_identifier_to_boot_image() for index, flavor in enumerate(self.kernel_flavors): self.boot_image_task.create_initrd( self.mbrid, 'initrd_kiwi_install', install_initrd=True, flavor=flavor, ) Command.run( [ 'mv', self.boot_image_task.initrd_filename, boot_path + '/' + Defaults.get_iso_kernel_flavor_file_name( 'initrd', index, flavor ), ] ) def _add_system_identifier_to_boot_image(self) -> None: filename = ''.join( [self.boot_image_task.boot_root_directory, '/system_identifier'] ) blockid = BlockID(self.diskname) with open(filename, 'w') as system_identifier: system_identifier.write(blockid.get_ptuuid()) self.boot_image_task.include_file(os.sep + os.path.basename(filename)) def _add_system_image_boot_options_to_boot_image(self) -> None: filename = ''.join( [self.boot_image_task.boot_root_directory, '/config.bootoptions'] ) self.boot_image_task.include_file(os.sep + os.path.basename(filename)) def _copy_system_image_initrd_to_iso_image(self) -> None: # The installed system is booted by kexec with the kernel of # the first flavor, see Defaults.get_iso_kernel_flavor_file_name() boot_names = self.boot_image_task.get_boot_names(self.kernel_flavors[0]) system_image_initrd = os.sep.join( [self.root_dir, 'boot', boot_names.initrd_name] ) shutil.copy( system_image_initrd, self.media_dir.name + '/initrd.system_image' ) def _write_install_image_info_to_iso_image(self) -> None: iso_trigger = self.media_dir.name + '/config.isoclient' with open(iso_trigger, 'w') as iso_system: iso_system.write(f'IMAGE="{self.squashed_diskname}\"\n') def _write_install_image_info_to_boot_image(self) -> None: initrd_trigger = ( self.boot_image_task.boot_root_directory + '/config.vmxsystem' ) with open(initrd_trigger, 'w') as vmx_system: vmx_system.write(f'IMAGE="{self.squashed_diskname}\"\n') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7431872 kiwi-11.1.8/kiwi/builder/kis.py0000644000000000000000000002723515273675667013265 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from typing import Dict, Optional # project from kiwi.defaults import Defaults from kiwi.boot.image import BootImage from kiwi.builder.filesystem import FileSystemBuilder from kiwi.utils.compress import Compress from kiwi.system.setup import SystemSetup from kiwi.system.kernel import Kernel from kiwi.system.result import Result from kiwi.runtime_config import RuntimeConfig from kiwi.archive.tar import ArchiveTar from kiwi.xml_state import XMLState from kiwi.exceptions import KiwiKisBootImageError log = logging.getLogger('kiwi') class KisBuilder: """ **Filesystem based image builder.** :param object xml_state: instance of :class:`XMLState` :param str target_dir: target directory path name :param str root_dir: system image root directory :param dict custom_args: Custom processing arguments defined as hash keys: * signing_keys: list of package signing keys * xz_options: string of XZ compression parameters """ def __init__( self, xml_state: XMLState, target_dir: str, root_dir: str, custom_args: Optional[Dict] = None, ): self.runtime_config = RuntimeConfig() self.target_dir = target_dir self.compressed = xml_state.build_type.get_compressed() self.xen_server = xml_state.is_xen_server() self.custom_cmdline = xml_state.build_type.get_kernelcmdline() self.filesystem = ( FileSystemBuilder(xml_state, target_dir, root_dir + '/') if xml_state.build_type.get_filesystem() else None ) self.archive = ( xml_state.build_type.get_archive() if xml_state.build_type.get_archive() is not None else True ) self.system_setup = SystemSetup(xml_state=xml_state, root_dir=root_dir) self.initrd_system = xml_state.get_initrd_system() self.boot_signing_keys = ( custom_args['signing_keys'] if custom_args and 'signing_keys' in custom_args else None ) self.xz_options = ( custom_args['xz_options'] if custom_args and 'xz_options' in custom_args else None ) self.boot_image_task = BootImage.new( xml_state, target_dir, root_dir, signing_keys=self.boot_signing_keys ) self.bundle_format = xml_state.get_build_type_bundle_format() self.image_name = ''.join( [ target_dir, '/', xml_state.xml_data.get_name(), '.' + Defaults.get_platform_name(), '-' + xml_state.get_image_version(), ] ) self.image: str = '' self.append_file = ''.join([self.image_name, '.append']) self.archive_name = ''.join([self.image_name, '.tar']) self.kernel_filename: str = '' self.hypervisor_filename: str = '' self.result = Result(xml_state) if not self.boot_image_task.has_initrd_support(): log.warning('Building without initrd support !') def create(self) -> Result: """ Build a component image consisting out of a boot image(initrd) plus its appropriate kernel files and the root filesystem image with a checksum. Image types which triggers this builder are: * image="kis" * image="pxe" :raises KiwiKisBootImageError: if no kernel or hipervisor is found in boot image tree :return: result :rtype: instance of :class:`Result` """ if self.filesystem: log.info('Creating root filesystem image') self.filesystem.create() os.rename(self.filesystem.filename, self.image_name) self.image = self.image_name if self.compressed: log.info('xz compressing root filesystem image') compress = Compress(self.image) self.image = compress.xz(self.xz_options) shasum = self.runtime_config.get_checksum_handler( source_filename=self.image, target_filename='{}{}'.format( self.image_name, self.runtime_config.get_checksum_handler(self.image).suffix, ), ) log.info(f'Creating root filesystem {shasum.suffix} checksum') shasum.digest() # prepare initrd if self.boot_image_task.has_initrd_support(): log.info('Creating boot image') self.boot_image_task.prepare() # export modprobe configuration to boot image self.system_setup.export_modprobe_setup( self.boot_image_task.boot_root_directory ) # extract kernel from boot system kernel = Kernel(self.boot_image_task.boot_root_directory) kernel_data = kernel.get_kernel() if kernel_data: self.kernel_filename = ''.join( [ os.path.basename(self.image_name), '-', kernel_data.version, '.kernel', ] ) kernel.copy_kernel(self.target_dir, self.kernel_filename) else: raise KiwiKisBootImageError( 'No kernel in boot image tree %s found' % self.boot_image_task.boot_root_directory ) # extract hypervisor from boot(initrd) root system if self.xen_server: hypervisor_data = kernel.get_xen_hypervisor() if hypervisor_data: self.hypervisor_filename = ''.join( [ os.path.basename(self.image_name), '-', hypervisor_data.name, ] ) kernel.copy_xen_hypervisor( self.target_dir, self.hypervisor_filename ) self.result.add( key='xen_hypervisor', filename=self.target_dir + '/' + self.hypervisor_filename, use_for_bundle=True, compress=False, shasum=True, ) else: raise KiwiKisBootImageError( 'No hypervisor in boot image tree %s found' % self.boot_image_task.boot_root_directory ) # create initrd if self.boot_image_task.has_initrd_support(): self.boot_image_task.create_initrd() # create append information # this information helps to configure the deployment infrastructure if ( self.filesystem and self.filesystem.root_uuid and self.initrd_system == 'dracut' ): cmdline = 'root=UUID={}'.format(self.filesystem.root_uuid) if self.custom_cmdline: cmdline += ' {}'.format(self.custom_cmdline) with open(self.append_file, 'w') as append: append.write(cmdline) # put results into a tarball if not self.xz_options: self.xz_options = Defaults.get_xz_compression_options() kis_tarball_files = [ self.kernel_filename, os.path.basename( '{}{}'.format( self.image_name, self.runtime_config.get_checksum_handler( f'{self.target_dir}/{self.kernel_filename}' ).suffix, ) ), ] if self.boot_image_task.initrd_filename: kis_tarball_files.append( os.path.basename(self.boot_image_task.initrd_filename) ) if self.image: kis_tarball_files.append(os.path.basename(self.image)) if ( self.filesystem and self.filesystem.root_uuid and self.initrd_system == 'dracut' ): kis_tarball_files.append(os.path.basename(self.append_file)) if self.archive: # Put all result files into a tar archive and add this # one file to the result instance kis_tarball = ArchiveTar( self.archive_name, create_from_file_list=True, file_list=kis_tarball_files, ) if self.compressed: self.archive_name = kis_tarball.create(self.target_dir) else: self.archive_name = kis_tarball.create_xz_compressed( self.target_dir, xz_options=self.xz_options ) Result.verify_image_size( self.runtime_config.get_max_size_constraint(), self.archive_name ) # store archive file name in result self.result.add( key='kis_archive', filename=self.archive_name, use_for_bundle=True, compress=self.runtime_config.get_bundle_compression( default=False ), shasum=True, ) else: # Treat all result files individually and add them to the # result instance. An eventually configured max size constraint # applies to the rootfs image only if self.image: Result.verify_image_size( self.runtime_config.get_max_size_constraint(), self.image ) for result_file in kis_tarball_files: compress_file = False filename = f'{self.target_dir}/{result_file}' keyname = f'kis_{result_file.split(".").pop()}' if self.image and filename == self.image: keyname = 'kis_rootfs' compress_file = self.runtime_config.get_bundle_compression( default=False ) self.result.add( key=keyname, filename=filename, use_for_bundle=True, compress=compress_file, shasum=False, ) # store image bundle_format in result if self.bundle_format: self.result.add_bundle_format(self.bundle_format) # create image root metadata self.result.add( key='image_packages', filename=self.system_setup.export_package_list(self.target_dir), use_for_bundle=True, compress=False, shasum=False, ) self.result.add( key='image_changes', filename=self.system_setup.export_package_changes(self.target_dir), use_for_bundle=True, compress=True, shasum=False, ) self.result.add( key='image_verified', filename=self.system_setup.export_package_verification( self.target_dir ), use_for_bundle=True, compress=False, shasum=False, ) return self.result ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7431872 kiwi-11.1.8/kiwi/builder/live.py0000644000000000000000000006322015273675667013430 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from contextlib import ExitStack import os import logging from typing import Dict, List, Union, cast, Optional import shutil # project import kiwi.defaults as defaults from kiwi.utils.veritysetup import VeritySetup from kiwi.utils.block import BlockID from kiwi.utils.temporary import Temporary from kiwi.bootloader.config import create_boot_loader_config from kiwi.bootloader.config.grub2 import BootLoaderConfigGrub2 from kiwi.bootloader.config.systemd_boot import BootLoaderSystemdBoot from kiwi.filesystem import FileSystem from kiwi.filesystem.isofs import FileSystemIsoFs from kiwi.filesystem.setup import FileSystemSetup from kiwi.storage.loop_device import LoopDevice from kiwi.storage.device_provider import DeviceProvider from kiwi.storage.luks_device import LuksDevice from kiwi.boot.image.dracut import BootImageDracut from kiwi.system.size import SystemSize from kiwi.system.setup import SystemSetup from kiwi.firmware import FirmWare from kiwi.defaults import Defaults from kiwi.path import Path from kiwi.system.result import Result from kiwi.iso_tools.iso import Iso from kiwi.system.identifier import SystemIdentifier from kiwi.system.kernel import Kernel from kiwi.runtime_config import RuntimeConfig from kiwi.iso_tools.base import IsoToolsBase from kiwi.xml_state import XMLState from kiwi.command import Command from kiwi.exceptions import KiwiLiveBootImageError log = logging.getLogger('kiwi') class LiveImageBuilder: """ **Live image builder** :param object xml_state: instance of :class:`XMLState` :param str target_dir: target directory path name :param str root_dir: root directory path name :param dict custom_args: Custom processing arguments """ def __init__( self, xml_state: XMLState, target_dir: str, root_dir: str, custom_args: Optional[Dict] = None, ): self.bootloader = xml_state.get_build_type_bootloader_name() if self.bootloader != 'systemd_boot': self.bootloader = 'grub2' self.root_filesystem_verity_blocks = ( xml_state.build_type.get_verity_blocks() ) self.arch = Defaults.get_platform_name() self.root_dir = root_dir self.target_dir = target_dir self.xml_state = xml_state self.live_type = xml_state.build_type.get_flags() # a boot menu entry and an initrd is created for the kernel of # each flavor, the empty flavor stands for the latest kernel self.kernel_flavors = ( xml_state.get_build_type_bootloader_kernel_flavors() or [''] ) # initrd file per kernel flavor, see create_live_iso_boot_images() self.initrd_files: Dict[str, str] = {} self.volume_id = ( xml_state.build_type.get_volid() or Defaults.get_volume_id() ) self.mbrid = SystemIdentifier() self.mbrid.calculate_id() self.application_id = ( self.xml_state.build_type.get_application_id() or self.mbrid.get_id() ) self.publisher = ( xml_state.build_type.get_publisher() or Defaults.get_publisher() ) self.custom_args = custom_args self.luks = xml_state.get_luks_credentials() self.luks_os = xml_state.build_type.get_luksOS() self.luks_format_options = xml_state.get_luks_format_options() self.luks_randomize = ( xml_state.build_type.get_luks_randomize() if xml_state.build_type.get_luks_randomize() is not None else True ) if not self.live_type: self.live_type = Defaults.get_default_live_iso_type() self.boot_image = BootImageDracut( xml_state, ( f'{root_dir}/boot' if self.bootloader == 'systemd_boot' else target_dir ), self.root_dir, ) self.firmware = FirmWare(xml_state) self.system_setup = SystemSetup( xml_state=xml_state, root_dir=self.root_dir ) self.bundle_format = xml_state.get_build_type_bundle_format() self.isoname = ''.join( [ target_dir, '/', xml_state.xml_data.get_name(), '.' + Defaults.get_platform_name(), '-' + xml_state.get_image_version(), '.iso', ] ) self.result = Result(xml_state) self.runtime_config = RuntimeConfig() self.custom_iso_args = { 'meta_data': { 'publisher': self.publisher, 'preparer': Defaults.get_preparer(), 'volume_id': self.volume_id, 'mbr_id': self.mbrid.get_id(), 'application_id': self.application_id, 'efi_mode': self.firmware.efi_mode(), 'efi_partition_table': self.firmware.get_partition_table_type(), 'gpt_hybrid_mbr': self.firmware.gpt_hybrid_mbr, 'legacy_bios_mode': self.firmware.legacy_bios_mode(), } } def create(self) -> Result: """ Build a bootable hybrid live ISO image Image types which triggers this builder are: * image="iso" :raises KiwiLiveBootImageError: if no kernel or hipervisor is found in boot image tree :return: result :rtype: instance of :class:`Result` """ # media dir to store CD contents self.media_dir = Temporary( prefix='live-media.', path=self.target_dir ).new_dir() # unpack cdroot user files to media dir self.system_setup.import_cdroot_files(self.media_dir.name) rootsize = SystemSize(self.media_dir.name) # custom iso metadata log.info('Using following live ISO metadata:') log.info('--> Application id: {0}'.format(self.application_id)) log.info('--> Publisher: {0}'.format(self.publisher)) log.info('--> Volume id: {0}'.format(self.volume_id)) log.info('Setting up live image bootloader configuration') with self._create_bootloader_instance() as bootloader_config: bootloader_config.setup_live_boot_images( mbrid=self.mbrid, lookup_path=self.root_dir ) IsoToolsBase.setup_media_loader_directory( self.boot_image.boot_root_directory, self.media_dir.name, bootloader_config.get_boot_theme(), ) bootloader_config.write_meta_data() bootloader_config.setup_live_image_config(mbrid=self.mbrid) bootloader_config.write() # call custom editbootconfig script if present self.system_setup.call_edit_boot_config_script( filesystem='iso:{0}'.format(self.media_dir.name), boot_part_id=1, working_directory=self.root_dir, ) self.system_setup.setup_selinux_file_contexts() # prepare dracut initrd call self.boot_image.prepare() # create dracut initrd for live image log.info('Creating live ISO boot image(s)') self.create_live_iso_boot_images( bootloader_config, modules=['pollcdrom'] ) # setup kernel file(s) and initrd in ISO boot layout if self.bootloader != 'systemd_boot': log.info( 'Setting up kernel file(s) and boot image in ISO boot layout' ) self._setup_live_iso_kernel_and_initrd() # calculate size and decide if we need UDF if rootsize.accumulate_mbyte_file_sizes() > 4096: log.info('ISO exceeds 4G size, using UDF filesystem') self.custom_iso_args['meta_data']['udf'] = True # pack system into live boot structure as expected by dracut log.info( 'Packing system into dracut live ISO type: {0}'.format( self.live_type ) ) root_filesystem = self.xml_state.build_type.get_filesystem() root_filesystem = ( root_filesystem if root_filesystem else Defaults.get_default_live_iso_root_filesystem() ) filesystem_custom_parameters = { 'mount_options': self.xml_state.get_fs_mount_option_list(), 'create_options': self.xml_state.get_fs_create_option_list(), } self.system_setup.setup_selinux_file_contexts() filesystem_setup = FileSystemSetup(self.xml_state, self.root_dir) if root_filesystem not in ['squashfs', 'erofs']: # Create a filesystem image of the specified type # and put it into a SquashFS container root_image = Temporary().new_file() with ExitStack() as stack: loop_provider = LoopDevice( root_image.name, filesystem_setup.get_size_mbytes(root_filesystem), self.xml_state.build_type.get_target_blocksize(), ) stack.push(loop_provider) loop_provider.create() luks_provider = None if self.luks is not None: luks_provider = LuksDevice(loop_provider) stack.push(luks_provider) luks_provider.create_crypto_luks( passphrase=self.luks or '', osname=self.luks_os, options=self.luks_format_options, keyfile='', randomize=self.luks_randomize, root_dir=self.root_dir, ) device_provider = ( luks_provider.get_device() or DeviceProvider() if luks_provider else loop_provider ) live_filesystem = FileSystem.new( name=root_filesystem, device_provider=device_provider, root_dir=self.root_dir + os.sep, custom_args=filesystem_custom_parameters, ) stack.push(live_filesystem) live_filesystem.create_on_device() log.info( '--> Syncing data to {0} root image'.format(root_filesystem) ) live_filesystem.sync_data( Defaults.get_exclude_list_for_root_data_sync() + Defaults.get_exclude_list_from_custom_exclude_files( self.root_dir ) ) log.info('--> Creating squashfs container for root image') self.live_container_dir = Temporary( prefix='live-container.', path=self.target_dir ).new_dir() Path.create(self.live_container_dir.name + '/LiveOS') shutil.copy( root_image.name, self.live_container_dir.name + '/LiveOS/rootfs.img', ) with FileSystem.new( name='squashfs', device_provider=DeviceProvider(), root_dir=self.live_container_dir.name, custom_args={ 'compression': self.xml_state.build_type.get_squashfscompression() }, ) as live_container_image: container_image = Temporary().new_file() live_container_image.create_on_file(container_image.name) if self.root_filesystem_verity_blocks: live_container_image.create_verity_layer( self.root_filesystem_verity_blocks if self.root_filesystem_verity_blocks != 'all' else None ) # set by create_verity_layer() assert live_container_image.veritysetup is not None self._write_veritytab_to_boot_image( container_image.name, live_container_image.veritysetup ) Path.create(self.media_dir.name + '/LiveOS') os.chmod(container_image.name, 0o644) shutil.copy( container_image.name, self.media_dir.name + '/LiveOS/squashfs.img', ) else: # Put the root filesystem into SquashFS/EroFS directly filesystem_custom_parameters.update( { 'compression': self.xml_state.build_type.get_squashfscompression() } if root_filesystem == 'squashfs' else { 'compression': self.xml_state.build_type.get_erofscompression() } ) with ExitStack() as stack: live_container_image = FileSystem.new( name=root_filesystem, device_provider=DeviceProvider(), root_dir=self.root_dir + os.sep, custom_args=filesystem_custom_parameters, ) stack.push(live_container_image) container_image = Temporary().new_file() live_container_image.create_on_file( filename=container_image.name, exclude=Defaults.get_exclude_list_for_root_data_sync() + Defaults.get_exclude_list_from_custom_exclude_files( self.root_dir ), ) if self.root_filesystem_verity_blocks: live_container_image.create_verity_layer( self.root_filesystem_verity_blocks if self.root_filesystem_verity_blocks != 'all' else None ) # set by create_verity_layer() assert live_container_image.veritysetup is not None self._write_veritytab_to_boot_image( container_image.name, live_container_image.veritysetup ) luks_image = None if self.luks is not None: # dump root filesystem blob on top of a LUKS blob # we are adding 20MB LUKS overhead luks_size_mb = ( os.path.getsize(container_image.name) / 1048576 ) luks_image = Temporary().new_file() loop_provider = LoopDevice( luks_image.name, int(luks_size_mb) + 20, self.xml_state.build_type.get_target_blocksize(), ) stack.push(loop_provider) loop_provider.create() luks_provider = LuksDevice(loop_provider) stack.push(luks_provider) luks_provider.create_crypto_luks( passphrase=self.luks or '', osname=self.luks_os, options=self.luks_format_options, keyfile='', randomize=self.luks_randomize, root_dir=self.root_dir, ) luks_device = luks_provider.get_device() or DeviceProvider() Command.run( [ 'dd', f'if={container_image.name}', f'of={luks_device.get_device()}', ] ) Path.create(self.media_dir.name + '/LiveOS') os.chmod(container_image.name, 0o644) # Note: we keep the filename of the read-only image as it is # even if another read-only filesystem not matching this # filename is used. This is because the following filename # is also used in the initrd code for the kiwi-live and # dmsquash dracut modules. The name can be overwritten # with the rd.live.squashimg boot option though. shutil.copy( luks_image.name if luks_image else container_image.name, self.media_dir.name + '/LiveOS/squashfs.img', ) if self.root_filesystem_verity_blocks: log.info('Rebuild live ISO boot image(s) to include veritysetup') with self._create_bootloader_instance() as bootloader_config: self.create_live_iso_boot_images( bootloader_config, modules=['pollcdrom'] ) if self.bootloader != 'systemd_boot': self._setup_live_iso_kernel_and_initrd() # create iso filesystem from media_dir log.info('Creating live ISO image') with FileSystemIsoFs( device_provider=DeviceProvider(), root_dir=self.media_dir.name, custom_args=self.custom_iso_args, ) as iso_image: iso_image.create_on_file(self.isoname) # include metadata for checkmedia tool if self.xml_state.build_type.get_mediacheck() is True: Iso.set_media_tag(self.isoname) Result.verify_image_size( self.runtime_config.get_max_size_constraint(), self.isoname ) if self.bundle_format: self.result.add_bundle_format(self.bundle_format) self.result.add( key='live_image', filename=self.isoname, use_for_bundle=True, compress=False, shasum=True, ) self.result.add( key='image_packages', filename=self.system_setup.export_package_list(self.target_dir), use_for_bundle=True, compress=False, shasum=False, ) self.result.add( key='image_changes', filename=self.system_setup.export_package_changes(self.target_dir), use_for_bundle=True, compress=True, shasum=False, ) self.result.add( key='image_verified', filename=self.system_setup.export_package_verification( self.target_dir ), use_for_bundle=True, compress=False, shasum=False, ) return self.result def create_live_iso_boot_images( self, bootloader_config: Union[BootLoaderConfigGrub2, BootLoaderSystemdBoot], modules: List[str] = [], ) -> None: live_dracut_modules = ( Defaults.get_live_dracut_modules_from_flag(self.live_type) + modules ) for dracut_module in live_dracut_modules: self.boot_image.include_module(dracut_module) self.boot_image.write_system_config_file( config={'modules': live_dracut_modules}, config_file=self.root_dir + '/etc/dracut.conf.d/02-livecd.conf', ) for flavor in self.kernel_flavors: # files included with delete_after_include are deleted # once the initrd of the last flavor is created self.boot_image.create_initrd( self.mbrid, basename=( f'{self.boot_image.initrd_base_name}-{flavor}' if flavor else None ), flavor=flavor, delete_included_files=flavor == self.kernel_flavors[-1], ) self.initrd_files[flavor] = self.boot_image.initrd_filename if self.bootloader == 'systemd_boot': # make sure the initrd name follows the dracut # naming conventions boot_names = self.boot_image.get_boot_names(flavor) if self.boot_image.initrd_filename: Command.run( [ 'mv', self.boot_image.initrd_filename, self.root_dir + ''.join(['/boot/', boot_names.initrd_name]), ] ) # Clean up leftover dracut config file (which can break installs) os.unlink(self.root_dir + '/etc/dracut.conf.d/02-livecd.conf') # create EFI FAT image if self.firmware.efi_mode(): self.efi_loader = Temporary( prefix='efi-loader.', path=self.target_dir ).new_file() bootloader_config._create_embedded_fat_efi_image( self.efi_loader.name ) self.custom_iso_args['meta_data'][ 'efi_loader' ] = self.efi_loader.name def _write_veritytab_to_boot_image( self, container_image_name: str, veritysetup: VeritySetup ) -> None: log.info('Creating generic boot image etc/veritytab') veritytab_filename = ''.join([self.root_dir, '/etc/veritytab']) block_operation = BlockID(container_image_name) filesystem = block_operation.get_filesystem() if filesystem == 'squashfs': # squashfs does not provide a label or uuid # The real device name is not known at this point, and # will be replaced in the initrd code with a device name # based on the loopsetup result of the compressed image file device_id = 'PLACEHOLDER' else: device_id = 'UUID={}'.format(block_operation.get_blkid('UUID')) with open(veritytab_filename, 'w') as veritytab: veritytab.write( 'verityroot {0} {0} {1} {2},{3}{4}'.format( device_id, veritysetup.verity_dict.get('Roothash'), f'hash-offset={veritysetup.verity_hash_offset}', f'hash-block-size={defaults.VERITY_HASH_BLOCKSIZE}', os.linesep, ) ) self.boot_image.include_file( filename=os.sep + os.sep.join(['etc', os.path.basename(veritytab_filename)]), delete_after_include=True, ) def _create_bootloader_instance( self, ) -> Union[BootLoaderConfigGrub2, BootLoaderSystemdBoot]: # ISO images boot with grub2 or systemd-boot only, any other # bootloader name is turned into grub2, see __init__ return cast( Union[BootLoaderConfigGrub2, BootLoaderSystemdBoot], create_boot_loader_config( name=self.bootloader, xml_state=self.xml_state, root_dir=self.root_dir, boot_dir=self.media_dir.name, custom_args=( Defaults.get_grub_custom_arguments(self.root_dir) if self.bootloader.startswith('grub') else {} ), ), ) def _setup_live_iso_kernel_and_initrd(self) -> None: """ Copy kernel and initrd from the root tree into the iso boot structure """ boot_path = ''.join( [self.media_dir.name, '/boot/', self.arch, '/loader'] ) Path.create(boot_path) # Move kernel files to iso filesystem structure, see # Defaults.get_iso_kernel_flavor_file_name() for their names kernel = Kernel(self.boot_image.boot_root_directory) for index, flavor in enumerate(self.kernel_flavors): if kernel.get_kernel(flavor=flavor): kernel.copy_kernel( boot_path, '/' + Defaults.get_iso_kernel_flavor_file_name( 'linux', index, flavor ), flavor=flavor, ) else: raise KiwiLiveBootImageError( 'No kernel{0} in boot image tree {1} found'.format( f' of flavor {flavor}' if flavor else '', self.boot_image.boot_root_directory, ) ) if self.xml_state.is_xen_server(): if kernel.get_xen_hypervisor(): kernel.copy_xen_hypervisor(boot_path, '/xen.gz') else: raise KiwiLiveBootImageError( 'No hypervisor in boot image tree {0} found'.format( self.boot_image.boot_root_directory ) ) # Move initrd(s) to iso filesystem structure for index, flavor in enumerate(self.kernel_flavors): initrd_file = self.initrd_files.get(flavor) or '' if os.path.exists(initrd_file): os.chmod(initrd_file, 0o644) shutil.move( initrd_file, boot_path + '/' + Defaults.get_iso_kernel_flavor_file_name( 'initrd', index, flavor ), ) else: raise KiwiLiveBootImageError( 'No boot image {0} in boot image tree {1} found'.format( initrd_file, self.boot_image.boot_root_directory ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7431872 kiwi-11.1.8/kiwi/builder/template/container_import.py0000644000000000000000000000463015273675667017660 0ustar00# Copyright (c) 2024 SUSE LLC. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import List from string import Template from textwrap import dedent class BuilderTemplateSystemdUnit: """ **systemd unit file templates** """ def __init__(self) -> None: self.unit = ( dedent( ''' # kiwi generated unit file [Unit] Description=Import Local Container(s) ''' ).strip() + os.linesep ) self.service = ( dedent( ''' [Service] Type=oneshot ''' ).strip() + os.linesep ) self.install = ( dedent( ''' [Install] WantedBy=multi-user.target ''' ).strip() + os.linesep ) def get_container_import_template( self, container_files: List[str], load_commands: List[List[str]], after: List[str], ) -> Template: template_data = self.unit for container_file in container_files: template_data += 'ConditionPathExists={0}{1}'.format( container_file, os.linesep ) if after: template_data += 'After={0}{1}'.format(' '.join(after), os.linesep) template_data += self.service for load_command in load_commands: template_data += 'ExecStart={0}{1}'.format( ' '.join(load_command), os.linesep ) for container_file in container_files: template_data += 'ExecStartPost=/bin/rm -f {0}{1}'.format( container_file, os.linesep ) template_data += self.install return Template(template_data) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7433155 kiwi-11.1.8/kiwi/chroot_manager.py0000644000000000000000000001035015273675667014027 0ustar00# Copyright (c) 2025 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from types import TracebackType from typing import List, Optional, NamedTuple, Type # project from kiwi.mount_manager import MountManager from kiwi.command import Command, CommandT, MutableMapping from kiwi.exceptions import KiwiUmountBusyError log = logging.getLogger('kiwi') class ChrootMount(NamedTuple): target: str source: Optional[str] = None class ChrootManager: """ **Implements methods for setting and unsetting a chroot environment** The caller is responsible for cleaning up bind mounts if the ChrootManager is used as is, without a context. The class also supports to be used as a context manager, where any bind or kernel filesystem mount is unmounted once the context manager's with block is left * :param string root_dir: path to change the root to * :param list binds: current root paths to bind to the chrooted path """ def __init__(self, root_dir: str, binds: List[ChrootMount] = []): self.root_dir = root_dir self.mounts: List[MountManager] = [] for bind in binds: self.mounts.append( MountManager( device=bind.source if bind.source else bind.target, mountpoint=os.path.normpath( os.sep.join([root_dir, bind.target]) ), ) ) def __enter__(self) -> "ChrootManager": try: self.mount() except Exception as e: try: self.umount() except Exception: pass raise e return self def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: self.umount() def mount(self) -> None: """ Mounts binds to the chroot path """ for mnt in self.mounts: mnt.bind_mount() def umount(self) -> None: """ Unmounts all binds from the chroot path If any unmount raises a KiwiUmountBusyError this is trapped and kept until the iteration over all bind mounts is over. """ errors = [] for mnt in reversed(self.mounts): try: mnt.umount() except KiwiUmountBusyError as e: errors.append(e) if errors: raise KiwiUmountBusyError(errors) def run( self, command: List[str], custom_env: Optional[MutableMapping[str, str]] = None, raise_on_error: bool = True, stderr_to_stdout: bool = False, raise_on_command_not_found: bool = True, ) -> Optional[CommandT]: """ This is a wrapper for Command.run method but pre-appending the chroot call at the command list :param list command: command and arguments :param dict custom_env: custom os.environ :param bool raise_on_error: control error behaviour :param bool stderr_to_stdout: redirects stderr to stdout :return: Contains call results in command type .. code:: python CommandT(output='string', error='string', returncode=int) :rtype: CommandT """ chroot_cmd = ['chroot', self.root_dir] chroot_cmd = chroot_cmd + command return Command.run( chroot_cmd, custom_env, raise_on_error, stderr_to_stdout, raise_on_command_not_found, ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7433155 kiwi-11.1.8/kiwi/cli.py0000644000000000000000000017464715273675667011632 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import typer import logging import sys import os from importlib.metadata import entry_points, EntryPoint from pathlib import Path from typer.core import TyperGroup from typing import Annotated, Any, Dict, Optional, List if sys.version_info >= (3, 8): from typing import Literal # pragma: no cover else: # pragma: no cover from typing_extensions import Literal # pragma: no cover # project from kiwi.exceptions import ( KiwiUnknownServiceName, KiwiCommandNotLoaded, KiwiLoadCommandUndefined, KiwiLoadPluginError, ) from kiwi.version import __version__ # from kiwi.help import Help from kiwi.defaults import Defaults log = logging.getLogger('kiwi') class PassThroughGroup(TyperGroup): """ **Command group for commands passing arguments to kiwi** Used by the system boxbuild and system stackbuild commands. Accepts the '--' separator as an alias for the kiwi subcommand, which keeps command lines written for the former kiwi-boxed-plugin and kiwi-stackbuild-plugin working """ def parse_args(self, ctx: Any, args: List[str]) -> List[str]: # ctx is a click Context, click is vendored by newer typer # versions such that no common import location exists if '--' in args: separator = args.index('--') args = args[:separator] + ['kiwi'] + args[separator + 1 :] return super().parse_args(ctx, args) class ManualPageGroup(TyperGroup): """ **Command group for commands providing a manual page** Used by the system, result and image services. Accepts the positional argument 'help' after a command, e.g. "kiwi-ng system build help", which shows the manual page of that command. typer cannot express a trailing positional argument which replaces all options of a command, in particular not if the command has required options. Thus the request is recognized before the command line of the command gets parsed and the command itself is not invoked. The task of the command shows the manual page instead """ def parse_args(self, ctx: Any, args: List[str]) -> List[str]: # ctx is a click Context, click is vendored by newer typer # versions such that no common import location exists if ( len(args) == 2 and args[1] == 'help' and self.get_command(ctx, args[0]) ): Cli.request_manual_page(ctx.info_name, args[0]) raise typer.Exit(0) return super().parse_args(ctx, args) class Cli: """ **Implements the main command line interface** An instance of the Cli class builds the entry point for the application and implements methods to load further command plugins which itself provides their own command line interface """ global_args: Dict = {} subcommand_args: Dict = {} plugins: Dict[str, typer.Typer] = {} cli_ok = False # plugins which provided commands that are now part of kiwi obsolete_plugins = ['kiwi_boxed_plugin', 'kiwi_stackbuild_plugin'] # system system = typer.Typer( cls=ManualPageGroup, help='system command for building images. The system space ' 'can also be extended by custom command plugins.', ) # result result = typer.Typer( cls=ManualPageGroup, help='result command for listing image result information ' 'and create result bundles.', ) # image image = typer.Typer( cls=ManualPageGroup, help='image command for retrieving image information ' 'prior building.', ) # system boxbuild boxbuild = typer.Typer( cls=PassThroughGroup, add_completion=True, invoke_without_command=True ) # system stackbuild stackbuild = typer.Typer( cls=PassThroughGroup, add_completion=True, invoke_without_command=True ) system.add_typer(boxbuild, name='boxbuild') system.add_typer(stackbuild, name='stackbuild') cli = typer.Typer() cli.add_typer(system, name='system') cli.add_typer(result, name='result') cli.add_typer(image, name='image') def __init__(self) -> None: Cli.cli_ok = False exit_code = 1 # load plugins... Cli.plugins.update(self.load_plugin_cli()) # add plugin cli's if there are any loaded for system_subcommand in sorted(Cli.plugins.keys()): Cli.system.add_typer( Cli.plugins[system_subcommand], name=system_subcommand, context_settings={'obj': Cli}, ) try: Cli.cli() except SystemExit as e: # avoid standalone mode: typer always exits here once the # command line is parsed. Keep the status of a usage error # and of a clean exit without a command to run, such as # --help, --version or a manual page request if e.code: sys.exit(e.code) if not Cli.cli_ok: sys.exit(0) if not Cli.cli_ok: sys.exit(exit_code) self.command_args = self.get_command_args(raise_if_no_command=False) self.command_loaded = None def version(self, perform: bool) -> None: if perform: print(f'KIWI (next generation) version {__version__}') raise typer.Exit(0) @staticmethod def _as_path_name(path: Optional[Path]) -> Optional[str]: """ Convert an optional Path option value into its string representation. Options annotated with a Path type are provided as PosixPath instance which cannot be used in a string context. An unset option stays unset :param Path path: option value or None :return: path name or None :rtype: str|None """ return f'{path}' if path is not None else None @staticmethod def _as_path_names(paths: Optional[List[Path]]) -> List[str]: """ Convert an optional list of Path option values into a list of their string representations :param list paths: list of option values or None :return: list of path names :rtype: list """ return [f'{path}' for path in paths or []] @staticmethod @cli.callback() def main( color_output: Annotated[ bool, typer.Option( '--color-output', help='use colors for warning and error messages', ), ] = False, config: Annotated[ Optional[Path], typer.Option( help='use specified runtime configuration file. If ' 'not specified the runtime configuration is looked ' 'up at ~/.config/kiwi/config.yml or /etc/kiwi.yml' ), ] = None, debug: Annotated[ bool, typer.Option( '--debug', help='print debug information, same as: --loglevel 10', ), ] = False, debug_run_scripts_in_screen: Annotated[ bool, typer.Option( '--debug-run-scripts-in-screen', help='run scripts called by kiwi in a screen session', ), ] = False, kiwi_file: Annotated[ Optional[str], typer.Option( help=' Basename of kiwi file which contains ' 'the main image configuration elements. If not specified ' 'kiwi searches for a file named config.xml or a file ' 'matching *.kiwi' ), ] = None, logfile: Annotated[ Optional[Path], typer.Option( help=' create a log file containing all log ' 'information including debug information even if this ' 'was not requested by the debug switch. The special ' 'call: "--logfile stdout" sends all information to ' 'standard out instead of writing to a file' ), ] = None, logsocket: Annotated[ Optional[Path], typer.Option( help=' send log data to the given Unix ' 'Domain socket in the same format as with --logfile' ), ] = None, loglevel: Annotated[ Optional[int], typer.Option( help=' specify logging level as number. ' 'Details about the available log levels can be found at: ' 'https://docs.python.org/3/library/logging.html#logging-levels ' 'Setting a log level causes all message >= level to be ' 'displayed.' ), ] = None, profile: Annotated[ Optional[List[str]], typer.Option( help=' Profile name, multiple profiles can be selected ' 'by passing this option multiple times' ), ] = [], setenv: Annotated[ Optional[List[str]], typer.Option( help=' export environment variable and its ' 'value into the caller environment. This option can be ' 'specified multiple times ' ), ] = [], shared_cache_dir: Annotated[ Optional[Path], typer.Option( help=' An alternative shared cache directory. ' 'The directory is shared via bind mount between the ' 'build host and image root system and contains ' 'information about package repositories and their ' 'cache and meta data.' ), ] = Path(os.sep + Defaults.get_shared_cache_location()), target_arch: Annotated[ Optional[str], typer.Option( help=' set the image architecture. By default the host ' 'architecture is used as the image architecture. If the ' 'specified architecture name does not match the host ' 'architecture and is therefore requesting a cross ' 'architecture image build, it is important to understand ' 'that for this process to work a preparatory step to ' 'support the image architecture and binary format on the ' 'building host is required first.' ), ] = None, temp_dir: Annotated[ Optional[Path], typer.Option( help=' An alternative base temporary directory. ' 'The provided path is used as base directory to store ' 'temporary files and directories.' ), ] = Path(Defaults.get_temp_location()), type: Annotated[ Optional[str], typer.Option( help=' Image build type. If not set the ' 'default XML specified build type will be used' ), ] = None, version: Annotated[ Optional[bool], typer.Option( '--version', help='show program version', callback=version ), ] = None, ) -> None: """ KIWI - Appliance Builder """ # start from a clean state, get_command_args() merges the # subcommand arguments into the global arguments Cli.global_args = {} Cli.global_args['--color-output'] = color_output Cli.global_args['--config'] = Cli._as_path_name(config) Cli.global_args['--debug'] = debug Cli.global_args['--debug-run-scripts-in-screen'] = ( debug_run_scripts_in_screen ) Cli.global_args['--kiwi-file'] = kiwi_file Cli.global_args['--logfile'] = Cli._as_path_name(logfile) Cli.global_args['--loglevel'] = loglevel Cli.global_args['--logsocket'] = Cli._as_path_name(logsocket) Cli.global_args['--profile'] = profile Cli.global_args['--setenv'] = setenv Cli.global_args['--shared-cache-dir'] = Cli._as_path_name( shared_cache_dir ) Cli.global_args['--target-arch'] = target_arch Cli.global_args['--temp-dir'] = Cli._as_path_name(temp_dir) Cli.global_args['--type'] = type Cli.global_args['command'] = None Cli.global_args['image'] = False Cli.global_args['result'] = False Cli.global_args['system'] = False @staticmethod def request_manual_page(service: str, command: str) -> None: """ Select the given command for showing its manual page Called for e.g. "kiwi-ng system build help". The command is selected like on a regular call but only carries the help flag. The task of the command checks for this flag and shows the manual page instead of running the command :param str service: service name, e.g. system :param str command: command name, e.g. build """ Cli.subcommand_args[command] = {'help': True} Cli.global_args[command] = True Cli.global_args['command'] = command Cli.global_args[service] = True Cli.cli_ok = True @staticmethod @image.command() def info( description: Annotated[ Path, typer.Option( help=' The description must be a directory ' 'containing a kiwi XML description and ' 'optional metadata files' ), ], resolve_package_list: Annotated[ Optional[bool], typer.Option( '--resolve-package-list', help='solve package dependencies and return a ' 'list of all packages including their attributes ' 'e.g. size, shasum, etc...', ), ] = False, list_profiles: Annotated[ Optional[bool], typer.Option( '--list-profiles', help='list profiles available for the selected/default type', ), ] = False, print_kiwi_env: Annotated[ Optional[bool], typer.Option( '--print-kiwi-env', help='list profiles available for the selected/default type', ), ] = False, ignore_repos: Annotated[ Optional[bool], typer.Option( '--ignore-repos', help='ignore all repos from the XML configuration', ), ] = False, add_repo: Annotated[ Optional[List[str]], typer.Option( help=' Add repository source, ' 'type, alias, priority, imageinclude(true|false), ' 'package_gpgcheck(true|false), list of signing_keys ' 'enclosed in curly brackets delimited by a colon, ' 'component list for debian based repos as string ' 'delimited by a space, main distribution name for ' 'debian based repos, repo_gpgcheck(true|false) and ' 'repo_sourcetype(metalink|baseurl|mirrorlist). The ' 'option can be specified multiple times' ), ] = [], add_repo_credentials: Annotated[ Optional[List[str]], typer.Option( help=' ' 'For repo sources of the form: uri://user:pass@location, ' 'set the user and password connected to the set-repo ' 'specification. If the provided value describes a ' 'filename in the filesystem, the first line of that ' 'file is read and used as credentials information.' '--add-repo-credentials is connected with the first ' '--add-repo specification and so on. The option can be ' 'specified multiple times' ), ] = [], print_xml: Annotated[ Optional[bool], typer.Option('--print-xml', help='print image description in XML'), ] = False, print_yaml: Annotated[ Optional[bool], typer.Option( '--print-yaml', help='print image description in YAML' ), ] = False, print_toml: Annotated[ Optional[bool], typer.Option( '--print-toml', help='print image description in TOML' ), ] = False, ) -> None: """ Provide information about the specified image description """ Cli.subcommand_args['info'] = { '--description': Cli._as_path_name(description), '--resolve-package-list': resolve_package_list, '--list-profiles': list_profiles, '--print-kiwi-env': print_kiwi_env, '--ignore-repos': ignore_repos, '--add-repo': add_repo, '--add-repo-credentials': add_repo_credentials, '--print-xml': print_xml, '--print-yaml': print_yaml, '--print-toml': print_toml, 'help': False, } Cli.global_args['info'] = True Cli.global_args['command'] = 'info' Cli.global_args['image'] = True Cli.cli_ok = True @staticmethod @image.command() def resize( target_dir: Annotated[ Path, typer.Option( help=' The target directory ' 'to expect image build results' ), ], size: Annotated[ str, typer.Option( help=' New size of the image. The value is either ' 'a size in bytes or can be specified with m=MB ' 'or g=GB. Example: 20g' ), ], root: Annotated[ Optional[Path], typer.Option( help=' The path to the root directory, if not ' 'specified kiwi searches the root directory ' 'in build/image-root below the specified target ' 'directory' ), ] = None, ) -> None: """ For disk based images, allow to resize the image to a new disk geometry. The additional space is free and not in use by the image. In order to make use of the additional free space a repartition process is required like it is provided by kiwi's oem boot code. Therefore the resize operation is useful for oem image builds most of the time """ Cli.subcommand_args['resize'] = { '--target-dir': Cli._as_path_name(target_dir), '--size': size, '--root': Cli._as_path_name(root), 'help': False, } Cli.global_args['resize'] = True Cli.global_args['command'] = 'resize' Cli.global_args['image'] = True Cli.cli_ok = True @staticmethod @result.command() def list( target_dir: Annotated[ Path, typer.Option( help='the target directory to expect image build results' ), ], ) -> None: """ List result information from a previously built image """ Cli.subcommand_args['list'] = { '--target-dir': Cli._as_path_name(target_dir), 'help': False, } Cli.global_args['list'] = True Cli.global_args['command'] = 'list' Cli.global_args['result'] = True Cli.cli_ok = True @staticmethod @result.command() def bundle( target_dir: Annotated[ Path, typer.Option( help=' The target directory to ' 'expect image build results' ), ], id: Annotated[ str, typer.Option( help=' The bundle id. A free form text ' 'appended to the version information of the result ' 'image filename' ), ], bundle_dir: Annotated[ str, typer.Option( help=' Directory to store the bundle results' ), ], bundle_format: Annotated[ Optional[str], typer.Option( help=' The bundle format to create the bundle. ' 'If provided this setting will overwrite an eventually ' 'provided bundle_format attribute from the main ' 'image description' ), ] = None, zsync_source: Annotated[ Optional[str], typer.Option( help=' Specify the download ' 'location from which the bundle file(s) can be ' 'fetched from. The information is effective if zsync ' 'is used to sync the bundle. The zsync control file ' 'is only created for those bundle files which are ' 'marked for compression because in a kiwi build ' 'only those are meaningful for a partial binary ' 'file download. It is expected that all files from a ' 'bundle are placed to the same download location' ), ] = None, package_as_rpm: Annotated[ Optional[bool], typer.Option( '--package-as-rpm', help='Take all result files and create an rpm package out of it', ), ] = False, no_compress: Annotated[ Optional[bool], typer.Option( '--no-compress', help='Do not compress the result image file(s)' ), ] = False, ) -> None: """ Create result bundle from the image build results in the specified target directory. Each result image will contain the specified bundle identifier as part of its filename. Uncompressed image files will also become xz compressed and a sha sum will be created from every result image. """ Cli.subcommand_args['bundle'] = { '--target-dir': Cli._as_path_name(target_dir), '--id': id, '--bundle-dir': bundle_dir, '--bundle-format': bundle_format, '--zsync-source': zsync_source, '--package-as-rpm': package_as_rpm, '--no-compress': no_compress, 'help': False, } Cli.global_args['bundle'] = True Cli.global_args['command'] = 'bundle' Cli.global_args['result'] = True Cli.cli_ok = True @staticmethod @system.command() def build( description: Annotated[ Path, typer.Option( help=' The description must be a ' 'directory containing a kiwi XML description ' 'and optional metadata files' ), ], target_dir: Annotated[ Path, typer.Option( help=' The target directory to ' 'store the system image file(s)' ), ], allow_existing_root: Annotated[ Optional[bool], typer.Option( '--allow-existing-root', help='Allow to use an existing root directory ' 'from an earlier build attempt. Use with caution ' 'this could cause an inconsistent root tree if the ' 'existing contents does not fit to the former ' 'image type setup', ), ] = False, clear_cache: Annotated[ Optional[bool], typer.Option( '--clear-cache', help='Delete repository cache for each of the ' 'used repositories before installing any package', ), ] = False, ignore_repos: Annotated[ Optional[bool], typer.Option( '--ignore-repos', help='Ignore all repos from the XML configuration', ), ] = False, ignore_repos_used_for_build: Annotated[ Optional[bool], typer.Option( '--ignore-repos-used-for-build', help='Ignore all repos from the XML configuration ' 'except the ones marked as imageonly', ), ] = False, set_repo: Annotated[ Optional[str], typer.Option( help=' Overwrite the first XML ' 'listed repository source, type, alias, priority, ' 'imageinclude(true|false), package_gpgcheck(true|false), ' 'list of signing_keys enclosed in curly brackets delimited ' 'by a colon, component list for debian based repos as string ' 'delimited by a space, main distribution name for ' 'debian based repos, repo_gpgcheck(true|false) and ' 'repo_sourcetype(metalink|baseurl|mirrorlist)' ), ] = None, set_repo_credentials: Annotated[ Optional[str], typer.Option( help=' ' 'For repo sources of the form: uri://user:pass@location, ' 'set the user and password connected to the set-repo ' 'specification. If the provided value describes a ' 'filename in the filesystem, the first line of that ' 'file is read and used as credentials information.' ), ] = None, add_repo: Annotated[ Optional[List[str]], typer.Option( help='Same as --set-repo, but it adds the repo to the ' 'current list of repositories. The option can be specified ' 'multiple times' ), ] = [], add_repo_credentials: Annotated[ Optional[List[str]], typer.Option( help='Same as --set-repo-credentials, but The first ' '--add-repo-credentials is connected with the first ' '--add-repo specification and so on. The option can be ' 'specified multiple times' ), ] = [], add_package: Annotated[ Optional[List[str]], typer.Option( help=' Install the given package name ' 'The option can be specified multiple times' ), ] = [], add_bootstrap_package: Annotated[ Optional[List[str]], typer.Option( help=' Install the given package name as ' 'part of the early bootstrap process. The option ' 'can be specified multiple times' ), ] = [], delete_package: Annotated[ Optional[List[str]], typer.Option( help=' Delete the given package name ' 'The option can be specified multiple times' ), ] = [], set_container_derived_from: Annotated[ Optional[str], typer.Option( help=' Overwrite the source location of the ' 'base container for the selected image type. ' 'The setting is only effective if the configured ' 'image type is setup with an initial derived_from reference' ), ] = None, set_container_tag: Annotated[ Optional[str], typer.Option( help=' Overwrite the container tag in the ' 'container configuration. The setting is only ' 'effective if the container configuraiton provides ' 'an initial tag value' ), ] = None, add_container_label: Annotated[ Optional[List[str]], typer.Option( help=' Add a container label in the ' 'container configuration metadata. The label with ' 'the provided key-value pair will be overwritten ' 'in case it was already defined in the XML description. ' 'The option can be specified multiple times' ), ] = [], set_type_attr: Annotated[ Optional[List[str]], typer.Option( help=' Overwrite/set the attribute ' 'with the provided value in the selected build type ' 'section. The option can be specified multiple times' ), ] = [], set_release_version: Annotated[ Optional[str], typer.Option( help=' Overwrite/set the release-version ' 'element in the selected build type preferences section' ), ] = None, signing_key: Annotated[ Optional[List[Path]], typer.Option( help=' Includes the given key-file as a trusted ' 'key for package manager validations. The option can be ' 'specified multiple times' ), ] = [], ca_cert: Annotated[ Optional[List[Path]], typer.Option( help='include additional CA certificate to import immediately ' 'after bootstrap and make available during the build process.' ), ] = [], ca_target_distribution: Annotated[ Optional[Literal['suse', 'redhat', 'debian', 'archlinux']], typer.Option( help='Specify target distribution for the import of ' 'certificates via the --ca-cert options(s) and/or the ' 'provided from the image description. ' 'The selected distribution is used in KIWI to map the ' 'distribution specific CA storage path and update tool ' 'for the import process.' ), ] = None, ) -> None: """ Build a system image from the specified description. The build command combines the prepare and create commands. """ Cli.subcommand_args['build'] = { '--description': Cli._as_path_name(description), '--target-dir': Cli._as_path_name(target_dir), '--allow-existing-root': allow_existing_root, '--clear-cache': clear_cache, '--ignore-repos': ignore_repos, '--ignore-repos-used-for-build': ignore_repos_used_for_build, '--set-repo': set_repo, '--set-repo-credentials': set_repo_credentials, '--add-repo': add_repo, '--add-repo-credentials': add_repo_credentials, '--add-package': add_package, '--add-bootstrap-package': add_bootstrap_package, '--delete-package': delete_package, '--set-container-derived-from': set_container_derived_from, '--set-container-tag': set_container_tag, '--add-container-label': add_container_label, '--set-type-attr': set_type_attr, '--set-release-version': set_release_version, '--signing-key': Cli._as_path_names(signing_key), '--ca-cert': Cli._as_path_names(ca_cert), '--ca-target-distribution': ca_target_distribution, 'help': False, } Cli.global_args['build'] = True Cli.global_args['command'] = 'build' Cli.global_args['system'] = True Cli.cli_ok = True @staticmethod @system.command() def prepare( description: Annotated[ Path, typer.Option( help=' The description must be a ' 'directory containing a kiwi XML description ' 'and optional metadata files' ), ], root: Annotated[ Path, typer.Option( help=' The path to the new root ' 'directory of the system ' ), ], allow_existing_root: Annotated[ Optional[bool], typer.Option( '--allow-existing-root', help='Allow to use an existing root directory ' 'from an earlier build attempt. Use with caution ' 'this could cause an inconsistent root tree if the ' 'existing contents does not fit to the former ' 'image type setup', ), ] = False, clear_cache: Annotated[ Optional[bool], typer.Option( '--clear-cache', help='Delete repository cache for each of the ' 'used repositories before installing any package', ), ] = False, ignore_repos: Annotated[ Optional[bool], typer.Option( '--ignore-repos', help='Ignore all repos from the XML configuration', ), ] = False, ignore_repos_used_for_build: Annotated[ Optional[bool], typer.Option( '--ignore-repos-used-for-build', help='Ignore all repos from the XML configuration ' 'except the ones marked as imageonly', ), ] = False, set_repo: Annotated[ Optional[str], typer.Option( help=' Overwrite the first XML ' 'listed repository source, type, alias, priority, ' 'imageinclude(true|false), package_gpgcheck(true|false), ' 'list of signing_keys enclosed in curly brackets delimited ' 'by a colon, component list for debian based repos as string ' 'delimited by a space, main distribution name for ' 'debian based repos, repo_gpgcheck(true|false) and ' 'repo_sourcetype(metalink|baseurl|mirrorlist)' ), ] = None, set_repo_credentials: Annotated[ Optional[str], typer.Option( help=' ' 'For repo sources of the form: uri://user:pass@location, ' 'set the user and password connected to the set-repo ' 'specification. If the provided value describes a ' 'filename in the filesystem, the first line of that ' 'file is read and used as credentials information.' ), ] = None, add_repo: Annotated[ Optional[List[str]], typer.Option( help='Same as --set-repo, but it adds the repo to the ' 'current list of repositories. The option can be specified ' 'multiple times' ), ] = [], add_repo_credentials: Annotated[ Optional[List[str]], typer.Option( help='Same as --set-repo-credentials, but The first ' '--add-repo-credentials is connected with the first ' '--add-repo specification and so on. The option can be ' 'specified multiple times' ), ] = [], add_package: Annotated[ Optional[List[str]], typer.Option( help=' Install the given package name ' 'The option can be specified multiple times' ), ] = [], add_bootstrap_package: Annotated[ Optional[List[str]], typer.Option( help=' Install the given package name as ' 'part of the early bootstrap process. The option ' 'can be specified multiple times' ), ] = [], delete_package: Annotated[ Optional[List[str]], typer.Option( help=' Delete the given package name ' 'The option can be specified multiple times' ), ] = [], set_container_derived_from: Annotated[ Optional[str], typer.Option( help=' Overwrite the source location of the ' 'base container for the selected image type. ' 'The setting is only effective if the configured ' 'image type is setup with an initial derived_from reference' ), ] = None, set_container_tag: Annotated[ Optional[str], typer.Option( help=' Overwrite the container tag in the ' 'container configuration. The setting is only ' 'effective if the container configuraiton provides ' 'an initial tag value' ), ] = None, add_container_label: Annotated[ Optional[List[str]], typer.Option( help=' Add a container label in the ' 'container configuration metadata. The label with ' 'the provided key-value pair will be overwritten ' 'in case it was already defined in the XML description. ' 'The option can be specified multiple times' ), ] = [], set_type_attr: Annotated[ Optional[List[str]], typer.Option( help=' Overwrite/set the attribute ' 'with the provided value in the selected build type ' 'section. The option can be specified multiple times' ), ] = [], set_release_version: Annotated[ Optional[str], typer.Option( help=' Overwrite/set the release-version ' 'element in the selected build type preferences section' ), ] = None, signing_key: Annotated[ Optional[List[Path]], typer.Option( help=' Includes the given key-file as a trusted ' 'key for package manager validations. The option can be ' 'specified multiple times' ), ] = [], ca_cert: Annotated[ Optional[List[Path]], typer.Option( help='include additional CA certificate to import immediately ' 'after bootstrap and make available during the build process.' ), ] = [], ca_target_distribution: Annotated[ Optional[Literal['suse', 'redhat', 'debian', 'archlinux']], typer.Option( help='Specify target distribution for the import of ' 'certificates via the --ca-cert options(s) and/or the ' 'provided from the image description. ' 'The selected distribution is used in KIWI to map the ' 'distribution specific CA storage path and update tool ' 'for the import process.' ), ] = None, ) -> None: """ Prepare and install a new system root tree for chroot access. """ Cli.subcommand_args['prepare'] = { '--description': Cli._as_path_name(description), '--root': Cli._as_path_name(root), '--allow-existing-root': allow_existing_root, '--clear-cache': clear_cache, '--ignore-repos': ignore_repos, '--ignore-repos-used-for-build': ignore_repos_used_for_build, '--set-repo': set_repo, '--set-repo-credentials': set_repo_credentials, '--add-repo': add_repo, '--add-repo-credentials': add_repo_credentials, '--add-package': add_package, '--add-bootstrap-package': add_bootstrap_package, '--delete-package': delete_package, '--set-container-derived-from': set_container_derived_from, '--set-container-tag': set_container_tag, '--add-container-label': add_container_label, '--set-type-attr': set_type_attr, '--set-release-version': set_release_version, '--signing-key': Cli._as_path_names(signing_key), '--ca-cert': Cli._as_path_names(ca_cert), '--ca-target-distribution': ca_target_distribution, 'help': False, } Cli.global_args['prepare'] = True Cli.global_args['command'] = 'prepare' Cli.global_args['system'] = True Cli.cli_ok = True @staticmethod @system.command() def update( root: Annotated[ Path, typer.Option(help=' The path to the root directory'), ], add_package: Annotated[ Optional[List[str]], typer.Option( help=' Install the given package name ' 'The option can be specified multiple times' ), ] = [], delete_package: Annotated[ Optional[List[str]], typer.Option( help=' Delete the given package name ' 'The option can be specified multiple times' ), ] = [], ) -> None: """ Update root system with latest repository updates and optionally allow to add or delete packages. """ Cli.subcommand_args['update'] = { '--root': Cli._as_path_name(root), '--add-package': add_package, '--delete-package': delete_package, 'help': False, } Cli.global_args['update'] = True Cli.global_args['command'] = 'update' Cli.global_args['system'] = True Cli.cli_ok = True @staticmethod @system.command() def create( root: Annotated[ Path, typer.Option(help=' The path to the root directory'), ], target_dir: Annotated[ Path, typer.Option( help=' The target directory to ' 'store the system image file(s)' ), ], signing_key: Annotated[ Optional[List[Path]], typer.Option( help=' Includes the given key-file as a trusted ' 'key for package manager validations. The option can be ' 'specified multiple times' ), ] = [], ) -> None: """ Create an image from the specified root directory. """ Cli.subcommand_args['create'] = { '--root': Cli._as_path_name(root), '--target-dir': Cli._as_path_name(target_dir), '--signing-key': Cli._as_path_names(signing_key), 'help': False, } Cli.global_args['create'] = True Cli.global_args['command'] = 'create' Cli.global_args['system'] = True Cli.cli_ok = True @staticmethod @boxbuild.callback( help='build a system image in a self contained VM or container', subcommand_metavar='kiwi [OPTIONS]', ) def boxbuild_options( box: Annotated[ Optional[str], typer.Option( help=' Name of the box to use for the build process.' ), ] = None, list_boxes: Annotated[ Optional[bool], typer.Option('--list-boxes', help='show available build boxes.'), ] = False, box_memory: Annotated[ Optional[str], typer.Option( help=' Number of GBs to reserve as main memory ' 'for the virtual machine. By default 8GB will be used.' ), ] = None, box_console: Annotated[ Optional[str], typer.Option( help=' Name of console in the kernel settings ' 'for the virtual machine. By default set to hvc0.' ), ] = None, box_smp_cpus: Annotated[ Optional[int], typer.Option( help=' Number of CPUs to use in the SMP setup. ' 'By default 4 CPUs will be used.' ), ] = 4, box_debug: Annotated[ Optional[bool], typer.Option( '--box-debug', help='In debug mode the started virtual machine will be kept open.', ), ] = False, container: Annotated[ Optional[bool], typer.Option( '--container', help='Build in container instead of a VM. Options related to ' 'building in a VM will have no effect.', ), ] = False, kiwi_version: Annotated[ Optional[str], typer.Option( help=' Specify a KIWI version to use for ' 'the build. The referenced KIWI will be fetched from ' 'pip and replaces the box installed KIWI version. ' 'Note: If --no-snapshot is used in combination ' 'with this option, the change of the KIWI version will ' 'be permanently stored in the used box.' ), ] = None, shared_path: Annotated[ Optional[Path], typer.Option( help=' Optional host path to share with the box. ' 'The same path as it is present on the host will also ' 'be available inside of the box during build time.' ), ] = None, no_update_check: Annotated[ Optional[bool], typer.Option( '--no-update-check', help='Skip check for available box update. The option ' 'has no effect if the selected box does not yet exist ' 'on the host.', ), ] = False, no_snapshot: Annotated[ Optional[bool], typer.Option( '--no-snapshot', help='Run box with snapshot mode switched off. This ' 'causes the box disk file to be modified by the build ' 'process and allows to keep a persistent package cache ' 'as part of the box. The option can be used to increase ' 'the build performance due to data stored in the box ' 'which does not have to be reloaded from the network. ' 'On the contrary this option invalidates the immutable ' 'box attribute and should be used with care. On update ' 'of the box all data stored will be wiped. To prevent ' 'this combine the option with the --no-update-check option.', ), ] = False, no_accel: Annotated[ Optional[bool], typer.Option( '--no-accel', help='Run box without hardware acceleration. By default ' 'KVM acceleration is activated', ), ] = False, qemu_9p_sharing: Annotated[ Optional[bool], typer.Option( '--9p-sharing', help='Select 9p backend to use for sharing data ' 'between the host and the box.', ), ] = False, virtiofs_sharing: Annotated[ Optional[bool], typer.Option( '--virtiofs-sharing', help='Select virtiofsd backend to use for sharing data ' 'between the host and the box.', ), ] = False, sshfs_sharing: Annotated[ Optional[bool], typer.Option( '--sshfs-sharing', help='Select sshfs backend to use for sharing data ' 'between the host and the box.', ), ] = False, ssh_key: Annotated[ Optional[str], typer.Option( help=' Name of ssh key to authorize for ' 'connection. By default id_rsa is used.' ), ] = 'id_rsa', ssh_port: Annotated[ Optional[int], typer.Option( help=' Port number to use to forward the ' 'guest SSH port to the host By default 10022 is used.' ), ] = 10022, x86_64: Annotated[ Optional[bool], typer.Option( '--x86_64', help='Select box for the x86_64 architecture. If no ' 'architecture is selected the host architecture is ' 'used for selecting the box. The selected box ' 'architecture also specifies the target architecture ' 'for the image build with that box.', ), ] = False, aarch64: Annotated[ Optional[bool], typer.Option( '--aarch64', help='Select box for the aarch64 architecture. If no ' 'architecture is selected the host architecture is ' 'used for selecting the box. The selected box ' 'architecture also specifies the target architecture ' 'for the image build with that box.', ), ] = False, machine: Annotated[ Optional[str], typer.Option( help=' Machine name used ' 'by QEMU. By default no specific value is used here ' 'and qemu selects its default machine type. For cross ' 'arch builds or for system architectures for which ' 'QEMU defines no default like for Arm, it is required ' 'to specify a machine name. If you do not care about ' 'reproducing the idiosyncrasies of a particular bit ' 'of hardware, the best option is to use the virt ' 'machine type.' ), ] = None, cpu: Annotated[ Optional[str], typer.Option( help=' CPU type used by QEMU. By default ' 'the host CPU type is used which is only a good ' 'selection if the host and the selected box are from ' 'the same architecture. On cross arch builds it is ' 'required to specify the CPU emulation the box should use' ), ] = None, ) -> None: Cli.subcommand_args['boxbuild'] = { '--box': box, '--list-boxes': list_boxes, '--box-memory': box_memory, '--box-console': box_console, '--box-smp-cpus': f'{box_smp_cpus}', '--box-debug': box_debug, '--container': container, '--kiwi-version': kiwi_version, '--shared-path': Cli._as_path_name(shared_path), '--no-update-check': no_update_check, '--no-snapshot': no_snapshot, '--no-accel': no_accel, '--9p-sharing': qemu_9p_sharing, '--virtiofs-sharing': virtiofs_sharing, '--sshfs-sharing': sshfs_sharing, '--ssh-key': ssh_key, '--ssh-port': f'{ssh_port}', '--x86_64': x86_64, '--aarch64': aarch64, '--machine': machine, '--cpu': cpu, 'system_build': [], 'help': False, } Cli.global_args['boxbuild'] = True Cli.global_args['command'] = 'boxbuild' Cli.global_args['system'] = True Cli.cli_ok = True @staticmethod @boxbuild.command( name='kiwi', context_settings={ 'allow_extra_args': True, 'ignore_unknown_options': True, }, ) def boxbuild_kiwi(ctx: typer.Context) -> None: """ List of command parameters as supported by the kiwi-ng build command. The information given here is passed along to the kiwi-ng system build command running in the virtual machine or container. """ Cli.subcommand_args['boxbuild']['system_build'] = ctx.args @staticmethod @stackbuild.callback( help='build an image based on a given stash container root.\n\n' 'If no --description is provided, stackbuild rebuilds the ' 'image from ' 'the stash container and passes the kiwi subcommand arguments ' 'to the kiwi-ng system create command. If a --description is ' 'provided, this description takes over precedence and a new ' 'image from this description based on the given stash container ' 'root will be built. In this case the kiwi subcommand arguments ' 'are passed to the kiwi-ng system build command.', subcommand_metavar='kiwi [OPTIONS]', ) def stackbuild_options( stash: Annotated[ List[str], typer.Option( help=' Name of the stash container. See system stash ' '--list for available stashes. Multiple --stash options will ' 'be stacked together in the given order' ), ], target_dir: Annotated[ Path, typer.Option( help=' The target directory to store the ' 'system image file(s)' ), ], description: Annotated[ Optional[Path], typer.Option(help=' Path to KIWI image description'), ] = None, from_registry: Annotated[ Optional[str], typer.Option( help=' Pull given stash container name from the ' 'provided registry URI' ), ] = None, ) -> None: Cli.subcommand_args['stackbuild'] = { '--stash': stash, '--target-dir': Cli._as_path_name(target_dir), '--description': Cli._as_path_name(description), '--from-registry': from_registry, 'system_build_or_create': [], 'help': False, } Cli.global_args['stackbuild'] = True Cli.global_args['command'] = 'stackbuild' Cli.global_args['system'] = True Cli.cli_ok = True @staticmethod @stackbuild.command( name='kiwi', context_settings={ 'allow_extra_args': True, 'ignore_unknown_options': True, }, ) def stackbuild_kiwi(ctx: typer.Context) -> None: """ List of command parameters as supported by the kiwi-ng build or create command. The information given here is passed along to the kiwi-ng system build or the kiwi-ng system create command depending on the presence of the --description option. """ Cli.subcommand_args['stackbuild']['system_build_or_create'] = ctx.args @staticmethod @system.command() def stash( root: Annotated[ Optional[Path], typer.Option( help=' The path to the root directory, ' 'usually the result of a former system prepare or ' 'build call' ), ] = None, tag: Annotated[ Optional[str], typer.Option( help=' The tag name for the container. ' 'By default set to: latest' ), ] = None, container_name: Annotated[ Optional[str], typer.Option( help=' The name of the container. By default ' 'set to the image name of the stash' ), ] = None, stash_list: Annotated[ Optional[bool], typer.Option('--list', help='List the available stashes'), ] = False, ) -> None: """ Create a container from the given root directory. """ Cli.subcommand_args['stash'] = { '--root': Cli._as_path_name(root), '--tag': tag, '--container-name': container_name, '--list': stash_list, 'help': False, } Cli.global_args['stash'] = True Cli.global_args['command'] = 'stash' Cli.global_args['system'] = True Cli.cli_ok = True def get_servicename(self) -> str: """ Extract service name from argument parse result :return: service name :rtype: str """ if Cli.global_args.get('image') is True: return 'image' elif Cli.global_args.get('system') is True: return 'system' elif Cli.global_args.get('result') is True: return 'result' else: raise KiwiUnknownServiceName('Unknown/Invalid Servicename') def get_command(self) -> str: """ Extract selected command name :return: command name :rtype: str """ return Cli.global_args['command'] def get_command_args(self, raise_if_no_command: bool = True) -> Dict: """ Get argument dict for selected command including global options :return: Contains dictionary of command arguments .. code:: python { '--some-option-name': 'value' } :rtype: dict """ result = Cli.global_args command = self.get_command() if Cli.subcommand_args.get(command): result.update(Cli.subcommand_args.get(command) or {}) elif raise_if_no_command: raise KiwiCommandNotLoaded(f'{command} command not loaded') return result def get_global_args(self) -> Dict: """ Get argument dict for global arguments :return: Contains dictionary of global arguments .. code:: python { '--some-global-option': 'value' } :rtype: dict """ result = {} for arg, value in list(Cli.global_args.items()): if not arg == 'command': if arg == '--type' and value == 'vmx': log.warning( 'vmx type is now a subset of oem, --type set to oem' ) value = 'oem' if arg == '--shared-cache-dir' and value: Defaults.set_shared_cache_location(value) if arg == '--temp-dir' and value: Defaults.set_temp_location(value) if arg == '--target-arch' and value: Defaults.set_platform_name(value) if arg == '--config' and value: # pragma: no cover Defaults.set_custom_runtime_config_file(value) result[arg] = value return result def load_plugin_cli(self) -> Dict[str, typer.Typer]: """ Loads plugin command line interface The loading is based on the plugin entry point name and requires the presence of a Typer based cli.py. The implementation of cli.py in the plugin also requires to provide a dict named typers. The matching of an entry point to be a valid kiwi plugin requires the entry point group to be set to kiwi.tasks and the entry point value must container the _plugin substring. :return: list of typer.Typer instances :rtype: list """ plugin_typers = {} for entry in self._get_module_entries(): module_name = entry.value.split('.')[0] if module_name in Cli.obsolete_plugins: continue if '_plugin' in entry.value: plugin_entry = EntryPoint( name='cli', value=f'{module_name}.cli', group='kiwi.tasks' ) try: plugin = plugin_entry.load() plugin_typers.update(plugin.typers) except ModuleNotFoundError: # plugin gets skipped if it does not provide # a typer based cli pass except Exception as issue: raise KiwiLoadPluginError(f'{plugin_entry}: {issue}') return plugin_typers def load_command(self) -> Any: """ Loads task class plugin according to service and command name :return: loaded task module :rtype: object """ discovered_tasks = {} for entry in self._get_module_entries(): if entry.value.split('.')[0] in Cli.obsolete_plugins: continue discovered_tasks[entry.name] = entry.load() service = self.get_servicename() command = self.get_command() if not command: raise KiwiLoadCommandUndefined( 'No command specified for {0} service'.format(service) ) self.command_loaded = discovered_tasks.get(f'{service}_{command}') if not self.command_loaded: prefix = 'usage:' discovered_tasks_for_service = '' for task in discovered_tasks: if task.startswith(service): discovered_tasks_for_service += '{0} kiwi-ng {1}\n'.format( prefix, task.replace('_', ' ') ) prefix = ' ' raise KiwiCommandNotLoaded( 'Command "{0}" not found\n\n{1}'.format( command, discovered_tasks_for_service ) ) return self.command_loaded def _get_module_entries(self) -> List[EntryPoint]: """ Lookup module entries matching the kiwi.tasks entry group """ entries: List[EntryPoint] = [] if sys.version_info >= (3, 12): for entry in list(entry_points()): # pragma: no cover if entry.group == 'kiwi.tasks': entries.append(entry) else: # pragma: no cover for entry in dict.get(entry_points(), 'kiwi.tasks') or {}: entries.append(entry) return entries ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7433155 kiwi-11.1.8/kiwi/command.py0000644000000000000000000002014315273675667012456 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import ( IO, Callable, Literal, List, MutableMapping, NamedTuple, Optional, overload, ) import logging import os import select import subprocess # project from kiwi.utils.codec import Codec from kiwi.exceptions import KiwiCommandError, KiwiCommandNotFound log = logging.getLogger('kiwi') class CommandT(NamedTuple): output: str error: str returncode: int class CommandCallT(NamedTuple): output: IO[bytes] output_available: Callable[[], bool] error: IO[bytes] error_available: Callable[[], bool] process: subprocess.Popen class Command: """ **Implements command invocation** An instance of Command provides methods to invoke external commands in blocking and non blocking mode. Control of stdout and stderr is given to the caller """ @overload @staticmethod def run( command: List[str], custom_env: Optional[MutableMapping[str, str]] = None, raise_on_error: bool = True, stderr_to_stdout: bool = False, raise_on_command_not_found: Literal[False] = False, ) -> CommandT: ... # pragma: no cover @overload @staticmethod def run( command: List[str], custom_env: Optional[MutableMapping[str, str]] = None, raise_on_error: bool = True, stderr_to_stdout: bool = False, raise_on_command_not_found: bool = True, ) -> Optional[CommandT]: ... # pragma: no cover @staticmethod def run( command: List[str], custom_env: Optional[MutableMapping[str, str]] = None, raise_on_error: bool = True, stderr_to_stdout: bool = False, raise_on_command_not_found: bool = True, ) -> Optional[CommandT]: """ Execute a program and block the caller. The return value is a CommandT namedtuple containing the stdout, stderr and return code information. Unless raise_on_error is set to `False` an exception is thrown if the command exits with an error code not equal to zero. If raise_on_command_not_found is `False` and the command is not found, then `None` is returned. Example: .. code:: python result = Command.run(['ls', '-l']) :param list command: command and arguments :param dict custom_env: custom os.environ :param bool raise_on_error: control error behaviour :param bool stderr_to_stdout: redirects stderr to stdout :return: Contains call results in command type .. code:: python CommandT(output='string', error='string', returncode=int) :rtype: CommandT """ from .path import Path environment = custom_env or os.environ cmd_abspath: Optional[str] if command[0].startswith("/"): cmd_abspath = command[0] if not os.path.exists(cmd_abspath): cmd_abspath = None else: cmd_abspath = Path.which( command[0], custom_env=environment, access_mode=os.X_OK ) if not cmd_abspath: message = f'Command "{command[0]}" not found in the environment' if raise_on_command_not_found: raise KiwiCommandNotFound(message) log.debug('EXEC: %s', message) return None stderr = subprocess.STDOUT if stderr_to_stdout else subprocess.PIPE log.debug('EXEC: [%s]', ' '.join(command)) try: process = subprocess.Popen( [cmd_abspath] + command[1:], stdout=subprocess.PIPE, stderr=stderr, env=environment, ) except (OSError, subprocess.SubprocessError) as e: raise KiwiCommandError( f'{command[0]}: {type(e).__name__}: {format(e)}' ) from e output, error = process.communicate() if process.returncode != 0 and raise_on_error: if not error: error = bytes(b'(no output on stderr)') if not output: output = bytes(b'(no output on stdout)') log.debug( 'EXEC: Failed with stderr: {0}, stdout: {1}'.format( Codec.decode(error), Codec.decode(output) ) ) raise KiwiCommandError( '{0}: stderr: {1}, stdout: {2}'.format( command[0], Codec.decode(error), Codec.decode(output) ) ) return CommandT( output=Codec.decode(output), error=Codec.decode(error), returncode=process.returncode, ) @staticmethod def call( command: List[str], custom_env: Optional[MutableMapping[str, str]] = None, ) -> CommandCallT: """ Execute a program and return an io file handle pair back. stdout and stderr are both on different channels. The caller must read from the output file handles in order to actually run the command. This can be done using the CommandIterator from command_process Example: .. code:: python process = Command.call(['ls', '-l']) :param list command: command and arguments :param list custom_env: custom os.environ :return: Contains process results in command type .. code:: python command( output='string', output_available=bool, error='string', error_available=bool, process=subprocess ) :rtype: namedtuple """ from .path import Path log.debug('EXEC: [%s]', ' '.join(command)) environment = custom_env or os.environ if not Path.which( command[0], custom_env=environment, access_mode=os.X_OK ): raise KiwiCommandNotFound( f'Command "{command[0]}" not found in the environment' ) try: process = subprocess.Popen( command, stdout=subprocess.PIPE, stderr=subprocess.PIPE, env=environment, ) except Exception as e: raise KiwiCommandError(f'{type(e).__name__}: {format(e)}') from e # guaranteed to be true as stdout & stderr equal subprocess.PIPE assert process.stdout and process.stderr # the narrowed types are kept in the select closures below stdout = process.stdout stderr = process.stderr def output_available() -> Callable[[], bool]: def _select() -> bool: readable, _, exceptional = select.select( [stdout], [], [stdout], 1e-4 ) if readable and not exceptional: return True return False return _select def error_available() -> Callable[[], bool]: def _select() -> bool: readable, _, exceptional = select.select( [stderr], [], [stderr], 1e-4 ) if readable and not exceptional: return True return False return _select return CommandCallT( output=process.stdout, output_available=output_available(), error=process.stderr, error_available=error_available(), process=process, ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7433155 kiwi-11.1.8/kiwi/command_process.py0000644000000000000000000001706015273675667014220 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from collections import namedtuple from kiwi.command import CommandCallT from typing import Any, NamedTuple, List, Callable # project from kiwi.utils.codec import Codec from kiwi.logger import Logger from kiwi.exceptions import KiwiCommandError log = logging.getLogger('kiwi') class PollT(NamedTuple): stdout_line: str stderr_line: str class CommandProcess: """ **Implements processing of non blocking Command calls** Provides methods to iterate over non blocking instances of the Command class with and without progress information :param subprocess command: instance of subprocess :param string log_topic: topic string for logging """ def __init__( self, command: CommandCallT, log_topic: str = 'system' ) -> None: self.command = CommandIterator(command) self.log_topic = log_topic self.items_processed = 0 def poll(self) -> None: """ Iterate over process, raise on error and log output """ for lineT in self.command: line = lineT.stdout_line if line: log.debug('%s: %s', self.log_topic, line) if self.command.get_error_code() != 0: raise KiwiCommandError(self.command.get_error_output()) def poll_show_progress( self, items_to_complete: List[str], match_method: Callable, with_stderr: bool = False, ) -> None: """ Iterate over process and show progress in percent raise on error and log output :param list items_to_complete: all items :param function match_method: method matching item """ self._init_progress() for lineT in self.command: lines = [lineT.stdout_line] if with_stderr: lines.append(lineT.stderr_line) for line in lines: if line: log.debug('%s: %s', self.log_topic, line) self._update_progress(match_method, items_to_complete, line) self._stop_progress() if self.command.get_error_code() != 0: raise KiwiCommandError(self.command.get_error_output()) def poll_and_watch(self) -> Any: """ Iterate over process don't raise on error and log stdout and stderr """ log.info(self.log_topic) log.debug('--------------out start-------------') for lineT in self.command: line = lineT.stdout_line if line: log.debug(line) log.debug('--------------out stop--------------') error_code = self.command.get_error_code() error_output = self.command.get_error_output() result = namedtuple('result', ['stderr', 'returncode']) if error_output: log.debug('--------------err start-------------') for line in error_output.split(os.linesep): log.debug(line) log.debug('--------------err stop--------------') return result(stderr=error_output, returncode=error_code) def create_match_method( self, method: Callable[[str, str], bool] ) -> Callable[[str, str], bool]: """ create a matcher function pointer which calls the given method as method(item_to_match, data) on dereference :param function method: function reference :return: function pointer :rtype: object """ def create_method(item_to_match: str, data: str) -> bool: return method(item_to_match, data) return create_method def returncode(self) -> int: return self.command.get_error_code() def _init_progress(self) -> None: Logger.progress(0, 100, '[ INFO ]: Processing') def _stop_progress(self) -> None: Logger.progress(100, 100, '[ INFO ]: Processing') def _update_progress( self, match_method: Callable, items_to_complete: List[str], command_output: str, ) -> None: items_count = len(items_to_complete) for item in items_to_complete: if match_method(item, command_output): self.items_processed += 1 if self.items_processed <= items_count: Logger.progress( self.items_processed, items_count, '[ INFO ]: Processing', ) class CommandIterator: """ **Implements an Iterator for Instances of Command** :param subprocess command: instance of subprocess """ def __init__(self, command: CommandCallT) -> None: self.command = command self.command_error_output = bytes(b'') self.command_output_line = bytes(b'') self.command_error_line = bytes(b'') self.output_eof_reached = False self.errors_eof_reached = False def __next__(self) -> PollT: line_stdout = '' line_stderr = '' if self.command.process.poll() is not None: if self.output_eof_reached and self.errors_eof_reached: raise StopIteration() if self.command.output_available(): byte_read = self.command.output.read(1) if not byte_read: self.output_eof_reached = True elif byte_read == bytes(b'\n'): line_stdout = Codec.decode(self.command_output_line) self.command_output_line = bytes(b'') else: self.command_output_line += byte_read if self.command.error_available(): byte_read = self.command.error.read(1) if not byte_read: self.errors_eof_reached = True elif byte_read == bytes(b'\n'): line_stderr = Codec.decode(self.command_error_line) self.command_error_line = bytes(b'') self.command_error_output += byte_read else: self.command_error_line += byte_read self.command_error_output += byte_read return PollT(stdout_line=line_stdout, stderr_line=line_stderr) def get_error_output(self) -> str: """ Provide data which was sent to the stderr channel :return: stderr data :rtype: str """ return Codec.decode(self.command_error_output) def get_error_code(self) -> int: """ Provide return value from processed command :return: errorcode :rtype: int """ return self.command.process.returncode def get_pid(self) -> int: """ Provide process ID of command while running :return: pid :rtype: int """ return self.command.process.pid def kill(self) -> None: """ Send kill signal SIGTERM to command process """ self.command.process.kill() def __iter__(self) -> 'CommandIterator': return self ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7433155 kiwi-11.1.8/kiwi/config/functions.sh0000644000000000000000000007231615273675667014310 0ustar00#!/bin/bash # Copyright (c) 2021 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # #====================================== # work in POSIX environment #-------------------------------------- export LANG=C export LC_ALL=C #====================================== # Common Functions #-------------------------------------- function mountProc { if ! mountpoint -q /proc; then mount -t proc proc /proc trap "umount /proc" EXIT fi } function mountCgroups { mount -t tmpfs cgroup_root /sys/fs/cgroup for group in devices blkio cpuset pids; do mkdir -p /sys/fs/cgroup/"${group}" mount -t cgroup "${group}" -o "${group}" /sys/fs/cgroup/"${group}" done } function umountCgroups { for group in devices blkio cpuset pids; do umount /sys/fs/cgroup/"${group}" done umount /sys/fs/cgroup } function setupContainerRuntime { cat >/etc/containers/containers.conf <<- EOF [engine] no_pivot_root = true events_logger = "none" cgroup_manager = "cgroupfs" EOF cat >/etc/containers/storage.conf <<- EOF [storage] driver = "vfs" graphroot = "/var/lib/containers/storage" runroot = "/var/run/containers/storage" EOF } function baseSystemdServiceInstalled { local service=$1 local sd_dirs=" /usr/lib/systemd/system /etc/systemd/system /run/systemd/system " local dir for dir in ${sd_dirs} ; do if [ -f "${dir}/${service}.service" ];then echo "${dir}/${service}.service" return fi if [ -f "${dir}/${service}.mount" ];then echo "${dir}/${service}.mount" return fi done } function baseSysVServiceInstalled { local service=$1 if [ -x "/etc/init.d/${service}" ];then echo "${service}" fi } function baseSystemdCall { local service_name=$1; shift local service local legacy_service service=$(baseSystemdServiceInstalled "${service_name}") if [ -n "${service}" ];then systemctl "$@" "${service_name}" else legacy_service=$(baseSysVServiceInstalled "${service_name}") if [ -n "${legacy_service}" ];then # systemd is sysV init compatible and still allows # to enable those type of services systemctl "$@" "${legacy_service}" fi fi } function baseInsertService { # /.../ # Enable a system service using systemctl # Examples: # # baseInsertService sshd # --> enable sshd service # # ---- local service=$1 baseSystemdCall "${service}" "enable" } function baseRemoveService { # /.../ # Disable a system service using systemctl # Example: # # baseRemoveService sshd # --> disable sshd service # ---- local service=$1 baseSystemdCall "${service}" "disable" } function baseService { # /.../ # Enable or Disable a service # Examples: # # baseService sshd on # --> enable sshd service # # baseService sshd off # --> disable sshd service # # ---- local service=$1 local target=$2 if [ -z "${target}" ];then echo "baseService: no target specified" return fi if [ -z "${service}" ];then echo "baseService: no service name specified" return fi if [ "${target}" = off ];then baseRemoveService "${service}" else baseInsertService "${service}" fi } #====================================== # suseImportBuildKey #-------------------------------------- function suseImportBuildKey { # /.../ # Add missing gpg keys to rpm database # ---- local KEY local TDIR local KFN local dumpsigs=/usr/lib/rpm/gnupg/dumpsigs TDIR=$(mktemp -d) if [ ! -d "${TDIR}" ]; then echo "suseImportBuildKey: Failed to create temp dir" return fi if [ -d "/usr/lib/rpm/gnupg/keys" ];then pushd "/usr/lib/rpm/gnupg/keys" || return else pushd "${TDIR}" || return if [ -x "${dumpsigs}" ];then ${dumpsigs} /usr/lib/rpm/gnupg/suse-build-key.gpg fi fi for KFN in gpg-pubkey-*.asc; do if [ ! -e "${KFN}" ];then # # check if file exists because if the glob match did # not find files bash will use the glob string as # result and we just continue in this case # continue fi KEY=$(basename "${KFN}" .asc) if rpm -q "${KEY}" >/dev/null; then continue fi echo "Importing ${KEY} to rpm database" rpm --import "${KFN}" done popd || return rm -rf "${TDIR}" } function baseStripLocales { local keepLocales="$*" find /usr/lib/locale -mindepth 1 -maxdepth 1 -type d 2>/dev/null |\ baseStripAndKeep "${keepLocales}" } function baseStripTranslations { local keepMatching="$*" find /usr/share/locale -name "*.mo" |\ grep -v "${keepMatching}" | xargs rm -f } function baseStripUnusedLibs { # /.../ # Remove libraries which are not directly linked # against applications in the bin directories # ---- local needlibs local found local dir local lib local lddref # /.../ # Find directly used libraries, by calling ldd # on files in *bin* # --- ldconfig rm -f /tmp/needlibs for i in /usr/bin/* /bin/* /sbin/* /usr/sbin/* /lib/systemd/systemd-*;do for n in $(ldd "$i" 2>/dev/null | cut -f2- -d "/" | cut -f1 -d " ");do if [ ! -e "/$n" ];then continue fi lddref="/$n" while true;do if lib=$(readlink "${lddref}"); then lddref="${lib}" continue fi break done lddref=$(basename "${lddref}") echo "${lddref}" >> /tmp/needlibs done done count=0 for i in $(sort /tmp/needlibs | uniq);do for d in \ /lib /lib64 /usr/lib /usr/lib64 \ /usr/X11R6/lib /usr/X11R6/lib64 \ /lib/x86_64-linux-gnu /usr/lib/x86_64-linux-gnu do if [ -e "$d/$i" ];then needlibs[${count}]="$d/$i" count=$((count + 1)) fi done done # /.../ # add exceptions # ---- for libname in $1; do for libfile in \ /lib*/"$libname"* /usr/lib*/"$libname"* \ /lib/x86_64-linux-gnu/"$libname"* \ /usr/lib/x86_64-linux-gnu/"$libname"* \ /usr/X11R6/lib*/"$libname"* do if [ -e "$libfile" ];then needlibs[$count]=$libfile count=$((count + 1)) fi done done # /.../ # find unused libs and remove it, dl loaded libs # seems not to be that important within the initrd # ---- rm -f /tmp/needlibs for i in \ /lib/lib* /lib64/lib* /usr/lib/lib* \ /usr/lib64/lib* /usr/X11R6/lib*/lib* \ /lib/x86_64-linux-gnu/lib* /usr/lib/x86_64-linux-gnu/lib* do found=0 if [ ! -e "$i" ];then continue fi if [ -d "$i" ];then continue fi if [ -L "$i" ];then continue fi for n in ${needlibs[*]};do if [ "$i" = "$n" ];then found=1; break fi done if [ "${found}" -eq 0 ];then echo "Removing library: $i" rm "$i" fi done } function baseUpdateSysConfig { # /.../ # Update the contents of a sysconfig variable # ---- local FILE=$1 local VAR local VAL if [ -f "${FILE}" ];then VAR=$2 VAL=$3 eval sed -i "s'@^\($VAR=\).*\$@\1\\\"$VAL\\\"@'" "${FILE}" else echo "warning: config file $FILE not found" fi } function baseStripInitrd { declare kiwi_initrd_system=${kiwi_initrd_system} declare kiwi_strip_tools=${kiwi_strip_tools} declare kiwi_strip_libs=${kiwi_strip_libs} #========================================== # Check for initrd system #------------------------------------------ if [ "${kiwi_initrd_system}" = "dracut" ]; then echo "dracut initrd system requested, initrd strip skipped" return fi #========================================== # remove unneeded tools #------------------------------------------ local tools="${kiwi_strip_tools}" tools="${tools} $*" for path in /sbin /usr/sbin /usr/bin /bin;do baseStripTools "${path}" "${tools}" done } function baseStripFirmware { # /.../ # check all kernel modules if they require a firmware and # strip out all firmware files which are not referenced # by a kernel module # ---- local IFS local base=/lib/modules local name local bmdir local kernel_module local firmware mkdir -p /lib/firmware-required find "${base}" \( -name "*.ko" -o -name "*.ko.xz" -o -name "*.ko.zst" -o -name "*.ko.gz" \) -print0 | \ while IFS= read -r -d $'\0' kernel_module; do firmware=$(modinfo "${kernel_module}" | grep ^firmware || :) if [ -z "${firmware}" ];then continue fi name=$(echo "$firmware" | cut -f2 -d:) if [ -z "${name}" ];then continue fi # could be more than one, loop for fname in $name ; do for match in /lib/firmware/"${fname}" \ /lib/firmware/"${fname}".xz \ /lib/firmware/"${fname}".gz \ /lib/firmware/"${fname}".zst \ /lib/firmware/*/"${fname}" \ /lib/firmware/*/"${fname}".xz \ /lib/firmware/*/"${fname}".gz \ /lib/firmware/*/"${fname}".zst ;do if [ -e "${match}" ];then match="${match//\/lib\/firmware\//}" bmdir=$(dirname "${match}") mkdir -p "/lib/firmware-required/${bmdir}" mv "/lib/firmware/${match}" \ "/lib/firmware-required/${bmdir}" fi done done done # Preserve licenses and txt files (which are needed for some firmware blobs) find /lib/firmware \( -name 'LICENSE*' -o -name '*txt' \) -print |\ while read -r match; do if [ -e "${match}" ];then match="${match//\/lib\/firmware\//}" bmdir=$(dirname "${match}") mkdir -p "/lib/firmware-required/${bmdir}" mv "/lib/firmware/${match}" "/lib/firmware-required/${bmdir}" fi done rm -rf /lib/firmware mv /lib/firmware-required /lib/firmware } function baseStripModules { # /.../ # search for updated modules and remove the old version # which might be provided by the standard kernel # ---- local kernel=/lib/modules local files local mlist local count=1 local mosum=1 local modup files=$(find ${kernel} -type f \( -name "*.ko" -o -name "*.ko.xz" \) ) mlist=$(for i in ${files};do echo "$i";done | sed -e "s@.*/@@g" | sort) #====================================== # create sorted module array #-------------------------------------- for mod in ${mlist};do name_list[$count]=${mod} count=$((count + 1)) done count=1 #====================================== # find duplicate modules by their name #-------------------------------------- while [ ${count} -lt ${#name_list[*]} ];do mod=${name_list[${count}]} mod_next=${name_list[$((count + 1))]} if [ "${mod}" = "$mod_next" ];then mosum=$((mosum + 1)) else if [ ${mosum} -gt 1 ];then modup="${modup} ${mod}" fi mosum=1 fi count=$((count + 1)) done #====================================== # sort out duplicates prefer updates #-------------------------------------- if [ -z "${modup}" ];then echo "baseStripModules: No old versions for update drivers found" return fi for file in ${files};do for mod in $modup;do if [[ ${file} =~ ${mod} ]] && [[ ! ${file} =~ "updates" ]];then echo "baseStripModules: Update driver found for ${mod}" echo "baseStripModules: Removing old version: ${file}" rm -f "${file}" fi done done } function baseStripKernelModules { for kernel_dir in /kernel-tree/*;do kernel_version=$(/usr/bin/basename "${kernel_dir}") if [ ! -d "/kernel-tree/${kernel_version}/kernel" ]; then continue fi echo "Downsizing kernel modules for ${kernel_dir}" for module in $( find "/kernel-tree/${kernel_version}/kernel" \ -name "*.ko" -o -name "*.ko.xz" | sort ); do if ! baseKernelDriverMatches "${module}"; then echo "Deleting unwanted module: ${module}" rm -f "${module}" fi done done } function baseUpdateModuleDependencies { local kernel_dir local kernel_version for kernel_dir in /lib/modules/*;do [ -d "${kernel_dir}" ] || continue kernel_version=$(/usr/bin/basename "${kernel_dir}") if [ -f "/boot/System.map-${kernel_version}" ];then /sbin/depmod -F \ "/boot/System.map-${kernel_version}" "${kernel_version}" fi done } function baseStripKernel { # /.../ # this function will strip the kernel # # 1. handle requests. Because this # information is generic not only files of the kernel # are affected but also other data which is unwanted # gets deleted here # # 2. only keep kernel modules matching the # patterns from the kiwi boot image description # # 3. lookup kernel module dependencies and bring back # modules which were removed but still required by # other modules kept in the system to stay consistent # # 4. lookup for duplicate kernel modules due to kernel # module updates and keep only the latest version # # 5. lookup for kernel firmware files and keep only those # for which a kernel driver is still present in the # system # ---- declare kiwi_initrd_system=${kiwi_initrd_system} declare kiwi_strip_delete=${kiwi_strip_delete} if [ "${kiwi_initrd_system}" = "dracut" ]; then echo "dracut initrd system requested, kernel strip skipped" else for delete in ${kiwi_strip_delete};do echo "Removing file/directory: ${delete}" rm -rf "${delete}" done baseCreateKernelTree baseStripKernelModules baseFixupKernelModuleDependencies baseSyncKernelTree baseStripModules baseStripFirmware baseUpdateModuleDependencies fi } function baseSetRunlevel { # /.../ # Set the systemd default target link according to the # specified value Examples: # # baseSetRunlevel 5 # --> set graphical.target as systemd default # # baseSetRunlevel shutdown.target # --> set shutdown.target as systemd default # # ---- local target=$1 local systemd_system=/usr/lib/systemd/system local systemd_default=/etc/systemd/system/default.target local systemd_consoles=$systemd_system/multi-user.target local systemd_graphics=$systemd_system/graphical.target case "${target}" in 1|2|3|5) # /.../ # Given target is a number, map the number to a service # We only allow console or graphics mode # ---- if [ "${target}" -lt 5 ];then ln -sf "${systemd_consoles}" "${systemd_default}" else ln -sf "${systemd_graphics}" "${systemd_default}" fi ;; *) # /.../ # Given target is a raw name; use this as systemd target # name and setup this target name as the default target # ---- if [ -e "${systemd_system}/${target}" ]; then ln -sf "${systemd_system}/${target}" "${systemd_default}" else echo "Can't find systemd target: ${target}" fi ;; esac } function baseSetupBuildDay { local buildDay buildDay="$(LC_ALL=C date -u '+%Y%m%d')" echo "build_day=${buildDay}" > /build_day } function baseVagrantSetup { # insert the default insecure ssh key from here: # https://github.com/hashicorp/vagrant/blob/master/keys/vagrant.pub mkdir -p /home/vagrant/.ssh/ chmod 0700 /home/vagrant/.ssh/ echo "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA6NF8iallvQVp22WDkTkyrtvp9eWW6A8YVr+kz4TjGYe7gHzIw+niNltGEFHzD8+v1I2YJ6oXevct1YeS0o9HZyN1Q9qgCgzUFtdOKLv6IedplqoPkcmF0aYet2PkEDo3MlTBckFXPITAMzF8dJSIFo9D8HfdOV0IAdx4O7PtixWKn5y2hMNG0zQPyUecp4pzC6kivAIhyfHilFR61RGL+GPXQ2MWZWFYbAGjyiYJnAmCP3NOTd0jMZEnDkbUvxhMmBYSdETk1rRgm+R4LOzFUGaHqHDLKLX+FIPKcF96hrucXzcWyLbIbEgE98OHlnVYCzRdK8jlqm8tehUc9c9WhQ== vagrant insecure public key" > /home/vagrant/.ssh/authorized_keys chmod 0600 /home/vagrant/.ssh/authorized_keys chown -R vagrant:vagrant /home/vagrant/ # apply recommended ssh settings for vagrant boxes SSHD_CONFIG=/etc/ssh/sshd_config.d/00-vagrant.conf if [[ ! -d "$(dirname ${SSHD_CONFIG})" ]]; then SSHD_CONFIG=/etc/ssh/sshd_config # prepend the settings, so that they take precedence echo -e "UseDNS no\nGSSAPIAuthentication no\n$(cat ${SSHD_CONFIG})" > ${SSHD_CONFIG} else echo -e "UseDNS no\nGSSAPIAuthentication no" > ${SSHD_CONFIG} fi # vagrant assumes that it can sudo without a password # => add the vagrant user to the sudoers list SUDOERS_LINE="vagrant ALL=(ALL) NOPASSWD: ALL" if [ -d /etc/sudoers.d ]; then echo "$SUDOERS_LINE" >| /etc/sudoers.d/vagrant visudo -cf /etc/sudoers.d/vagrant chmod 0440 /etc/sudoers.d/vagrant else echo "$SUDOERS_LINE" >> /etc/sudoers visudo -cf /etc/sudoers fi # the default shared folder mkdir -p /vagrant chown -R vagrant:vagrant /vagrant # SSH service baseInsertService sshd } #====================================== # Common Functions (SUSE) #-------------------------------------- function suseRemoveService { # function kept for compatibility baseRemoveService "$@" } function suseInsertService { # function kept for compatibility baseInsertService "$@" } function suseService { # function kept for compatibility baseService "$@" } function suseStripInitrd { baseStripInitrd "$@" } function suseStripKernel { baseStripKernel } function suseSetupProduct { # /.../ # This function creates the /etc/products.d/baseproduct # link pointing to the product referenced by either # /etc/SuSE-brand or /etc/os-release or the latest .prod file # available in /etc/products.d # ---- local prod=undef if [ -f /etc/SuSE-brand ];then prod=$(head /etc/SuSE-brand -n 1) elif [ -f /etc/os-release ];then prod=$(while read -r line; do if [[ $line =~ ^NAME ]]; then echo "$line"; fi; done < /etc/os-release | cut -d '=' -f 2 | cut -d '"' -f 2) fi if [ -d /etc/products.d ];then pushd /etc/products.d || return if [ -f "${prod}.prod" ];then ln -sf "${prod}.prod" baseproduct elif [ -f "SUSE_${prod}.prod" ];then ln -sf "SUSE_${prod}.prod" baseproduct else find_prod() { for f in *; do if [[ $f =~ \.prod$ ]]; then echo "$f" fi done } prod=$(find_prod | tail -n 1) if [ -f "${prod}" ];then ln -sf "${prod}" baseproduct fi fi popd || return fi } #====================================== # Helper methods #-------------------------------------- function Echo { # /.../ # print a message to the controling terminal # ---- local option="" local prefix="----->" local optn="" local opte="" while getopts "bne" option;do case ${option} in b) prefix=" " ;; n) optn="-n" ;; e) opte="-e" ;; *) echo "Invalid argument: ${option}" ;; esac done shift $((OPTIND - 1)) echo "${optn}" "${opte}" "${prefix} $1" OPTIND=1 } function Debug { # /.../ # print message if variable DEBUG is set to 1 # ----- if test "${DEBUG:-0}" = 1;then echo "+++++> (caller:${FUNCNAME[1]}:${FUNCNAME[2]} ) $*" fi } function baseQuoteFile { # /.../ # Quote file to be shell sourceable # ----- local file=$1 local conf=$file.quoted # create clean input, no empty lines and comments grep -v '^$' "${file}" | grep -v '^[ \t]*#' > "${conf}" # remove start/stop quoting from values sed -E -i -e s"#(^[a-zA-Z0-9_]+)=[\"'](.*)[\"']#\1=\2#" "${conf}" # remove backslash quotes if any sed -E -i -e s"#\\\\(.)#\1#g" "${conf}" # quote simple quotation marks sed -E -i -e s"#'+#'\\\\''#g" "${conf}" # add '...' quoting to values sed -E -i -e s"#(^[a-zA-Z0-9_]+)=(.*)#\1='\2'#" "${conf}" mv "${conf}" "${file}" } function baseCreateKernelTree { # /.../ # Create a copy of the kernel source tree under # /kernel-tree/ for stripping operations # ---- echo "Creating copy of kernel tree for strip operations" mountProc mkdir -p /kernel-tree cp -a /lib/modules/* /kernel-tree/ } function baseSyncKernelTree { # /.../ # Overwrite the original kernel tree with a minimized # version from /kernel-tree/. # ---- echo "Replace kernel tree with downsized version" mountProc rm -rf /lib/modules/* cp -a /kernel-tree/* /lib/modules/ rm -rf /kernel-tree } function baseFixupKernelModuleDependencies { # /.../ # Browse through the kernel tree and check if kernel # module dependencies are broken, if yes fix them # ---- local kernel_dir local kernel_version local module local module_name local module_info local dependency local module_files mountProc for kernel_dir in /kernel-tree/*;do echo "Checking kernel dependencies for ${kernel_dir}" kernel_version=$(/usr/bin/basename "${kernel_dir}") module_files=$( find "/kernel-tree/${kernel_version}" \ -name "*.ko" -o -name "*.ko.xz" ) for module in ${module_files};do module_u=${module%.xz} module_name=$(/usr/bin/basename "${module_u}") module_info=$(/sbin/modprobe \ --set-version "${kernel_version}" --ignore-install \ --show-depends "${module_name%.ko}" |\ sed -ne 's:.*insmod /\?::p' ) for dependency in ${module_info}; do if [ ! -f "/${dependency}" ]; then continue fi dependency_module=${dependency/lib\/modules/kernel-tree} if [ ! -f "${dependency_module}" ];then echo -e "Fix ${module}:\n --> needs: ${dependency_module}" mkdir -p "$(/usr/bin/dirname "${dependency_module}")" cp -a "${dependency}" "${dependency_module}" fi done done done } function baseKernelDriverMatches { # /.../ # Check if the provided kernel module name matches # the kiwi driver pattern # ---- declare kiwi_drivers=${kiwi_drivers} module=$1 for pattern in $(echo "${kiwi_drivers}" | tr , ' '); do if [[ ${module} =~ ${pattern} ]];then return 0 fi done return 1 } function baseStripAndKeep { # /.../ # helper function for the baseStrip* functions # reads the list of files to check from stdin for removing # - params - files which should be kept # ---- local keepFiles="$*" local found local baseFile local keep local file while read -r file; do baseFile=$(/usr/bin/basename "${file}") found=0 for keep in ${keepFiles};do if echo "${baseFile}" | grep -q "${keep}"; then found=1 break fi done if [ "${found}" = 0 ]; then Rm -rf "${file}" fi done } function baseStripTools { # /.../ # baseStripTools {list of toolpath} {list of tools} # Helper function for suseStripInitrd, only keep # the provided tools from the list local tpath=$1 local tools=$2 local found local file local IFS find "${tpath}" -print0 | \ while IFS= read -r -d $'\0' file; do found=0 base=$(/usr/bin/basename "${file}") for need in ${tools};do if [ "${base}" = "$need" ];then found=1 break fi done if [ "${found}" = 0 ] && [ ! -d "${file}" ];then Rm -fv "${file}" fi done } function Rm { # /.../ # delete files & anounce it to log # ---- Debug "rm $*" rm "$@" } function deprecated { { echo "DEPRECATED: $1() is obsolete" echo "[" cat echo "]" } >&2 exit 1 } #====================================== # Deprecated methods #-------------------------------------- function baseCleanMount { deprecated "${FUNCNAME[0]}" <<- EOF Cleanup operations are a responsibility of the kiwi code EOF } function baseMount { deprecated "${FUNCNAME[0]}" <<- EOF Mounting of kernel and other base filesystems are a responsibility of the kiwi code EOF } function suseActivateDefaultServices { deprecated "${FUNCNAME[0]}" <<- EOF There is no generic applicable list of default services It is expected that the installation of software handles this properly. Optional services should be handled explicitly EOF } function baseSetupUserPermissions { deprecated "${FUNCNAME[0]}" <<- EOF This is done in kiwi by chkstat EOF } function suseConfig { deprecated "${FUNCNAME[0]}" <<- EOF suse script no longer present EOF } function baseGetPackagesForDeletion { deprecated "${FUNCNAME[0]}" <<- EOF Provided by the kiwi_delete environment variable EOF } function baseGetProfilesUsed { deprecated "${FUNCNAME[0]}" <<- EOF Provided by the kiwi_profiles environment variable EOF } function baseStripMans { deprecated "${FUNCNAME[0]}" <<- EOF Man pages are marked as documentation by the package manager and can be excluded via rpm-excludedocs EOF } function baseStripDocs { deprecated "${FUNCNAME[0]}" <<- EOF Documentation lives at different places and a method to do this in a common way should not be a responsibility of kiwi EOF } function baseStripInfos { deprecated "${FUNCNAME[0]}" <<- EOF Info files are marked as documentation by the package manager and can be excluded via rpm-excludedocs EOF } function Rpm { deprecated "${FUNCNAME[0]}" <<- EOF Please call rpm as it fits in the caller scope EOF } function rhelStripInitrd { deprecated "${FUNCNAME[0]}" <<- EOF Useful only in the context of a kiwi created initrd This concept was never exposed to RHEL/Fedora EOF } function debianStripInitrd { deprecated "${FUNCNAME[0]}" <<- EOF Useful only in the context of a kiwi created initrd This concept was never exposed to Debian/Ubuntu EOF } function rhelStripKernel { deprecated "${FUNCNAME[0]}" <<- EOF Useful only in the context of a kiwi created initrd This concept was never exposed to RHEL/Fedora EOF } function debianStripKernel { deprecated "${FUNCNAME[0]}" <<- EOF Useful only in the context of a kiwi created initrd This concept was never exposed to Debian/Ubuntu EOF } function rhelSplashToGrub { deprecated "${FUNCNAME[0]}" <<- EOF Code based on distros out of support and no longer using kernel splash EOF } function suseSetupProductInformation { deprecated "${FUNCNAME[0]}" <<- EOF Utilizes zypper to install a product information. Product handling in zypper has changed. The method here was based on distros out of support EOF } function baseCleanup { deprecated "${FUNCNAME[0]}" <<- EOF Cleanup operations are a responsibility of the kiwi code EOF } function suseCleanup { deprecated "${FUNCNAME[0]}" <<- EOF Cleanup operations are a responsibility of the kiwi code EOF } function suseRemoveYaST { deprecated "${FUNCNAME[0]}" <<- EOF There is no standard uninstall method for YaST which is common across distributions. To prevent installation of YaST make sure it does not get pulled in with the packages. If this is inevitable delete it based on packages in the kiwi delete/uninstall sections EOF } # vim: set noexpandtab: ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7445486 kiwi-11.1.8/kiwi/config/kiwi_boxed_plugin.yml0000644000000000000000000001747215273675667016173 0ustar00box: - name: tumbleweed mem_mb: 8096M processors: 4 console: hvc0 arch: - name: x86_64 cmdline: - root=/dev/vda3 - rd.plymouth=0 source: obs://Virtualization:Appliances:SelfContained:tumbleweed/images packages_file: TumbleWeed-Box.x86_64-System.json boxfiles: - TumbleWeed-Box.x86_64-Kernel.tar.xz - TumbleWeed-Box.x86_64-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/tumbleweed/images/tumbleweed:latest use_initrd: true - name: aarch64 cmdline: - root=/dev/vda2 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:tumbleweed/images packages_file: TumbleWeed-Box.aarch64-System.json boxfiles: - TumbleWeed-Box.aarch64-Kernel.tar.xz - TumbleWeed-Box.aarch64-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/tumbleweed/images/tumbleweed:latest use_initrd: true - name: s390x cmdline: - root=/dev/vda1 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:tumbleweed/images packages_file: TumbleWeed-Box.s390x-System.json boxfiles: - TumbleWeed-Box.s390x-Kernel.tar.xz - TumbleWeed-Box.s390x-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/tumbleweed/images/tumbleweed:latest use_initrd: true - name: leap mem_mb: 8096M processors: 4 console: hvc0 arch: - name: x86_64 cmdline: - root=/dev/vda1 - rd.plymouth=0 source: obs://Virtualization:Appliances:SelfContained:leap/images packages_file: Leap-Box.x86_64-System.json boxfiles: - Leap-Box.x86_64-Kernel.tar.xz - Leap-Box.x86_64-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/leap/images/leap:latest use_initrd: true - name: fedora mem_mb: 8096M processors: 4 console: hvc0 arch: - name: x86_64 cmdline: - root=/dev/vda3 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:fedora/images packages_file: Fedora-Box.x86_64-System.json boxfiles: - Fedora-Box.x86_64-Kernel.tar.xz - Fedora-Box.x86_64-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/fedora/images/fedora:latest use_initrd: true - name: ubuntu mem_mb: 8096M processors: 4 console: hvc0 arch: - name: x86_64 cmdline: - root=/dev/vda3 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:ubuntu/images packages_file: Ubuntu-Box.x86_64-System.json boxfiles: - Ubuntu-Box.x86_64-Kernel.tar.xz - Ubuntu-Box.x86_64-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/ubuntu/images/ubuntu:latest use_initrd: true - name: aarch64 cmdline: - root=/dev/vda2 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:ubuntu/images packages_file: Ubuntu-Box.aarch64-System.json boxfiles: - Ubuntu-Box.aarch64-Kernel.tar.xz - Ubuntu-Box.aarch64-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/ubuntu/images/ubuntu:latest use_initrd: true - name: universal mem_mb: 8096M processors: 4 console: hvc0 arch: - name: x86_64 cmdline: - root=/dev/vda3 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:universal/images packages_file: Universal-Box.x86_64-System.json boxfiles: - Universal-Box.x86_64-Kernel.tar.xz - Universal-Box.x86_64-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/universal/images/universal:latest use_initrd: true - name: aarch64 cmdline: - root=/dev/vda2 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:universal/images packages_file: Universal-Box.aarch64-System.json boxfiles: - Universal-Box.aarch64-Kernel.tar.xz - Universal-Box.aarch64-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/universal/images/universal:latest use_initrd: true - name: s390x cmdline: - root=/dev/vda1 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:universal/images packages_file: Universal-Box.s390x-System.json boxfiles: - Universal-Box.s390x-Kernel.tar.xz - Universal-Box.s390x-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/universal/images/universal:latest use_initrd: true - name: ppc64le cmdline: - root=/dev/vda2 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:universal/images packages_file: Universal-Box.ppc64le-System.json boxfiles: - Universal-Box.ppc64le-Kernel.tar.xz - Universal-Box.ppc64le-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/universal/images/universal:latest use_initrd: true - name: staging mem_mb: 8096M processors: 4 console: hvc0 arch: - name: x86_64 cmdline: - root=/dev/vda3 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:staging/images packages_file: Staging-Box.x86_64-System.json boxfiles: - Staging-Box.x86_64-Kernel.tar.xz - Staging-Box.x86_64-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/staging/images/staging:latest use_initrd: true - name: aarch64 cmdline: - root=/dev/vda2 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:staging/images packages_file: Staging-Box.aarch64-System.json boxfiles: - Staging-Box.aarch64-Kernel.tar.xz - Staging-Box.aarch64-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/staging/images/staging:latest use_initrd: true - name: s390x cmdline: - root=/dev/vda1 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:staging/images packages_file: Staging-Box.s390x-System.json boxfiles: - Staging-Box.s390x-Kernel.tar.xz - Staging-Box.s390x-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/staging/images/staging:latest use_initrd: true - name: ppc64le cmdline: - root=/dev/vda2 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:staging/images packages_file: Staging-Box.ppc64le-System.json boxfiles: - Staging-Box.ppc64le-Kernel.tar.xz - Staging-Box.ppc64le-System.qcow2 container: registry.opensuse.org/virtualization/appliances/selfcontained/staging/images/staging:latest use_initrd: true ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7445486 kiwi-11.1.8/kiwi/config/strip.xml0000644000000000000000000002603615273675667013625 0ustar00 Marcus Schäfer ms@suse.com default items to keep or delete from the kiwi initrd 2.7.1 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7445486 kiwi-11.1.8/kiwi/container/__init__.py0000644000000000000000000000417015273675667014563 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from abc import ABCMeta, abstractmethod from typing import Dict, Optional from kiwi.container.base import ContainerImageBase from kiwi.exceptions import KiwiContainerImageSetupError class ContainerImage(metaclass=ABCMeta): """ **Container Image factory** :param string name: container system name :param string root_dir: root directory path name :param dict custom_args: custom arguments """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( name: str, root_dir: str, custom_args: Optional[Dict] = None ) -> ContainerImageBase: # noqa: E252 name_map = {'docker': 'OCI', 'oci': 'OCI', 'appx': 'Appx', 'wsl': 'Wsl'} args_map = { 'docker': [root_dir, 'docker-archive', custom_args], 'oci': [root_dir, 'oci-archive', custom_args], 'appx': [root_dir, custom_args], 'wsl': [root_dir, custom_args], } try: container_image = importlib.import_module( 'kiwi.container.{}'.format('oci' if name == 'docker' else name) ) module_name = 'ContainerImage{}'.format(name_map[name]) return container_image.__dict__[module_name](*args_map[name]) except Exception: raise KiwiContainerImageSetupError( 'Support for {0} container not implemented'.format(name) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7447097 kiwi-11.1.8/kiwi/container/appx.py0000644000000000000000000001114215273675667013771 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from typing import Dict # project from kiwi.utils.temporary import Temporary from kiwi.archive.tar import ArchiveTar from kiwi.defaults import Defaults from kiwi.utils.compress import Compress from kiwi.runtime_config import RuntimeConfig from kiwi.command import Command from kiwi.container.base import ContainerImageBase from kiwi.exceptions import KiwiContainerSetupError log = logging.getLogger('kiwi') class ContainerImageAppx(ContainerImageBase): """ Create Appx container from a root directory for WSL(Windows Subsystem Linux) :param string root_dir: root directory path name :param dict custom_args: Custom processing arguments defined as hash keys: Example .. code:: python { 'metadata_path': 'directory' } """ def __init__(self, root_dir: str, custom_args: Dict[str, str] = {}): self.root_dir = root_dir self.wsl_config = custom_args or {} self.runtime_config = RuntimeConfig() self.meta_data_path = format(self.wsl_config.get('metadata_path') or '') if not self.meta_data_path: raise KiwiContainerSetupError( 'No metadata path specified to build appx container' ) if not os.path.exists(self.meta_data_path): raise KiwiContainerSetupError( 'Specified metadata path {0} does not exist'.format( self.meta_data_path ) ) def create( self, filename: str, base_image: str = '', ensure_empty_tmpdirs: bool = False, compress_archive: bool = False, ) -> str: """ Create WSL/Appx archive :param string filename: archive file name :param string base_image: not-supported :param bool ensure_empty_tmpdirs: not-supported :param bool compress_archive: compress container archive """ exclude_list = ( Defaults.get_exclude_list_for_root_data_sync() + Defaults.get_exclude_list_from_custom_exclude_files(self.root_dir) ) exclude_list.append('boot') exclude_list.append('dev') exclude_list.append('sys') exclude_list.append('proc') # The C code of WSL-DistroLauncher harcodes the name for the # root tarball to be install.tar.gz. Thus we have to use this # name for the root tarball archive_file_name = os.sep.join([self.meta_data_path, 'install.tar']) archive = ArchiveTar(archive_file_name) archive_file_name = archive.create(self.root_dir, exclude=exclude_list) compressor = Compress(archive_file_name) archive_file_name = compressor.gzip() filemap_file = Temporary().new_file() with open(filemap_file.name, 'w') as filemap: filemap.write('[Files]{0}'.format(os.linesep)) for topdir, dirs, files in sorted(os.walk(self.meta_data_path)): for entry in sorted(dirs + files): if entry in files: mapfile = os.sep.join([topdir, entry]) mapfile_relative = os.path.relpath( mapfile, start=self.meta_data_path ) log.info( 'Adding {0} to Appx filemap as relative path {1}'.format( mapfile, mapfile_relative ) ) filemap.write( '"{0}" "{1}"{2}'.format( mapfile, mapfile_relative, os.linesep ) ) Command.run(['appx', '-o', filename, '-f', filemap_file.name]) if compress_archive: compress = Compress(filename) filename = compress.xz(self.runtime_config.get_xz_options()) return filename ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7447097 kiwi-11.1.8/kiwi/container/base.py0000644000000000000000000000170415273675667013736 0ustar00# Copyright (c) 2023 SUSE LLC # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from abc import ABC, abstractmethod class ContainerImageBase(ABC): @abstractmethod def create( self, filename: str, base_image: str, ensure_empty_tmpdirs: bool, compress_archive: bool = False, ) -> str: pass # pragma: no cover ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7447097 kiwi-11.1.8/kiwi/container/oci.py0000644000000000000000000002023015273675667013571 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from typing import Dict, List, Optional, TypedDict # project from kiwi.utils.compress import Compress from kiwi.runtime_config import RuntimeConfig from kiwi.defaults import Defaults from kiwi.oci_tools import OCI from kiwi.container.base import ContainerImageBase log = logging.getLogger('kiwi') class OciConfig(TypedDict, total=False): container_name: str container_tag: str additional_names: List[str] entry_command: List[str] entry_subcommand: List[str] maintainer: str user: str workingdir: str expose_ports: List[str] volumes: List[str] environment: Dict[str, str] labels: Dict[str, str] history: Dict[str, str] class ContainerImageOCI(ContainerImageBase): """ Create oci container from a root directory :param string root_dir: root directory path name :param dict custom_args: Custom processing arguments defined as hash keys: Example .. code:: python { 'container_name': 'name', 'container_tag': '1.0', 'additional_names': ['current', 'foobar'], 'entry_command': ['/bin/bash', '-x'], 'entry_subcommand': ['ls', '-l'], 'maintainer': 'tux', 'user': 'root', 'workingdir': '/root', 'expose_ports': ['80', '42'], 'volumes': ['/var/log', '/tmp'], 'environment': {'PATH': '/bin'}, 'labels': {'name': 'value'}, 'history': { 'created_by': 'some explanation here', 'comment': 'some comment here', 'author': 'tux' } } """ def __init__( self, root_dir: str, transport: str, custom_args: Optional[OciConfig] = None, ) -> None: self.root_dir = root_dir self.archive_transport = transport self.oci_config = custom_args or {} # for builds inside the buildservice we include a reference to the # specific build. Thus disturl label only exists inside the # buildservice. if Defaults.is_buildservice_worker(): bs_label = 'org.openbuildservice.disturl' # Do not label anything if the build service label is # already present if ( 'labels' not in self.oci_config or bs_label not in self.oci_config['labels'] ): self._append_buildservice_disturl_label() if 'container_name' not in self.oci_config: log.info( 'No container configuration provided, ' 'using default container name "kiwi-container:latest"' ) self.oci_config['container_name'] = ( Defaults.get_default_container_name() ) self.oci_config['container_tag'] = ( Defaults.get_default_container_tag() ) if 'container_tag' not in self.oci_config: self.oci_config['container_tag'] = ( Defaults.get_default_container_tag() ) if 'history' not in self.oci_config: self.oci_config['history'] = {} if 'created_by' not in self.oci_config['history']: self.oci_config['history'][ 'created_by' ] = Defaults.get_default_container_created_by() def create( self, filename: str, base_image: str, ensure_empty_tmpdirs: bool = True, compress_archive: bool = False, ) -> str: """ Create compressed oci system container tar archive :param string filename: archive file name :param string base_image: archive used as a base image :param bool ensure_empty_tmpdirs: exclude system tmp directories :param bool compress_archive: compress container archive """ exclude_list = Defaults.get_exclude_list_for_root_data_sync( ensure_empty_tmpdirs ) + Defaults.get_exclude_list_from_custom_exclude_files(self.root_dir) exclude_list.append('dev/*') exclude_list.append('sys/*') exclude_list.append('proc/*') with OCI.new() as oci: if base_image: oci.import_container_image( 'oci-archive:{0}:{1}'.format( base_image, Defaults.get_container_base_image_tag() ) ) else: # Apply default subcommand only for base images if ( 'entry_command' not in self.oci_config and 'entry_subcommand' not in self.oci_config ): self.oci_config['entry_subcommand'] = ( Defaults.get_default_container_subcommand() ) oci.init_container() image_ref = '{0}:{1}'.format( self.oci_config['container_name'], self.oci_config['container_tag'], ) oci.unpack() oci.sync_rootfs(self.root_dir, exclude_list) oci.repack(self.oci_config) oci.set_config(self.oci_config) oci.post_process() image_ref = '{0}:{1}'.format( self.oci_config['container_name'], self.oci_config['container_tag'], ) additional_refs: List[str] = [] if self.archive_transport == 'docker-archive': if 'additional_names' in self.oci_config: additional_refs = [] for name in self.oci_config['additional_names']: name_parts = name.partition(':') if not name_parts[0]: additional_refs.append( '{0}:{1}'.format( self.oci_config['container_name'], name_parts[2], ) ) elif not name_parts[2]: additional_refs.append( '{0}:{1}'.format( name_parts[0], self.oci_config['container_tag'], ) ) else: additional_refs.append( '{0}:{1}'.format(name_parts[0], name_parts[2]) ) oci.export_container_image( filename, self.archive_transport, image_ref, additional_refs ) if compress_archive: compress = Compress(filename) filename = compress.xz(RuntimeConfig().get_xz_options()) return filename def _append_buildservice_disturl_label(self) -> None: with open(os.sep + Defaults.get_buildservice_env_name()) as env: for line in env: if line.startswith('BUILD_DISTURL') and '=' in line: disturl = line.split('=')[1].lstrip('\'\"').rstrip('\n\'\"') if disturl: label = {'org.openbuildservice.disturl': disturl} if self.oci_config.get('labels'): self.oci_config['labels'].update(label) else: self.oci_config['labels'] = label return log.warning('Could not find BUILD_DISTURL inside .buildenv') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7447097 kiwi-11.1.8/kiwi/container/setup/__init__.py0000644000000000000000000000342115273675667015721 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from abc import ABCMeta, abstractmethod from typing import Dict, Optional # project from kiwi.container.setup.base import ContainerSetupBase from kiwi.exceptions import KiwiContainerSetupError class ContainerSetup(metaclass=ABCMeta): """ container setup factory """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( name: str, root_dir: str, custom_args: Optional[Dict] = None ) -> ContainerSetupBase: name_map = { 'docker': 'Docker', 'oci': 'OCI', 'appx': 'Appx', 'wsl': 'Wsl', } try: container_setup = importlib.import_module( 'kiwi.container.setup.{}'.format(name) ) module_name = 'ContainerSetup{}'.format(name_map[name]) return container_setup.__dict__[module_name](root_dir, custom_args) except Exception: raise KiwiContainerSetupError( 'Support for {0} container not implemented'.format(name) ) ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74488 kiwi-11.1.8/kiwi/container/setup/appx.py0000644000000000000000000001247215273675667015140 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import List, Optional, cast from lxml import etree from xml.dom import minidom # project from kiwi.container.setup.base import ContainerSetupBase from kiwi.exceptions import KiwiContainerSetupError from kiwi.defaults import Defaults class ContainerSetupAppx(ContainerSetupBase): """ WSL/Appx container setup """ def setup(self) -> None: """ Setup container metadata """ self.appx_at_microsoft = 'http://schemas.microsoft.com/appx' self.appx_manifest_file = os.sep.join( [ cast(str, self.custom_args.get('metadata_path')), 'AppxManifest.xml', ] ) self.appx_namespace_map = dict( wsl='{0}/manifest/foundation/windows10'.format( self.appx_at_microsoft ), uap='{0}/manifest/uap/windows10'.format(self.appx_at_microsoft), desktop='{0}/manifest/desktop/windows10'.format( self.appx_at_microsoft ), uap3='{0}/manifest/uap/windows10/3'.format(self.appx_at_microsoft), mp='{0}/2014/phone/manifest'.format(self.appx_at_microsoft), ) if not os.path.exists(self.appx_manifest_file): raise KiwiContainerSetupError( 'Appx Manifest not found at: {0}'.format( self.appx_manifest_file ) ) try: self.appx_manifest = etree.parse(self.appx_manifest_file) self._update_identity() self._update_desktop_visual() self._update_application_metadata() xml_data_unformatted = etree.tostring(self.appx_manifest.getroot()) xml_data_domtree = minidom.parseString(xml_data_unformatted) xml_data_raw = xml_data_domtree.toprettyxml( indent=' ', encoding="utf-8" ) with open(self.appx_manifest_file, 'wb') as appx_manifest: for line in xml_data_raw.split(b'\n'): if line.split(): appx_manifest.write(line + b'\n') except Exception as issue: raise KiwiContainerSetupError( 'Failed to update Appx Manifest: {0}'.format(issue) ) def _update_identity(self) -> None: identities = self._get_xpath('//wsl:Identity') history = self.custom_args.get('history') or {} for identity in identities: if self._get_microsoft_processor_architecture(): identity.set( 'ProcessorArchitecture', self._get_microsoft_processor_architecture(), ) if history.get('package_version'): identity.set('Version', history.get('package_version')) if history.get('created_by'): identity.set('Publisher', history.get('created_by')) def _update_desktop_visual(self) -> None: history = self.custom_args.get('history') or {} visuals = self._get_xpath( '//wsl:Applications/wsl:Application/uap:VisualElements' ) for visual in visuals: if history.get('comment'): visual.set('Description', history.get('comment')) def _update_application_metadata(self) -> None: history = self.custom_args.get('history') or {} applications = self._get_xpath('//wsl:Applications/wsl:Application') extensions = self._get_xpath( '//wsl:Applications/wsl:Application/' 'wsl:Extensions/uap3:Extension' ) aliases = self._get_xpath( '//wsl:Applications/wsl:Application/' 'wsl:Extensions/uap3:Extension/uap3:AppExecutionAlias/' 'desktop:ExecutionAlias' ) for application in applications: if history.get('application_id'): application.set('Id', history.get('application_id')) if history.get('launcher'): application.set('Executable', history.get('launcher')) for extension in extensions: if history.get('launcher'): extension.set('Executable', history.get('launcher')) for alias in aliases: if history.get('launcher'): alias.set('Alias', history.get('launcher')) def _get_xpath(self, expression: str) -> List[etree._Element]: return self.appx_manifest.getroot().xpath( expression, namespaces=self.appx_namespace_map ) def _get_microsoft_processor_architecture(self) -> Optional[str]: windows = {'x86_64': 'x64'} return windows.get(Defaults.get_platform_name()) ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74488 kiwi-11.1.8/kiwi/container/setup/base.py0000644000000000000000000001244115273675667015076 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import collections import os from typing import Any, Dict, Optional # project from kiwi.command import Command from kiwi.exceptions import KiwiContainerSetupError class ContainerSetupBase: """ Base class for setting up the root system to create a container image from for e.g docker. The methods here are generic to linux systems following the FHS standard and modern enough e.g based on systemd Attributes * :attr:`root_dir` root directory path name * :attr:`custom_args` dict of custom arguments """ def __init__( self, root_dir: str, custom_args: Optional[Dict] = None ) -> None: if not os.path.exists(root_dir): raise KiwiContainerSetupError( f'Container root directory {root_dir} does not exist' ) self.root_dir = root_dir self.custom_args: Dict[str, Any] = custom_args or {} if 'container_name' not in self.custom_args: self.custom_args['container_name'] = 'system-container' self.post_init(custom_args) def post_init(self, custom_args: Optional[Dict]) -> None: """ Post initialization method Implementation in specialized container setup class :param list custom_args: unused """ pass def setup(self) -> None: """ Setup container metadata Implementation in specialized bootloader class required """ raise NotImplementedError def deactivate_bootloader_setup(self) -> None: """ Container bootloader setup Tell the system there is no bootloader configuration it needs to care for. A container does not boot """ bootloader_setup = self.root_dir + '/etc/sysconfig/bootloader' if os.path.exists(bootloader_setup): self._update_config( bootloader_setup, { 'LOADER_LOCATION': 'LOADER_LOCATION="none"', 'LOADER_TYPE': 'LOADER_TYPE="none"', }, ) def deactivate_root_filesystem_check(self) -> None: """ Container filesystem check setup The root filesystem of a container could be an overlay or a mapped device. In any case it should not be checked for consistency as this is should be done by the container infrastructure """ boot_setup = self.root_dir + '/etc/sysconfig/boot' if os.path.exists(boot_setup): self._update_config( boot_setup, {'ROOTFS_BLKDEV': 'ROOTFS_BLKDEV="/dev/null"'} ) def deactivate_systemd_service(self, name: str) -> None: """ Container system services setup Init systems among others also controls services which starts at boot time. A container does not really boot. Thus some services needs to be deactivated :param string name: systemd service name """ service_file = self.root_dir + '/usr/lib/systemd/system/' + name if os.path.exists(service_file): try: Command.run(['ln', '-s', '-f', '/dev/null', service_file]) except Exception as e: raise KiwiContainerSetupError( f'Failed to deactivate service {name}: {format(e)}' ) def setup_root_console(self) -> None: """ Container console setup /dev/console should be allowed to login by root """ securetty = self.root_dir + '/etc/securetty' if not os.path.exists(securetty): with open(securetty, 'w'): pass self._update_config(securetty, {'console': 'console'}) def get_container_name(self) -> str: """ Container name :return: name :rtype: str """ return self.custom_args['container_name'] def _update_config( self, filename: str, update_record: Dict[str, str] ) -> None: data = [] with open(filename, 'r') as config: data = config.read().rsplit('\n') sorted_record = collections.OrderedDict(sorted(update_record.items())) for current_value, new_value in list(sorted_record.items()): entry_found = False for index in range(0, len(data)): line = data[index] if line.startswith(current_value): entry_found = True data[index] = new_value if not entry_found: data.append(new_value) with open(filename, 'w') as config: config.write('%s\n' % '\n'.join(data)) ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74488 kiwi-11.1.8/kiwi/container/setup/docker.py0000644000000000000000000000153615273675667015436 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # # project from kiwi.container.setup.oci import ContainerSetupOCI class ContainerSetupDocker(ContainerSetupOCI): """ Docker container setup """ ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74488 kiwi-11.1.8/kiwi/container/setup/oci.py0000644000000000000000000000326215273675667014737 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # # project from typing import Dict, Optional from kiwi.container.setup.base import ContainerSetupBase class ContainerSetupOCI(ContainerSetupBase): """ Oci container setup """ def post_init(self, custom_args: Optional[Dict]) -> None: """ Post initialization method Store custom arguments :param list custom_args: custom bootloader arguments """ if custom_args: self.custom_args = custom_args def setup(self) -> None: """ Setup system for use with docker """ services_to_deactivate = [ 'device-mapper.service', 'kbd.service', 'swap.service', 'udev.service', 'proc-sys-fs-binfmt_misc.automount', ] self.deactivate_bootloader_setup() self.deactivate_root_filesystem_check() self.setup_root_console() for service in services_to_deactivate: self.deactivate_systemd_service(service) ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74488 kiwi-11.1.8/kiwi/container/setup/wsl.py0000644000000000000000000000343615273675667014775 0ustar00# Copyright (c) 2025 SUSE LLC. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os # project from kiwi.container.setup.base import ContainerSetupBase from kiwi.exceptions import KiwiContainerSetupError class ContainerSetupWsl(ContainerSetupBase): """ WSL new tar setup """ def setup(self) -> None: """ Setup container metadata """ # It's expected that the container metadata for the # new WSL format is provided by a package or via overlay # data. Thus this setup routine only checks for the # presence of the data and fails when missing distribution_conf = os.path.normpath( os.sep.join([self.root_dir, 'etc', 'wsl-distribution.conf']) ) wsl_conf = os.path.normpath( os.sep.join([self.root_dir, 'etc', 'wsl.conf']) ) if not os.path.exists(distribution_conf): raise KiwiContainerSetupError( f'Mandatory WSL {distribution_conf} not found in root tree' ) if not os.path.exists(wsl_conf): raise KiwiContainerSetupError( f'Mandatory WSL {wsl_conf} not found in root tree' ) ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74488 kiwi-11.1.8/kiwi/container/wsl.py0000644000000000000000000000477015273675667013637 0ustar00# Copyright (c) 2025 SUSE LLC. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Dict # project from kiwi.archive.tar import ArchiveTar from kiwi.defaults import Defaults from kiwi.utils.compress import Compress from kiwi.command import Command from kiwi.container.base import ContainerImageBase class ContainerImageWsl(ContainerImageBase): """ Create new WSL root tar WSL(Windows Subsystem Linux >= 2.4.4) :param string root_dir: root directory path name :param dict custom_args: Custom processing arguments defined as hash keys """ def __init__(self, root_dir: str, custom_args: Dict[str, str] = {}): self.root_dir = root_dir self.wsl_config = custom_args or {} def create( self, filename: str, base_image: str = '', ensure_empty_tmpdirs: bool = False, compress_archive: bool = True, ) -> str: """ Create WSL root tar :param string filename: archive file name :param string base_image: not-supported :param bool ensure_empty_tmpdirs: not-supported :param bool compress_archive: not-supported """ exclude_list = ( Defaults.get_exclude_list_for_root_data_sync() + Defaults.get_exclude_list_from_custom_exclude_files(self.root_dir) ) exclude_list.append('boot') exclude_list.append('dev') exclude_list.append('sys') exclude_list.append('proc') archive_file_name = filename archive = ArchiveTar(archive_file_name) archive_file_name = archive.create( self.root_dir, exclude=exclude_list, options=['--numeric-owner', '--absolute-names'], ) compressor = Compress(archive_file_name) archive_file_name = compressor.gzip() Command.run(['mv', archive_file_name, filename]) return filename ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74488 kiwi-11.1.8/kiwi/defaults.py0000644000000000000000000017632015273675667012660 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging import os import glob import importlib from importlib.resources import as_file from importlib.util import find_spec from importlib.machinery import ModuleSpec from collections import namedtuple import platform import yaml from typing import ( TYPE_CHECKING, Any, Dict, List, Literal, NamedTuple, Optional, Union, ) # project from kiwi.path import Path from kiwi.version import __githash__, __version__ from kiwi.exceptions import KiwiBootLoaderGrubDataError if TYPE_CHECKING: # pragma: nocover from kiwi.system.profile import Profile shim_loader_type = NamedTuple( 'shim_loader_type', [('filename', str), ('binaryname', str)] ) grub_loader_type = NamedTuple( 'grub_loader_type', [('filename', str), ('binaryname', str), ('targetname', str)], ) unit_type = NamedTuple( 'unit_type', [('byte', str), ('kb', str), ('mb', str), ('gb', str)] ) # Default module variables DM_METADATA_FORMAT_VERSION = '1' DM_METADATA_OFFSET = 4096 # 4kb VERITY_DATA_BLOCKSIZE = 4096 # 4kb VERITY_HASH_BLOCKSIZE = 4096 # 4kb INTEGRITY_SECTOR_SIZE = 512 INTEGRITY_ALGORITHM = 'sha256' INTEGRITY_KEY_ALGORITHM = 'hmac-sha256' UNIT = unit_type(byte='b', kb='k', mb='m', gb='g') POST_DISK_SYNC_SCRIPT = 'disk.sh' PRE_DISK_SYNC_SCRIPT = 'pre_disk_sync.sh' POST_BOOTSTRAP_SCRIPT = 'post_bootstrap.sh' POST_PREPARE_SCRIPT = 'config.sh' POST_PREPARE_OVERLAY_SCRIPT = 'config-overlay.sh' POST_HOST_PREPARE_OVERLAY_SCRIPT = 'config-host-overlay.sh' PRE_CREATE_SCRIPT = 'images.sh' EDIT_BOOT_CONFIG_SCRIPT = 'edit_boot_config.sh' EDIT_BOOT_INSTALL_SCRIPT = 'edit_boot_install.sh' IMAGE_METADATA_DIR = 'image' ROOT_VOLUME_NAME = 'LVRoot' SHARED_CACHE_DIR = '/var/cache/kiwi' MODULE_SPEC: Optional[ModuleSpec] = find_spec('kiwi') RUNTIME_CHECKER_METADATA = ( '{}/runtime_checker_metadata.yml'.format( os.path.dirname(MODULE_SPEC.origin or 'unknown') ) if MODULE_SPEC else 'unknown' ) TEMP_DIR = '/var/tmp' LOCAL_CONTAINERS = '/var/tmp/kiwi_containers' CUSTOM_RUNTIME_CONFIG_FILE: Optional[str] = None ETC_RUNTIME_CONFIG_FILE = '/etc/kiwi.yml' ETC_RUNTIME_CONFIG_DIR = '/etc/kiwi.yml.d' USR_RUNTIME_CONFIG_FILE = '/usr/share/kiwi/kiwi.yml' USR_RUNTIME_CONFIG_DIR = '/usr/share/kiwi/kiwi.yml.d' PLATFORM_MACHINE = platform.machine() EFI_FAT_IMAGE_SIZE = 20 # kernel flavor name of the kernels without flavor, see Kernel.is_flavor KERNEL_FLAVOR_NONE = 'none' # optional package manager environment variables PACKAGE_MANAGER_ENV_VARS = '/.kiwi.package_manager.env' # host proxy configuration taken into account for package managers HOST_SYSCONFIG_PROXY = '/etc/sysconfig/proxy' HOST_DNF_CONFIG = '/etc/dnf/dnf.conf' # Distribution specific CA store and tooling CA_UPDATE_MAP = { 'suse': { 'tool': 'update-ca-certificates', 'destination_path': '/etc/pki/trust/anchors', }, 'redhat': { 'tool': 'update-ca-trust', 'destination_path': '/etc/pki/ca-trust/source/anchors/', }, 'debian': { 'tool': 'update-ca-certificates', 'destination_path': '/usr/local/share/ca-certificates/', }, 'archlinux': { 'tool': 'update-ca-trust', 'destination_path': '/etc/ca-certificates/trust-source/anchors/', }, } log = logging.getLogger('kiwi') class Defaults: """ **Implements default values** Provides static methods for default values and state information """ def __init__(self) -> None: self.defaults: Dict[str, Any] = { # alignment in bytes 'kiwi_align': 1048576, # start sector number 'kiwi_startsector': 2048, # sectorsize in bytes 'kiwi_sectorsize': 512, # inode size in bytes for inode based filesystems 'kiwi_inode_size': 256, # inode ratio for inode based filesystems 'kiwi_inode_ratio': 16384, # minimum inode number for inode based filesystems 'kiwi_min_inodes': 20000, # kiwi git revision 'kiwi_revision': __githash__, } self.profile_key_list = [ 'kiwi_align', 'kiwi_startsector', 'kiwi_sectorsize', 'kiwi_revision', ] @staticmethod def get_luks_key_length() -> int: """ Provides key length to use for random luks keys """ return 256 @staticmethod def get_swapsize_mbytes() -> int: """ Provides swapsize in MB """ return 128 @staticmethod def get_xz_compression_options() -> List[str]: """ Provides compression options for the xz compressor :return: Contains list of options .. code:: python ['--option=value'] :rtype: list """ return ['--threads=0'] @staticmethod def get_platform_name() -> str: """ Provides the machine architecture name as used by KIWI This is the architecture name as it is returned by 'uname -m' with one exception for the 32bit x86 architecture which is handled as 'ix86' in general :return: architecture name :rtype: str """ arch = PLATFORM_MACHINE if arch == 'i686' or arch == 'i586': arch = 'ix86' return arch @staticmethod def set_platform_name(name: str) -> None: """ Sets the platform architecture once :param str name: an architecture name """ global PLATFORM_MACHINE PLATFORM_MACHINE = name @staticmethod def is_x86_arch(arch: str) -> bool: """ Checks if machine architecture is x86 based Any arch that matches 32bit and 64bit x86 architecture causes the method to return True. Anything else will cause the method to return False :rtype: bool """ x86_arch_names = ['x86_64', 'i686', 'i586', 'ix86'] if arch in x86_arch_names: return True return False @staticmethod def is_ppc64_arch(arch: str) -> bool: """ Checks if machine architecture is ppc64 based Any arch that matches little endian or big endian ppc64 architecture causes the method to return True. Anything else will cause the method to return False :rtype: bool """ ppc64_arch_names = ['ppc64', 'ppc64le'] if arch in ppc64_arch_names: return True return False @staticmethod def is_buildservice_worker() -> bool: """ Checks if build host is an open buildservice machine The presence of /.buildenv on the build host indicates we are building inside of the open buildservice :return: True if obs worker, else False :rtype: bool """ return os.path.exists(os.sep + Defaults.get_buildservice_env_name()) @staticmethod def get_buildservice_env_name() -> str: """ Provides the base name of the environment file in a buildservice worker :return: file basename :rtype: str """ return '.buildenv' @staticmethod def get_obs_download_server_url() -> str: """ Provides the default download server url hosting the public open buildservice repositories :return: url path :rtype: str """ return 'http://download.opensuse.org/repositories' @staticmethod def get_obs_api_server_url() -> str: """ Provides the default API server url to access the public open buildservice API :return: url path :rtype: str """ return 'https://api.opensuse.org' @staticmethod def get_solvable_location() -> str: """ Provides the directory to store SAT solvables for repositories. The solvable files are used to perform package dependency and metadata resolution :return: directory path :rtype: str """ return '/var/tmp/kiwi/satsolver' @staticmethod def set_runtime_checker_metadata(filename: str) -> None: """ Sets the runtime checker metadata filename :param str filename: a file path name """ global RUNTIME_CHECKER_METADATA RUNTIME_CHECKER_METADATA = filename @staticmethod def set_shared_cache_location(location: str) -> None: """ Sets the shared cache location once :param str location: a location path """ global SHARED_CACHE_DIR SHARED_CACHE_DIR = location @staticmethod def set_custom_runtime_config_file(filename: str) -> None: """ Sets the runtime config file once :param str filename: a file path name """ global CUSTOM_RUNTIME_CONFIG_FILE CUSTOM_RUNTIME_CONFIG_FILE = filename @staticmethod def set_temp_location(location: str) -> None: """ Sets the temp directory location once :param str location: a location path """ global TEMP_DIR TEMP_DIR = location @staticmethod def get_shared_cache_location() -> str: """ Provides the shared cache location This is a directory which shares data from the image buildsystem host with the image root system. The location is returned as an absolute path stripped off by the leading '/'. This is because the path is transparently used on the host / and inside of the image imageroot/ :return: directory path :rtype: str """ return os.path.abspath(os.path.normpath(SHARED_CACHE_DIR)).lstrip( os.sep ) @staticmethod def get_temp_location() -> str: """ Provides the base temp directory location This is the directory used to store any temporary files and directories created by kiwi during runtime :return: directory path :rtype: str """ return os.path.abspath(os.path.normpath(TEMP_DIR)) @staticmethod def get_sync_options() -> List[str]: """ Provides list of default data sync options :return: list of rsync options :rtype: list """ return [ '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', ] @staticmethod def get_sync_sparse() -> bool: """ Provides default setting for sparse data sync If enabled, rsync is called with the --sparse option which turns sequences of null bytes in the source data into holes on the target. :return: True or False :rtype: bool """ return False @staticmethod def get_removed_files_name() -> str: """ Provides base file name to store removed files in a delta root build """ return 'removed' @staticmethod def get_system_files_name() -> str: """ Provides base file name to store system files in a container build """ return 'systemfiles' @staticmethod def get_exclude_list_for_removed_files_detection() -> List[str]: """ Provides list of files/dirs to exclude from the removed files detection in a delta root build """ return [ 'etc/hosts.kiwi', 'etc/hosts.sha', 'etc/resolv.conf.kiwi', 'etc/resolv.conf.sha', 'etc/sysconfig/proxy.kiwi', 'etc/sysconfig/proxy.sha', 'usr/lib/sysimage/rpm', ] @staticmethod def get_exclude_list_for_root_data_sync( no_tmpdirs: bool = True, ) -> List[str]: """ Provides the list of files or folders that are created by KIWI for its own purposes. Those files should be not be included in the resulting image. :return: list of file and directory names :rtype: list """ exclude_list = ['image', '.kconfig'] if no_tmpdirs: exclude_list += ['run/*', 'tmp/*'] exclude_list += [ Defaults.get_buildservice_env_name(), Defaults.get_shared_cache_location(), ] return exclude_list @staticmethod def get_runtime_checker_metadata() -> Dict: with open(RUNTIME_CHECKER_METADATA) as meta: return yaml.safe_load(meta) @staticmethod def _parse_exclude_file(root_dir: str, exclude_filename: str) -> List: """ Retrieves an exclusion list from the provided metadata file The file should contain a YAML dictionary with a top-level key named 'exclude' and the list of exclusions as its value. The list of exclusions may include: * file paths * folder paths * glob patterns Paths and patterns should be relative to the filesystem or directory that they're being excluded from. :return: list of paths and glob patterns :param string root_dir: image root directory :param string exclude_filename: file exclusion YAML metadata file :rtype: list """ exclude_file = os.sep.join([root_dir, 'image', exclude_filename]) exclude_list = [] if os.path.isfile(exclude_file): with open(exclude_file) as exclude: exclude_dict = yaml.safe_load(exclude) exclude_data = exclude_dict.get('exclude') if exclude_data and isinstance(exclude_data, list): for exclude_file in exclude_data: exclude_list.append(exclude_file.lstrip(os.sep)) else: log.warning( f'invalid yaml structure in {exclude_file}, ignored' ) return exclude_list @staticmethod def get_exclude_list_from_custom_exclude_files(root_dir: str) -> List: """ Gets the list of excluded items for the root filesystem from the optional metadata file image/exclude_files.yaml :return: list of paths and glob patterns :param string root_dir: image root directory :rtype: list """ return Defaults._parse_exclude_file(root_dir, 'exclude_files.yaml') @staticmethod def get_exclude_list_from_custom_exclude_files_for_efifatimage( root_dir: str, ) -> List: """ Gets the list of excluded items for the ESP's EFI folder from the optional metadata file image/exclude_files_efifatimage.yaml Excluded items must be relative to the ESP's /EFI directory. :return: list of paths and glob patterns :param string root_dir: EFI root directory :rtype: list """ return Defaults._parse_exclude_file( root_dir, 'exclude_files_efifatimage.yaml' ) @staticmethod def get_exclude_list_for_non_physical_devices() -> List[str]: """ Provides the list of folders that are not associated with a physical device. KIWI returns the basename of the folders typically used as mountpoint for those devices. :return: list of file and directory names :rtype: list """ exclude_list = ['proc', 'sys', 'dev'] return exclude_list @staticmethod def get_failsafe_kernel_options() -> str: """ Provides failsafe boot kernel options :return: list of kernel options .. code:: python ['option=value', 'option'] :rtype: list """ return ' '.join( ['ide=nodma', 'apm=off', 'noresume', 'edd=off', 'nomodeset', '3'] ) @staticmethod def get_volume_id() -> str: """ Provides default value for ISO volume ID :return: name :rtype: str """ return 'CDROM' @staticmethod def get_install_volume_id() -> str: """ Provides default value for ISO volume ID for install media :return: name :rtype: str """ return 'INSTALL' @staticmethod def get_snapper_config_template_file(root: str) -> str: """ Provides the default configuration template file for snapper. The location in etc/ are preferred over files in usr/ :return: file path :rtype: str """ snapper_templates = [ 'etc/snapper/config-templates/default', 'usr/share/snapper/config-templates/default', ] snapper_default_conf = '' for snapper_template in snapper_templates: template_config = os.path.join(root, snapper_template) if os.path.exists(template_config): snapper_default_conf = template_config break return snapper_default_conf @staticmethod def get_default_bootloader() -> str: """ Return default bootloader name which is grub2 :return: bootloader name :rtype: str """ return 'grub2' @staticmethod def get_grub_custom_arguments(root_dir: str) -> Dict[str, str]: return { 'grub_directory_name': Defaults.get_grub_boot_directory_name( root_dir ), 'grub_load_command': 'configfile', } @staticmethod def get_grub_boot_directory_name(lookup_path: str) -> str: """ Provides grub2 data directory name in boot/ directory Depending on the distribution the grub2 boot path could be either boot/grub2 or boot/grub. The method will decide for the correct base directory name according to the name pattern of the installed grub2 tools :return: directory basename :rtype: str """ if Path.which(filename='grub2-install', root_dir=lookup_path): # the presence of grub2-install is an indicator to put all # grub2 data below boot/grub2 return 'grub2' else: # in any other case the assumption is made that all grub # boot data should live below boot/grub return 'grub' @staticmethod def get_grub_basic_modules(multiboot: bool) -> List[str]: """ Provides list of basic grub modules :param bool multiboot: grub multiboot mode :return: list of module names :rtype: list """ modules = [ 'ext2', 'iso9660', 'linux', 'echo', 'configfile', 'search_label', 'search_fs_file', 'search', 'search_fs_uuid', 'ls', 'normal', 'gzio', 'png', 'fat', 'gettext', 'font', 'minicmd', 'gfxterm', 'gfxmenu', 'all_video', 'xfs', 'btrfs', 'squash4', 'lvm', 'luks', 'gcry_rijndael', 'gcry_sha256', 'gcry_sha512', 'crypto', 'cryptodisk', 'test', 'true', 'loadenv', ] if multiboot: modules.append('multiboot') return modules @staticmethod def get_grub_efi_modules(multiboot: bool = False) -> List[str]: """ Provides list of grub efi modules :param bool multiboot: grub multiboot mode :return: list of module names :rtype: list """ modules = Defaults.get_grub_basic_modules(multiboot) + [ 'part_gpt', 'part_msdos', 'efi_gop', ] return modules @staticmethod def get_grub_platform_modules(multiboot: bool = False) -> List[str]: """ Provides list of platform specific grub modules :param bool multiboot: grub multiboot mode :return: list of module names :rtype: list """ modules = Defaults.get_grub_basic_modules(multiboot) if Defaults.is_ppc64_arch(Defaults.get_platform_name()): return Defaults.get_grub_ofw_modules() else: modules += [ 'part_gpt', 'part_msdos', 'biosdisk', 'vga', 'vbe', 'chain', 'boot', ] return modules @staticmethod def get_grub_ofw_modules() -> List[str]: """ Provides list of grub ofw modules (ppc) :return: list of module names :rtype: list """ modules = Defaults.get_grub_basic_modules(multiboot=False) + [ 'part_gpt', 'part_msdos', 'boot', ] return modules @staticmethod def get_grub_s390_modules() -> List[str]: """ Provides list of grub ofw modules (s390) :return: list of module names :rtype: list """ modules = Defaults.get_grub_basic_modules(multiboot=False) + [ 'part_gpt', 'part_msdos', 'boot', ] return modules @staticmethod def get_grub_path( root_path: str, filename: str, raise_on_error: bool = True ) -> str: """ Provides grub path to given search file Depending on the distribution grub could be installed below a grub2 or grub directory. grub could also reside in /usr/lib as well as in /usr/share. Therefore this information needs to be dynamically looked up :param string root_path: root path to start the lookup from :param string filename: filename to search :param bool raise_on_error: raise on not found, defaults to True The method returns the path to the given grub search file. By default it raises a KiwiBootLoaderGrubDataError exception if the file could not be found in any of the search locations. If raise_on_error is set to False and no file could be found the function returns None :return: filepath :rtype: str """ log.debug(f'Searching grub file: {filename}') install_dirs = ['usr/share', 'usr/lib'] lookup_list = [] for grub_name in ['grub2', 'grub']: for install_dir in install_dirs: grub_path = os.path.join( root_path, install_dir, grub_name, filename ) log.debug(f'--> {grub_path}') if os.path.exists(grub_path): log.debug(f'--> Found in: {grub_path}') return grub_path lookup_list.append(grub_path) if raise_on_error: raise KiwiBootLoaderGrubDataError( 'grub path {0} not found in {1}'.format(filename, lookup_list) ) return '' @staticmethod def get_preparer() -> str: """ Provides ISO preparer name :return: name :rtype: str """ return 'KIWI - https://github.com/OSInside/kiwi' @staticmethod def get_publisher() -> str: """ Provides ISO publisher name :return: name :rtype: str """ return 'SUSE LINUX GmbH' @staticmethod def get_shim_loader(root_path: str) -> List[shim_loader_type]: """ Provides shim loader file path Searches distribution specific locations to find shim.efi below the given root path :param string root_path: image root path :return: list of shim_loader_type :rtype: list """ result = [] shim_pattern_type = namedtuple( 'shim_pattern_type', ['pattern', 'binaryname'] ) shim_file_patterns = [ shim_pattern_type( '/usr/lib/shim/shim*.efi.signed.latest', 'bootx64.efi' ), shim_pattern_type('/usr/lib/shim/shim*.efi.signed', 'bootx64.efi'), shim_pattern_type('/usr/lib/grub/*-efi-signed', 'bootx64.efi'), shim_pattern_type('/usr/share/efi/x86_64/shim.efi', 'bootx64.efi'), shim_pattern_type( '/usr/share/efi/aarch64/shim.efi', 'bootaa64.efi' ), shim_pattern_type('/usr/lib64/efi/shim.efi', 'bootx64.efi'), shim_pattern_type('/boot/efi/EFI/*/shimx64.efi', 'bootx64.efi'), shim_pattern_type('/boot/efi/EFI/*/shimia32.efi', 'bootia32.efi'), shim_pattern_type('/boot/efi/EFI/*/shimaa64.efi', 'bootaa64.efi'), shim_pattern_type( '/boot/efi/EFI/*/shimriscv64.efi', 'bootriscv64.efi' ), shim_pattern_type('/boot/efi/EFI/*/shim.efi', 'bootx64.efi'), shim_pattern_type('/usr/lib/shim/shim*.efi', 'bootx64.efi'), ] for shim_file_pattern in shim_file_patterns: for shim_file in sorted( glob.iglob(root_path + shim_file_pattern.pattern), key=len ): result.append( shim_loader_type(shim_file, shim_file_pattern.binaryname) ) # one match only expected, per pattern break return result @staticmethod def get_mok_manager(root_path: str) -> List[str]: """ Provides Mok Manager file path Searches distribution specific locations to find the Mok Manager EFI binary :param str root_path: image root path :return: file path or None :rtype: str """ result = [] mok_manager_file_patterns = [ '/usr/share/efi/*/MokManager.efi', '/usr/lib64/efi/MokManager.efi', '/boot/efi/EFI/*/mm*.efi', '/usr/lib/shim/mm*.efi', ] for mok_manager_file_pattern in mok_manager_file_patterns: for mm_file in glob.iglob(root_path + mok_manager_file_pattern): result.append(mm_file) return result @staticmethod def get_grub_efi_font_directory(root_path: str) -> Optional[str]: """ Provides distribution specific EFI font directory used with grub. :param string root_path: image root path :return: file path or None :rtype: str """ font_dir_patterns = ['/boot/efi/EFI/*/fonts'] for font_dir_pattern in font_dir_patterns: for font_dir in glob.iglob(root_path + font_dir_pattern): return font_dir return None @staticmethod def get_unsigned_grub_loader( root_path: str, target_type: str = 'disk' ) -> List[grub_loader_type]: """ Provides unsigned grub efi loader file path Searches distribution specific locations to find a distro grub EFI binary within the given root path :param string root_path: image root path :return: list of grub_loader_type :rtype: list """ result = [] grub_pattern_type = namedtuple( 'grub_pattern_type', ['pattern', 'binaryname', 'targetname'] ) unsigned_grub_file_patterns = { 'disk': [ grub_pattern_type( '/usr/share/grub*/x86_64-efi/grub.efi', 'grub.efi', 'bootx64.efi', ), grub_pattern_type( '/usr/lib/grub*/x86_64-efi/grub.efi', 'grub.efi', 'bootx64.efi', ), grub_pattern_type( '/boot/efi/EFI/*/grubx64.efi', 'grubx64.efi', 'bootx64.efi' ), grub_pattern_type( '/boot/efi/EFI/*/grubia32.efi', 'grubia32.efi', 'bootia32.efi', ), grub_pattern_type( '/boot/efi/EFI/*/grubaa64.efi', 'grubaa64.efi', 'bootaa64.efi', ), grub_pattern_type( '/boot/efi/EFI/*/grubriscv64.efi', 'grubriscv64.efi', 'bootriscv64.efi', ), ], 'iso': [ grub_pattern_type( '/boot/efi/EFI/*/gcdx64.efi', 'grubx64.efi', 'bootx64.efi' ), grub_pattern_type( '/usr/share/grub*/x86_64-efi/grub.efi', 'grub.efi', 'bootx64.efi', ), grub_pattern_type( '/usr/lib/grub*/x86_64-efi/grub.efi', 'grub.efi', 'bootx64.efi', ), grub_pattern_type( '/boot/efi/EFI/*/grubx64.efi', 'grubx64.efi', 'bootx64.efi' ), grub_pattern_type( '/boot/efi/EFI/*/grubia32.efi', 'grubia32.efi', 'bootia32.efi', ), grub_pattern_type( '/boot/efi/EFI/*/grubaa64.efi', 'grubaa64.efi', 'bootaa64.efi', ), grub_pattern_type( '/boot/efi/EFI/*/grubriscv64.efi', 'grubriscv64.efi', 'bootriscv64.efi', ), ], } for unsigned_grub_file_pattern in unsigned_grub_file_patterns[ target_type ]: for unsigned_grub_file in glob.iglob( root_path + unsigned_grub_file_pattern.pattern ): result.append( grub_loader_type( unsigned_grub_file, unsigned_grub_file_pattern.binaryname, unsigned_grub_file_pattern.targetname, ) ) # one match only expected, per pattern break return result @staticmethod def get_grub_chrp_loader(boot_path: str) -> str: """ Lookup CHRP boot loader (ppc) :param string boot_path: boot path :return: file base name :rtype: str """ for chrp_loader in ['grub.elf', 'core.elf']: for grub_chrp in glob.iglob( os.sep.join( [boot_path, 'boot/grub*/powerpc-ieee1275', chrp_loader] ) ): log.info(f'Found CHRP loader at: {grub_chrp}') return os.path.basename(grub_chrp) raise KiwiBootLoaderGrubDataError( f'CHRP loader not found in {boot_path}' ) @staticmethod def get_grub_platform_core_loader(root_path: str) -> Optional[str]: """ Provides grub bios image Searches distribution specific locations to find the core bios image below the given root path :param string root_path: image root path :return: file path or None :rtype: str """ bios_grub_core_patterns = [ '/usr/share/grub*/{0}/{1}'.format( Defaults.get_grub_platform_module_directory_name(), Defaults.get_grub_platform_image_name(), ), '/usr/lib/grub*/{0}/{1}'.format( Defaults.get_grub_platform_module_directory_name(), Defaults.get_grub_platform_image_name(), ), ] for bios_grub_core_pattern in bios_grub_core_patterns: for bios_grub_core in glob.iglob( root_path + bios_grub_core_pattern ): return bios_grub_core return None @staticmethod def get_iso_grub_loader() -> str: """ Return name of eltorito grub image used as ISO loader :return: file base name :rtype: str """ return 'eltorito.img' @staticmethod def get_iso_grub_mbr() -> str: """ Return name of hybrid MBR image used as ISO boot record :return: file base name :rtype: str """ return 'boot_hybrid.img' @staticmethod def get_signed_grub_loader( root_path: str, target_type: str = 'disk' ) -> List[grub_loader_type]: """ Provides shim signed grub loader file path Searches distribution specific locations to find a grub EFI binary within the given root path :param str root_path: image root path :return: list of grub_loader_type :rtype: list """ result = [] grub_pattern_type = namedtuple( 'grub_pattern_type', ['pattern', 'binaryname', 'targetname'] ) signed_grub_file_patterns = { 'disk': [ grub_pattern_type( '/usr/share/efi/*/grub.efi', 'grub.efi', 'bootx64.efi' ), grub_pattern_type( '/usr/lib64/efi/grub.efi', 'grub.efi', 'bootx64.efi' ), grub_pattern_type( '/boot/efi/EFI/*/grubx64.efi', 'grubx64.efi', 'bootx64.efi' ), grub_pattern_type( '/boot/efi/EFI/*/grubia32.efi', 'grubia32.efi', 'bootia32.efi', ), grub_pattern_type( '/boot/efi/EFI/*/grubaa64.efi', 'grubaa64.efi', 'bootaa64.efi', ), grub_pattern_type( '/boot/efi/EFI/*/grubriscv64.efi', 'grubriscv64.efi', 'bootriscv64.efi', ), grub_pattern_type( '/usr/share/grub*/*-efi/grub.efi', 'grub.efi', 'bootx64.efi' ), grub_pattern_type( '/usr/lib/grub/x86_64-efi-signed/grubx64.efi.signed', 'grubx64.efi', 'bootx64.efi', ), ], 'iso': [ grub_pattern_type( '/boot/efi/EFI/*/gcdx64.efi', 'grubx64.efi', 'bootx64.efi' ), grub_pattern_type( '/boot/efi/EFI/*/gcdaa64.efi', 'grubaa64.efi', 'bootaa64.efi', ), grub_pattern_type( '/usr/share/efi/x86_64/grub.efi', 'grub.efi', 'grubx64.efi' ), grub_pattern_type( '/usr/share/efi/aarch64/grub.efi', 'grub.efi', 'grubaa64.efi', ), grub_pattern_type( '/usr/lib64/efi/grub.efi', 'grub.efi', 'bootx64.efi' ), grub_pattern_type( '/boot/efi/EFI/*/grubx64.efi', 'grubx64.efi', 'bootx64.efi' ), grub_pattern_type( '/boot/efi/EFI/*/grubia32.efi', 'grubia32.efi', 'bootia32.efi', ), grub_pattern_type( '/boot/efi/EFI/*/grubaa64.efi', 'grubaa64.efi', 'bootaa64.efi', ), grub_pattern_type( '/boot/efi/EFI/*/grubriscv64.efi', 'grubriscv64.efi', 'bootriscv64.efi', ), grub_pattern_type( '/usr/share/grub*/x86_64-efi/grub.efi', 'grub.efi', 'bootx64.efi', ), grub_pattern_type( '/usr/lib/grub/x86_64-efi-signed/grubx64.efi.signed', 'grubx64.efi', 'bootx64.efi', ), ], } for signed_grub in signed_grub_file_patterns[target_type]: for signed_grub_file in glob.iglob(root_path + signed_grub.pattern): result.append( grub_loader_type( signed_grub_file, signed_grub.binaryname, signed_grub.targetname, ) ) # one match only expected, per pattern break return result @staticmethod def get_efi_vendor_directory(efi_path: str) -> Optional[str]: """ Provides EFI vendor directory if present Looks up distribution specific EFI vendor directory :param string root_path: path to efi mountpoint :return: directory path or None :rtype: str """ efi_vendor_directories = [ 'EFI/fedora', 'EFI/redhat', 'EFI/centos', 'EFI/almalinux', 'EFI/opensuse', 'EFI/ubuntu', 'EFI/debian', ] for efi_vendor_directory in efi_vendor_directories: efi_vendor_directory = os.sep.join([efi_path, efi_vendor_directory]) if os.path.exists(efi_vendor_directory): return efi_vendor_directory return None @staticmethod def get_vendor_grubenv(efi_path: str) -> Optional[str]: efi_vendor_directory = Defaults.get_efi_vendor_directory(efi_path) if efi_vendor_directory: grubenv = os.sep.join([efi_vendor_directory, 'grubenv']) if os.path.exists(grubenv): return grubenv return None @staticmethod def get_shim_vendor_directories(root_path: str) -> List[str]: """ Provides list of shim vendor directories Searches distribution specific locations to find shim.efi below the given root path and return the directory names to the file found :param string root_path: image root path :return: list of directory names or empty list :rtype: list """ shim_vendor_patterns = ['/boot/efi/EFI/*/shim*.efi', '/EFI/*/shim*.efi'] vendor_paths = [] for shim_vendor_pattern in shim_vendor_patterns: for shim_file in glob.iglob(root_path + shim_vendor_pattern): shim_path = os.path.dirname(shim_file) if shim_path not in vendor_paths: vendor_paths.append(shim_path) return vendor_paths @staticmethod def get_default_volume_group_name() -> str: """ Provides default LVM volume group name :return: name :rtype: str """ return 'systemVG' @staticmethod def get_min_partition_mbytes() -> int: """ Provides default minimum partition size in mbytes :return: mbsize value :rtype: int """ return 10 @staticmethod def get_min_volume_mbytes(filesystem: str) -> int: """ Provides default minimum LVM volume size in mbytes per filesystem :return: mbsize value :rtype: int """ if filesystem == 'btrfs': return 120 elif filesystem == 'xfs': return 300 else: return 30 @staticmethod def get_lvm_overhead_mbytes() -> int: """ Provides empiric LVM overhead size in mbytes :return: mbsize value :rtype: int """ return 80 @staticmethod def get_default_boot_mbytes() -> int: """ Provides default boot partition size in mbytes :return: mbsize value :rtype: int """ return 300 @staticmethod def get_default_efi_boot_mbytes() -> int: """ Provides default EFI partition size in mbytes :return: mbsize value :rtype: int """ return 20 @staticmethod def get_recovery_spare_mbytes() -> int: """ Provides spare size of recovery partition in mbytes :return: mbsize value :rtype: int """ return 300 @staticmethod def get_default_legacy_bios_mbytes() -> int: """ Provides default size of bios_grub partition in mbytes :return: mbsize value :rtype: int """ return 2 @staticmethod def get_default_prep_mbytes() -> int: """ Provides default size of prep partition in mbytes :return: mbsize value :rtype: int """ return 8 @staticmethod def get_disk_format_types() -> List[str]: """ Provides supported disk format types :return: disk types :rtype: list """ return [ 'gce', 'qcow2', 'vmdk', 'ova', 'meta', 'vmx', 'vhd', 'vhdx', 'vhdfixed', 'vdi', 'vagrant.libvirt.box', 'vagrant.virtualbox.box', 'oci', ] @staticmethod def get_vagrant_config_virtualbox_guest_additions() -> bool: """ Provides the default value for ``vagrantconfig.virtualbox_guest_additions_present`` :return: whether guest additions are expected to be present in the vagrant box :rtype: bool """ return False @staticmethod def get_firmware_types() -> Dict[str, List[str]]: """ Provides supported architecture specific firmware types :return: firmware types per architecture :rtype: dict """ return { 'x86_64': ['efi', 'uefi', 'bios', 'ec2'], 'i586': ['bios'], 'i686': ['bios'], 'ix86': ['bios'], 'aarch64': ['efi', 'uefi'], 'arm64': ['efi', 'uefi'], 'armv5el': ['efi', 'uefi'], 'armv5tel': ['efi', 'uefi'], 'armv6hl': ['efi', 'uefi'], 'armv6l': ['efi', 'uefi'], 'armv7hl': ['efi', 'uefi'], 'armv7l': ['efi', 'uefi'], 'armv8l': ['efi', 'uefi'], 'loongarch64': ['efi', 'uefi'], 'ppc': ['ofw'], 'ppc64': ['ofw', 'opal'], 'ppc64le': ['ofw', 'opal'], 'riscv64': ['efi', 'uefi'], 's390': [], 's390x': [], } @staticmethod def get_default_firmware(arch: str) -> Optional[str]: """ Provides default firmware for specified architecture :param string arch: machine architecture name :return: firmware name :rtype: str """ default_firmware = { 'x86_64': 'bios', 'i586': 'bios', 'i686': 'bios', 'ix86': 'bios', 'loongarch64': 'efi', 'ppc': 'ofw', 'ppc64': 'ofw', 'ppc64le': 'ofw', 'arm64': 'efi', 'aarch64': 'efi', 'armv5el': 'efi', 'armv5tel': 'efi', 'armv6hl': 'efi', 'armv6l': 'efi', 'armv7hl': 'efi', 'armv7l': 'efi', 'armv8l': 'efi', 'riscv64': 'efi', } if arch in default_firmware: return default_firmware[arch] return None @staticmethod def get_efi_capable_firmware_names() -> List[str]: """ Provides list of EFI capable firmware names. These are those for which kiwi supports the creation of an EFI bootable disk image :return: firmware names :rtype: list """ return ['efi', 'uefi'] @staticmethod def get_ec2_capable_firmware_names() -> List[str]: """ Provides list of EC2 capable firmware names. These are those for which kiwi supports the creation of disk images bootable within the Amazon EC2 public cloud :return: firmware names :rtype: list """ return ['ec2'] @staticmethod def get_efi_module_directory_name(arch: str) -> Optional[str]: """ Provides architecture specific EFI directory name which stores the EFI binaries for the desired architecture. :param string arch: machine architecture name :return: directory name :rtype: str """ default_module_directory_names = { 'x86_64': 'x86_64-efi', 'i386': 'i386-efi', # There is no dedicated xen architecture but there are # modules provided for xen. Thus we treat it as an # architecture 'x86_64_xen': 'x86_64-xen', 'aarch64': 'arm64-efi', 'arm64': 'arm64-efi', 'armv5el': 'arm-efi', 'armv5tel': 'arm-efi', 'armv6l': 'arm-efi', 'armv7l': 'arm-efi', 'armv8l': 'arm-efi', 'loongarch64': 'loongarch64-efi', 'riscv64': 'riscv64-efi', } return default_module_directory_names.get(arch) @staticmethod def get_grub_platform_module_directory_name() -> str: """ Provides grub platform specific directory name which stores the grub module binaries :return: directory name :rtype: str """ return ( 'powerpc-ieee1275' if Defaults.is_ppc64_arch(Defaults.get_platform_name()) else 'i386-pc' ) @staticmethod def get_efi_image_name(arch: str) -> Optional[str]: """ Provides architecture specific EFI boot binary name :param string arch: machine architecture name :return: name :rtype: str """ default_efi_image_names = { 'x86_64': 'bootx64.efi', 'i386': 'bootia32.efi', 'aarch64': 'bootaa64.efi', 'arm64': 'bootaa64.efi', 'armv5el': 'bootarm.efi', 'armv5tel': 'bootarm.efi', 'armv6l': 'bootarm.efi', 'armv7l': 'bootarm.efi', 'armv8l': 'bootarm.efi', 'loongarch64': 'bootloongarch64.efi', 'riscv64': 'bootriscv64.efi', } return default_efi_image_names.get(arch) @staticmethod def get_grub_platform_image_name() -> str: """ Provides platform specific core boot binary name :return: name :rtype: str """ return ( 'grub.elf' if Defaults.is_ppc64_arch(Defaults.get_platform_name()) else 'core.img' ) @staticmethod def get_default_boot_timeout_seconds() -> int: """ Provides default boot timeout in seconds :return: seconds :rtype: int """ return 10 @staticmethod def get_default_disk_start_sector() -> int: """ Provides the default initial disk sector for the first disk partition. :return: sector value :rtype: int """ return Defaults().defaults['kiwi_startsector'] @staticmethod def get_default_efi_partition_table_type() -> str: """ Provides the default partition table type for efi firmwares. :return: partition table type name :rtype: str """ return 'gpt' @staticmethod def get_default_inode_size() -> int: """ Provides default size of inodes in bytes. This is only relevant for inode based filesystems :return: bytesize value :rtype: int """ return Defaults().defaults['kiwi_inode_size'] @staticmethod def get_archive_image_types() -> List[str]: """ Provides list of supported archive image types :return: archive names :rtype: list """ return ['tbz', 'cpio'] @staticmethod def get_container_image_types() -> List[str]: """ Provides list of supported container image types :return: container names :rtype: list """ return ['docker', 'oci', 'appx', 'wsl'] @staticmethod def get_filesystem_image_types() -> List[str]: """ Provides list of supported filesystem image types :return: filesystem names :rtype: list """ return [ 'ext2', 'ext3', 'ext4', 'btrfs', 'squashfs', 'xfs', 'fat16', 'fat32', 'erofs', ] @staticmethod def get_default_live_iso_type() -> str: """ Provides default live iso union type :return: live iso type :rtype: str """ return 'overlay' @staticmethod def get_default_uri_type() -> str: """ Provides default URI type Absolute path specifications used in the context of an URI will apply the specified default mime type :return: URI mime type :rtype: str """ return 'dir:/' @staticmethod def get_dracut_conf_name() -> str: """ Provides file path of dracut config file to be used with KIWI :return: file path name :rtype: str """ return '/etc/dracut.conf.d/02-kiwi.conf' @staticmethod def get_live_dracut_modules_from_flag(flag_name: str) -> List[str]: """ Provides flag_name to dracut modules name map Depending on the value of the flag attribute in the KIWI image description specific dracut modules need to be selected :return: dracut module names as list :rtype: list """ live_modules = { 'overlay': ['kiwi-live'], 'dmsquash': ['dmsquash-live', 'livenet'], } if flag_name in live_modules: return live_modules[flag_name] else: return ['kiwi-live'] @staticmethod def get_default_live_iso_root_filesystem() -> str: """ Provides default live iso root filesystem type :return: filesystem name :rtype: str """ return 'ext4' @staticmethod def get_live_iso_persistent_boot_options( persistent_filesystem: Optional[str] = None, ) -> List[str]: """ Provides list of boot options passed to the dracut kiwi-live module to setup persistent writing :return: list of boot options :rtype: list """ live_iso_persistent_boot_options = ['rd.live.overlay.persistent'] if persistent_filesystem: live_iso_persistent_boot_options.append( 'rd.live.overlay.cowfs={0}'.format(persistent_filesystem) ) return live_iso_persistent_boot_options @staticmethod def get_disk_image_types() -> List[str]: """ Provides supported disk image types :return: disk image type names :rtype: list """ return ['oem'] @staticmethod def get_live_image_types() -> List[str]: """ Provides supported live image types :return: live image type names :rtype: list """ return ['iso'] @staticmethod def get_kis_image_types() -> List[str]: """ Provides supported kis image types :return: kis image type names :rtype: list """ return ['kis', 'pxe'] @staticmethod def get_enclaves_image_types() -> List[str]: """ Provides supported enclave(initrd-only) image types :return: enclave image type names :rtype: list """ return ['enclave'] @staticmethod def get_boot_image_description_path() -> str: """ Provides the path to find custom kiwi boot descriptions :return: directory path :rtype: str """ return '/usr/share/kiwi/custom_boot' @staticmethod def get_boot_image_strip_file() -> str: """ Provides the file path to bootloader strip metadata. This file contains information about the files and directories automatically striped out from the kiwi initrd :return: file path :rtype: str """ return Defaults.project_file('config/strip.xml') @staticmethod def get_schema_file() -> str: """ Provides file path to kiwi RelaxNG schema :return: file path :rtype: str """ return Defaults.project_file('schema/kiwi.rng') @staticmethod def get_common_functions_file() -> str: """ Provides the file path to config functions metadata. This file contains bash functions used for system configuration or in the boot code from the kiwi initrd :return: file path :rtype: str """ return Defaults.project_file('config/functions.sh') @staticmethod def get_xsl_stylesheet_file() -> str: """ Provides the file path to the KIWI XSLT style sheets :return: file path :rtype: str """ return Defaults.project_file('xsl/master.xsl') @staticmethod def get_schematron_module_name() -> str: """ Provides module name for XML SchemaTron validations :return: python module name :rtype: str """ return 'lxml.isoschematron' @staticmethod def project_file(filename: str) -> str: """ Provides the python module base directory search path The method uses the importlib.resources.path method to identify files and directories from the application :param string filename: relative project file :return: absolute file path name :rtype: str """ with as_file(importlib.resources.files('kiwi')) as path: return f'{path}/{filename}' @staticmethod def get_imported_root_image(root_dir: str) -> str: """ Provides the path to an imported root system image If the image description specified a derived_from attribute the file from this attribute is copied into the root_dir using the name as provided by this method :param string root_dir: image root directory :return: file path name :rtype: str """ return os.sep.join([root_dir, 'image', 'imported_root']) @staticmethod def get_iso_boot_path() -> str: """ Provides arch specific relative path to boot files on kiwi iso filesystems :return: relative path name :rtype: str """ return os.sep.join(['boot', Defaults.get_platform_name()]) @staticmethod def get_iso_kernel_flavor_file_name( name: str, index: int, flavor: str ) -> str: """ Provides the name of the kernel or initrd file of the kernel of the given flavor in the boot directory of ISO images The files of the first flavor, which provides the default boot menu entry, keep the given name, e.g linux. This is also the name the install image boots the installed system from with kexec. The files of each further flavor have the flavor appended, e.g linux-rt :param str name: base file name, e.g linux or initrd :param int index: index of the flavor in the kernel flavor list :param str flavor: kernel flavor name :return: file name :rtype: str """ return f'{name}-{flavor}' if index else name @staticmethod def get_iso_tool_category() -> str: """ Provides default iso tool category :return: name :rtype: str """ return 'xorriso' @staticmethod def get_iso_media_tag_tool() -> Literal['checkmedia']: """ Provides default iso media tag tool :return: name :rtype: str """ return 'checkmedia' @staticmethod def get_container_compression() -> bool: """ Provides default container compression :return: True :rtype: bool """ return True @staticmethod def get_default_container_name() -> str: """ Provides the default container name. :return: name :rtype: str """ return 'kiwi-container' @staticmethod def get_container_base_image_tag() -> str: """ Provides the tag used to identify base layers during the build of derived images. :return: tag :rtype: str """ return 'base_layer' @staticmethod def get_oci_archive_tool() -> str: """ Provides the default OCI archive tool name. :return: name :rtype: str """ return 'umoci' @staticmethod def get_part_mapper_tool() -> str: """ Provides the default partition mapper tool name. :return: name :rtype: str """ host_architecture = Defaults.get_platform_name() if 's390' in host_architecture: return 'kpartx' return 'partx' @staticmethod def get_default_container_tag() -> str: """ Provides the default container tag. :return: tag :rtype: str """ return 'latest' @staticmethod def get_default_container_subcommand() -> List[str]: """ Provides the default container subcommand. :return: command as a list of arguments :rtype: list """ return ['/bin/bash'] @staticmethod def get_default_container_created_by() -> str: """ Provides the default 'created by' history entry for containers. :return: the specific kiwi version used for the build :rtype: str """ return 'KIWI {0}'.format(__version__) @staticmethod def get_custom_rpm_macros_path() -> str: """ Returns the custom macros directory for the rpm database. :return: path name :rtype: str """ return 'usr/lib/rpm/macros.d' @staticmethod def get_custom_rpm_bootstrap_macro_name() -> str: """ Returns the rpm bootstrap macro file name created in the custom rpm macros path :return: filename :rtype: str """ return 'macros.kiwi-bootstrap-config' @staticmethod def get_custom_rpm_image_macro_name() -> str: """ Returns the rpm image macro file name created in the custom rpm macros path :return: filename :rtype: str """ return 'macros.kiwi-image-config' @staticmethod def get_default_package_manager() -> str: """ Returns the default package manager name if none is configured in the image description :return: package manager name :rtype: str """ return 'dnf4' @staticmethod def get_default_packager_tool(package_manager: str) -> Optional[str]: """ Provides the packager tool according to the package manager :param string package_manager: package manger name :return: packager tool binary name :rtype: str """ rpm_based = ['zypper', 'dnf4', 'dnf5', 'microdnf'] deb_based = ['apt'] if package_manager in rpm_based: return 'rpm' elif package_manager in deb_based: return 'dpkg' elif package_manager == 'pacman': return 'pacman' return None @staticmethod def get_discoverable_partition_ids() -> Dict[str, str]: """ Provides arch specific partition UUIDs as defined by the UAPI group :return: partition UUIDs :rtype: dict """ arch = Defaults.get_platform_name() part_uuids_archs = { 'x86_64': { 'root': '4f68bce3e8cd4db196e7fbcaf984b709', 'usr': '8484680c952148c69c11b0720656f69e', 'usr-verity': '77ff5f63e7b64633acf41565b864c0e6', }, 'ix86': { 'root': '44479540f29741b29af7d131d5f0458a', 'usr': '75250d768cc6458ebd66bd47cc81a812', 'usr-verity': '8f461b0d14ee4e819aa9049b6fb97abd', }, 'aarch64': { 'root': 'b921b0451df041c3af444c6f280d3fae', 'usr': 'b0e01050ee5f4390949a9101b17104e9', 'usr-verity': '6e11a4e7fbca4dedb9e9e1a512bb664e', }, 'riscv64': { 'root': '72ec70a6cf7440e6bd494bda08e8f224', 'usr': 'beaec34b8442439ba40b984381ed097d', 'usr-verity': '8f1056be9b0547c481d6be53128e5b54', }, } part_uuids_arch = part_uuids_archs.get(arch) or {} return { 'root': part_uuids_arch.get('root') or '', 'usr': part_uuids_arch.get('usr') or '', 'usr-verity': part_uuids_arch.get('usr-verity') or '', 'usr-secondary': '75250d768cc6458ebd66bd47cc81a812', 'usr-secondary-verity': '8f461b0d14ee4e819aa9049b6fb97abd', 'esp': 'c12a7328f81f11d2ba4b00a0c93ec93b', 'xbootldr': 'bc13c2ff59e64262a352b275fd6f7172', 'swap': '0657fd6da4ab43c484e50933c84b4f4f', 'home': '933ac7e12eb44f13b8440e14e2aef915', 'srv': '3b8f842520e04f3b907f1a25a76f98e8', 'var': '4d21b016b53445c2a9fb5c16e091fd2d', 'tmp': '7ec6f5573bc54acab29316ef5df639d1', 'user-home': '773f91ef66d449b5bd83d683bf40ad16', 'linux-generic': '0fc63daf848347728e793d69d8477de4', } @staticmethod def get_bls_loader_entries_dir() -> str: """ Provide default loader entries directory for BLS loaders :return: directory name :rtype: str """ return '/boot/loader/entries' @staticmethod def get_apk_repo_config() -> str: """ Repository file for apk :return: file path name :rtype: str """ return '/etc/apk/repositories' @staticmethod def get_ca_update_map(target_distribution: str) -> Optional[Dict[str, str]]: return CA_UPDATE_MAP.get(target_distribution) @staticmethod def get_ca_target_distributions() -> List[str]: return sorted(CA_UPDATE_MAP.keys()) def get(self, key: str) -> Optional[Union[int, str]]: """ Implements get method for profile elements :param string key: profile keyname :return: key value :rtype: str """ return self.defaults.get(key) @staticmethod def get_profile_file(root_dir: str) -> str: """ Return name of profile file for given root directory """ return root_dir + '/.profile' def to_profile(self, profile: 'Profile') -> None: """ Implements method to add list of profile keys and their values to the specified instance of a Profile class :param object profile: Profile instance """ for key in sorted(self.profile_key_list): # Do not apply default values to any variable that was # already defined in the profile instance. cur_profile = profile.dot_profile if key not in cur_profile or cur_profile[key] is None: profile.add(key, self.get(key)) ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74488 kiwi-11.1.8/kiwi/exceptions.py0000644000000000000000000005610115273675667013224 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Sequence, Union class KiwiError(Exception): """ **Base class to handle all known exceptions** Specific exceptions are implemented as sub classes of KiwiError Attributes :param string message: Exception message text """ def __init__( self, message: Union[str, Exception, Sequence[Exception]] ) -> None: self.message = message def __str__(self) -> str: return format(self.message) class KiwiArchiveSetupError(KiwiError): """ Exception raised if an unsupported image archive type is used. """ class KiwiArchiveTarError(KiwiError): """ Exception raised if impossible to determine which tar command version is installed on the underlying system """ class KiwiBootImageSetupError(KiwiError): """ Exception raised if an unsupported initrd system type is used. """ class KiwiBootLoaderConfigSetupError(KiwiError): """ Exception raised if a configuration for an unsupported bootloader is requested. """ class KiwiBootLoaderGrubDataError(KiwiError): """ Exception raised if no grub installation was found. """ class KiwiBootLoaderGrubFontError(KiwiError): """ Exception raised if no grub unicode font was found. """ class KiwiBootLoaderGrubInstallError(KiwiError): """ Exception raised if grub install to master boot record has failed. """ class KiwiBootLoaderGrubMenuEntryError(KiwiError): """ Exception raised if the menu entry of a kernel to be selected as the default entry was not found in the grub configuration. """ class KiwiBootLoaderGrubModulesError(KiwiError): """ Exception raised if the synchronisation of modules from the grub installation to the boot space has failed. """ class KiwiBootLoaderGrubPlatformError(KiwiError): """ Exception raised if an attempt was made to use grub on an unsupported platform. """ class KiwiBootLoaderGrubSecureBootError(KiwiError): """ Exception raised if the Microsoft signed shim loader or grub2 loader could not be found in the image root system """ class KiwiBootLoaderInstallSetupError(KiwiError): """ Exception raised if an installation for an unsupported bootloader is requested. """ class KiwiBootLoaderTargetError(KiwiError): """ Exception raised if the target to read the bootloader path from is not a disk or an iso image. """ class KiwiBootLoaderZiplInstallError(KiwiError): """ Exception raised if the installation of zipl has failed. """ class KiwiBootLoaderZiplPlatformError(KiwiError): """ Exception raised if a configuration for an unsupported zipl architecture is requested. """ class KiwiBootLoaderZiplSetupError(KiwiError): """ Exception raised if the data set to configure the zipl bootloader is incomplete. """ class KiwiBootStrapPhaseFailed(KiwiError): """ Exception raised if the bootstrap phase of the system prepare command has failed. """ class KiwiBundleError(KiwiError): """ Exception raised if the system bundle command has failed. """ class KiwiCommandError(KiwiError): """ Exception raised if an external command called via a Command instance has returned with an exit code != 0 or could not be called at all. """ class KiwiCommandNotFound(KiwiError): """ Exception raised if any executable command cannot be found in the evironment PATH variable. """ class KiwiCommandNotLoaded(KiwiError): """ Exception raised if a kiwi command task module could not be loaded. """ class KiwiCompressionFormatUnknown(KiwiError): """ Exception raised if the compression format of the data could not be detected. """ class KiwiConfigFileNotFound(KiwiError): """ Exception raised if no kiwi XML description was found. """ class KiwiConfigFileFormatNotSupported(KiwiError): """ Exception raised if kiwi description file format is not supported. """ class KiwiContainerSetupError(KiwiError): """ Exception raised if an error in the creation of the container archive happened. """ class KiwiContainerImageSetupError(KiwiError): """ Exception raised if an attempt to create a container instance for an unsupported container type is performed. """ class KiwiDataStructureError(KiwiError): """ Exception raised if the XML description failed to parse the data structure. """ class KiwiDebianBootstrapError(KiwiError): """ Exception raised if the bootstrap installation for Debian based systems has failed """ class KiwiDescriptionInvalid(KiwiError): """ Exception raised if the XML description failed to validate the XML schema. """ class KiwiDeviceProviderError(KiwiError): """ Exception raised if a storage provide is asked for its managed device but no such device exists. """ class KiwiDiskBootImageError(KiwiError): """ Exception raised if a kiwi boot image does not provide the requested data, e.g kernel, or hypervisor files. """ class KiwiDiskFormatSetupError(KiwiError): """ Exception raised if an attempt was made to create a disk format instance of an unsupported disk format. """ class KiwiDiskGeometryError(KiwiError): """ Exception raised if the disk geometry (partition table) could not be read or evaluated against their expected geometry and capabilities. """ class KiwiDistributionNameError(KiwiError): """ Exception raised if the distribution name could not be found. The information is extracted from the boot attribute of the XML description. If no boot attribute is present or does not match the naming conventions the exception is raised. """ class KiwiExtensionError(KiwiError): """ Exception raised if an extension section of the same namespace is used multiple times as toplevel section within the extension section. Each extension must have a single toplevel entry point qualified by its namespace """ class KiwiFileNotFound(KiwiError): """ Exception raised if the requested file could not be found. """ class KiwiFileSystemSetupError(KiwiError): """ Exception raised if an attempt was made to build an unsupported or unspecified filesystem. """ class KiwiFileSystemSyncError(KiwiError): """ Exception raised if the data sync from the system into the loop mounted filesystem image failed. """ class KiwiFormatSetupError(KiwiError): """ Exception raised if the requested disk format could not be created. """ class KiwiHelpNoCommandGiven(KiwiError): """ Exception raised if the request for the help page is executed without a command to show the help for. """ class KiwiImageResizeError(KiwiError): """ Exception raised if the request to resize a disk image failed. Reasons could be a missing raw disk reference or a wrong size specification. """ class KiwiImportDescriptionError(KiwiError): """ Exception raised if the XML description data and scripts could not be imported into the root of the image. """ class KiwiInstallBootImageError(KiwiError): """ Exception raised if the required files to boot an installation image could not be found, e.g kernel or hypervisor. """ class KiwiInstallMediaError(KiwiError): """ Exception raised if a request for an installation media is made but the system image type is not an oem type. """ class KiwiInstallPhaseFailed(KiwiError): """ Exception raised if the install phase of a system prepare command has failed. """ class KiwiPackagesDeletePhaseFailed(KiwiError): """ Exception raised if the packages deletion phase in system prepare fails. """ class KiwiIsoMetaDataError(KiwiError): """ Exception raised if an inconsistency in the ISO header was found such like invalid eltorito specification or a broken path table. """ class KiwiIsoToolError(KiwiError): """ Exception raised if an iso helper tool such as isoinfo could not be found on the build system. """ class KiwiKernelLookupError(KiwiError): """ Exception raised if the search for the kernel image file failed """ class KiwiLiveBootImageError(KiwiError): """ Exception raised if an attempt was made to use an unsupported live iso type. """ class KiwiLuksSetupError(KiwiError): """ Exception raised if not enough user data is provided to setup the luks encryption on the given device. """ class KiwiLoadCommandUndefined(KiwiError): """ Exception raised if no command is specified for a given service on the commandline. """ class KiwiLoadPluginError(KiwiError): """ Exception raised if loading the plugin has failed """ class KiwiLogFileSetupFailed(KiwiError): """ Exception raised if the log file could not be created. """ class KiwiLogSocketSetupFailed(KiwiError): """ Exception raised if the Unix Domain log socket could not be created. """ class KiwiLoopSetupError(KiwiError): """ Exception raised if not enough user data to create a loop device is specified. """ class KiwiMappedDeviceError(KiwiError): """ Exception raised if the device to become mapped does not exist. """ class KiwiMountKernelFileSystemsError(KiwiError): """ Exception raised if a kernel filesystem such as proc or sys could not be mounted. """ class KiwiMountSharedDirectoryError(KiwiError): """ Exception raised if the host <-> image shared directory could not be mounted. """ class KiwiNotImplementedError(KiwiError): """ Exception raised if a functionality is not yet implemented. """ class KiwiOCIArchiveToolError(KiwiError): """ Exception raised if the requested OCI archive tool is not supported """ class KiwiOSReleaseImportError(KiwiError): """ Exception raised if reading etc/os-release caused an issue """ class KiwiEnvImportError(KiwiError): """ Exception raised if extending os.environ with another env file caused an issue """ class KiwiPackageManagerSetupError(KiwiError): """ Exception raised if an attempt was made to create a package manager instance for an unsupported package manager. """ class KiwiPartitionerGptFlagError(KiwiError): """ Exception raised if an attempt was made to set an unknown partition flag for an entry in the GPT table. """ class KiwiPartitionerMsDosFlagError(KiwiError): """ Exception raised if an attempt was made to set an unknown partition flag for an entry in the MSDOS table. """ class KiwiPartitionerSetupError(KiwiError): """ Exception raised if an attempt was made to create an instance of a partitioner for an unsupporte partitioner. """ class KiwiPrivilegesError(KiwiError): """ Exception raised if root privileges are required but not granted. """ class KiwiProfileNotFound(KiwiError): """ Exception raised if a specified profile does not exist in the XML configuration. """ class KiwiKisBootImageError(KiwiError): """ Exception raised if a required boot file e.g the kernel could not be found in the process of building a kis image. """ class KiwiEnclaveBootImageError(KiwiError): """ Exception raised if no kernel image was found while building an enclave image. """ class KiwiRaidSetupError(KiwiError): """ Exception raised if invalid or not enough user data is provided to create a raid array on the specified storage device. """ class KiwiRepositorySetupError(KiwiError): """ Exception raised if an attempt was made to create an instance of a repository for an unsupported package manager. """ class KiwiRequestedTypeError(KiwiError): """ Exception raised if an attempt was made to build an image for an unsupported image type. """ class KiwiRequestError(KiwiError): """ Exception raised if a package request could not be processed by the corresponding package manager instance. """ class KiwiResizeRawDiskError(KiwiError): """ Exception raised if an attempt was made to resize the image disk to a smaller size than the current one. Simply shrinking a disk image file is not possible without data corruption because the partitions were setup to use the entire disk geometry as it fits into the file. A successful shrinking operation would require the filesystems and the partition table to be reduced which is not done by the provided simple storage resize method. In addition without the user overwriting the disk size in the XML setup, kiwi will calculate the minimum required size in order to store the data. Thus in almost all cases it will not be possible to store the data in a smaller disk. """ class KiwiResultError(KiwiError): """ Exception raised if the image build result pickle information could not be created or loaded. """ class KiwiRootDirExists(KiwiError): """ Exception raised if the specified image root directory already exists and should not be re-used. """ class KiwiRootInitCreationError(KiwiError): """ Exception raised if the initialization of a new image root directory has failed. """ class KiwiRpmDirNotRemoteError(KiwiError): """ Exception raised if the provided rpm-dir repository is not local """ class KiwiRuntimeConfigFileError(KiwiError): """ Exception raised if the provided custom runtime config file could not be found """ class KiwiRuntimeConfigFormatError(KiwiError): """ Exception raised if the expected format in the yaml KIWI runtime config file does not match """ class KiwiRuntimeError(KiwiError): """ Exception raised if a runtime check has failed. """ class KiwiSatSolverJobError(KiwiError): """ Exception raised if a sat solver job can not be done, e.g because the requested package or collection does not exist in the registered repository metadata """ class KiwiSatSolverJobProblems(KiwiError): """ Exception raised if the sat solver operations returned with solver problems e.g package conflicts """ class KiwiSatSolverPluginError(KiwiError): """ Exception raised if the python solv module failed to load. The solv module is provided by SUSE's rpm package python-solv and provides a python binding to the libsolv C library """ class KiwiAnyMarkupPluginError(KiwiError): """ Exception raised if the python anymarkup module failed to load. """ class KiwiMarkupConversionError(KiwiError): """ Exception raised if the markup format conversion is not possible. """ class KiwiSchemaImportError(KiwiError): """ Exception raised if the schema file could not be read by lxml.RelaxNG. """ class KiwiScriptFailed(KiwiError): """ Exception raised if a user script returned with an exit code != 0. """ class KiwiSetupIntermediateConfigError(KiwiError): """ Exception raised if the setup of the temporary image system configuration for the duration of the build process has failed. """ class KiwiSolverRepositorySetupError(KiwiError): """ Exception raised if the repository type is not supported for the creation of a SAT solvable """ class KiwiSystemDeletePackagesFailed(KiwiError): """ Exception raised if the deletion of a package has failed in the corresponding package manager instance. """ class KiwiSystemInstallPackagesFailed(KiwiError): """ Exception raised if the installation of a package has failed in the corresponding package manager instance. """ class KiwiSystemUpdateFailed(KiwiError): """ Exception raised if the package upgrade has failed in the corresponding package manager instance. """ class KiwiTargetDirectoryNotFound(KiwiError): """ Exception raised if the specified target directory to store the image results was not found. """ class KiwiTemplateError(KiwiError): """ Exception raised if the substitution of variables in a configuration file template has failed. """ class KiwiTypeNotFound(KiwiError): """ Exception raised if no build type was found in the XML description. """ class KiwiUnknownServiceName(KiwiError): """ Exception raised if an unknown service name was provided on the commandline. """ class KiwiUriOpenError(KiwiError): """ Exception raised if the urllib urlopen request has failed """ class KiwiUriStyleUnknown(KiwiError): """ Exception raised if an unsupported URI style was used in the source definition of a repository. """ class KiwiUriTypeUnknown(KiwiError): """ Exception raised if the protocol type of an URI is unknown in the source definition of a repository. """ class KiwiValidationError(KiwiError): """ Exception raised if the XML validation against the schema has failed. """ class KiwiVhdTagError(KiwiError): """ Exception raised if the GUID tag is not provided in the expected format. """ class KiwiVolumeGroupConflict(KiwiError): """ Exception raised if the requested LVM volume group already is in use on the build system. """ class KiwiVolumeManagerSetupError(KiwiError): """ Exception raised if the preconditions for volume mangement support are not met or an attempt was made to create an instance of a volume manager for an unsupported volume management system. """ class KiwiSnapshotManagerSetupError(KiwiError): """ Exception raised if an attempt was made to create an instance of a snapshot manager for an unsupported snapshot management system. """ class KiwiVolumeRootIDError(KiwiError): """ Exception raised if the root volume can not be found. This concept currently exists only for the btrfs subvolume system. """ class KiwiRootImportError(KiwiError): """ Exception is raised when something fails during the root import procedure. """ class KiwiContainerBuilderError(KiwiError): """ Exception is raised when something fails during a container image build procedure. """ class KiwiSizeError(KiwiError): """ Exception is raised when the convertion from a given size in string format to a number. """ class KiwiCommandCapabilitiesError(KiwiError): """ Exception is raised when some the CommandCapabilities methods fails, usually meaning there is some issue trying to parse some command output. """ class KiwiDecodingError(KiwiError): """ Exception is raised on decoding literals failure """ class KiwiBuildahError(KiwiError): """ Exception raised on inconsistent buildah class calls """ class KiwiFileAccessError(KiwiError): """ Exception raised if accessing a file or its metadata failed """ class KiwiShellVariableValueError(KiwiError): """ Exception raised if a given python value cannot be converted into a string representation for use in shell scripts """ class KiwiIncludFileNotFoundError(KiwiError): """ Exception raised if the file reference in an statement could not be found """ class KiwiUmountBusyError(KiwiError): """ Exception raised if the attempt to umount a resource has failed """ class KiwiCustomPartitionConflictError(KiwiError): """ Exception raised if the entry in a custom partition setup conflicts with an existing partition table layout setting """ class KiwiVolumeTooSmallError(KiwiError): """ Exception raised if the specified volume size is smaller than the required bytes to store the data """ class KiwiPartitionTooSmallError(KiwiError): """ Exception raised if the specified partition size is smaller than the required bytes to store the data """ class KiwiCredentialsError(KiwiError): """ Exception raised if required credentials information is missing """ class KiwiOffsetError(KiwiError): """ Exception raised if the offset for a seek operation does not match the expected data to write """ class KiwiBootLoaderDiskPasswordError(KiwiError): """ Exception raised if the disk password could not be set """ class KiwiEnclaveFormatError(KiwiError): """ Exception raised if no enclave_format attribute specified for the selected build type """ class KiwiCATargetDistributionError(KiwiError): """ Exception raised if no CA target distribution can be found but the request to import custom CA certificates was issued """ class KiwiBoxConfigError(KiwiError): """ Exception raised if the box config yaml file is invalid """ class KiwiBoxNameError(KiwiError): """ Exception raised if the boxname could not be found """ class KiwiBoxVirtioFsError(KiwiError): """ Exception raised if virtiofsd does not start """ class KiwiBoxArchNotFoundError(KiwiError): """ Exception raised if the selected architecture has no box configuration """ class KiwiBoxQEMUBinaryNotFound(KiwiError): """ Exception raised if no QEMU binary for the desired box architecture could be found """ class KiwiBoxSSHPortInvalid(KiwiError): """ Exception raised if an invalid SSH port is passed as an argument """ class KiwiBoxSSHKeyNotFound(KiwiError): """ Exception raised if the SSH pkey file could not be found """ class KiwiBoxChecksumError(KiwiError): """ Exception raised in case of a box file checksum error """ class KiwiBoxDownloadError(KiwiError): """ Exception raised in case of a box download issue """ class KiwiBoxTargetPathError(KiwiError): """ Exception raised in case of an issue creating or accessing the box build target dir """ class KiwiBoxBuildError(KiwiError): """ Exception raised if the build process in a box failed or could not be started """ class KiwiStackBuildTargetDirExists(KiwiError): """ Exception raised if the stackbuild image root directory already exists """ class KiwiStackBuildContainerNameInvalid(KiwiError): """ Exception raised if the image name cannot be used as stash container name """ class KiwiStackBuildRootSyncFailed(KiwiError): """ Exception raised if the rsync process to sync the stash into the root-tree failed """ ././@PaxHeader0000000000000000000000000000003200000000000010210 xustar0026 mtime=1794079670.74488 kiwi-11.1.8/kiwi/filesystem/__init__.py0000644000000000000000000000665015273675667014772 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from typing import Dict, List, Optional from abc import ABCMeta, abstractmethod # project from kiwi.storage.device_provider import DeviceProvider from kiwi.filesystem.base import FileSystemBase from kiwi.exceptions import KiwiFileSystemSetupError filesystem_class_map = { 'ext2': 'Ext2', 'ext3': 'Ext3', 'ext4': 'Ext4', 'btrfs': 'Btrfs', 'xfs': 'Xfs', 'fat16': 'Fat16', 'fat32': 'Fat32', 'squashfs': 'SquashFs', 'swap': 'Swap', 'erofs': 'EroFs', } class FileSystem(metaclass=ABCMeta): """ **FileSystem factory** :param string name: filesystem name :param object device_provider: Instance of DeviceProvider :param string root_dir: root directory path name :param dict custom_args: dict of custom filesystem arguments """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( name: str, device_provider: DeviceProvider, root_dir: Optional[str] = None, custom_args: Optional[Dict] = None, # noqa: E252 ) -> FileSystemBase: try: filesystem = importlib.import_module( 'kiwi.filesystem.{0}'.format(name) ) return filesystem.__dict__[ 'FileSystem{0}'.format(filesystem_class_map[name]) ](device_provider, root_dir, custom_args) except Exception as issue: raise KiwiFileSystemSetupError( 'Support for {0} filesystem not implemented: {1}'.format( name, issue ) ) @staticmethod def sparse_install_mount_options(name: str) -> List[str]: """ Provide the mount options that the filesystem implementation of the given name declares as needed at install time for a sparse data sync to be effective. Reading the declaration does not require an instance of the filesystem. This allows callers that mount a filesystem they did not create, as the volume managers do, to apply the same options as the filesystem implementation would. :param string name: filesystem name :return: list of mount options :rtype: list """ try: filesystem = importlib.import_module( 'kiwi.filesystem.{0}'.format(name) ) return filesystem.__dict__[ 'FileSystem{0}'.format(filesystem_class_map[name]) ].sparse_install_mount_options except Exception: # A filesystem that cannot be looked up declares nothing. # Reporting an unsupported filesystem is the task of new(), # which is where one gets created. return [] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/base.py0000644000000000000000000004106415273675667014143 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import uuid import random import logging import copy from functools import reduce from types import TracebackType from typing import Dict, List, Optional, Type # project import kiwi.defaults as defaults from kiwi.defaults import Defaults from kiwi.runtime_config import RuntimeConfig from kiwi.utils.sync import DataSync from kiwi.mount_manager import MountManager from kiwi.command import Command from kiwi.storage.device_provider import DeviceProvider from kiwi.utils.veritysetup import VeritySetup from kiwi.exceptions import KiwiFileSystemSyncError log = logging.getLogger('kiwi') class FileSystemBase: """ **Implements base class for filesystem interface** :param object device_provider: Instance of a class based on DeviceProvider required for filesystems which needs a block device for creation. In most cases the DeviceProvider is a LoopDevice :param string root_dir: root directory path name :param dict custom_args: custom filesystem arguments """ # Mount options applied only to the install time mount of a newly created # filesystem. They are deliberately not part of the mount options from the # image description and therefore never end up in the fstab of the # image. A filesystem implementation declares options here when sparse # sync cannot work without them, see the xfs implementation for an # example. sparse_install_mount_options: List[str] = [] def __init__( self, device_provider: DeviceProvider, root_dir: str = '', custom_args: Dict = {}, ) -> None: # filesystems created with a block device stores the mountpoint # here. The file name of the file containing the filesystem is # stored in the device_provider if the filesystem is represented # as a file there self.filesystem_mount: Optional[MountManager] = None # the underlaying device provider. This is only required if the # filesystem required a block device to become created self.device_provider = device_provider self.root_dir = root_dir # filesystems created without a block device stores the result # filesystem file name here self.filename = '' self.custom_args: Dict = {} self.post_init(custom_args) self.veritysetup: Optional[VeritySetup] = None def __enter__(self) -> 'FileSystemBase': return self def post_init(self, custom_args: Dict) -> None: """ Post initialization method Store dictionary of custom arguments if not empty. This overrides the default custom argument hash :param dict custom_args: custom arguments .. code:: python { 'create_options': ['option'], 'mount_options': ['option'], 'meta_data': { 'key': 'value' } } """ if custom_args: self.custom_args = copy.deepcopy(custom_args) if not self.custom_args.get('create_options'): self.custom_args['create_options'] = [] if not self.custom_args.get('meta_data'): self.custom_args['meta_data'] = {} if not self.custom_args.get('mount_options'): self.custom_args['mount_options'] = [] if not self.custom_args.get('fs_attributes'): self.custom_args['fs_attributes'] = [] def set_uuid(self) -> None: """ Create new random filesystem UUID Implement in specialized filesystem class for filesystems which supports the concept of an UUID and allows to change it """ log.warning( 'Instance {0} has no support for setting a new UUID label'.format( type(self).__name__ ) ) def create_on_device( self, label: Optional[str] = None, size: int = 0, unit: str = defaults.UNIT.kb, uuid: Optional[str] = None, ) -> None: """ Create filesystem on block device Implement in specialized filesystem class for filesystems which requires a block device for creation, e.g ext4. :param str label: label name :param int size: size value, can also be counted from the end via -X The value is interpreted in units of: unit :param str unit: unit name. Default unit is set to: defaults.UNIT.kb :param str uuid: UUID name """ raise NotImplementedError def create_on_file( self, filename: str, label: Optional[str] = None, exclude: Optional[List[str]] = None, ) -> None: """ Create filesystem from root data tree Implement in specialized filesystem class for filesystems which requires a data tree for creation, e.g squashfs. :param string filename: result file path name :param string label: label name :param list exclude: list of exclude dirs/files """ raise NotImplementedError def get_mountpoint(self) -> Optional[str]: """ Provides mount point directory Effective use of the directory is guaranteed only after sync_data :return: directory path name :rtype: string """ if self.filesystem_mount: return self.filesystem_mount.mountpoint return None def sync_data(self, exclude: List[str] = []) -> MountManager: """ Copy data tree into filesystem :param list exclude: list of exclude dirs/files :return: The mount created for syncing data. It should be used to un-mount the filesystem again. """ if not self.root_dir: raise KiwiFileSystemSyncError('no root directory specified') if not os.path.exists(self.root_dir): raise KiwiFileSystemSyncError( f'given root directory {self.root_dir} does not exist' ) self.filesystem_mount = MountManager( device=self.device_provider.get_device() ) self.filesystem_mount.mount(self._get_install_mount_options()) self._apply_attributes() data = DataSync(self.root_dir, self.filesystem_mount.mountpoint) data.sync_data(exclude=exclude, options=Defaults.get_sync_options()) return self.filesystem_mount def _get_install_mount_options(self) -> List[str]: """ Provide mount options for the install time mount of the filesystem the image payload is synced into. These are the mount options from the image description, plus any options the filesystem implementation declares as needed for a sparse data sync. The latter apply to this mount only and are not passed on to the fstab of the image. As everywhere else in kiwi the result is a list of at most one element, holding the comma separated option string that is passed along to the -o mount option. :return: max one element list with mount option string :rtype: list """ return FileSystemBase.merge_install_mount_options( self.sparse_install_mount_options, self.custom_args['mount_options'] ) @staticmethod def merge_install_mount_options( sparse_options: List[str], given_options: List[str] ) -> List[str]: """ Merge the mount options declared for a sparse data sync into the mount options from the image description. The declared options are only used if a sparse data sync was requested, and only for an option the image description does not set itself. The result describes an install time mount and is never used to build the fstab of the image. This is a static method because a filesystem is not always mounted by its own implementation. The volume managers mount the volumes they created themselves and use this to arrive at the same options. :param list sparse_options: declared sparse sync mount options :param list given_options: mount options from the image description :return: max one element list with mount option string :rtype: list """ if not sparse_options or not RuntimeConfig().get_sync_sparse(): return list(given_options) options = ','.join(given_options).split(',') if given_options else [] given_names = [option.split('=')[0] for option in options if option] for option in sparse_options: if option.split('=')[0] in given_names: # an explicit setting from the image description wins continue log.info( 'Using install time mount option {0} for sparse sync'.format( option ) ) options.append(option) return [','.join(options)] if options else [] def create_verity_layer( self, blocks: Optional[int] = None, filename: Optional[str] = None ) -> None: """ Create veritysetup on device :param int block: Number of blocks to use for veritysetup. If not specified the entire root device is used :param str filename: Target filename to use for VeritySetup. If not specified the filename or block special provided at object construction time is used """ on_file_name = filename or self.filename self.veritysetup = VeritySetup( on_file_name or self.device_provider.get_device(), blocks ) log.info( '--> Creating dm verity hash ({0} blocks)...'.format( blocks or 'all' ) ) log.debug( '--> dm verity metadata: {0}'.format(self.veritysetup.format()) ) def create_verification_metadata(self, device_node: str = '') -> None: """ Write verification block at the end of the device :param str device_node: Target device node, if not specified the root device from this instance is used """ if self.veritysetup: log.info('--> Creating verification metadata...') self.veritysetup.create_verity_verification_metadata() log.info('--> Signing verification metadata...') self.veritysetup.sign_verification_metadata() self.veritysetup.write_verification_metadata( device_node or self.device_provider.get_device() ) def mount(self) -> None: """ Mount the filesystem """ if self.filesystem_mount: self.filesystem_mount.mount(self.custom_args['mount_options']) def umount(self) -> None: """ Umounts the filesystem in case it is mounted, does nothing otherwise """ if self.filesystem_mount: log.info('umount %s instance', type(self).__name__) self.filesystem_mount.umount() def umount_volumes(self) -> None: """ Consistency layer with regards to VolumeManager classes Invokes umount """ self.umount() def mount_volumes(self) -> None: """ Consistency layer with regards to VolumeManager classes Invokes mount """ self.mount() def get_volumes(self) -> Dict: """ Consistency layer with regards to VolumeManager classes Raises """ raise NotImplementedError def get_root_volume_name(self) -> None: """ Consistency layer with regards to VolumeManager classes Raises """ raise NotImplementedError def get_fstab( self, persistency_type: str = 'by-label', filesystem_name: str = '' ) -> List[str]: """ Consistency layer with regards to VolumeManager classes Raises """ raise NotImplementedError def set_property_readonly_root(self) -> None: """ Consistency layer with regards to VolumeManager classes Raises """ raise NotImplementedError def _generate_seed_uuid(self, label: str, random_bits: int = 128) -> str: """ Create random UUID. If SOURCE_DATE_EPOCH is present use SOURCE_DATE_EPOCH + label name as seed """ sde = os.environ.get('SOURCE_DATE_EPOCH') if sde: label_seed = reduce(lambda x, y: x + y, map(ord, label)) epoch_seed = label_seed + int(sde) log.info( 'Using UUID seed SOURCE_DATE_EPOCH:{0} + LABEL:{1}={2}'.format( sde, label, label_seed ) ) rd = random.Random() rd.seed(epoch_seed) return format(uuid.UUID(int=rd.getrandbits(random_bits))) else: return format(uuid.uuid4()) def _map_size(self, size: float, from_unit: str, to_unit: str) -> float: """ Return byte size value for given size and unit :param float size: requested filesystem size. The value is interpreted by the given from_unit. :param str from_unit: source unit :param str to_unit: target unit :return: size value in unit: to_unit :rtype: float """ unit_map = { defaults.UNIT.byte: 1, defaults.UNIT.kb: 1024, defaults.UNIT.mb: 1048576, defaults.UNIT.gb: 1073741824, } byte_size = size * unit_map[from_unit] return byte_size / unit_map[to_unit] def _fs_size( self, size: float, blocksize: int = 1, unit: str = defaults.UNIT.kb ) -> str: """ Calculate filesystem size parameter in number of blocksize blocks. If the given size is <= 0 the calculation is done from the actual size of the block device reduced by the given size :param float size: requested filesystem size. The value is interpreted by the given unit. :param int blocksize: blocksize as requested from the filesystem creation tool for specifying the filesystem size. The value is interpreted by the given unit. By default set to: 1 :param str unit: Unit to use for calculations and return value Default unit is set to: defaults.UNIT.kb :return: an int block count of the specified unit as str :rtype: str """ if size > 0: result_size = size / blocksize else: device_name = self.device_provider.get_device() device_byte_size = self.device_provider.get_byte_size(device_name) requested_byte_size = self._map_size(size, unit, defaults.UNIT.byte) result_size = self._map_size( (device_byte_size + requested_byte_size) / blocksize, from_unit=defaults.UNIT.byte, to_unit=unit, ) return format(int(result_size)) def _apply_attributes(self) -> None: """ Apply filesystem attributes """ attribute_map = {'synchronous-updates': '+S', 'no-copy-on-write': '+C'} for attribute in self.custom_args['fs_attributes']: if attribute_map.get(attribute): assert self.filesystem_mount is not None log.info( '--> setting {0} for {1}'.format( attribute, self.filesystem_mount.mountpoint ) ) Command.run( [ 'chattr', attribute_map[attribute], self.filesystem_mount.mountpoint, ] ) def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: self.umount() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/btrfs.py0000644000000000000000000000470715273675667014354 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Optional # project import kiwi.defaults as defaults from kiwi.command import Command from kiwi.filesystem.base import FileSystemBase class FileSystemBtrfs(FileSystemBase): """ **Implements creation of btrfs filesystem** """ def create_on_device( self, label: Optional[str] = None, size: int = 0, unit: str = defaults.UNIT.kb, uuid: Optional[str] = None, ) -> None: """ Create btrfs filesystem on block device :param str label: label name :param int size: size value, can also be counted from the end via -X The value is interpreted in units of: unit :param str unit: unit name. Default unit is set to: defaults.UNIT.kb :param str uuid: UUID name """ device = self.device_provider.get_device() call_args = self.custom_args['create_options'].copy() if not uuid and label: uuid = self._generate_seed_uuid(label) if label: call_args.append('-L') call_args.append(label) if uuid: call_args.append('-U') call_args.append(uuid) if size: call_args.append('--byte-count') call_args.append( self._fs_size( size=self._map_size( size, from_unit=unit, to_unit=defaults.UNIT.byte ), unit=defaults.UNIT.byte, ) ) Command.run(['mkfs.btrfs'] + call_args + [device]) def set_uuid(self) -> None: """ Create new random filesystem UUID """ device = self.device_provider.get_device() Command.run(['btrfstune', '-f', '-u', device]) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/erofs.py0000644000000000000000000000440215273675667014342 0ustar00# Copyright (c) 2024 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import List, Optional # project from kiwi.filesystem.base import FileSystemBase from kiwi.command import Command class FileSystemEroFs(FileSystemBase): """ **Implements creation of erofs filesystem** """ def create_on_file( self, filename: str, label: Optional[str] = None, exclude: Optional[List[str]] = None, ) -> None: """ Create erofs filesystem from data tree :param string filename: result file path name :param string label: volume label :param list exclude: list of exclude dirs/files """ self.filename = filename exclude_options = [] compression = self.custom_args.get('compression') call_args = self.custom_args['create_options'].copy() if compression: call_args.append('-z') call_args.append(compression) if exclude: for item in exclude: # item is a glob, but erofs requires a POSIX extended regex. # Translate the glob to a regex for correct behaviour. # # We can't use fnmatch.translate, as that produces a Python regex. as_regex = '^' + item.replace('*', '.*') + '$' exclude_options.append(f'--exclude-regex={as_regex}') if label: call_args.append('-L') call_args.append(label) Command.run( ['mkfs.erofs'] + call_args + exclude_options + [self.filename, self.root_dir] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/ext2.py0000644000000000000000000000475715273675667014123 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see from typing import Optional # project import kiwi.defaults as defaults from kiwi.filesystem.base import FileSystemBase from kiwi.command import Command class FileSystemExt2(FileSystemBase): """ **Implements creation of ext2 filesystem** """ def create_on_device( self, label: Optional[str] = None, size: int = 0, unit: str = defaults.UNIT.kb, uuid: Optional[str] = None, ) -> None: """ Create ext2 filesystem on block device :param str label: label name :param int size: size value, can also be counted from the end via -X The value is interpreted in units of: unit :param str unit: unit name. Default unit is set to: defaults.UNIT.kb :param str uuid: UUID name """ device_args = [self.device_provider.get_device()] call_args = self.custom_args['create_options'].copy() if not uuid and label: uuid = self._generate_seed_uuid(label) if label: call_args.append('-L') call_args.append(label) if uuid: call_args.append('-U') call_args.append(uuid) if size: device_args.append( self._fs_size( size=self._map_size( size, from_unit=unit, to_unit=defaults.UNIT.kb ), unit=defaults.UNIT.kb, ) ) Command.run(['mkfs.ext2'] + call_args + device_args) def set_uuid(self) -> None: """ Create new random filesystem UUID """ device = self.device_provider.get_device() Command.run(['e2fsck', '-y', '-f', device], raise_on_error=False) Command.run(['tune2fs', '-f', '-U', 'random', device]) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/ext3.py0000644000000000000000000000475715273675667014124 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see from typing import Optional # project import kiwi.defaults as defaults from kiwi.filesystem.base import FileSystemBase from kiwi.command import Command class FileSystemExt3(FileSystemBase): """ **Implements creation of ext3 filesystem** """ def create_on_device( self, label: Optional[str] = None, size: int = 0, unit: str = defaults.UNIT.kb, uuid: Optional[str] = None, ) -> None: """ Create ext3 filesystem on block device :param str label: label name :param int size: size value, can also be counted from the end via -X The value is interpreted in units of: unit :param str unit: unit name. Default unit is set to: defaults.UNIT.kb :param str uuid: UUID name """ device_args = [self.device_provider.get_device()] call_args = self.custom_args['create_options'].copy() if not uuid and label: uuid = self._generate_seed_uuid(label) if label: call_args.append('-L') call_args.append(label) if uuid: call_args.append('-U') call_args.append(uuid) if size: device_args.append( self._fs_size( size=self._map_size( size, from_unit=unit, to_unit=defaults.UNIT.kb ), unit=defaults.UNIT.kb, ) ) Command.run(['mkfs.ext3'] + call_args + device_args) def set_uuid(self) -> None: """ Create new random filesystem UUID """ device = self.device_provider.get_device() Command.run(['e2fsck', '-y', '-f', device], raise_on_error=False) Command.run(['tune2fs', '-f', '-U', 'random', device]) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/ext4.py0000644000000000000000000000475715273675667014125 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see from typing import Optional # project import kiwi.defaults as defaults from kiwi.filesystem.base import FileSystemBase from kiwi.command import Command class FileSystemExt4(FileSystemBase): """ **Implements creation of ext4 filesystem** """ def create_on_device( self, label: Optional[str] = None, size: int = 0, unit: str = defaults.UNIT.kb, uuid: Optional[str] = None, ) -> None: """ Create ext4 filesystem on block device :param str label: label name :param int size: size value, can also be counted from the end via -X The value is interpreted in units of: unit :param str unit: unit name. Default unit is set to: defaults.UNIT.kb :param str uuid: UUID name """ device_args = [self.device_provider.get_device()] call_args = self.custom_args['create_options'].copy() if not uuid and label: uuid = self._generate_seed_uuid(label) if label: call_args.append('-L') call_args.append(label) if uuid: call_args.append('-U') call_args.append(uuid) if size: device_args.append( self._fs_size( size=self._map_size( size, from_unit=unit, to_unit=defaults.UNIT.kb ), unit=defaults.UNIT.kb, ) ) Command.run(['mkfs.ext4'] + call_args + device_args) def set_uuid(self) -> None: """ Create new random filesystem UUID """ device = self.device_provider.get_device() Command.run(['e2fsck', '-y', '-f', device], raise_on_error=False) Command.run(['tune2fs', '-f', '-U', 'random', device]) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/fat16.py0000644000000000000000000000477615273675667014163 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see from typing import Optional # project from uuid import UUID import kiwi.defaults as defaults from kiwi.filesystem.base import FileSystemBase from kiwi.command import Command class FileSystemFat16(FileSystemBase): """ **Implements creation of fat16 filesystem** """ def create_on_device( self, label: Optional[str] = None, size: int = 0, unit: str = defaults.UNIT.kb, uuid: Optional[str] = None, ) -> None: """ Create fat16 filesystem on block device :param str label: label name :param int size: size value, can also be counted from the end via -X The value is interpreted in units of: unit :param str unit: unit name. Default unit is set to: defaults.UNIT.kb :param str uuid: Volume Label, there is no real UUID on fat """ device_args = [self.device_provider.get_device()] call_args = self.custom_args['create_options'].copy() if not uuid and label: uuid = self._generate_seed_uuid(label) if label: call_args.append('-n') call_args.append(label) if uuid: call_args.append('-i') call_args.append(f'{UUID(uuid).time_low:08X}') if size: device_args.append( self._fs_size( size=self._map_size( size, from_unit=unit, to_unit=defaults.UNIT.kb ), unit=defaults.UNIT.kb, ) ) Command.run(['mkdosfs', '-F16', '-I'] + call_args + device_args) def set_uuid(self) -> None: """ Create new random filesystem UUID """ device = self.device_provider.get_device() Command.run(['mlabel', '-n', '-i', device, '::']) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/fat32.py0000644000000000000000000000477615273675667014161 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see from typing import Optional # project from uuid import UUID import kiwi.defaults as defaults from kiwi.filesystem.base import FileSystemBase from kiwi.command import Command class FileSystemFat32(FileSystemBase): """ **Implements creation of fat32 filesystem** """ def create_on_device( self, label: Optional[str] = None, size: int = 0, unit: str = defaults.UNIT.kb, uuid: Optional[str] = None, ) -> None: """ Create fat32 filesystem on block device :param str label: label name :param int size: size value, can also be counted from the end via -X The value is interpreted in units of: unit :param str unit: unit name. Default unit is set to: defaults.UNIT.kb :param str uuid: Volume Label, there is no real UUID on fat """ device_args = [self.device_provider.get_device()] call_args = self.custom_args['create_options'].copy() if not uuid and label: uuid = self._generate_seed_uuid(label) if label: call_args.append('-n') call_args.append(label) if uuid: call_args.append('-i') call_args.append(f'{UUID(uuid).time_low:08X}') if size: device_args.append( self._fs_size( size=self._map_size( size, from_unit=unit, to_unit=defaults.UNIT.kb ), unit=defaults.UNIT.kb, ) ) Command.run(['mkdosfs', '-F32', '-I'] + call_args + device_args) def set_uuid(self) -> None: """ Create new random filesystem UUID """ device = self.device_provider.get_device() Command.run(['mlabel', '-n', '-i', device, '::']) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/isofs.py0000644000000000000000000000343315273675667014352 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging from typing import List, Optional # project from kiwi.filesystem.base import FileSystemBase from kiwi.iso_tools import IsoTools log = logging.getLogger('kiwi') class FileSystemIsoFs(FileSystemBase): """ **Implements creation of iso filesystem** """ def create_on_file( self, filename: str, label: Optional[str] = None, exclude: Optional[List[str]] = None, ) -> None: """ Create iso filesystem from data tree There is no label which could be set for iso filesystem thus this parameter is not used :param string filename: result file path name :param string label: unused :param list exclude: unused """ self.filename = filename meta_data = self.custom_args['meta_data'] efi_loader = meta_data.get('efi_loader') iso_tool = IsoTools.new(self.root_dir) iso_tool.init_iso_creation_parameters(meta_data) if efi_loader: iso_tool.add_efi_loader_parameters(efi_loader, meta_data) iso_tool.create_iso(self.filename) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/setup.py0000644000000000000000000000667615273675667014403 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Optional import logging # project from kiwi.system.size import SystemSize from kiwi.defaults import Defaults from kiwi.xml_state import XMLState log = logging.getLogger('kiwi') class FileSystemSetup: """ **Implement filesystem setup methods** Methods from this class provides information from the root directory required before building a filesystem image :param object xml_state: Instance of XMLState :param string root_dir: root directory path """ def __init__(self, xml_state: XMLState, root_dir: str): self.configured_size = xml_state.get_build_type_size( include_unpartitioned=True ) if xml_state.get_build_type_unpartitioned_bytes() > 0: log.warning( 'Unpartitoned size attribute is ignored for filesystem images' ) self.size = SystemSize(root_dir) self.requested_image_type = xml_state.get_build_type_name() if self.requested_image_type in Defaults.get_filesystem_image_types(): self.requested_filesystem = self.requested_image_type else: self.requested_filesystem = xml_state.build_type.get_filesystem() def get_size_mbytes(self, filesystem: Optional[str] = None) -> int: """ Precalculate the requires size in mbytes to store all data from the root directory in the requested filesystem. Return the configured value if present, if not return the calculated result :param string filesystem: name :return: mbytes :rtype: int """ fstype = self.requested_filesystem if not filesystem else filesystem root_dir_mbytes = self.size.accumulate_mbyte_file_sizes() filesystem_mbytes = self.size.customize(root_dir_mbytes, fstype) if not self.configured_size: log.info('Using calculated size: %d MB', filesystem_mbytes) return filesystem_mbytes elif self.configured_size.additive: result_filesystem_mbytes = ( self.configured_size.mbytes + filesystem_mbytes ) log.info( 'Using configured size: %d MB + %d MB calculated = %d MB', self.configured_size.mbytes, filesystem_mbytes, result_filesystem_mbytes, ) return result_filesystem_mbytes else: log.info( 'Using configured size: %d MB', self.configured_size.mbytes ) if self.configured_size.mbytes < filesystem_mbytes: log.warning( '--> Configured size smaller than calculated size: %d MB', filesystem_mbytes, ) return self.configured_size.mbytes ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/squashfs.py0000644000000000000000000000600515273675667015062 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import List, Optional # project from kiwi.filesystem.base import FileSystemBase from kiwi.command import Command from kiwi.defaults import Defaults class FileSystemSquashFs(FileSystemBase): """ **Implements creation of squashfs filesystem** """ def create_on_file( self, filename: str, label: Optional[str] = None, exclude: Optional[List[str]] = None, ) -> None: """ Create squashfs filesystem from data tree There is no label which could be set for squashfs thus this parameter is not used :param string filename: result file path name :param string label: unused :param list exclude: list of exclude dirs/files """ self.filename = filename exclude_options = [] compression = self.custom_args.get('compression') call_args = self.custom_args['create_options'].copy() if compression is None or compression == 'xz': if '-comp' not in self.custom_args['create_options']: call_args.append('-comp') call_args.append('xz') if '-Xbcj' not in self.custom_args['create_options']: host_architecture = Defaults.get_platform_name() if Defaults.is_x86_arch(host_architecture): call_args.append('-Xbcj') call_args.append('x86') if 'ppc' in host_architecture: call_args.append('-Xbcj') call_args.append('powerpc') elif compression != 'uncompressed': if '-comp' not in self.custom_args['create_options']: call_args.append('-comp') call_args.append(compression) else: for flag in ['-noI', '-noD', '-noF', '-noX']: if flag not in self.custom_args['create_options']: call_args.append(flag) if exclude: exclude_options.extend(['-wildcards', '-e']) for item in exclude: exclude_options.append(item) Command.run( [ 'mksquashfs', self.root_dir, self.filename, '-noappend', '-b', '1M', ] + call_args + exclude_options ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/swap.py0000644000000000000000000000310515273675667014175 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see from typing import Optional # project import kiwi.defaults as defaults from kiwi.filesystem.base import FileSystemBase from kiwi.command import Command class FileSystemSwap(FileSystemBase): """ **Implements creation of swap space** """ def create_on_device( self, label: Optional[str] = None, size: int = 0, unit: str = defaults.UNIT.kb, uuid: Optional[str] = None, ) -> None: """ Create swap space on block device :param string label: label name :param int size: unused :param str unit: unused :param str uuid: unused """ device = self.device_provider.get_device() call_args = self.custom_args['create_options'].copy() if label: call_args.append('-L') call_args.append(label) Command.run(['mkswap'] + call_args + [device]) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/filesystem/xfs.py0000644000000000000000000000764515273675667014040 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Optional # project import kiwi.defaults as defaults from kiwi.filesystem.base import FileSystemBase from kiwi.command import Command class FileSystemXfs(FileSystemBase): """ **Implements creation of xfs filesystem** """ # Minimize speculative preallocation when a sparse data sync is requested. # # rsync --sparse only seeks forward across a sequence of null bytes, it # does not punch a hole. On xfs most small skips lead to speculative # preallocation (optimized for a fast-changing runtime) instead of the # desired holes (as desired during one-time image construction). # rsync therefore fails to save most space without this setting. sparse_install_mount_options = ['allocsize=4k'] def create_on_device( self, label: Optional[str] = None, size: int = 0, unit: str = defaults.UNIT.kb, uuid: Optional[str] = None, ) -> None: """ Create xfs filesystem on block device :param str label: label name :param int size: size value, can also be counted from the end via -X The value is interpreted in units of: unit :param str unit: unit name. Default unit is set to: defaults.UNIT.kb :param str uuid: UUID name """ device = self.device_provider.get_device() call_args = self.custom_args['create_options'].copy() if not uuid and label: uuid = self._generate_seed_uuid(label) if label: call_args.append('-L') call_args.append(label) if uuid: call_args.append('-m') call_args.append(f'uuid={uuid}') if size: call_args.append('-d') call_args.append( 'size={0}k'.format( self._fs_size( size=self._map_size( size, from_unit=unit, to_unit=defaults.UNIT.kb ), unit=defaults.UNIT.kb, ) ) ) Command.run(['mkfs.xfs', '-f'] + call_args + [device]) # Materialize log on disk. Recent mkfs.xfs versions (v 5.5+) do not # write zeros into the log, but FALLOC_FL_ZERO_RANGE that space. # This leads to sparse holes in the underlying image file. Image # upload tools may skip these holes when creating EBS snapshots. # EBS is usually returning 0 when reading from such sparse areas, # but not when the image is server-side encrypted, where you get # decrypt(0) == noise instead. When mounting file system with # partially garbled logs, XFS trips and cannot find its log head, # and ultimately gives up ("XFS (nvme0n1p1): log mount/recovery # failed: error -117"). Jumping to cycle count 2 forces real, # non-zero writes throughout the log and sidesteps the problem. Command.run(['xfs_db', '-x', '-c', 'logformat -c 2', device]) def set_uuid(self) -> None: """ Create new random filesystem UUID """ device = self.device_provider.get_device() Command.run(['xfs_repair', '-L', device]) Command.run(['xfs_admin', '-U', 'generate', device]) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/firmware.py0000644000000000000000000001425115273675667012657 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re from typing import Optional # project from .defaults import Defaults from .xml_state import XMLState from .exceptions import KiwiNotImplementedError class FirmWare: """ **Implements firmware specific methods** According to the selected firmware some parameters in a disk image changes. This class provides methods to provide firmware dependant information * :param object xml_state: instance of :class:`XMLState` """ def __init__(self, xml_state: XMLState) -> None: self.arch = Defaults.get_platform_name() self.zipl_target_type = xml_state.get_build_type_bootloader_targettype() self.firmware = xml_state.build_type.get_firmware() self.efipart_mbytes = xml_state.build_type.get_efipartsize() self.efi_partition_table = xml_state.build_type.get_efiparttable() self.gpt_hybrid_mbr = xml_state.build_type.get_gpt_hybrid_mbr() self.efi_csm = ( True if xml_state.build_type.get_eficsm() is None else xml_state.build_type.get_eficsm() ) if not self.firmware: self.firmware = Defaults.get_default_firmware(self.arch) if self.firmware and self.firmware != 'custom': firmware_types = Defaults.get_firmware_types() if self.firmware not in firmware_types[self.arch]: raise KiwiNotImplementedError( 'support for firmware %s for arch %s not implemented' % (self.firmware, self.arch) ) def get_partition_table_type(self) -> str: """ Provides partition table type according to architecture and firmware :return: partition table name :rtype: str """ if 's390' in self.arch: if self.zipl_target_type and 'CDL' in self.zipl_target_type: return 'dasd' elif self.zipl_target_type and 'GPT' in self.zipl_target_type: return 'gpt' else: return 'msdos' elif 'ppc64' in self.arch: return 'gpt' elif self.efi_mode(): default_efi_table = Defaults.get_default_efi_partition_table_type() return self.efi_partition_table or default_efi_table else: return 'msdos' def legacy_bios_mode(self) -> bool: """ Check if the legacy boot from BIOS systems should be activated :return: True or False :rtype: bool """ if self.get_partition_table_type() == 'gpt': if ( (self.arch == 'x86_64' or re.match('i.86', self.arch)) and (self.firmware == 'efi' or self.firmware == 'uefi') and self.efi_csm ): return True else: return False elif self.get_partition_table_type() == 'msdos': if self.arch == 'x86_64' or re.match('i.86', self.arch): return True else: return False else: return False def efi_mode(self) -> str: """ Check if EFI mode is requested :return: The requested EFI mode or None if no EFI mode requested :rtype: str """ if self.firmware in Defaults.get_efi_capable_firmware_names(): return self.firmware return '' def ec2_mode(self) -> Optional[str]: """ Check if EC2 mode is requested :return: True or False :rtype: bool """ if self.firmware in Defaults.get_ec2_capable_firmware_names(): return self.firmware return None def bios_mode(self) -> bool: """ Check if BIOS mode is requested :return: True or False :rtype: bool """ if self.firmware == 'bios': return True else: return False def ofw_mode(self) -> bool: """ Check if OFW mode is requested :return: True or False :rtype: bool """ if self.firmware == 'ofw': return True else: return False def opal_mode(self) -> bool: """ Check if Opal mode is requested :return: True or False :rtype: bool """ if self.firmware == 'opal': return True else: return False def get_legacy_bios_partition_size(self) -> int: """ Size of legacy bios_grub partition if legacy BIOS mode is required. Returns 0 if no such partition is needed :return: mbsize value :rtype: int """ if self.legacy_bios_mode() and self.efi_mode(): return Defaults.get_default_legacy_bios_mbytes() else: return 0 def get_efi_partition_size(self) -> int: """ Size of EFI partition. Returns 0 if no such partition is needed :return: mbsize value :rtype: int """ if self.efi_mode(): if self.efipart_mbytes: return self.efipart_mbytes else: return Defaults.get_default_efi_boot_mbytes() else: return 0 def get_prep_partition_size(self) -> int: """ Size of Prep partition if OFW mode is requested. Returns 0 if no such partition is needed :return: mbsize value :rtype: int """ if self.ofw_mode(): return Defaults.get_default_prep_mbytes() else: return 0 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/help.py0000644000000000000000000000276315273675667012000 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import subprocess from typing import Optional # project from .exceptions import KiwiHelpNoCommandGiven class Help: """ **Implements man page help for kiwi commands** Each kiwi command implements their own manual page, which is shown if the positional argument 'help' is passed to the command. """ def show(self, command: Optional[str] = None) -> None: """ Call man to show the command specific manual page All kiwi commands store their manual page in the section '8' of the man system. The calling process is replaced by the man process :param string command: man page name """ if not command: raise KiwiHelpNoCommandGiven("No help context specified") subprocess.call('man 8 ' + command, shell=True) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7454617 kiwi-11.1.8/kiwi/iso_tools/__init__.py0000644000000000000000000000311015273675667014604 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from typing import Any from abc import ABCMeta, abstractmethod # project from kiwi.exceptions import KiwiIsoToolError from kiwi.runtime_config import RuntimeConfig class IsoTools(metaclass=ABCMeta): """ **IsoTools factory** """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new(source_dir: str) -> Any: name_map = {'xorriso': 'XorrIso'} runtime_config = RuntimeConfig() tool = runtime_config.get_iso_tool_category() try: iso_tool = importlib.import_module('kiwi.iso_tools.{}'.format(tool)) module_name = 'IsoTools{}'.format(name_map[tool]) return iso_tool.__dict__[module_name](source_dir) except Exception: raise KiwiIsoToolError( 'No support for {} tool available'.format(tool) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7460392 kiwi-11.1.8/kiwi/iso_tools/base.py0000644000000000000000000001272515273675667013773 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import shutil import logging from typing import Dict, List, Optional, Union # project from kiwi.defaults import Defaults from kiwi.command import Command from kiwi.utils.sync import DataSync from kiwi.path import Path log = logging.getLogger('kiwi') class IsoToolsBase: """ **Base Class for Parameter API for iso creation tools** """ def __init__(self, source_dir: str) -> None: """ Base class for IsoTools :param string source_dir: data source dir, usually root_dir """ self.arch = Defaults.get_platform_name() self.source_dir = source_dir self.boot_path = Defaults.get_iso_boot_path() self.iso_parameters: List[str] = [] self.iso_loaders: List[str] = [] def get_tool_name(self) -> str: """ Return caller name for iso creation tool Implementation in specialized tool class :return: tool name :rtype: str """ raise NotImplementedError def init_iso_creation_parameters( self, custom_args: Optional[Dict[str, Union[str, bool]]] = None ) -> None: """ Create a set of standard parameters for the main loader Implementation in specialized tool class :param list custom_args: unused """ raise NotImplementedError def add_efi_loader_parameters( self, loader_file: str, custom_args: Optional[Dict[str, Union[str, bool]]] = None, ) -> None: """ Add ISO creation parameters to embed the EFI loader Implementation in specialized tool class """ raise NotImplementedError def create_iso( self, filename: str, hidden_files: Optional[List[str]] = None ) -> None: """ Create iso file Implementation in specialized tool class :param str filename: unused :param list hidden_files: unused """ raise NotImplementedError def list_iso(self, isofile: str) -> None: """ List contents of an ISO image :param str isofile: unused """ raise NotImplementedError def has_iso_hybrid_capability(self) -> bool: """ Indicate if the iso tool has the capability to embed a partition table into the iso such that it can be used as both; an iso and a disk Implementation in specialized tool class """ raise NotImplementedError @staticmethod def setup_media_loader_directory( lookup_path: str, media_path: str, boot_theme: Optional[str] ) -> None: loader_data = lookup_path + '/image/loader/' media_boot_path = os.sep.join( [media_path, Defaults.get_iso_boot_path(), 'loader'] ) Path.wipe(loader_data) Path.create(loader_data) grub_image_file_names = [ Defaults.get_iso_grub_loader(), Defaults.get_iso_grub_mbr(), ] loader_files = [] for grub_image_file_name in grub_image_file_names: grub_file = Defaults.get_grub_path( lookup_path, 'i386-pc/{0}'.format(grub_image_file_name), raise_on_error=False, ) if grub_file and os.path.exists(grub_file): loader_files.append(grub_file) log.debug('Copying loader files to {0}'.format(loader_data)) for loader_file in loader_files: log.debug('--> Copying {0}'.format(loader_file)) shutil.copy(loader_file, loader_data) bash_command = ' '.join( ['cp', lookup_path + '/boot/memtest*', loader_data + '/memtest'] ) Command.run(command=['bash', '-c', bash_command], raise_on_error=False) if boot_theme: theme_path = ''.join( [lookup_path, '/etc/bootsplash/themes/', boot_theme] ) if os.path.exists(theme_path + '/cdrom/gfxboot.cfg'): bash_command = ' '.join( ['cp', theme_path + '/cdrom/*', loader_data] ) Command.run(['bash', '-c', bash_command]) # don't move down one menu entry the first time a F-key is used Command.run( [ 'gfxboot', '--config-file', loader_data + '/gfxboot.cfg', '--change-config', 'install::autodown=0', ] ) if os.path.exists(theme_path + '/bootloader/message'): Command.run( ['cp', theme_path + '/bootloader/message', loader_data] ) Path.create(media_boot_path) data = DataSync(loader_data, media_boot_path) data.sync_data(options=['-a']) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7460392 kiwi-11.1.8/kiwi/iso_tools/iso.py0000644000000000000000000000364615273675667013655 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # # project from kiwi.defaults import Defaults from kiwi.command import Command from kiwi.runtime_config import RuntimeConfig class Iso: """ **Implements helper methods around the creation of ISO filesystems** """ def __init__(self, source_dir: str) -> None: """ Create an instance of Iso helpers :param str source_dir: Directory path for iso source dir, root of ISO """ self.source_dir = source_dir self.boot_path = Defaults.get_iso_boot_path() @staticmethod def set_media_tag(isofile: str) -> None: """ Include checksum tag in the ISO so it can be verified with the mediacheck program. :param str isofile: path to the ISO file """ media_tagger = RuntimeConfig().get_iso_media_tag_tool() if media_tagger == 'checkmedia': Command.run( [ 'tagmedia', '--digest', 'sha256', '--check', '--pad', '0', isofile, ] ) elif media_tagger == 'isomd5sum': Command.run(['implantisomd5', '--force', isofile]) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7460392 kiwi-11.1.8/kiwi/iso_tools/xorriso.py0000644000000000000000000002057715273675667014572 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from typing import Dict, List, Optional, Union # project from kiwi.iso_tools.base import IsoToolsBase from kiwi.path import Path from kiwi.command import Command from kiwi.exceptions import KiwiIsoToolError from kiwi.defaults import Defaults log = logging.getLogger('kiwi') class IsoToolsXorrIso(IsoToolsBase): """ **xorriso wrapper class** Implementation of Parameter API for iso creation tools using the libburnia project. Addressed here is the tool xorriso """ def has_iso_hybrid_capability(self) -> bool: """ Indicate if the iso tool has the capability to embed a partition table into the iso such that it can be used as both; an iso and a disk :return: True or False :rtype: bool """ return True def get_tool_name(self) -> str: """ Lookup xorriso in search path :raises KiwiIsoToolError: if xorriso tool is not found :return: xorriso tool path :rtype: str """ xorriso = Path.which('xorriso') if xorriso: return xorriso raise KiwiIsoToolError('xorriso tool not found') def init_iso_creation_parameters( self, custom_args: Optional[Dict[str, Union[str, bool]]] = None ) -> None: """ Create a set of standard parameters :param list custom_args: custom ISO meta data """ legacy_bios_mode = True if custom_args: application_id = custom_args.get( 'application_id' ) or custom_args.get('mbr_id') if application_id: self.iso_parameters += [ '-application_id', format(application_id), ] if 'publisher' in custom_args: self.iso_parameters += [ '-publisher', format(custom_args['publisher']), ] if 'preparer' in custom_args: self.iso_parameters += [ '-preparer_id', format(custom_args['preparer']), ] if 'volume_id' in custom_args: self.iso_parameters += [ '-volid', format(custom_args['volume_id']), ] if 'legacy_bios_mode' in custom_args: legacy_bios_mode = bool(custom_args['legacy_bios_mode']) catalog_file = self.boot_path + '/boot.catalog' self.iso_parameters += ['-joliet', 'on', '-padding', '0'] if Defaults.is_ppc64_arch(self.arch): self.iso_parameters += ['-compliance', 'untranslated_names'] else: self.iso_parameters += [ # https://lists.gnu.org/archive/html/bug-xorriso/2024-11/msg00012.html '-compliance', 'no_emul_toc', ] if Defaults.is_x86_arch(self.arch) and legacy_bios_mode: mbr_file = os.sep.join( [ self.source_dir, self.boot_path, 'loader', Defaults.get_iso_grub_mbr(), ] ) loader_file = os.sep.join( [self.boot_path, 'loader', Defaults.get_iso_grub_loader()] ) self.iso_loaders += [ '-boot_image', 'grub', 'bin_path={0}'.format(loader_file), ] if os.path.exists(mbr_file): self.iso_loaders += [ '-boot_image', 'grub', 'grub2_mbr={0}'.format(mbr_file), ] else: log.warning(f'No hybrid MBR file found: {mbr_file}: skipped') self.iso_loaders += ['-boot_image', 'grub', 'grub2_boot_info=on'] if Defaults.is_ppc64_arch(self.arch): self.iso_loaders += ['-boot_image', 'any', 'chrp_boot_part=on'] else: self.iso_loaders += [ '-boot_image', 'any', 'partition_offset=16', '-boot_image', 'any', 'cat_path={0}'.format(catalog_file), '-boot_image', 'any', 'cat_hidden=on', '-boot_image', 'any', 'boot_info_table=on', '-boot_image', 'any', 'platform_id=0x00', '-boot_image', 'any', 'emul_type=no_emulation', '-boot_image', 'any', 'load_size=2048', ] def add_efi_loader_parameters( self, loader_file: str, custom_args: Optional[Dict[str, Union[str, bool]]] = None, ) -> None: """ Add ISO creation parameters to embed the EFI loader In order to boot the ISO from EFI, the EFI binary is added as alternative loader to the ISO creation parameter list. The EFI binary must be included into a fat filesystem in order to become recognized by the firmware. For details about this file refer to _create_embedded_fat_efi_image() from bootloader/config/grub2.py """ if custom_args: efi_partition_table = custom_args.get('efi_partition_table', '') legacy_bios_mode = custom_args.get('legacy_bios_mode', False) gpt_hybrid_mbr = custom_args.get('gpt_hybrid_mbr', False) if efi_partition_table == 'gpt': self.iso_loaders += [ '-boot_image', 'any', 'appended_part_as=gpt', ] if gpt_hybrid_mbr and legacy_bios_mode: self.iso_loaders += [ '-boot_image', 'any', 'mbr_force_bootable=on', ] self.iso_loaders += [ '-append_partition', '2', '0xef', loader_file, '-boot_image', 'any', 'next', '-boot_image', 'any', 'efi_path=--interval:appended_partition_2:all::', '-boot_image', 'any', 'platform_id=0xef', '-boot_image', 'any', 'emul_type=no_emulation', ] def create_iso( self, filename: str, hidden_files: Optional[List[str]] = None ) -> None: """ Creates the iso file with the given filename using xorriso :param str filename: output filename :param list hidden_files: list of hidden files """ hidden_files_parameters = [] if hidden_files: for hidden_file in hidden_files: hidden_files_parameters += [ '--', '-find', hidden_file, '-exec', 'hide', 'on', ] Path.wipe(filename) Command.run( [self.get_tool_name()] + self.iso_parameters + [ '-outdev', filename, '-map', self.source_dir, '/', '-chmod', '0755', '/', '--', ] + self.iso_loaders + hidden_files_parameters ) report_call = Command.run( [ self.get_tool_name(), '-indev', filename, '-report_system_area', 'plain', ] ) log.debug(report_call.output) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7460392 kiwi-11.1.8/kiwi/kiwi.py0000644000000000000000000000325415273675667012007 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import sys import logging # project from kiwi.app import App from kiwi.exceptions import KiwiError log = logging.getLogger('kiwi') def main() -> None: """ kiwi - main application entry point Initializes a global log object and handles all errors of the application. Every known error is inherited from KiwiError, everything else is passed down until the generic Exception which is handled as unexpected error including the python backtrace """ try: App() except KiwiError as e: # known exception, log information and exit log.error('%s: %s', type(e).__name__, format(e)) sys.exit(1) except KeyboardInterrupt: log.error('kiwi aborted by keyboard interrupt') sys.exit(1) except SystemExit as e: # user exception, program aborted by user sys.exit(e.code) except Exception: # exception we did no expect, show python backtrace log.error('Unexpected error:') raise ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7460392 kiwi-11.1.8/kiwi/logger.py0000644000000000000000000002036215273675667012322 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Dict, Optional, List, TextIO import logging from kiwi.logger_socket import PlainTextSocketHandler import sys # project from kiwi.logger_color_formatter import ColorFormatter from kiwi.logger_filter import ( LoggerSchedulerFilter, InfoFilter, DebugFilter, ErrorFilter, WarningFilter, ) from kiwi.exceptions import KiwiLogFileSetupFailed, KiwiLogSocketSetupFailed class Logger(logging.Logger): """ **Extended logging facility based on Python logging** :param str name: name of the logger """ def __init__(self, name: str): logging.Logger.__init__(self, name) self.log_handlers: Dict = {} self.logfile: Optional[str] = None # log INFO to stdout self._add_stream_handler( 'info', '[ %(levelname)-8s]: %(asctime)-8s | %(message)s', [InfoFilter(), LoggerSchedulerFilter()], ) # log WARNING messages to stdout self._add_stream_handler( 'warning', '[ %(levelname)-8s]: %(asctime)-8s | %(message)s', [WarningFilter()], ) # log DEBUG messages to stdout self._add_stream_handler( 'debug', '[ %(levelname)-8s]: %(asctime)-8s | %(message)s', [DebugFilter()], ) # log ERROR messages to stderr self._add_stream_handler( 'error', '[ %(levelname)-8s]: %(asctime)-8s | %(message)s', [ErrorFilter()], sys.__stderr__, ) self.log_level = self.level self.log_flags: Dict[str, bool] = {} def getLogLevel(self) -> int: """ Return currently used log level :return: log level number :rtype: int """ return self.log_level def getLogFlags(self) -> Dict[str, bool]: """ Return logging flags :return: Dictionary with flags and their activation status :rtype: dict """ return self.log_flags def setLogLevel( self, level: int, except_for: List[str] = [], only_for: List[str] = [] ) -> None: """ Set custom log level for all console handlers :param int level: log level number :param list except_for: set log level to all handlers except for the given list :param list only_for: set log level to the given handlers only if both except_for and only_for handlers are specified, the except_for list will be ignored """ self.log_level = level if only_for: for handler_type in self.log_handlers: if handler_type in only_for: self.log_handlers[handler_type].setLevel(level) return for handler_type in self.log_handlers: if handler_type not in except_for: self.log_handlers[handler_type].setLevel(level) def setLogFlag(self, flag: str, value: bool = True) -> None: """ Set logging flag for further properties of the logging facility Available flags are: * run-scripts-in-screen :param str flag: name """ self.log_flags[flag] = value def set_color_format(self) -> None: """ Set color format for all console handlers """ for handler_type in self.log_handlers: message_format = None if handler_type == 'debug': message_format = ( '$LIGHTCOLOR[ %(levelname)-8s]: %(asctime)-8s | %(message)s' ) elif handler_type == 'warning' or handler_type == 'error': message_format = ( '$COLOR[ %(levelname)-8s]: %(asctime)-8s | %(message)s' ) if message_format: self.log_handlers[handler_type].setFormatter( ColorFormatter(message_format, '%H:%M:%S') ) def set_logfile(self, filename: str) -> None: """ Set logfile handler :param str filename: logfile file path """ try: if filename == 'stdout': # special case, log usual log file contents to stdout handler = logging.StreamHandler(sys.__stdout__) else: handler = logging.FileHandler( filename=filename, encoding='utf-8' ) self.logfile = filename handler.setFormatter( logging.Formatter( '[ %(levelname)-8s]: %(asctime)-8s | %(message)s', '%H:%M:%S', ) ) handler.addFilter(LoggerSchedulerFilter()) self.addHandler(handler) self.log_handlers['file'] = handler except Exception as e: raise KiwiLogFileSetupFailed(f'{type(e).__name__}: {format(e)}') def set_log_socket(self, filename: str) -> None: """ Set log socket handler :param str filename: UDS socket file path. Note if there is no server listening on the socket the log handler setup will fail """ try: handler = PlainTextSocketHandler(filename, None) handler.makeSocket() handler.setFormatter( logging.Formatter( '[ %(levelname)-8s]: %(asctime)-8s | %(message)s', '%H:%M:%S', ) ) handler.addFilter(LoggerSchedulerFilter()) self.addHandler(handler) self.log_handlers['socket'] = handler except Exception as e: raise KiwiLogSocketSetupFailed( 'UDS socket: {0}:{1}: {2}'.format(filename, type(e).__name__, e) ) def get_logfile(self) -> Optional[str]: """ Return file path name of logfile :return: file path :rtype: str """ return self.logfile @staticmethod def progress( current: int, total: int, prefix: str, bar_length: int = 40 ) -> None: """ Custom progress log information. progress information is intentionally only logged to stdout and will bypass any handlers. We don't want this information to show up in the log file :param int current: current item :param int total: total number of items :param string prefix: prefix name :param int bar_length: length of progress bar """ try: percent = float(current) / total except Exception: # we don't want the progress to raise an exception # In case of any error e.g division by zero the current # way out is to skip the progress update return hashes = '#' * int(round(percent * bar_length)) spaces = ' ' * (bar_length - len(hashes)) sys.stdout.write( '\r{0}: [{1}] {2}%'.format( prefix, hashes + spaces, int(round(percent * 100)) ) ) if current == 100: sys.stdout.write('\n') sys.stdout.flush() def _add_stream_handler( self, handler_type: str, message_format: str, message_filter: List[logging.Filter], channel: Optional[TextIO] = sys.__stdout__, ) -> None: handler = logging.StreamHandler(channel) handler.setFormatter(logging.Formatter(message_format, '%H:%M:%S')) for rule in message_filter: handler.addFilter(rule) self.addHandler(handler) self.log_handlers[handler_type] = handler ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7460392 kiwi-11.1.8/kiwi/logger_color_formatter.py0000644000000000000000000000731215273675667015603 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging class ColorMessage: """ **Implements color messages for Python logging facility** Has to implement the format_message method to serve as message formatter """ def __init__(self) -> None: BLACK, RED, GREEN, YELLOW, BLUE, MAGENTA, CYAN, WHITE = list(range(8)) self.color = { 'BLACK': BLACK, 'WARNING': YELLOW, 'INFO': WHITE, 'DEBUG': WHITE, 'CRITICAL': YELLOW, 'ERROR': RED, 'RED': RED, 'GREEN': GREEN, 'YELLOW': YELLOW, 'BLUE': BLUE, 'MAGENTA': MAGENTA, 'CYAN': CYAN, 'WHITE': WHITE, } self.esc = { 'reset': '\033[0m', 'color': '\033[3;%dm', 'color_light': '\033[2;%dm', 'bold': '\033[1m', } def format_message(self, level: str, message: str) -> str: """ Message formatter with support for embedded color sequences The Message is allowed to contain the following color metadata: * $RESET, reset to no color mode * $BOLD, bold * $COLOR, color the following text * $LIGHTCOLOR, light color the following text The color of the message depends on the level and is defined in the ColorMessage constructor :param str level: color level name :param str message: text :return: color message with escape sequences :rtype: str """ message = ( message.replace('$RESET', self.esc['reset']) .replace('$BOLD', self.esc['bold']) .replace('$COLOR', self.esc['color'] % (30 + self.color[level])) .replace( '$LIGHTCOLOR', self.esc['color_light'] % (30 + self.color[level]), ) ) for color_name, color_id in list(self.color.items()): message = ( message.replace( '$' + color_name, self.esc['color'] % (color_id + 30) ) .replace( '$BG' + color_name, self.esc['color'] % (color_id + 40) ) .replace( '$BG-' + color_name, self.esc['color'] % (color_id + 40) ) ) return message + self.esc['reset'] class ColorFormatter(logging.Formatter): """ **Extended standard logging Formatter** Extended format supporting text with color metadata Example: .. code:: python ColorFormatter(message_format, '%H:%M:%S') """ def format(self, record: logging.LogRecord) -> str: """ Creates a logging Formatter with support for color messages :param tuple record: logging message record :return: result from format_message :rtype: str """ color = ColorMessage() levelname = record.levelname message = logging.Formatter.format(self, record) return color.format_message(levelname, message) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7460392 kiwi-11.1.8/kiwi/logger_filter.py0000644000000000000000000000612215273675667013665 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging class LoggerSchedulerFilter(logging.Filter): """ **Extended standard logging Filter** """ def filter(self, record: logging.LogRecord) -> bool: """ Messages from apscheduler scheduler instances are filtered out They conflict with console progress information :param tuple record: logging message record :return: True|False :rtype: bool """ ignorables = ['apscheduler.scheduler', 'apscheduler.executors.default'] return bool(record.name not in ignorables) class InfoFilter(logging.Filter): """ **Extended standard logging Filter** """ def filter(self, record: logging.LogRecord) -> bool: """ Only messages with record level INFO can pass for messages with another level an extra handler is used :param tuple record: logging message record :return: True|False :rtype: bool """ return True if record.levelno == logging.INFO else False class DebugFilter(logging.Filter): """ **Extended standard debug logging Filter** """ def filter(self, record: logging.LogRecord) -> bool: """ Only messages with record level DEBUG can pass for messages with another level an extra handler is used :param tuple record: logging message record :return: True|False :rtype: bool """ return True if record.levelno == logging.DEBUG else False class ErrorFilter(logging.Filter): """ **Extended standard error logging Filter** """ def filter(self, record: logging.LogRecord) -> bool: """ Only messages with record level DEBUG can pass for messages with another level an extra handler is used :param tuple record: logging message record :return: True|False :rtype: bool """ return True if record.levelno == logging.ERROR else False class WarningFilter(logging.Filter): """ **Extended standard warning logging Filter** """ def filter(self, record: logging.LogRecord) -> bool: """ Only messages with record level WARNING can pass for messages with another level an extra handler is used :param tuple record: logging message record :return: True|False :rtype: bool """ return True if record.levelno == logging.WARNING else False ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7460392 kiwi-11.1.8/kiwi/logger_socket.py0000644000000000000000000000366315273675667013677 0ustar00# Copyright (c) 2022 Marcus Schäfer. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging.handlers class PlainTextSocketHandler(logging.handlers.SocketHandler): def makePickle(self, record: logging.LogRecord) -> bytes: """ Custom makePickle method which actually does not pickle the messages into the pickle binary format but just sends the log message as plain text. A simple server listening could then look like the following example .. code:: python sock_file = '/tmp/log_socket' buffer = 1024 if os.path.exists(sock_file): os.unlink(sock_file) sock = socket.socket(socket.AF_UNIX, socket.SOCK_STREAM) sock.bind(sock_file) sock.listen(1) while True: connection, client_address = sock.accept() try: while True: data = connection.recv(buffer) if not data: break print(data.decode()) finally: connection.close() """ # the formatter is always set by Logger.set_log_socket assert self.formatter message = self.formatter.format(record) return message.encode() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7460392 kiwi-11.1.8/kiwi/markup/__init__.py0000644000000000000000000000350615273675667014102 0ustar00# Copyright (c) 2020 SUSE LLC. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from abc import ABCMeta, abstractmethod import logging # project from kiwi.markup.base import MarkupBase from kiwi.exceptions import KiwiAnyMarkupPluginError log = logging.getLogger('kiwi') class Markup(metaclass=ABCMeta): """ **Markup factory** :param str description: path to description file """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new(description: str, name: str = 'any') -> MarkupBase: # noqa: E252 try: markup = Markup._load_markup_by_name(name, description) log.info('Support for multiple markup descriptions available') except KiwiAnyMarkupPluginError: markup = Markup._load_markup_by_name('xml', description) log.info('Support for XML markup available') return markup @staticmethod def _load_markup_by_name(name: str, description: str) -> MarkupBase: name_map = {'any': 'Any', 'xml': 'XML'} markup = importlib.import_module('kiwi.markup.{0}'.format(name)) return markup.__dict__['Markup{0}'.format(name_map[name])](description) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.746392 kiwi-11.1.8/kiwi/markup/any.py0000644000000000000000000001013215273675667013123 0ustar00# Copyright (c) 2020 SUSE LLC. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Any import importlib import importlib.util # project from kiwi.utils.temporary import Temporary from kiwi.markup.base import MarkupBase from kiwi.exceptions import KiwiDescriptionInvalid, KiwiAnyMarkupPluginError class MarkupAny(MarkupBase): """ **Implements markup handling for XML, YAML, JSON and INI** """ def post_init(self) -> None: """ Convert given description file into XML The anymarkup module supports auto detection of the given input format and can convert YAML, JSON and INI to XML """ try: anymarkup_mod = 'anymarkup' if importlib.util.find_spec('anymarkup_core'): anymarkup_mod = 'anymarkup_core' self.anymarkup: Any = importlib.import_module(anymarkup_mod) except Exception as issue: raise KiwiAnyMarkupPluginError(issue) try: self.description_markup_processed = Temporary().new_file() markup = self.anymarkup.parse_file( self.description, force_types=None ) self.anymarkup.serialize_file( markup, self.description_markup_processed.name, format='xml' ) except Exception as issue: raise KiwiDescriptionInvalid(issue) def get_xml_description(self) -> str: """ Return XML description file name :return: file path name :rtype: str """ return self.apply_xslt_stylesheets( self.description_markup_processed.name ) def get_toml_description(self) -> str: """ Return TOML description file name :return: file path name :rtype: str """ xml_description_xslt_transformed = self.apply_xslt_stylesheets( self.description_markup_processed.name ) markup = self.anymarkup.parse_file( xml_description_xslt_transformed, force_types=None ) self.anymarkup.serialize_file( markup, xml_description_xslt_transformed, format='toml' ) return xml_description_xslt_transformed def get_yaml_description(self) -> str: """ Return YAML description file name :return: file path name :rtype: str """ xml_description_xslt_transformed = self.apply_xslt_stylesheets( self.description_markup_processed.name ) markup = self.anymarkup.parse_file( xml_description_xslt_transformed, force_types=None ) # The translation to yaml runs from a translation to json first # This is done because a direct translation from xml to yaml # causes the ordered mapping to be included. See # http://yaml.org/type/omap.html. In the context of kiwi this # ordering information is however not needed. The order of # sections and attributes doesn't play a role. In json no # such ordering concept exists and this is way to convert to # yaml without the !!omap definitions. self.anymarkup.serialize_file( markup, xml_description_xslt_transformed, format='json' ) markup = self.anymarkup.parse_file( xml_description_xslt_transformed, force_types=None ) self.anymarkup.serialize_file( markup, xml_description_xslt_transformed, format='yaml' ) return xml_description_xslt_transformed ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.746392 kiwi-11.1.8/kiwi/markup/base.py0000644000000000000000000001073715273675667013261 0ustar00# Copyright (c) 2020 SUSE LLC. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import Any, Optional from lxml import etree from urllib.parse import urlparse # project from kiwi.utils.temporary import Temporary from kiwi.defaults import Defaults from kiwi.exceptions import ( KiwiConfigFileFormatNotSupported, KiwiDescriptionInvalid, KiwiIncludFileNotFoundError, ) class MarkupBase: """ **Implements base class for Markup interface** Attributes :param str description: description path """ def __init__(self, description: str): self.description = description self.post_init() def post_init(self) -> None: """ Post initialization method """ pass def apply_xslt_stylesheets(self, description: str) -> str: """ Apply XSLT style sheet rules to an xml file The result of the XSLT processing is stored in a named temporary file and returned to the caller :param str description: path to an XML description file """ # Parse the provided description, raising the appropriate # exception if parsing fails. try: parsed_description = etree.parse(description) except etree.XMLSyntaxError: raise KiwiConfigFileFormatNotSupported( 'Configuration file could not be parsed. ' 'In case your configuration file is XML it most likely ' 'contains a syntax error. For other formats the ' 'Python anymarkup module is required.' ) xslt_transform_parser = etree.XMLParser() xslt_transform_parser.resolvers.add( FileResolver(os.path.dirname(self.description)) ) xslt_transform = etree.XSLT( etree.parse( Defaults.get_xsl_stylesheet_file(), xslt_transform_parser ) ) self.description_xslt_processed = Temporary( prefix='kiwi_xslt-' ).new_file() try: with open(self.description_xslt_processed.name, "wb") as xsltout: xsltout.write( etree.tostring( xslt_transform(parsed_description), pretty_print=True ) ) except etree.XMLSyntaxError as issue: raise KiwiDescriptionInvalid(issue) except etree.XSLTApplyError as issue: raise KiwiDescriptionInvalid(issue) return self.description_xslt_processed.name def get_xml_description(self) -> str: """ Return XML description file name Implementation in specialized Markup class """ raise NotImplementedError def get_yaml_description(self) -> str: """ Return YAML description file name Implementation in specialized Markup class """ raise NotImplementedError def get_toml_description(self) -> str: """ Return TOML description file name Implementation in specialized Markup class """ raise NotImplementedError class FileResolver(etree.Resolver): def __init__(self, description_dir: str) -> None: self.description_dir = description_dir def resolve(self, url: str, pubid: Optional[str], context: Any) -> Any: if url.startswith('this://'): url = url.replace('this://', '') url = 'dir://{0}'.format( os.path.realpath(os.path.join(self.description_dir, url)) ) uri = urlparse(url) if uri.path and uri.netloc: url = ''.join([uri.netloc, uri.path]) elif uri.path: url = uri.path if os.path.exists(url): return self.resolve_filename(url, context) else: raise KiwiIncludFileNotFoundError( f'include reference {url!r} does not exist' ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.746392 kiwi-11.1.8/kiwi/markup/xml.py0000644000000000000000000000316415273675667013143 0ustar00# Copyright (c) 2020 SUSE LLC. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # # project from kiwi.markup.base import MarkupBase from kiwi.exceptions import KiwiMarkupConversionError class MarkupXML(MarkupBase): """ **Implements plain XML markup handling** """ def get_xml_description(self) -> str: """ Return XML description file name :return: file path name :rtype: string """ return self.apply_xslt_stylesheets(self.description) def get_yaml_description(self) -> str: """ Conversion into YAML format not supported by base XML markup """ raise KiwiMarkupConversionError( 'Conversion to YAML not supported, install anymarkup-core module' ) def get_toml_description(self) -> str: """ Conversion into TOML format not supported by base XML markup """ raise KiwiMarkupConversionError( 'Conversion to TOML not supported, install anymarkup-core module' ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.746392 kiwi-11.1.8/kiwi/mount_manager.py0000644000000000000000000001771215273675667013704 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import time import logging from textwrap import dedent from types import TracebackType from typing import List, Dict, Optional, Type # project from kiwi.path import Path from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.exceptions import KiwiCommandError, KiwiUmountBusyError from kiwi.utils.block import BlockID log = logging.getLogger('kiwi') class MountManager: """ **Implements methods for mounting, umounting and mount checking** The caller is responsible for unmounting the device if the MountManager is used as is. The class also supports to be used as a context manager, where the device is unmounted once the context manager's with block is left * :param string device: device node name * :param string mountpoint: mountpoint directory name * :param dict attributes: optional attributes to store """ def __init__( self, device: str, mountpoint: str = '', attributes: Dict[str, str] = {} ): self.device = device self.attributes = attributes if not mountpoint: self.mountpoint_tempdir = Temporary( prefix='kiwi_mount_manager.' ).new_dir() self.mountpoint = self.mountpoint_tempdir.name else: Path.create(mountpoint) self.mountpoint = mountpoint def __enter__(self) -> "MountManager": return self def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: self.umount() def get_attributes(self) -> Dict[str, str]: """ Return attributes dict for this mount manager """ return self.attributes def bind_mount(self) -> None: """ Bind mount the device to the mountpoint """ if self.device and not self.is_mounted(): Command.run(['mount', '-n', '--bind', self.device, self.mountpoint]) def overlay_mount(self, lower: str) -> None: self.device = 'overlay' self.lower = lower self.upper = f'{self.mountpoint}_cow' self.work = f'{self.mountpoint}_work' Path.create(self.upper) Path.create(self.work) if not self.is_mounted(): Command.run( [ 'mount', '-t', 'overlay', self.device, self.mountpoint, '-o', 'lowerdir={0},upperdir={1},workdir={2}'.format( lower, self.upper, self.work ), ] ) def tmpfs_mount(self) -> None: """ tmpfs mount the device to the mountpoint """ if not self.is_mounted(): Command.run(['mount', '-t', 'tmpfs', 'tmpfs', self.mountpoint]) def mount(self, options: List[str] = []) -> None: """ Standard mount the device to the mountpoint :param list options: mount options """ if self.device and not self.is_mounted(): option_list = [] if options: option_list = ['-o'] + options type_list = [] filesystem = BlockID(self.device).get_filesystem() if filesystem: type_list = ['-t', filesystem] Command.run( ['mount'] + type_list + option_list + [self.device, self.mountpoint] ) def umount_lazy(self) -> None: """ Umount by the mountpoint directory in lazy mode Release the mount in any case, however the time when the mounted resource is released by the kernel depends on when the resource enters the non busy state """ if self.is_mounted(): Command.run(['umount', '-l', self.mountpoint]) def umount(self, raise_on_busy: bool = True) -> bool: """ Umount by the mountpoint directory Wait up to 10sec trying to umount. If the resource stays busy the call will raise an exception unless raise_on_busy is set to False. In case the umount failed and raise_on_busy is set to False, the method returns False to indicate the error condition. :return: True or False :rtype: bool """ if self.is_mounted(): umounted_successfully = False for busy in range(0, 5): try: Command.run(['umount', self.mountpoint]) umounted_successfully = True break except KiwiCommandError as err: log.warning( f'{busy} umount of {self.mountpoint} failed with: {err}' ) time.sleep(1) if not umounted_successfully: try: Command.run(['umount', '--lazy', self.mountpoint]) umounted_successfully = True except KiwiCommandError as err: log.error(f'umount of {self.mountpoint} failed with: {err}') if not umounted_successfully: if raise_on_busy: lsof = Path.which('lsof', access_mode=os.X_OK) if lsof: open_files = Command.run( [lsof, '+c', '0', self.mountpoint], raise_on_error=False, ) open_files_info = 'Open files status:{0}{1}'.format( os.linesep, open_files.output ) else: open_files_info = 'For further details install: lsof' message = dedent( '''\n Failed to umount: {0}. Your build host system is in an inconsistent state. The cleanup of the created resource was not possible because it is still busy. This resource and all nested resources stays active on your host and needs a manual cleanup. Please do not use the intermediate state of the image files created so far. There is no guarantee that the produced results are valid. {1} ''' ) raise KiwiUmountBusyError( message.format(self.mountpoint, open_files_info) ) else: log.warning( '{0} still busy at {1}'.format( self.mountpoint, type(self).__name__ ) ) # skip removing the mountpoint directory return False return True def is_mounted(self) -> bool: """ Check if mounted :return: True or False :rtype: bool """ mountpoint_call = Command.run( command=['mountpoint', '-q', self.mountpoint], raise_on_error=False ) return mountpoint_call.returncode == 0 ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.746392 kiwi-11.1.8/kiwi/oci_tools/__init__.py0000644000000000000000000000301115273675667014564 0ustar00# Copyright (c) 2018 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from abc import ABCMeta, abstractmethod from kiwi.oci_tools.base import OCIBase # project from kiwi.runtime_config import RuntimeConfig from kiwi.exceptions import KiwiOCIArchiveToolError class OCI(metaclass=ABCMeta): """ **OCI Factory** """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new() -> OCIBase: tool_name = RuntimeConfig().get_oci_archive_tool() if tool_name == "umoci": from kiwi.oci_tools.umoci import OCIUmoci return OCIUmoci() elif tool_name == "buildah": from kiwi.oci_tools.buildah import OCIBuildah return OCIBuildah() else: raise KiwiOCIArchiveToolError( 'No support for {0} tool available'.format(tool_name) ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.746591 kiwi-11.1.8/kiwi/oci_tools/base.py0000644000000000000000000001445415273675667013754 0ustar00# Copyright (c) 2018 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from datetime import datetime, timezone from types import TracebackType from typing import Any, List, Mapping, Optional, Type # project from kiwi.path import Path from kiwi.utils.command_capabilities import CommandCapabilities from kiwi.utils.sync import DataSync class OCIBase: """ **Base Class for Open Container Interface operations** An initiative to formulate industry standards around container formats and runtime is available at https://www.opencontainers.org Different tools to implement the specifications had been created. The purpose of this class and its sub-classes is to provide a common interface in kiwi to allow using all tools such that the container support in kiwi covers every linux distribution no matter what tooling was preferred """ def __init__(self) -> None: self.oci_root_dir: Optional[str] = None sde = os.environ.get('SOURCE_DATE_EPOCH') if sde: self.creation_date = datetime.fromtimestamp( int(sde), tz=timezone.utc ).strftime('%Y-%m-%dT%H:%M:%S+00:00') else: self.creation_date = datetime.utcnow().strftime( '%Y-%m-%dT%H:%M:%S+00:00' ) self.post_init() def __enter__(self) -> 'OCIBase': return self def post_init(self) -> None: """ Post initialization method Implementation in specialized OCI tool class if required """ pass def import_container_image(self, container_image_ref: str) -> None: """ Imports container image reference to a working space Implementation in specialized tool class :param string container_image_ref: image reference to import """ raise NotImplementedError def export_container_image( self, filename: str, transport: str, image_ref: str, additional_refs: Optional[List[str]] = None, ) -> None: """ Exports the working container to a container image archive Implementation in specialized tool class :param str filename: The resulting filename :param str transport: The archive format :param str image_ref: Image reference of the exported image :param list additional_names: List of additional references """ raise NotImplementedError def init_container(self) -> None: """ Initialize a new container Implementation in specialized tool class """ raise NotImplementedError def unpack(self) -> None: """ Unpack current container root data Implementation in specialized tool class """ raise NotImplementedError def sync_rootfs( self, root_dir: str, exclude_list: Optional[List[str]] = None ) -> None: """ Synchronizes the image root with the rootfs of the container Implementation in specialized tool class :param string root_dir: root directory of the prepare step :param list exclude_list: list of paths to exclude """ raise NotImplementedError def import_rootfs( self, root_dir: str, exclude_list: Optional[List[str]] = None ) -> None: """ Synchronizes the container rootfs with the root tree of the build Implementation in specialized tool class :param string root_dir: root directory used in prepare step :param list exclude_list: list of paths to exclude """ raise NotImplementedError def repack(self, oci_config: Mapping[str, Any]) -> None: """ Pack root data directory into container image Implementation in specialized tool class :param list oci_config: meta data list """ raise NotImplementedError def set_config(self, oci_config: Mapping[str, Any]) -> None: """ Set list of meta data information such as entry_point, maintainer, etc... to the container. The validation of the list content is handled by the underlaying toolkit Implementation in specialized tool class :param list oci_config: meta data list """ raise NotImplementedError def post_process(self) -> None: """ Performs latest steps after the container layers is added and configured. Implementation in specialized tool class """ raise NotImplementedError @staticmethod def _sync_data( origin: str, destination: str, exclude_list: Optional[List[str]] = None, options: Optional[List[str]] = None, ) -> None: """ Synchronizes the origin and destination paths to be equivalent :param string origin: the source path :param string destination: the destination path """ sync = DataSync(origin, destination) sync.sync_data(options=options, exclude=exclude_list) @staticmethod def _skopeo_provides_tmpdir_option() -> bool: """ Check if skopeo provides the --tmpdir option Beginning with version >= 0.2 skopeo provides it. """ tool = 'skopeo' expected_version = (0, 2, 0) if Path.which(filename=tool, access_mode=os.X_OK): if CommandCapabilities.check_version( tool, expected_version, raise_on_error=False ): return True return False # pragma: no cover def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: pass ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.746591 kiwi-11.1.8/kiwi/oci_tools/buildah.py0000644000000000000000000003146215273675667014450 0ustar00# Copyright (c) 2019 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms owf the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging import os import random import string from types import TracebackType from typing import Any, List, Mapping, Optional, Type # project from kiwi.oci_tools.base import OCIBase from kiwi.command import Command from kiwi.path import Path from kiwi.defaults import Defaults from kiwi.exceptions import KiwiBuildahError log = logging.getLogger('kiwi') class OCIBuildah(OCIBase): """ **Open Container Operations using buildah** """ def post_init(self) -> None: """ Initializes some default parameters """ self.working_image: Optional[str] = None self.imported_image: Optional[str] = None self.working_container: Optional[str] = None def __enter__(self) -> 'OCIBuildah': return self def import_container_image(self, container_image_ref: str) -> None: """ Imports container image reference to the OCI containers storage. :param str container_image_ref: container image reference """ if not self.imported_image: self.imported_image = 'kiwi-image-{0}:{1}'.format( self._random_string_generator(), Defaults.get_container_base_image_tag(), ) else: raise KiwiBuildahError( "Image already imported, called: '{0}'".format( self.imported_image ) ) # We are making use of skopeo instead of only calling 'buildah from' # because we want to control the image name loaded into the containers # storage. This way we are certain to not leave any left over after the # build. Command.run( [ 'skopeo', 'copy', container_image_ref, 'containers-storage:{0}'.format(self.imported_image), ] + ( ['--tmpdir', Defaults.get_temp_location()] if self._skopeo_provides_tmpdir_option() else [] ) ) if not self.working_container: self.working_container = 'kiwi-container-{0}'.format( self._random_string_generator() ) else: raise KiwiBuildahError( "Container already initated, called: '{0}'".format( self.working_container ) ) Command.run( [ 'buildah', 'from', '--name', self.working_container, 'containers-storage:{0}'.format(self.imported_image), ] ) def export_container_image( self, filename: str, transport: str, image_ref: str, additional_names: Optional[List[str]] = None, ) -> None: """ Exports the working container to a container image archive :param str filename: The resulting filename :param str transport: The archive format :param str image_ref: Reference of the exported image :param list additional_names: List of additional references """ extra_tags_opt = [] if additional_names: for ref in additional_names: extra_tags_opt.extend(['--additional-tag', ref]) # make sure the target tar file does not exist # skopeo doesn't support force overwrite Path.wipe(filename) if self.working_image: export_image = self.working_image elif self.imported_image: export_image = self.imported_image else: raise KiwiBuildahError("There is no image to export defined") # we are using 'skopeo copy' to export images instead of 'buildah push' # because buildah does not support multiple tags Command.run( [ 'skopeo', 'copy', 'containers-storage:{0}'.format(export_image), '{0}:{1}:{2}'.format(transport, filename, image_ref), ] + extra_tags_opt + ( ['--tmpdir', Defaults.get_temp_location()] if self._skopeo_provides_tmpdir_option() else [] ) ) def init_container(self) -> None: """ Initialize a new container in OCI containers storage """ if not self.working_container: self.working_container = 'kiwi-container-{0}'.format( self._random_string_generator() ) else: raise KiwiBuildahError( "Image already imported or initated at '{0}' container".format( self.working_container ) ) Command.run( ['buildah', 'from', '--name', self.working_container, 'scratch'] ) def unpack(self) -> None: """ Mounts current container root data to a directory """ assert self.working_container cmd = Command.run(['buildah', 'mount', self.working_container]) self.oci_root_dir = cmd.output.rstrip() def sync_rootfs( self, root_dir: str, exclude_list: Optional[List[str]] = None ) -> None: """ Synchronizes the image root with the rootfs of the container :param string root_dir: root directory of the prepare step :param list exclude_list: list of paths to exclude """ assert self.oci_root_dir self._sync_data( ''.join([root_dir, os.sep]), self.oci_root_dir, exclude_list=exclude_list, options=Defaults.get_sync_options() + [ '--filter', '-x! user.*', '--filter', '-x! security.ima*', '--filter', '-x! security.capability*', '--delete', ], ) def import_rootfs( self, root_dir: str, exclude_list: Optional[List[str]] = None ) -> None: """ Synchronizes the container rootfs with the root tree of the build :param string root_dir: root directory used in prepare step :param list exclude_list: list of paths to exclude """ assert self.oci_root_dir self._sync_data( os.sep.join([self.oci_root_dir, '']), root_dir, exclude_list=exclude_list, options=Defaults.get_sync_options(), ) def repack(self, oci_config: Mapping[str, Any]) -> None: """ Pack root data directory into container image :param list oci_config: unused parameter """ assert self.working_container Command.run(['buildah', 'umount', self.working_container]) def set_config(self, oci_config: Mapping[str, Any]) -> None: """ Set list of meta data information such as entry_point, maintainer, etc... to the container. :param list oci_config: meta data list :param bool base_image: True|False """ assert self.working_container config_args = self._process_oci_config_to_arguments(oci_config) Command.run( ['buildah', 'config'] + config_args + [self.working_container] ) def post_process(self) -> None: """ Commits the OCI container into an OCI image """ if not self.working_image and self.working_container: self.working_image = 'kiwi-image-{0}:{1}'.format( self._random_string_generator(), 'tag-{0}'.format(self._random_string_generator()), ) else: raise KiwiBuildahError( "No container to commit or container already committed" ) output = Command.run( [ 'buildah', 'commit', '--rm', '--format', 'oci', self.working_container, self.working_image, ] ) self.working_image = output.output.rstrip() self.working_container = None @classmethod def _process_oci_config_to_arguments( self, oci_config: Mapping[str, Any] ) -> List[str]: """ Process the oci configuration dictionary into a list of arguments for the 'buildah config' command :param list oci_config: meta data list :return: List of buildah config arguments :rtype: list """ arguments = [] if 'maintainer' in oci_config: arguments.append('--author={0}'.format(oci_config['maintainer'])) if 'user' in oci_config: arguments.append('--user={0}'.format(oci_config['user'])) if 'workingdir' in oci_config: arguments.append( '--workingdir={0}'.format(oci_config['workingdir']) ) if 'entry_command' in oci_config: arguments.append( '--entrypoint=[{0}]'.format( ','.join( ['"{0}"'.format(x) for x in oci_config['entry_command']] ) ) ) if 'entry_subcommand' in oci_config: arguments.append( '--cmd={0}'.format(' '.join(oci_config['entry_subcommand'])) ) if 'volumes' in oci_config: for vol in oci_config['volumes']: arguments.append('--volume={0}'.format(vol)) if 'stopsignal' in oci_config: arguments.append( '--stop-signal={0}'.format(oci_config['stopsignal']) ) if 'expose_ports' in oci_config: for port in oci_config['expose_ports']: arguments.append('--port={0}'.format(port)) if 'environment' in oci_config: for name in sorted(oci_config['environment']): arguments.append( '--env={0}={1}'.format( name, oci_config['environment'][name] ) ) if 'labels' in oci_config: for name in sorted(oci_config['labels']): arguments.append( '--label={0}={1}'.format(name, oci_config['labels'][name]) ) if 'history' in oci_config: if 'comment' in oci_config['history']: arguments.append( '--history-comment={0}'.format( oci_config['history']['comment'] ) ) if 'created_by' in oci_config['history']: arguments.append( '--created-by={0}'.format( oci_config['history']['created_by'] ) ) if 'author' in oci_config['history']: log.warning('Author field in history is ignored using buildah') return arguments @classmethod def _random_string_generator( cls, chars_num: int = 6, allchars: str = string.ascii_lowercase + string.digits, ) -> str: """ Creates a random string with the given length of characters choosen randomly from a given list of possible characters. Buildah makes use of the hosts configured containers storage of OCI images. This method is used to avoid name collisions with any previous image or container present in the host. :param int chars_num: Lenght of the generated random string :param list allchars: List of possible characters :return: generated random string :rtype: string """ return "".join(random.choice(allchars) for x in range(chars_num)) def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: if self.working_container: Command.run(['buildah', 'umount', self.working_container]) Command.run(['buildah', 'rm', self.working_container]) if self.working_image: Command.run(['buildah', 'rmi', self.working_image]) if self.imported_image: Command.run(['buildah', 'rmi', self.imported_image]) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.746591 kiwi-11.1.8/kiwi/oci_tools/umoci.py0000644000000000000000000002450115273675667014150 0ustar00# Copyright (c) 2018 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import Any, List, Mapping, Optional # project from kiwi.utils.temporary import Temporary from kiwi.oci_tools.base import OCIBase from kiwi.command import Command from kiwi.path import Path from kiwi.utils.command_capabilities import CommandCapabilities from kiwi.defaults import Defaults class OCIUmoci(OCIBase): """ **Open Container Operations using umoci** """ def post_init(self) -> None: """ Initializes some umoci parameters and options """ self.oci_dir_tempfile = Temporary(prefix='kiwi_oci_dir.').new_dir() self.oci_dir = self.oci_dir_tempfile.name self.container_dir = os.sep.join([self.oci_dir, 'oci_layout']) self.working_image = '{0}:{1}'.format( self.container_dir, Defaults.get_container_base_image_tag() ) if CommandCapabilities.has_option_in_help( 'umoci', '--no-history', ['config', '--help'], raise_on_error=False ): self.no_history_flag = ['--no-history'] else: self.no_history_flag = [] def import_container_image(self, container_image_ref: str) -> None: """ Imports container image reference to an OCI layout :param str container_image_ref: container image reference """ Command.run( [ 'skopeo', 'copy', container_image_ref, 'oci:{0}:{1}'.format( self.container_dir, Defaults.get_container_base_image_tag() ), ] + ( ['--tmpdir', Defaults.get_temp_location()] if self._skopeo_provides_tmpdir_option() else [] ) ) def export_container_image( self, filename: str, transport: str, image_ref: str, additional_names: Optional[List[str]] = None, ) -> None: """ Exports the working container to a container image archive :param str filename: The resulting filename :param str transport: The archive format :param str image_name: Name of the exported image :param str image_tag: Tag of the exported image :param list additional_names: List of additional references """ extra_tags_opt = [] if additional_names: for ref in additional_names: extra_tags_opt.extend(['--additional-tag', ref]) # make sure the target tar file does not exist # skopeo doesn't support force overwrite Path.wipe(filename) Command.run( [ 'skopeo', 'copy', 'oci:{0}'.format(self.working_image), '{0}:{1}:{2}'.format(transport, filename, image_ref), ] + extra_tags_opt + ( ['--tmpdir', Defaults.get_temp_location()] if self._skopeo_provides_tmpdir_option() else [] ) ) def init_container(self) -> None: """ Initialize a new container layout :param bool base_image: True|False """ Command.run(['umoci', 'init', '--layout', self.container_dir]) Command.run(['umoci', 'new', '--image', self.working_image]) def unpack(self) -> None: """ Unpack current container root data """ self.oci_root_dir_tempdir = Temporary( prefix='kiwi_oci_root_dir.' ).new_dir() self.oci_root_dir = self.oci_root_dir_tempdir.name Command.run( [ 'umoci', 'unpack', '--image', self.working_image, self.oci_root_dir, ] ) def sync_rootfs( self, root_dir: str, exclude_list: Optional[List[str]] = None ) -> None: """ Synchronizes the image root with the rootfs of the container :param string root_dir: root directory of the prepare step :param list exclude_list: list of paths to exclude """ assert self.oci_root_dir self._sync_data( ''.join([root_dir, os.sep]), os.sep.join([self.oci_root_dir, 'rootfs']), exclude_list=exclude_list, options=Defaults.get_sync_options() + ['--delete'], ) def import_rootfs( self, root_dir: str, exclude_list: Optional[List[str]] = None ) -> None: """ Synchronizes the container rootfs with the root tree of the build :param string root_dir: root directory used in prepare step :param list exclude_list: list of paths to exclude """ assert self.oci_root_dir self._sync_data( os.sep.join([self.oci_root_dir, 'rootfs', '']), root_dir, exclude_list=exclude_list, options=Defaults.get_sync_options(), ) def repack(self, oci_config: Mapping[str, Any]) -> None: """ Pack root data directory into container image :param list oci_config: meta data list """ assert self.oci_root_dir history_flags = self._process_oci_history_to_arguments(oci_config) history_flags.extend(['--history.created', self.creation_date]) Command.run( ['umoci', 'repack'] + history_flags + ['--image', self.working_image, self.oci_root_dir] ) def set_config(self, oci_config: Mapping[str, Any]) -> None: """ Set list of meta data information such as entry_point, maintainer, etc... to the container. :param list oci_config: meta data list """ config_args = self._process_oci_config_to_arguments(oci_config) Command.run( ['umoci', 'config'] + config_args + self.no_history_flag + [ '--image', self.working_image, '--tag', oci_config['container_tag'], '--created', self.creation_date, ] ) self.working_image = '{0}:{1}'.format( self.container_dir, oci_config['container_tag'] ) @staticmethod def _process_oci_config_to_arguments( oci_config: Mapping[str, Any], ) -> List[str]: """ Process the oci configuration dictionary into a list of arguments for the 'umoci config' command :param list oci_config: meta data list :return: List of umoci config arguments :rtype: list """ arguments = [] if 'maintainer' in oci_config: arguments.append('--author={0}'.format(oci_config['maintainer'])) if 'user' in oci_config: arguments.append('--config.user={0}'.format(oci_config['user'])) if 'workingdir' in oci_config: arguments.append( '--config.workingdir={0}'.format(oci_config['workingdir']) ) if 'entry_command' in oci_config: if len(oci_config['entry_command']) == 0: arguments.append('--clear=config.entrypoint') else: for arg in oci_config['entry_command']: arguments.append('--config.entrypoint={0}'.format(arg)) if 'entry_subcommand' in oci_config: if len(oci_config['entry_subcommand']) == 0: arguments.append('--clear=config.cmd') else: for arg in oci_config['entry_subcommand']: arguments.append('--config.cmd={0}'.format(arg)) if 'volumes' in oci_config: for vol in oci_config['volumes']: arguments.append('--config.volume={0}'.format(vol)) if 'stopsignal' in oci_config: arguments.append( '--config.stopsignal={0}'.format(oci_config['stopsignal']) ) if 'expose_ports' in oci_config: for port in oci_config['expose_ports']: arguments.append('--config.exposedports={0}'.format(port)) if 'environment' in oci_config: for name in sorted(oci_config['environment']): arguments.append( '--config.env={0}={1}'.format( name, oci_config['environment'][name] ) ) if 'labels' in oci_config: for name in sorted(oci_config['labels']): arguments.append( '--config.label={0}={1}'.format( name, oci_config['labels'][name] ) ) return arguments @staticmethod def _process_oci_history_to_arguments( oci_config: Mapping[str, Any], ) -> List[str]: history_args = [] if 'history' in oci_config: if 'comment' in oci_config['history']: history_args.append( '--history.comment={0}'.format( oci_config['history']['comment'] ) ) if 'created_by' in oci_config['history']: history_args.append( '--history.created_by={0}'.format( oci_config['history']['created_by'] ) ) if 'author' in oci_config['history']: history_args.append( '--history.author={0}'.format( oci_config['history']['author'] ) ) return history_args def post_process(self) -> None: """ Cleanup unused data from operations """ Command.run(['umoci', 'gc', '--layout', self.container_dir]) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.746591 kiwi-11.1.8/kiwi/package_manager/__init__.py0000644000000000000000000000551615273675667015673 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from typing import TYPE_CHECKING, List from abc import ABCMeta, abstractmethod import logging # project from kiwi.exceptions import KiwiPackageManagerSetupError if TYPE_CHECKING: # pragma: nocover from kiwi.package_manager.base import PackageManagerBase log = logging.getLogger('kiwi') class PackageManager(metaclass=ABCMeta): """ **Package manager factory** :param object repository: instance of :class:`Repository` :param str package_manager: package manager name :param list custom_args: custom package manager arguments list :raises KiwiPackageManagerSetupError: if the requested package manager type is not supported :return: package manager :rtype: PackageManagerBase subclass """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( repository: object, package_manager_name: str, custom_args: List = [], release_version: str = '', ) -> 'PackageManagerBase': name_map = { 'zypper': ['zypper', 'Zypper'], 'dnf': ['dnf', 'Dnf'], 'dnf5': ['dnf5', 'Dnf5'], 'dnf4': ['dnf4', 'Dnf4'], 'microdnf': ['microdnf', 'MicroDnf'], 'pacman': ['pacman', 'Pacman'], 'apt': ['apt', 'Apt'], 'apk': ['apk', 'Apk'], } try: module_namespace, module_name = name_map[package_manager_name] package_manager = importlib.import_module( 'kiwi.package_manager.{0}'.format(module_namespace) ) module_name = 'PackageManager{0}'.format(module_name) manager = package_manager.__dict__[module_name]( repository, custom_args, release_version ) except Exception as issue: raise KiwiPackageManagerSetupError( 'Support for package manager {0} not implemented {1}'.format( package_manager_name, issue ) ) log.info( 'Using package manager backend: {0}'.format(package_manager_name) ) return manager ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7467964 kiwi-11.1.8/kiwi/package_manager/apk.py0000644000000000000000000001727515273675667014714 0ustar00# Copyright (c) 2025 SUSE LLC. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re import logging from typing import List, Dict, Optional # project from kiwi.command import CommandCallT from kiwi.command import Command from kiwi.package_manager.base import PackageManagerBase from kiwi.system.root_bind import RootBind from kiwi.exceptions import KiwiBootStrapPhaseFailed log = logging.getLogger('kiwi') class PackageManagerApk(PackageManagerBase): """ **Implements Installation/Deletion of packages/collections with apk** :param dict command_env: apk command environment from repository runtime configuration """ def post_init(self, custom_args: Optional[List[str]] = None) -> None: """ Post initialization method Store custom apk arguments :param list custom_args: custom apk arguments """ self.custom_args: List[str] = custom_args or [] runtime_config = self.repository.runtime_config() self.command_env = runtime_config['command_env'] self.bootstrap_repo = runtime_config['bootstrap_repo'] def request_package(self, name: str) -> None: """ Queue a package request :param str name: package name """ self.package_requests.append(name) def request_collection(self, name: str) -> None: """ Queue a collection request apk does not distinguish the installation of packages and collections. Because of that collections are listed together with package requests and a warning message is shown. :param str name: apk group name """ log.warning( ( 'apk treats collection installations as regular packages.' 'It is preferred to list them as regular packages' ) ) self.package_requests.append(name) def request_product(self, name: str) -> None: """ Queue a product request There is no product definition in the Alpine Linux repo data :param str name: unused """ pass def request_package_exclusion(self, name: str) -> None: """ Queue a package exclusion(skip) request :param str name: package name """ self.exclude_requests.append(name) def setup_repository_modules( self, collection_modules: Dict[str, List[str]] ) -> None: """ Repository modules not supported for apk. The method does nothing in this scope :param dict collection_modules: unused """ pass def process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, bootstrap_package: Optional[str] = None, ) -> CommandCallT: """ Process package install requests for bootstrap phase (no chroot) :param object root_bind: unused :param str bootstrap_package: unused :return: process results in command type :rtype: namedtuple """ if not self.bootstrap_repo: raise KiwiBootStrapPhaseFailed( 'No bootstrap repository URI available' ) if not self.package_requests: self.package_requests.append('alpine-base') apk_command = ( ['apk'] + ['--root', self.root_dir] + self.custom_args + [ '-X', self.bootstrap_repo, '-U', '--allow-untrusted', '--initdb', 'add', ] + self.package_requests ) self.cleanup_requests() return Command.call(apk_command, self.command_env) def process_install_requests(self) -> CommandCallT: """ Process package install requests for image phase (chroot) :return: process results in command type :rtype: namedtuple """ Command.run( ['chroot', self.root_dir, 'apk', 'update'], self.command_env ) apk_command = ( ['chroot', self.root_dir, 'apk'] + self.custom_args + ['add'] + self.package_requests ) self.cleanup_requests() return Command.call(apk_command, self.command_env) def process_delete_requests(self, force: bool = False) -> CommandCallT: """ Process package delete requests (chroot) :param bool force: force deletion: unused :raises KiwiRequestError: if none of the packages to delete is installed :return: process results in command type :rtype: namedtuple """ Command.run( ['chroot', self.root_dir, 'apk', 'update'], self.command_env ) apk_command = ( ['chroot', self.root_dir, 'apk'] + self.custom_args + ['del'] + self.package_requests ) self.cleanup_requests() return Command.call(apk_command, self.command_env) def update(self) -> CommandCallT: """ Process package update requests (chroot) :return: process results in command type :rtype: namedtuple """ Command.run( ['chroot', self.root_dir, 'apk', 'update'], self.command_env ) return Command.call( ['chroot', self.root_dir, 'apk', 'upgrade'] + self.custom_args, self.command_env, ) def process_only_required(self) -> None: """ Setup package processing only for required packages. This is the only option in apk, nothing to do here. """ pass def process_plus_recommended(self) -> None: """ Setup package processing to also include recommended dependencies. There is no such concept of recommended dependencies in apk. """ pass def match_package_installed( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been installed This match for the package to be installed in the output of the apk command is not 100% accurate. There might be false positives due to sub package names starting with the same base package name :param str package_name: package_name :param str package_manager_output: dnf status line :returns: True|False :rtype: bool """ return bool( re.match( '.* Installing {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def match_package_deleted( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been deleted :param str package_name: package_name :param str package_manager_output: apk status line :returns: True|False :rtype: bool """ return bool( re.match( '.* Removing {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7467964 kiwi-11.1.8/kiwi/package_manager/apt.py0000644000000000000000000005307215273675667014720 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re import os import glob import logging import pathlib from typing import List, Dict, Optional # project from kiwi.command import CommandCallT from kiwi.command import Command from kiwi.path import Path from kiwi.package_manager.base import PackageManagerBase from kiwi.system.root_bind import RootBind from kiwi.repository.apt import RepositoryApt from kiwi.utils.temporary import Temporary import kiwi.defaults as defaults from kiwi.exceptions import ( KiwiDebianBootstrapError, KiwiRequestError, KiwiFileNotFound, ) log = logging.getLogger('kiwi') class PackageManagerApt(PackageManagerBase): """ **Implements Installation/Deletion of packages/collections with apt-get** :param list apt_get_args: apt-get arguments from repository runtime configuration :param dict command_env: apt-get command environment from repository runtime configuration """ def post_init(self, custom_args: List = []) -> None: """ Post initialization method Store custom apt-get arguments :param list custom_args: custom apt-get arguments """ self.repository: RepositoryApt = self.repository self.custom_args = custom_args self.deboostrap_minbase: bool = True runtime_config = self.repository.runtime_config() self.apt_get_args = runtime_config['apt_get_args'] self.command_env = runtime_config['command_env'] self.distribution = runtime_config['distribution'] self.distribution_path = runtime_config['distribution_path'] self.bootstrap_packages: List[str] = [] def request_package(self, name: str) -> None: """ Queue a package request :param str name: package name """ self.package_requests.append(name) def request_collection(self, name: str) -> None: """ Queue a collection request There is no collection definition in the deb repo data :param str name: unused """ log.warning('Collection(%s) handling not supported for apt-get', name) def request_product(self, name: str) -> None: """ Queue a product request There is no product definition in the deb repo data :param str name: unused """ log.warning('Product(%s) handling not supported for apt-get', name) def request_package_exclusion(self, name: str) -> None: """ Queue a package exclusion(skip) request Package exclusion for apt package manager not yet implemented :param str name: unused """ log.warning( 'Package exclusion for (%s) not supported for apt-get', name ) def setup_repository_modules( self, collection_modules: Dict[str, List[str]] ) -> None: """ Repository modules not supported for apt-get The method does nothing in this scope :param dict collection_modules: unused """ pass def process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, bootstrap_package: Optional[str] = None, ) -> CommandCallT: """ Process package install requests for bootstrap phase (no chroot) Either a manual unpacking strategy or a prebuilt bootstrap package can be used to bootstrap a new system. :param object root_bind: unused :param str bootstrap_package: package name of a bootstrap package :return: process results as command instance :rtype: command_call_type """ if bootstrap_package: return self._process_install_requests_bootstrap_prebuild_root( bootstrap_package ) else: return self._process_install_requests_bootstrap() def _process_install_requests_bootstrap_prebuild_root( self, bootstrap_package: str ) -> CommandCallT: """ Process bootstrap phase (no chroot) using a prebuilt bootstrap package. The package has to provide a tarball below the directory /var/cache/kiwi/bootstrap/PACKAGE_NAME.ARCH.tar.xz and will be unpacked to serve as the bootstrap root. The optionally listed packages in the kiwi bootstrap section will be installed as part of a chroot install and returned as command instance :param str bootstrap_package: package name of the bootstrap package containing the bootstrap root as a tarball :return: process results as command instance :rtype: command_call_type """ # Install prebuilt bootstrap package on build host update_command = ( ['apt-get'] + self.apt_get_args + self.custom_args + ['update'] ) install_command = ( ['apt-get'] + self.apt_get_args + self.custom_args + ['install', bootstrap_package] ) Command.run(update_command, self.command_env) Command.run(install_command, self.command_env) # Unpack prebuilt bootstrap root tarball as new root bootstrap_root_tarball = '/var/lib/bootstrap/{0}.{1}.tar.xz'.format( bootstrap_package, defaults.PLATFORM_MACHINE ) if not os.path.isfile(bootstrap_root_tarball): raise KiwiFileNotFound( f'bootstrap tarball: {bootstrap_root_tarball!r} not found' ) Command.run(['tar', '-C', self.root_dir, '-xf', bootstrap_root_tarball]) # Install eventual bootstrap packages as standard system install return self.process_install_requests() def _process_install_requests_bootstrap(self) -> CommandCallT: """ Process package install requests for bootstrap phase (no chroot). :raises KiwiDebianBootstrapError :return: process results in command type :rtype: CommandCallT """ # we invoke apt-get install to download all the essential packages. # With DPkg::Pre-Install-Pkgs, we specify a shell command that will # receive the list of packages that will be installed on stdin. # By configuring Debug::pkgDpkgPm=1, apt-get install will not # actually execute any dpkg commands, so all it does is download # the essential debs and tell us their full in the apt cache without # actually installing them. try: # TODO: Drop once apt 2.5.4 is widely available. pathlib.Path(f'{self.root_dir}/var/lib/dpkg').mkdir( parents=True, exist_ok=True ) # Older versions of apt look for the status file both within and # without the tree, but do not create the status file within the # tree. pathlib.Path(f'{self.root_dir}/var/lib/dpkg/status.kiwi').touch() # Some versions of apt don't create the status file outside the # tree, e.g. 2.4.14. pathlib.Path('/var/lib/dpkg/status.kiwi').touch() pathlib.Path(f'{self.root_dir}/var/lib/dpkg/available').touch() if 'apt' not in self.package_requests: self.package_requests.append('apt') update_cache = ( ['apt-get'] + self.apt_get_args + self.custom_args + ['update'] ) result = Command.run(update_cache, self.command_env) log.debug('Apt update: {0} {1}'.format(result.output, result.error)) package_names = Temporary(prefix='kiwi_debs_').new_file() self.bootstrap_packages = ['?essential'] + self.package_requests download_bootstrap = ( ['apt-get'] + self.apt_get_args + self.custom_args + [ 'install', '-oDebug::pkgDPkgPm=1', f'-oDPkg::Pre-Install-Pkgs::=cat >{package_names.name}', ] + self.bootstrap_packages ) # Download solved bootstrap packages result = Command.run(download_bootstrap, self.command_env) log.debug( 'Apt download: {0} {1}'.format(result.output, result.error) ) # Extract bootstrap packages with open(package_names.name) as packages: solved_debootstrap_packages = [p.rstrip() for p in packages] self.command_env['PATH'] = '$PATH:/usr/bin:/bin:/usr/sbin:/sbin' for package in solved_debootstrap_packages: Command.run( [ 'bash', '-c', 'dpkg-deb --fsys-tarfile {0} | tar -C {1} -x'.format( package, self.root_dir ), ], self.command_env, ) # Run package scripts. Unfortuantely Debian based systems # requires special sauce for bootstrap. See the exceptions # we have to apply below: # # * manual order is required to make sure users(root) exists # * the usr-merge strategy only works after bootstrap # # 1. Pass: Run package scripts, manual order self._run_bootstrap_scripts( solved_debootstrap_packages, only_for=['base-passwd'], skip=['usrmerge'], ) # 2. Pass: Run package scripts in apt order self._run_bootstrap_scripts( solved_debootstrap_packages, skip=['usrmerge'] ) self.cleanup_requests() return Command.call(update_cache, self.command_env) except Exception as e: raise KiwiDebianBootstrapError(f'{type(e).__name__}: {format(e)}') def process_install_requests(self) -> CommandCallT: """ Process package install requests for image phase (chroot) :return: process results in command type :rtype: namedtuple """ update_command = ['chroot', self.root_dir, 'apt-get'] update_command.extend( Path.move_to_root(self.root_dir, self.apt_get_args) ) update_command.extend(self.custom_args) update_command.append('update') Command.run(update_command, self.command_env) apt_get_command = ['chroot', self.root_dir, 'apt-get'] apt_get_command.extend( Path.move_to_root(self.root_dir, self.apt_get_args) ) apt_get_command.extend(self.custom_args) apt_get_command.append('install') # Due to the special bootstrap process, the packages unpacked # during bootstrap are not properly listed in the apt index. # Therefore the bootstrap packages are added to the install # phase which causes an install of this packages again to # fix the apt index and provide a consistent system from # an apt perspective. apt_get_command.extend(self.bootstrap_packages) apt_get_command.extend(self._package_requests()) return Command.call(apt_get_command, self.command_env) def process_delete_requests(self, force: bool = False) -> CommandCallT: """ Process package delete requests (chroot) :param bool force: force deletion: true|false :raises KiwiRequestError: if none of the packages to delete is installed :return: process results in command type :rtype: namedtuple """ delete_items = [] for delete_item in self._package_requests(): try: Command.run( ['chroot', self.root_dir, 'dpkg', '-l', delete_item] ) delete_items.append(delete_item) except Exception: # ignore packages which are not installed pass if not delete_items: raise KiwiRequestError( 'None of the requested packages to delete are installed' ) # deleting debs for some reason can also trigger package # scripts from the libc-bin (glibc) package. This often # results in calls like ldconfig which failed unless the # system would be really running. Since the deletion # happens via chroot and with the system in offline mode # many attempts to uninstall a package, even cracefully # failed for this reason. So far I only saw the workaround # to make ldconfig a noop during the process of uninstall. # This is not a nice solution and I dislike it. However, # the only one I could come up with to turn the package # uninstall in a useful feature in kiwi. Command.run( [ 'cp', f'{self.root_dir}/usr/sbin/ldconfig', f'{self.root_dir}/usr/sbin/ldconfig.orig', ] ) Command.run( [ 'cp', f'{self.root_dir}/usr/bin/true', f'{self.root_dir}/usr/sbin/ldconfig', ] ) if force: # force deleting debs only worked well for me when ignoring # the pre/post-inst and pre/post-remove codings. No idea why it # ends in so many conflicts but if you want to force get rid # of stuff this was the only way I could come up with. There # are still cases when it does not work depending on the many # code that runs on deleting for package in delete_items: pre_delete_pattern = ( f'{self.root_dir}/var/lib/dpkg/info/{package}*.pre*' ) post_delete_pattern = ( f'{self.root_dir}/var/lib/dpkg/info/{package}*.post*' ) for delete_file in glob.iglob(pre_delete_pattern): Path.wipe(delete_file) for delete_file in glob.iglob(post_delete_pattern): Path.wipe(delete_file) apt_get_command = ['chroot', self.root_dir, 'dpkg'] apt_get_command.extend( [ '--remove', '--force-remove-reinstreq', '--force-remove-essential', '--force-depends', ] ) apt_get_command.extend(delete_items) else: apt_get_command = ['chroot', self.root_dir, 'apt-get'] apt_get_command.extend( Path.move_to_root(self.root_dir, self.apt_get_args) ) apt_get_command.extend(self.custom_args) apt_get_command.extend(['--auto-remove', 'remove']) apt_get_command.extend(delete_items) return Command.call(apt_get_command, self.command_env) def post_process_delete_requests( self, root_bind: Optional[RootBind] = None ) -> None: """ Revert system changes done prior deleting packages :param object root_bind: unused """ Command.run( [ 'mv', f'{self.root_dir}/usr/sbin/ldconfig.orig', f'{self.root_dir}/usr/sbin/ldconfig', ] ) def update(self) -> CommandCallT: """ Process package update requests (chroot) :return: process results in command type :rtype: namedtuple """ apt_get_command = ['chroot', self.root_dir, 'apt-get'] apt_get_command.extend( Path.move_to_root(self.root_dir, self.apt_get_args) ) apt_get_command.extend(self.custom_args) apt_get_command.append('upgrade') return Command.call(apt_get_command, self.command_env) def process_only_required(self) -> None: """ Setup package processing only for required packages """ if '--no-install-recommends' not in self.custom_args: self.custom_args.append('--no-install-recommends') self.deboostrap_minbase = True def process_plus_recommended(self) -> None: """ Setup package processing to also include recommended dependencies. """ if '--no-install-recommends' in self.custom_args: self.custom_args.remove('--no-install-recommends') self.deboostrap_minbase = False def match_package_installed( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been installed This match for the package to be installed in the output of the apt-get command is not 100% accurate. There might be false positives due to sub package names starting with the same base package name :param str package_name: package_name :param str package_manager_output: apt-get status line :returns: True|False :rtype: bool """ return bool( re.match( '.*Unpacking {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def match_package_deleted( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been deleted :param str package_name: package_name :param str package_manager_output: apt-get status line :returns: True|False :rtype: bool """ return bool( re.match( '.*Removing {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def clean_leftovers(self) -> None: """ Cleans package manager related data not needed in the resulting image such as the repository keyring files used at build time. Keyring files of repositories marked with imageinclude or imageonly are stored in /usr/share/keyrings and stay in the image """ self.repository.delete_trusted_keys() def _package_requests(self) -> List: items = self.package_requests[:] self.cleanup_requests() return items def _run_bootstrap_scripts( self, solved_debootstrap_packages: List[str], only_for: List[str] = [], skip: List[str] = [], ) -> None: # TODO: this should not be needed but without setting # the following environment variables no package pre/post # script completes its task. I leave it up to the Debian # experts to provide a fix if needed. self.command_env['DPKG_MAINTSCRIPT_NAME'] = 'true' self.command_env['DPKG_MAINTSCRIPT_PACKAGE'] = 'libc6' post_script_dir = Temporary( prefix='kiwi_debpost.', path=self.root_dir ).new_dir() for package in solved_debootstrap_packages: package_base_name = os.path.basename(package) go_ahead = False if only_for else True for name in only_for: if name in package_base_name: go_ahead = True break for name in skip: if name in package_base_name: go_ahead = False break if not go_ahead: continue log.debug(f'Running pre/post scripts for: {package_base_name}') package_metadata_dir = ( f'{post_script_dir.name}/{os.path.basename(package)}' ) Command.run(['dpkg', '-e', package, package_metadata_dir]) script_pre = f'{package_metadata_dir}/preinst' script_post = f'{package_metadata_dir}/postinst' # 1. preinst if os.path.exists(script_pre): Command.run(['chmod', '755', script_pre]) Command.run( [ 'chroot', self.root_dir, f'{script_pre.replace(self.root_dir, "")}', 'install', ], self.command_env, ) # 2. postinst if os.path.exists(script_post): Command.run(['chmod', '755', script_post]) try: Command.run( [ 'chroot', self.root_dir, f'{script_post.replace(self.root_dir, "")}', 'configure', ], self.command_env, ) except Exception: # Some newer postinst scripts require a non-empty # version number as second parameter. Command.run( [ 'chroot', self.root_dir, f'{script_post.replace(self.root_dir, "")}', 'configure', "0", ], self.command_env, ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7467964 kiwi-11.1.8/kiwi/package_manager/base.py0000644000000000000000000002012015273675667015032 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from types import TracebackType from typing import List, Dict, Optional, Type from kiwi.api_helper import decommissioned from kiwi.command import CommandCallT from kiwi.system.root_bind import RootBind from kiwi.repository.base import RepositoryBase class PackageManagerBase: """ **Implements base class for Package Management** :param object repository: instance of :class:`Repository` :param str root_dir: root directory path name :param list package_requests: list of packages to install or delete :param list collection_requests: list of collections to install :param list product_requests: list of products to install """ def __init__( self, repository: RepositoryBase, custom_args: List = [], release_version: str = '', ) -> None: self.repository = repository self.root_dir = repository.root_dir self.package_requests: List[str] = [] self.collection_requests: List[str] = [] self.product_requests: List[str] = [] self.exclude_requests: List[str] = [] self.release_version = release_version or '0' self.post_init(custom_args or []) def __enter__(self) -> 'PackageManagerBase': return self def post_init(self, custom_args: List = []) -> None: """ Post initialization method Implementation in specialized package manager class :param list custom_args: unused """ pass def request_package(self, name: str) -> None: """ Queue a package request Implementation in specialized package manager class :param str name: unused """ raise NotImplementedError def request_collection(self, name: str) -> None: """ Queue a package collection Implementation in specialized package manager class :param str name: unused """ raise NotImplementedError def request_product(self, name: str) -> None: """ Queue a product request Implementation in specialized package manager class :param str name: unused """ raise NotImplementedError @decommissioned def request_package_lock(self, name: str) -> None: pass # pragma: no cover def request_package_exclusion(self, name: str) -> None: """ Queue a package exclusion(skip) request Implementation in specialized package manager class :param str name: unused """ raise NotImplementedError def setup_repository_modules( self, collection_modules: Dict[str, List[str]] ) -> None: """ Setup repository modules and streams Implementation in specialized package manager class :param dict collection_modules: unused """ raise NotImplementedError def process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, bootstrap_package: Optional[str] = None, ) -> CommandCallT: """ Process package install requests for bootstrap phase (no chroot) Implementation in specialized package manager class """ raise NotImplementedError def process_install_requests(self) -> CommandCallT: """ Process package install requests for image phase (chroot) Implementation in specialized package manager class """ raise NotImplementedError def process_delete_requests(self, force: bool = False) -> CommandCallT: """ Process package delete requests (chroot) Implementation in specialized package manager class :param bool force: unused """ raise NotImplementedError def update(self) -> CommandCallT: """ Process package update requests (chroot) Implementation in specialized package manager class """ raise NotImplementedError def process_only_required(self) -> None: """ Setup package processing only for required packages Implementation in specialized package manager class """ raise NotImplementedError def process_plus_recommended(self) -> None: """ Setup package processing to also include recommended dependencies Implementation in specialized package manager class """ raise NotImplementedError def match_package_installed( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been installed Implementation in specialized package manager class :param str package_name: unused :param str package_manager_output: unused :return: True|False :rtype: bool """ raise NotImplementedError def match_package_deleted( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been deleted Implementation in specialized package manager class :param str package_name: unused :param str package_manager_output: unused :return: True|False :rtype: bool """ raise NotImplementedError @decommissioned def database_consistent(self) -> None: pass # pragma: no cover @decommissioned def dump_reload_package_database(self, version: int = 45) -> None: pass # pragma: no cover def post_process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, delta_root: bool = False ) -> None: """ Process extra code required after bootstrapping Implementation in specialized package manager class """ pass def post_process_delete_requests( self, root_bind: Optional[RootBind] = None ) -> None: """ Process extra code required after deleting packages Implementation in specialized package manager class """ pass @staticmethod def has_failed(returncode: int) -> bool: """ Evaluate given result return code Any returncode != 0 is considered an error unless overwritten in specialized package manager class :param int returncode: return code number :return: True|False :rtype: boolean """ return returncode != 0 def get_error_details(self) -> str: """ Provide further error details In case the package manager call failed this method will return package manager specific error information if there is any :return: further error data as str or empty str :rtype: str """ return '' def clean_leftovers(self) -> None: """ Cleans package manager related data not needed in the resulting image such as custom macros Implementation in specialized package manager class """ pass def cleanup_requests(self) -> None: """ Cleanup request queues """ del self.package_requests[:] del self.collection_requests[:] del self.product_requests[:] del self.exclude_requests[:] def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: if self.repository: self.repository.cleanup() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7467964 kiwi-11.1.8/kiwi/package_manager/dnf.py0000644000000000000000000000621415273675667014677 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import List, Dict, no_type_check, Optional # project from kiwi.command import CommandCallT from kiwi.package_manager.base import PackageManagerBase from kiwi.system.root_bind import RootBind from kiwi.api_helper import decommissioned class PackageManagerDnf(PackageManagerBase): """ decommissioned, moved to PackageManagerDnf4 """ @decommissioned def post_init(self, custom_args: List = []) -> None: pass # pragma: no cover @decommissioned def request_package(self, name: str) -> None: pass # pragma: no cover @decommissioned def request_collection(self, name: str) -> None: pass # pragma: no cover @decommissioned def request_product(self, name: str) -> None: pass # pragma: no cover @decommissioned def request_package_exclusion(self, name: str) -> None: pass # pragma: no cover @decommissioned def setup_repository_modules( self, collection_modules: Dict[str, List[str]] ) -> None: pass # pragma: no cover @no_type_check @decommissioned def process_install_requests_bootstrap( self, root_bind: RootBind = None, bootstrap_package: str = None ) -> CommandCallT: pass # pragma: no cover @no_type_check @decommissioned def process_install_requests(self) -> CommandCallT: pass # pragma: no cover @no_type_check @decommissioned def process_delete_requests(self, force: bool = False) -> CommandCallT: pass # pragma: no cover @no_type_check @decommissioned def update(self) -> CommandCallT: pass # pragma: no cover @decommissioned def process_only_required(self) -> None: pass # pragma: no cover @decommissioned def process_plus_recommended(self) -> None: pass # pragma: no cover @no_type_check @decommissioned def match_package_installed( self, package_name: str, package_manager_output: str ) -> bool: pass # pragma: no cover @no_type_check @decommissioned def match_package_deleted( self, package_name: str, package_manager_output: str ) -> bool: pass # pragma: no cover @decommissioned def post_process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, delta_root: bool = False ) -> None: pass # pragma: no cover @decommissioned def clean_leftovers(self) -> None: pass # pragma: no cover ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7467964 kiwi-11.1.8/kiwi/package_manager/dnf4.py0000644000000000000000000003043215273675667014762 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import re from typing import List, Dict, Optional # project from kiwi.command import CommandCallT from kiwi.command import Command from kiwi.utils.rpm_database import RpmDataBase from kiwi.utils.rpm import Rpm from kiwi.package_manager.base import PackageManagerBase from kiwi.system.root_bind import RootBind from kiwi.path import Path from kiwi.defaults import Defaults from kiwi.exceptions import KiwiRequestError class PackageManagerDnf4(PackageManagerBase): """ ***Implements base class for installation/deletion of packages and collections using dnf*** :param doct dnf_args: dnf arguments from repository runtime configuration :param dict command_env: dnf command environment from repository runtime configuration """ def post_init(self, custom_args: List = []) -> None: """ Post initialization method :param list custom_args: custom dnf arguments """ self.custom_args = custom_args runtime_config = self.repository.runtime_config() self.dnf_args = runtime_config['dnf_args'] self.command_env = runtime_config['command_env'] def request_package(self, name: str) -> None: """ Queue a package request :param str name: package name """ self.package_requests.append(name) def request_collection(self, name: str) -> None: """ Queue a collection request :param str name: dnf group ID name """ self.collection_requests.append(f'@{name}') def request_product(self, name: str) -> None: """ Queue a product request There is no product definition in the fedora repo data :param str name: unused """ pass def request_package_exclusion(self, name: str) -> None: """ Queue a package exclusion(skip) request :param str name: package name """ self.exclude_requests.append(name) def _get_dnf4_binary_name(self, root: Optional[str] = None) -> str: """ Identify whether dnf is 'dnf4' or 'dnf-3' :param str root: lookup binary name below this root directory :return: name of dnf4 command :rtype: str """ dnf4_binary = 'dnf-3' dnf4_search_env = ( {'PATH': os.sep.join([root, 'usr', 'bin'])} if root else None ) # Python interpreter specific path if Path.which( filename='dnf4', custom_env=dnf4_search_env, access_mode=os.X_OK ): dnf4_binary = 'dnf4' return dnf4_binary def setup_repository_modules( self, collection_modules: Dict[str, List[str]] ) -> None: """ Setup repository modules and streams :param dict collection_modules: Expect dict of the form: .. code:: python { 'enable': [ "module:stream", "module" ], 'disable': [ "module" ] } """ dnf_module_command = ( [self._get_dnf4_binary_name()] + self.dnf_args + [ '--installroot', self.root_dir, f'--releasever={self.release_version}', ] + self.custom_args + ['module'] ) for disable_module in collection_modules['disable']: Command.run( dnf_module_command + ['disable', disable_module], self.command_env, ) for enable_module in collection_modules['enable']: Command.run( dnf_module_command + ['reset', enable_module.split(':')[0]], self.command_env, ) Command.run( dnf_module_command + ['enable', enable_module], self.command_env ) def process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, bootstrap_package: Optional[str] = None, ) -> CommandCallT: """ Process package install requests for bootstrap phase (no chroot) :param object root_bind: unused :param str bootstrap_package: unused :return: process results in command type :rtype: namedtuple """ dnf4 = self._get_dnf4_binary_name() exclude_args = [] if self.exclude_requests: # For DNF, excluding a package means removing it from # the solver operation. This is done by adding --exclude # to the command line. This means that if the package is # hard required by another package, it will break the transaction. for package in self.exclude_requests: exclude_args.append('--exclude=' + package) Command.run( [dnf4] + self.dnf_args + [f'--releasever={self.release_version}'] + ['makecache'], self.command_env, ) dnf_command = ( [dnf4] + self.dnf_args + [ '--installroot', self.root_dir, f'--releasever={self.release_version}', ] + self.custom_args + exclude_args + ['install'] + self.package_requests + self.collection_requests ) self.cleanup_requests() return Command.call(dnf_command, self.command_env) def process_install_requests(self) -> CommandCallT: """ Process package install requests for image phase (chroot) :return: process results in command type :rtype: namedtuple """ dnf4 = self._get_dnf4_binary_name(self.root_dir) exclude_args = [] if self.exclude_requests: # For DNF, excluding a package means removing it from # the solver operation. This is done by adding --exclude # to the command line. This means that if the package is # hard required by another package, it will break the transaction. for package in self.exclude_requests: exclude_args.append('--exclude=' + package) chroot_dnf_args = Path.move_to_root(self.root_dir, self.dnf_args) dnf_command = ( ['chroot', self.root_dir, dnf4] + chroot_dnf_args + [f'--releasever={self.release_version}'] + self.custom_args + exclude_args + ['install'] + self.package_requests + self.collection_requests ) self.cleanup_requests() return Command.call(dnf_command, self.command_env) def process_delete_requests(self, force: bool = False) -> CommandCallT: """ Process package delete requests (chroot) :param bool force: force deletion: true|false :raises KiwiRequestError: if none of the packages to delete is installed. :return: process results in command type :rtype: namedtuple """ if force: delete_items = [] for delete_item in self.package_requests: try: Command.run( ['chroot', self.root_dir, 'rpm', '-q', delete_item] ) delete_items.append(delete_item) except Exception: # ignore packages which are not installed pass if not delete_items: raise KiwiRequestError( 'None of the requested packages to delete are installed' ) self.cleanup_requests() delete_options = ['--nodeps', '--allmatches', '--noscripts'] return Command.call( ['chroot', self.root_dir, 'rpm', '-e'] + delete_options + delete_items, self.command_env, ) else: dnf4 = self._get_dnf4_binary_name(self.root_dir) chroot_dnf_args = Path.move_to_root(self.root_dir, self.dnf_args) dnf_command = ( ['chroot', self.root_dir, dnf4] + chroot_dnf_args + [f'--releasever={self.release_version}'] + self.custom_args + ['autoremove'] + self.package_requests ) self.cleanup_requests() return Command.call(dnf_command, self.command_env) def update(self) -> CommandCallT: """ Process package update requests (chroot) :return: process results in command type :rtype: namedtuple """ dnf4 = self._get_dnf4_binary_name(self.root_dir) chroot_dnf_args = Path.move_to_root(self.root_dir, self.dnf_args) return Command.call( ['chroot', self.root_dir, dnf4] + chroot_dnf_args + [f'--releasever={self.release_version}'] + self.custom_args + ['upgrade'], self.command_env, ) def process_only_required(self) -> None: """ Setup package processing only for required packages """ if '--setopt=install_weak_deps=False' not in self.custom_args: self.custom_args.append('--setopt=install_weak_deps=False') def process_plus_recommended(self) -> None: """ Setup package processing to also include recommended dependencies. """ if '--setopt=install_weak_deps=False' in self.custom_args: self.custom_args.remove('--setopt=install_weak_deps=False') def match_package_installed( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been installed This match for the package to be installed in the output of the dnf command is not 100% accurate. There might be false positives due to sub package names starting with the same base package name :param str package_name: package_name :param str package_manager_output: dnf status line :returns: True|False :rtype: bool """ return bool( re.match( '.*Installing.*: {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def match_package_deleted( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been deleted :param str package_name: package_name :param str package_manager_output: dnf status line :returns: True|False :rtype: bool """ return bool( re.match( '.*Removing.*: {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def post_process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, delta_root: bool = False ) -> None: """ Move the rpm database to the place as it is expected by the rpm package installed during bootstrap phase :param object root_bind: unused :param bool delta_root: unused """ rpmdb = RpmDataBase(self.root_dir) if rpmdb.has_rpm(): rpmdb.rebuild_database() rpmdb.set_database_to_image_path() def clean_leftovers(self) -> None: """ Cleans package manager related data not needed in the resulting image such as custom macros """ Rpm( self.root_dir, Defaults.get_custom_rpm_image_macro_name() ).wipe_config() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7467964 kiwi-11.1.8/kiwi/package_manager/dnf5.py0000644000000000000000000003070415273675667014765 0ustar00# Copyright (c) 2023 Marcus Schäfer. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re from typing import List, Dict, Optional # project from kiwi.command import CommandCallT from kiwi.command import Command from kiwi.utils.rpm_database import RpmDataBase from kiwi.utils.rpm import Rpm from kiwi.package_manager.base import PackageManagerBase from kiwi.system.root_bind import RootBind from kiwi.path import Path from kiwi.defaults import Defaults from kiwi.exceptions import KiwiRequestError class PackageManagerDnf5(PackageManagerBase): """ ***Implements base class for installation/deletion of packages and collections using the next generation dnf5*** :param doct dnf_args: dnf arguments from repository runtime configuration :param dict command_env: dnf command environment from repository runtime configuration """ def post_init(self, custom_args: List = []) -> None: """ Post initialization method :param list custom_args: custom dnf arguments """ self.custom_args = custom_args runtime_config = self.repository.runtime_config() self.dnf_args = runtime_config['dnf_args'] self.command_env = runtime_config['command_env'] def request_package(self, name: str) -> None: """ Queue a package request :param str name: package name """ self.package_requests.append(name) def request_collection(self, name: str) -> None: """ Queue a collection request :param str name: dnf group ID name """ self.collection_requests.append(f'@{name}') def request_product(self, name: str) -> None: """ Queue a product request There is no product definition in the fedora repo data :param str name: unused """ pass def request_package_exclusion(self, name: str) -> None: """ Queue a package exclusion(skip) request :param str name: package name """ self.exclude_requests.append(name) def setup_repository_modules( self, collection_modules: Dict[str, List[str]] ) -> None: """ Setup repository modules and streams :param dict collection_modules: Expect dict of the form: .. code:: python { 'enable': [ "module:stream", "module" ], 'disable': [ "module" ] } """ dnf_module_command = ( ['dnf5'] + self.dnf_args + [ '--installroot', self.root_dir, f'--releasever={self.release_version}', ] + self.custom_args + ['module'] ) for disable_module in collection_modules['disable']: Command.run( dnf_module_command + ['disable', disable_module], self.command_env, ) for enable_module in collection_modules['enable']: Command.run( dnf_module_command + ['reset', enable_module.split(':')[0]], self.command_env, ) Command.run( dnf_module_command + ['enable', enable_module], self.command_env ) def process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, bootstrap_package: Optional[str] = None, ) -> CommandCallT: """ Process package install requests for bootstrap phase (no chroot) :param object root_bind: unused :param str bootstrap_package: unused :return: process results in command type :rtype: namedtuple """ exclude_args = [] if self.exclude_requests: # For DNF, excluding a package means removing it from # the solver operation. This is done by adding --exclude # to the command line. This means that if the package is # hard required by another package, it will break the transaction. for package in self.exclude_requests: exclude_args.append('--exclude=' + package) Command.run( ['dnf5'] + self.dnf_args + [f'--releasever={self.release_version}'] + ['makecache'], self.command_env, ) dnf_command = ( ['dnf5'] + self.dnf_args + [ '--installroot', self.root_dir, f'--releasever={self.release_version}', ] + self.custom_args + exclude_args + ['install'] + self.package_requests + self.collection_requests ) self.cleanup_requests() return Command.call(dnf_command, self.command_env) def process_install_requests(self) -> CommandCallT: """ Process package install requests for image phase (chroot) :return: process results in command type :rtype: namedtuple """ exclude_args = [] if self.exclude_requests: # For DNF, excluding a package means removing it from # the solver operation. This is done by adding --exclude # to the command line. This means that if the package is # hard required by another package, it will break the transaction. for package in self.exclude_requests: exclude_args.append('--exclude=' + package) chroot_dnf_args = Path.move_to_root(self.root_dir, self.dnf_args) dnf_command = ( ['chroot', self.root_dir, 'dnf5'] + chroot_dnf_args + [f'--releasever={self.release_version}'] + self.custom_args + exclude_args + ['install'] + self.package_requests + self.collection_requests ) self.cleanup_requests() return Command.call(dnf_command, self.command_env) def process_delete_requests(self, force: bool = False) -> CommandCallT: """ Process package delete requests (chroot) :param bool force: force deletion: true|false :raises KiwiRequestError: if none of the packages to delete is installed. :return: process results in command type :rtype: namedtuple """ if force: delete_items = [] for delete_item in self.package_requests: try: Command.run( ['chroot', self.root_dir, 'rpm', '-q', delete_item] ) delete_items.append(delete_item) except Exception: # ignore packages which are not installed pass if not delete_items: raise KiwiRequestError( 'None of the requested packages to delete are installed' ) self.cleanup_requests() delete_options = ['--nodeps', '--allmatches', '--noscripts'] return Command.call( ['chroot', self.root_dir, 'rpm', '-e'] + delete_options + delete_items, self.command_env, ) else: chroot_dnf_args = Path.move_to_root(self.root_dir, self.dnf_args) dnf_command = ( ['chroot', self.root_dir, 'dnf5'] + chroot_dnf_args + [ f'--releasever={self.release_version}', '--setopt=clean_requirements_on_remove=true', ] + self.custom_args + ['remove'] + self.package_requests ) self.cleanup_requests() return Command.call(dnf_command, self.command_env) def update(self) -> CommandCallT: """ Process package update requests (chroot) :return: process results in command type :rtype: namedtuple """ chroot_dnf_args = Path.move_to_root(self.root_dir, self.dnf_args) return Command.call( ['chroot', self.root_dir, 'dnf5'] + chroot_dnf_args + [f'--releasever={self.release_version}'] + self.custom_args + ['upgrade'], self.command_env, ) def process_only_required(self) -> None: """ Setup package processing only for required packages """ self.__clean_pattern_type() self.custom_args.append('--setopt=install_weak_deps=False') self.custom_args.append('--setopt=group_package_types=mandatory') def process_plus_recommended(self) -> None: """ Setup package processing to also include recommended dependencies. """ self.__clean_pattern_type() self.custom_args.append('--setopt=install_weak_deps=True') self.custom_args.append( '--setopt=group_package_types=default,mandatory,conditional' ) def match_package_installed( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been installed This match for the package to be installed in the output of the dnf command is not 100% accurate. There might be false positives due to sub package names starting with the same base package name :param str package_name: package_name :param str package_manager_output: dnf status line :returns: True|False :rtype: bool """ return bool( re.match( '.*Installing.* {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def match_package_deleted( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been deleted :param str package_name: package_name :param str package_manager_output: dnf status line :returns: True|False :rtype: bool """ return bool( re.match( '.*Removing.* {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def post_process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, delta_root: bool = False ) -> None: """ Move the rpm database to the place as it is expected by the rpm package installed during bootstrap phase :param object root_bind: unused :param bool delta_root: unused """ rpmdb = RpmDataBase(self.root_dir) if rpmdb.has_rpm(): rpmdb.rebuild_database() rpmdb.set_database_to_image_path() def clean_leftovers(self) -> None: """ Cleans package manager related data not needed in the resulting image such as custom macros """ Rpm( self.root_dir, Defaults.get_custom_rpm_image_macro_name() ).wipe_config() def __clean_pattern_type(self) -> None: """ Setup package processing only for required packages """ if '--setopt=install_weak_deps=True' in self.custom_args: self.custom_args.remove('--setopt=install_weak_deps=True') if '--setopt=install_weak_deps=False' in self.custom_args: self.custom_args.remove('--setopt=install_weak_deps=False') if ( '--setopt=group_package_types=default,mandatory,conditional' in self.custom_args ): self.custom_args.remove( '--setopt=group_package_types=default,mandatory,conditional' ) if '--setopt=group_package_types=mandatory' in self.custom_args: self.custom_args.remove('--setopt=group_package_types=mandatory') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7467964 kiwi-11.1.8/kiwi/package_manager/microdnf.py0000644000000000000000000002753215273675667015737 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re import logging from typing import List, Dict, Optional # project from kiwi.command import CommandCallT from kiwi.command import Command from kiwi.utils.rpm_database import RpmDataBase from kiwi.utils.rpm import Rpm from kiwi.package_manager.base import PackageManagerBase from kiwi.system.root_bind import RootBind from kiwi.path import Path from kiwi.defaults import Defaults from kiwi.repository.dnf4 import RepositoryDnf4 from kiwi.exceptions import KiwiRequestError log = logging.getLogger('kiwi') class PackageManagerMicroDnf(PackageManagerBase): """ **Implements Installation/Deletion of packages/collections with microdnf*** :param doct dnf_args: microdnf arguments from repository runtime configuration :param dict command_env: microdnf command environment from repository runtime configuration """ def post_init(self, custom_args: List = []) -> None: """ Post initialization method :param list custom_args: custom microdnf arguments """ self.repository: RepositoryDnf4 = self.repository self.custom_args = custom_args runtime_config = self.repository.runtime_config() self.dnf_args = runtime_config['dnf_args'] self.command_env = runtime_config['command_env'] def request_package(self, name: str) -> None: """ Queue a package request :param str name: package name """ self.package_requests.append(name) def request_collection(self, name: str) -> None: """ Queue a collection request :param str name: dnf group name """ log.warning('Group(%s) handling not yet supported for microdnf', name) def request_product(self, name: str) -> None: """ Queue a product request There is no product definition in the fedora repo data :param str name: unused """ pass def request_package_exclusion(self, name: str) -> None: """ Queue a package exclusion(skip) request :param str name: package name """ self.exclude_requests.append(name) def setup_repository_modules( self, collection_modules: Dict[str, List[str]] ) -> None: """ Setup repository modules and streams :param dict collection_modules: Expect dict of the form: .. code:: python { 'enable': [ "module:stream", "module" ], 'disable': [ "module" ] } """ microdnf_module_command = ( ['microdnf'] + ['--refresh'] + self.dnf_args + [ '--installroot', self.root_dir, f'--releasever={self.release_version}', '--noplugins', '--setopt=cachedir={0}'.format( self.repository.shared_dnf_dir['cache-dir'] ), '--setopt=reposdir={0}'.format( self.repository.shared_dnf_dir['reposd-dir'] ), '--setopt=varsdir={0}'.format( self.repository.shared_dnf_dir['vars-dir'] ), ] + self.custom_args + ['module'] ) for disable_module in collection_modules['disable']: Command.run( microdnf_module_command + ['disable', disable_module], self.command_env, ) for enable_module in collection_modules['enable']: Command.run( microdnf_module_command + ['reset', enable_module.split(':')[0]], self.command_env, ) Command.run( microdnf_module_command + ['enable', enable_module], self.command_env, ) def process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, bootstrap_package: Optional[str] = None, ) -> CommandCallT: """ Process package install requests for bootstrap phase (no chroot) :param object root_bind: unused :param str bootstrap_package: unused :return: process results in command type :rtype: namedtuple """ microdnf_command = ( ['microdnf'] + ['--refresh'] + self.dnf_args + [ '--installroot', self.root_dir, f'--releasever={self.release_version}', '--noplugins', '--setopt=cachedir={0}'.format( self.repository.shared_dnf_dir['cache-dir'] ), '--setopt=reposdir={0}'.format( self.repository.shared_dnf_dir['reposd-dir'] ), '--setopt=varsdir={0}'.format( self.repository.shared_dnf_dir['vars-dir'] ), ] + self.custom_args + ['install'] + self.package_requests ) self.cleanup_requests() return Command.call(microdnf_command, self.command_env) def process_install_requests(self) -> CommandCallT: """ Process package install requests for image phase (chroot) :return: process results in command type :rtype: namedtuple """ exclude_args = [] if self.exclude_requests: # For DNF, excluding a package means removing it from # the solver operation. This is done by adding --exclude # to the command line. This means that if the package is # hard required by another package, it will break the transaction. for package in self.exclude_requests: exclude_args.append('--exclude=' + package) chroot_dnf_args = Path.move_to_root(self.root_dir, self.dnf_args) microdnf_command = ( ['chroot', self.root_dir, 'microdnf'] + chroot_dnf_args + [f'--releasever={self.release_version}'] + self.custom_args + exclude_args + ['install'] + self.package_requests ) self.cleanup_requests() return Command.call(microdnf_command, self.command_env) def process_delete_requests(self, force: bool = False) -> CommandCallT: """ Process package delete requests (chroot) :param bool force: force deletion: true|false :raises KiwiRequestError: if none of the packages to delete is installed. :return: process results in command type :rtype: namedtuple """ if force: delete_items = [] for delete_item in self.package_requests: try: Command.run( ['chroot', self.root_dir, 'rpm', '-q', delete_item] ) delete_items.append(delete_item) except Exception: # ignore packages which are not installed pass if not delete_items: raise KiwiRequestError( 'None of the requested packages to delete are installed' ) self.cleanup_requests() delete_options = ['--nodeps', '--allmatches', '--noscripts'] return Command.call( ['chroot', self.root_dir, 'rpm', '-e'] + delete_options + delete_items, self.command_env, ) else: chroot_dnf_args = Path.move_to_root(self.root_dir, self.dnf_args) dnf_command = ( ['chroot', self.root_dir, 'microdnf'] + chroot_dnf_args + [f'--releasever={self.release_version}'] + self.custom_args + ['remove'] + self.package_requests ) self.cleanup_requests() return Command.call(dnf_command, self.command_env) def update(self) -> CommandCallT: """ Process package update requests (chroot) :return: process results in command type :rtype: namedtuple """ chroot_dnf_args = Path.move_to_root(self.root_dir, self.dnf_args) return Command.call( ['chroot', self.root_dir, 'microdnf'] + chroot_dnf_args + [f'--releasever={self.release_version}'] + self.custom_args + ['upgrade'], self.command_env, ) def process_only_required(self) -> None: """ Setup package processing only for required packages """ if '--setopt=install_weak_deps=0' not in self.custom_args: self.custom_args.append('--setopt=install_weak_deps=0') def process_plus_recommended(self) -> None: """ Setup package processing to also include recommended dependencies. """ if '--setopt=install_weak_deps=0' in self.custom_args: self.custom_args.remove('--setopt=install_weak_deps=0') def match_package_installed( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been installed This match for the package to be installed in the output of the microdnf command is not 100% accurate. There might be false positives due to sub package names starting with the same base package name :param str package_name: package_name :param str package_manager_output: microdnf status line :returns: True|False :rtype: bool """ return bool( re.match( '.*Installing : {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def match_package_deleted( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been deleted :param str package_name: package_name :param str package_manager_output: microdnf status line :returns: True|False :rtype: bool """ return bool( re.match( '.*Removing: {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def post_process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, delta_root: bool = False ) -> None: """ Move the rpm database to the place as it is expected by the rpm package installed during bootstrap phase :param object root_bind: unused :param bool delta_root: unused """ rpmdb = RpmDataBase(self.root_dir) if rpmdb.has_rpm(): rpmdb.rebuild_database() rpmdb.set_database_to_image_path() def clean_leftovers(self) -> None: """ Cleans package manager related data not needed in the resulting image such as custom macros """ Rpm( self.root_dir, Defaults.get_custom_rpm_image_macro_name() ).wipe_config() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7467964 kiwi-11.1.8/kiwi/package_manager/pacman.py0000644000000000000000000002047715273675667015376 0ustar00# Copyright (c) 2019 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re import logging from typing import List, Dict, Optional # project from kiwi.command import CommandCallT from kiwi.command import Command from kiwi.package_manager.base import PackageManagerBase from kiwi.system.root_bind import RootBind from kiwi.exceptions import KiwiRequestError from kiwi.path import Path log = logging.getLogger('kiwi') class PackageManagerPacman(PackageManagerBase): """ **Implements Installation/Deletion of packages/collections with pacman** :param list pacman_args: pacman arguments from repository runtime configuration :param dict command_env: pacman command environment from repository runtime configuration """ def post_init(self, custom_args: Optional[List[str]] = None) -> None: """ Post initialization method Store custom pacman arguments :param list custom_args: custom pacman arguments """ self.custom_args: List[str] = custom_args or [] runtime_config = self.repository.runtime_config() self.pacman_args = runtime_config['pacman_args'] self.command_env = runtime_config['command_env'] def request_package(self, name: str) -> None: """ Queue a package request :param str name: package name """ self.package_requests.append(name) def request_collection(self, name: str) -> None: """ Queue a collection request Pacman does not distinguish the installation of pacakges and collections. Because of that collections are listed together with package requests and a warning message is shown. :param str name: pacman group name """ log.warning( ( 'Pacman treats collection installations as regular packages.' 'It is preferred to list them as regular packages' ) ) self.package_requests.append(name) def request_product(self, name: str) -> None: """ Queue a product request There is no product definition in the Arch Linux repo data :param str name: unused """ pass def request_package_exclusion(self, name: str) -> None: """ Queue a package exclusion(skip) request :param str name: package name """ self.exclude_requests.append(name) def setup_repository_modules( self, collection_modules: Dict[str, List[str]] ) -> None: """ Repository modules not supported for pacman. The method does nothing in this scope :param dict collection_modules: unused """ pass def process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, bootstrap_package: Optional[str] = None, ) -> CommandCallT: """ Process package install requests for bootstrap phase (no chroot) :param object root_bind: unused :param str bootstrap_package: unused :return: process results in command type :rtype: namedtuple """ Command.run( ['pacman'] + self.pacman_args + ['--root', self.root_dir, '-Sy'], self.command_env, ) pacman_command = ( ['pacman'] + self.pacman_args + ['--root', self.root_dir] + self.custom_args + [ '-S', '--needed', '--overwrite', '{}/var/run'.format(self.root_dir), ] + self.package_requests ) self.cleanup_requests() return Command.call(pacman_command, self.command_env) def process_install_requests(self) -> CommandCallT: """ Process package install requests for image phase (chroot) :return: process results in command type :rtype: namedtuple """ chroot_pacman_args = Path.move_to_root(self.root_dir, self.pacman_args) pacman_command = ( ['chroot', self.root_dir, 'pacman'] + chroot_pacman_args + self.custom_args + ['-S', '--needed'] + self.package_requests ) self.cleanup_requests() return Command.call(pacman_command, self.command_env) def process_delete_requests(self, force: bool = False) -> CommandCallT: """ Process package delete requests (chroot) :param bool force: force deletion: true|false :raises KiwiRequestError: if none of the packages to delete is installed :return: process results in command type :rtype: namedtuple """ delete_items = [] for delete_item in self.package_requests: try: Command.run( ['chroot', self.root_dir, 'pacman', '-Qi', delete_item] ) delete_items.append(delete_item) except Exception: # ignore packages which are not installed pass if not delete_items: raise KiwiRequestError( 'None of the requested packages to delete are installed' ) self.cleanup_requests() chroot_pacman_args = Path.move_to_root(self.root_dir, self.pacman_args) return Command.call( ['chroot', self.root_dir, 'pacman'] + chroot_pacman_args + self.custom_args + ['-Rdd' if force else '-Rs'] + delete_items, self.command_env, ) def update(self) -> CommandCallT: """ Process package update requests (chroot) :return: process results in command type :rtype: namedtuple """ chroot_pacman_args = Path.move_to_root(self.root_dir, self.pacman_args) return Command.call( ['chroot', self.root_dir, 'pacman'] + chroot_pacman_args + self.custom_args + ['-Su'], self.command_env, ) def process_only_required(self) -> None: """ Setup package processing only for required packages. This is the only option in pacman, nothing to do here. """ pass def process_plus_recommended(self) -> None: """ Setup package processing to also include recommended dependencies. There is no such concept of recommended dependencies in pacman. """ pass def match_package_installed( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been installed This match for the package to be installed in the output of the pacman command is not 100% accurate. There might be false positives due to sub package names starting with the same base package name :param str package_name: package_name :param str package_manager_output: dnf status line :returns: True|False :rtype: bool """ return bool( re.match( '.* installing {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def match_package_deleted( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been deleted :param str package_name: package_name :param str package_manager_output: pacman status line :returns: True|False :rtype: bool """ return bool( re.match( '.* removing {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7467964 kiwi-11.1.8/kiwi/package_manager/zypper.py0000644000000000000000000003000715273675667015456 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re import os from typing import List, Dict, Optional # project from kiwi.command import CommandCallT from kiwi.command import Command from kiwi.package_manager.base import PackageManagerBase from kiwi.system.root_bind import RootBind from kiwi.utils.rpm_database import RpmDataBase from kiwi.utils.rpm import Rpm from kiwi.path import Path from kiwi.exceptions import KiwiRequestError from kiwi.defaults import Defaults class PackageManagerZypper(PackageManagerBase): """ **Implements Installation/Deletion of packages/collections with zypper** :param list zypper_args: zypper arguments from repository runtime configuration :param dict command_env: zypper command environment from repository runtime configuration """ def post_init(self, custom_args: List = []) -> None: """ Post initialization method Store custom zypper arguments :param list custom_args: custom zypper arguments """ self.anonymousId_file = '/var/lib/zypp/AnonymousUniqueId' self.custom_args = custom_args runtime_config = self.repository.runtime_config() self.zypper_args = runtime_config['zypper_args'] self.chroot_zypper_args = Path.move_to_root( self.root_dir, self.zypper_args ) self.command_env = runtime_config['command_env'] self.chroot_command_env = dict(self.command_env) if 'ZYPP_CONF' in self.command_env: self.chroot_command_env['ZYPP_CONF'] = Path.move_to_root( self.root_dir, [self.command_env['ZYPP_CONF']] )[0] def request_package(self, name: str) -> None: """ Queue a package request :param str name: package name """ self.package_requests.append(name) def request_collection(self, name: str) -> None: """ Queue a collection request :param str name: zypper pattern name """ self.collection_requests.append('pattern:' + name) def request_product(self, name: str) -> None: """ Queue a product request :param str name: zypper product name """ self.product_requests.append('product:' + name) def request_package_exclusion(self, name: str) -> None: """ Queue a package exclusion(skip) request :param str name: package name """ self.exclude_requests.append(name) def setup_repository_modules( self, collection_modules: Dict[str, List[str]] ) -> None: """ Repository modules not supported for zypper. The method does nothing in this scope :param dict collection_modules: unused """ pass def process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, bootstrap_package: Optional[str] = None, ) -> CommandCallT: """ Process package install requests for bootstrap phase (no chroot) :param object root_bind: unused :param str bootstrap_package: unused :return: process results in command type :rtype: namedtuple """ command = ( ['zypper'] + self.zypper_args + [ '--root', self.root_dir, 'install', '--download', 'in-advance', '--auto-agree-with-licenses', ] + self.custom_args + ['--'] + self._install_items() ) return Command.call(command, self.command_env) def process_install_requests(self) -> CommandCallT: """ Process package install requests for image phase (chroot) :return: process results in command type :rtype: namedtuple """ if self.exclude_requests: # For zypper excluding a package means, removing it from # the solver operation. This is done by adding a package # lock. This means that if the package is hard required # by another package, it will break the transaction. metadata_dir = ''.join([self.root_dir, '/etc/zypp']) if not os.path.exists(metadata_dir): Path.create(metadata_dir) for package in self.exclude_requests: Command.run( ['chroot', self.root_dir, 'zypper'] + self.chroot_zypper_args + ['al'] + [package], self.chroot_command_env, ) return Command.call( ['chroot', self.root_dir, 'zypper'] + self.chroot_zypper_args + [ 'install', '--download', 'in-advance', '--auto-agree-with-licenses', ] + self.custom_args + ['--'] + self._install_items(), self.chroot_command_env, ) def process_delete_requests(self, force: bool = False) -> CommandCallT: """ Process package delete requests (chroot) :param bool force: force deletion: true|false :raises KiwiRequestError: if none of the packages to delete is installed :return: process results in command type :rtype: namedtuple """ if force: delete_items = [] for delete_item in self._delete_items(): try: Command.run( ['chroot', self.root_dir, 'rpm', '-q', delete_item] ) delete_items.append(delete_item) except Exception: # ignore packages which are not installed pass if not delete_items: raise KiwiRequestError( 'None of the requested packages to delete are installed' ) self.cleanup_requests() force_options = ['--nodeps', '--allmatches', '--noscripts'] return Command.call( ['chroot', self.root_dir, 'rpm', '-e'] + force_options + delete_items, self.chroot_command_env, ) else: zypper_command = ( ['chroot', self.root_dir, 'zypper'] + self.chroot_zypper_args + ['remove', '-u', '--force-resolution'] + self._delete_items() ) self.cleanup_requests() return Command.call(zypper_command, self.chroot_command_env) def update(self) -> CommandCallT: """ Process package update requests (chroot) :return: process results in command type :rtype: namedtuple """ return Command.call( ['chroot', self.root_dir, 'zypper'] + self.chroot_zypper_args + [ 'update', '--download', 'in-advance', '--auto-agree-with-licenses', ] + self.custom_args, self.chroot_command_env, ) def process_only_required(self) -> None: """ Setup package processing only for required packages """ if '--no-recommends' not in self.custom_args: self.custom_args.append('--no-recommends') def process_plus_recommended(self) -> None: """ Setup package processing to also include recommended dependencies. """ if '--no-recommends' in self.custom_args: self.custom_args.remove('--no-recommends') def match_package_installed( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been installed This match for the package to be installed in the output of the zypper command is not 100% accurate. There might be false positives due to sub package names starting with the same base package name :param str package_name: package_name :param str package_manager_output: zypper status line :returns: True|False :rtype: bool """ return bool( re.match( '.*Installing: {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def match_package_deleted( self, package_name: str, package_manager_output: str ) -> bool: """ Match expression to indicate a package has been deleted :param str package_name: package_name :param str package_manager_output: zypper status line :returns: True|False :rtype: bool """ return bool( re.match( '.*Removing: {0}.*'.format(re.escape(package_name)), package_manager_output, ) ) def post_process_install_requests_bootstrap( self, root_bind: Optional[RootBind] = None, delta_root: bool = False ) -> None: """ Move the rpm database to the place as it is expected by the rpm package installed during bootstrap phase :param object root_bind: unused :param bool delta_root: unused """ rpmdb = RpmDataBase(self.root_dir) if rpmdb.has_rpm(): rpmdb.rebuild_database() rpmdb.set_database_to_image_path() @staticmethod def has_failed(returncode: int) -> bool: """ Evaluate given result return code In zypper any return code == 0 or >= 100 is considered success. Any return code different from 0 and < 100 is treated as an error we care for. Return codes >= 100 indicates an issue like 'new kernel needs reboot of the system' or similar which we don't care in the scope of image building :param int returncode: return code number :return: True|False :rtype: boolean """ error_codes = [ 104, # - ZYPPER_EXIT_INF_CAP_NOT_FOUND 105, # - ZYPPER_EXIT_ON_SIGNAL 106, # - ZYPPER_EXIT_INF_REPOS_SKIPPED 127, # - Command Not Found ] if returncode == 0: # All is good return False elif returncode in error_codes: # Treat matching exit code as error return True elif returncode >= 100: # Treat all other 100 codes as non error codes return False # Treat any other error code as error return True def clean_leftovers(self) -> None: """ Cleans package manager related data not needed in the resulting image such as custom macros """ Rpm( self.root_dir, Defaults.get_custom_rpm_image_macro_name() ).wipe_config() id_file = os.path.normpath( os.sep.join([self.root_dir, self.anonymousId_file]) ) if os.path.exists(id_file): os.unlink(id_file) def _install_items(self) -> List: items = ( self.package_requests + self.collection_requests + self.product_requests ) self.cleanup_requests() return items def _delete_items(self) -> List: # collections and products can't be deleted items = [] items += self.package_requests self.cleanup_requests() return items ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7467964 kiwi-11.1.8/kiwi/partitioner/__init__.py0000644000000000000000000000465415273675667015150 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from typing import TYPE_CHECKING, Optional from abc import ABCMeta, abstractmethod import logging # project from kiwi.exceptions import KiwiPartitionerSetupError if TYPE_CHECKING: # pragma: nocover from kiwi.partitioner.base import PartitionerBase log = logging.getLogger('kiwi') class Partitioner(metaclass=ABCMeta): """ **Partitioner factory** :param string table_type: Table type name :param object storage_provider: Instance of class based on DeviceProvider :param int start_sector: sector number :param bool extended_layout: support extended layout for msdos table """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( table_type: str, storage_provider: object, start_sector: Optional[int] = None, extended_layout: bool = False, ) -> 'PartitionerBase': name_map = {'msdos': 'MsDos', 'gpt': 'Gpt', 'dasd': 'Dasd'} try: partitioner = importlib.import_module( 'kiwi.partitioner.{0}'.format(table_type) ) module_name = 'Partitioner{0}'.format(name_map[table_type]) if table_type == 'dasd' and start_sector: log.warning( 'disk start_sector value is ignored for dasd partitions' ) start_sector = None return partitioner.__dict__[module_name]( storage_provider, start_sector, extended_layout ) except Exception as issue: raise KiwiPartitionerSetupError( 'Support for {0} partitioner not implemented: {1}'.format( table_type, issue ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7472916 kiwi-11.1.8/kiwi/partitioner/base.py0000644000000000000000000001032515273675667014313 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import List, Dict, Union, Optional # project from kiwi.storage.device_provider import DeviceProvider class PartitionerBase: """ **Base class for partitioners** """ def __init__( self, disk_provider: DeviceProvider, start_sector: Optional[int] = None, extended_layout: bool = False, ) -> None: """ Base class constructor for partitioners :param object disk_provider: Instance of DeviceProvider :param int start_sector: sector number :param bool extended_layout: If set to true and on msdos table type when creating more than 4 partitions, this will cause the fourth partition to be an extended partition and all following partitions will be placed as logical partitions inside of that extended partition """ self.disk_device = disk_provider.get_device() self.partition_id = 0 self.partition_count = 0 self.start_sector = start_sector self.extended_layout = extended_layout self.flag_map: Dict[str, Union[bool, str, None]] = {} self.post_init() def post_init(self) -> None: """ Post initialization method Implementation in specialized partitioner class """ pass def get_id(self) -> int: """ Current partition number Zero indicates no partition has been created so far :return: partition number :rtype: int """ return self.partition_id def create( self, name: str, mbsize: Union[int, str], type_name: str, flags: List[str] = [], partition_id: Optional[int] = None, ) -> None: """ Create partition Implementation in specialized partitioner class :param string name: unused :param int mbsize: unused :param string type_name: unused :param list flags: unused :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. """ raise NotImplementedError def set_flag(self, partition_id: Union[int, str], flag_name: str) -> None: """ Set partition flag Implementation in specialized partitioner class :param int partition_id: unused :param string flag_name: unused """ raise NotImplementedError def set_uuid(self, partition_id: Union[int, str], uuid: str) -> None: """ Set partition UUID Implementation in specialized partitioner class :param int partition_id: unused :param string uuid: unused """ raise NotImplementedError def set_hybrid_mbr(self) -> None: """ Turn partition table into hybrid table if supported Implementation in specialized partitioner class """ raise NotImplementedError def set_mbr(self) -> None: """ Turn partition table into MBR (msdos table) Implementation in specialized partitioner class """ raise NotImplementedError def set_start_sector(self, start_sector: int) -> None: """ Set start sector of first partition as configured :param int start_sector: unused Does nothing by default """ pass def resize_table(self, entries: int = 0) -> None: """ Resize partition table :param int entries: unused """ raise NotImplementedError ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7472916 kiwi-11.1.8/kiwi/partitioner/dasd.py0000644000000000000000000000713715273675667014323 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging from typing import List, Optional, Union # project from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.partitioner.base import PartitionerBase log = logging.getLogger('kiwi') class PartitionerDasd(PartitionerBase): """ **Implements DASD partition setup** """ def post_init(self) -> None: """ Post initialization method Setup fdasd partition type/flag map """ self.flag_map = { 'f.active': None, 't.linux': '1', 't.swap': '1', 't.lvm': '1', 't.raid': '1', 't.efi': None, 't.csm': None, } def create( self, name: str, mbsize: Union[int, str], type_name: str, flags: Optional[List[str]] = None, partition_id: Optional[int] = None, ) -> None: """ Create DASD partition :param string name: partition name :param int mbsize: partition size :param string type_name: unused :param list flags: unused :param int partition_id: unused """ self.partition_id += 1 fdasd_input = Temporary().new_file() with open(fdasd_input.name, 'w') as partition: log.debug( '%s: fdasd: n p cur_position +%sM w q', name, format(mbsize) ) if mbsize == 'all_free': partition.write('n\np\n\n\nw\nq\n') else: partition.write(f'n\np\n\n+{mbsize}M\nw\nq\n') bash_command = ' '.join( ['cat', fdasd_input.name, '|', 'fdasd', '-f', self.disk_device] ) try: Command.run(['bash', '-c', bash_command]) except Exception: # unfortunately fdasd reports that it can't read in the partition # table which I consider a bug in fdasd. However the table was # correctly created and therefore we continue. Problem is that we # are not able to detect real errors with the fdasd operation at # that point. log.debug('potential fdasd errors were ignored') def set_uuid(self, partition_id: Union[int, str], uuid: str) -> None: """ Set partition UUID Nothing to be done here for DASD devices :param int partition_id: unused :param string uuid: unused """ pass # pragma: nocover def set_flag(self, partition_id: Union[int, str], flag_name: str) -> None: """ Set partition flag Nothing to be done here for DASD devices :param int partition_id: unused :param string flag_name: unused """ pass # pragma: nocover def resize_table(self, entries: Optional[int] = None) -> None: """ Resize partition table Nothing to be done here for DASD devices :param int entries: unused """ pass ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7472916 kiwi-11.1.8/kiwi/partitioner/gpt.py0000644000000000000000000001503315273675667014174 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging from typing import List, Optional, Union # project from kiwi.command import Command from kiwi.partitioner.base import PartitionerBase from kiwi.exceptions import KiwiPartitionerGptFlagError log = logging.getLogger('kiwi') class PartitionerGpt(PartitionerBase): """ **Implements GPT partition setup** """ def post_init(self) -> None: """ Post initialization method Setup gdisk partition type/flag map """ self.flag_map = { 'f.active': None, 't.csm': 'EF02', 't.linux': '8300', 't.swap': '8200', 't.lvm': '8E00', 't.raid': 'FD00', 't.efi': 'EF00', 't.prep': '4100', } self.partition_map: dict[int, int] = {} def create( self, name: str, mbsize: Union[int, str], type_name: str, flags: Optional[List[str]] = None, partition_id: Optional[int] = None, ) -> None: """ Create GPT partition :param string name: partition name :param int mbsize: partition size :param string type_name: partition type :param list flags: additional flags :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing """ self.partition_id = ( partition_id if partition_id else self.partition_id + 1 ) self.partition_count += 1 self.partition_map[self.partition_count] = self.partition_id if mbsize == 'all_free': partition_end = '0' else: partition_end = '+' + format(mbsize) + 'M' if self.partition_count > 1 or not self.start_sector: # A start sector value of 0 specifies the default value # defined in sgdisk self.start_sector = 0 Command.run( [ 'sgdisk', '--align-end', '-n', ':'.join( [ format(self.partition_id), format(self.start_sector), partition_end, ] ), '-c', ':'.join([format(self.partition_id), name]), self.disk_device, ] ) self.set_flag(self.partition_id, type_name) if flags: for flag_name in flags: self.set_flag(self.partition_id, flag_name) def set_flag(self, partition_id: Union[int, str], flag_name: str) -> None: """ Set GPT partition flag :param int partition_id: partition number :param string flag_name: name from flag map """ if flag_name not in self.flag_map: raise KiwiPartitionerGptFlagError( f'Unknown partition flag {flag_name}' ) if self.flag_map[flag_name]: Command.run( [ 'sgdisk', '-t', ':'.join( [format(partition_id), format(self.flag_map[flag_name])] ), self.disk_device, ] ) else: log.warning('Flag %s ignored on GPT', flag_name) def set_uuid(self, partition_id: Union[int, str], uuid: str) -> None: """ Set partition UUID (TypeCode) :param int partition_id: partition number :param string uuid: UUID """ Command.run( ['sgdisk', '--typecode', f'{partition_id}:{uuid}', self.disk_device] ) def set_hybrid_mbr(self) -> None: """ Turn partition table into hybrid GPT/MBR table """ partition_ids = [] partition_number_to_embed = self.partition_count if partition_number_to_embed > 3: # the max number of partitions to embed is 3 # for details see man sgdisk log.debug( 'maximum number of GPT hybrid MBR partitions is 3, got %d', partition_number_to_embed, ) partition_number_to_embed = 3 log.debug( 'reduced GPT hybrid MBR partition count to %d', partition_number_to_embed, ) for number in range(1, partition_number_to_embed + 1): if self.partition_map.get(number): partition_ids.append(format(self.partition_map[number])) Command.run(['sgdisk', '-h', ':'.join(partition_ids), self.disk_device]) def set_mbr(self) -> None: """ Turn partition table into MBR (msdos table) """ partition_ids = [] efi_partition_number = None for number in range(1, self.partition_id + 1): if self.partition_map.get(number): partition_info = Command.run( [ 'sgdisk', '-i={0}'.format(self.partition_map[number]), self.disk_device, ] ) if '(EFI System)' in partition_info.output: efi_partition_number = self.partition_map[number] partition_ids.append(format(self.partition_map[number])) if efi_partition_number: # turn former EFI partition into standard linux partition self.set_flag(efi_partition_number, 't.linux') Command.run(['sgdisk', '-m', ':'.join(partition_ids), self.disk_device]) def resize_table(self, entries: int = 128) -> None: """ Resize partition table :param int entries: number of default entries """ Command.run( [ 'sgdisk', '--resize-table', '{0}'.format(entries), self.disk_device, ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7472916 kiwi-11.1.8/kiwi/partitioner/msdos.py0000644000000000000000000002406415273675667014533 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging from typing import List, Optional, Union # project from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.partitioner.base import PartitionerBase from kiwi.utils.block import BlockID from kiwi.exceptions import KiwiPartitionerMsDosFlagError log = logging.getLogger('kiwi') class PartitionerMsDos(PartitionerBase): """ **Implement old style msdos partition setup** """ def post_init(self) -> None: """ Post initialization method Setup sfdisk partition type/flag map """ self.default_start = 2048 self.sector_size = 512 self.flag_map = { 'f.active': True, 't.linux': '83', 't.swap': '82', 't.lvm': '8e', 't.raid': 'fd', 't.efi': None, 't.csm': None, 't.prep': '41', 't.extended': '5', } def create( self, name: str, mbsize: Union[int, str], type_name: str, flags: List[str] = [], partition_id: Optional[int] = None, ) -> None: """ Create msdos partition :param string name: partition name :param int mbsize: partition size :param string type_name: partition type :param list flags: additional flags :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. """ if self.extended_layout: if self.partition_count < 3: # in primary boundary self._create_primary( name, mbsize, type_name, flags, partition_id ) elif self.partition_count == 3: # at primary boundary, create extended + logical self._create_extended(name) self._create_logical( name, mbsize, type_name, flags, partition_id ) elif self.partition_count > 3: # in logical boundary self._create_logical( name, mbsize, type_name, flags, partition_id ) else: self._create_primary(name, mbsize, type_name, flags, partition_id) def set_flag(self, partition_id: Union[int, str], flag_name: str) -> None: """ Set msdos partition flag :param int partition_id: partition number :param string flag_name: name from flag map """ partition_id = partition_id if partition_id else self.partition_id if flag_name not in self.flag_map: raise KiwiPartitionerMsDosFlagError( f'Unknown partition flag {flag_name}' ) flag_val = self.flag_map[flag_name] if flag_val: if flag_name == 'f.active': Command.run( [ 'sfdisk', '--activate', self.disk_device, format(partition_id), ] ) elif isinstance(flag_val, str): Command.run( [ 'sfdisk', '-c', self.disk_device, format(partition_id), flag_val, ] ) else: log.warning('Flag %s ignored on msdos', flag_name) def resize_table(self, entries: Optional[int] = None) -> None: """ Resize partition table Nothing to be done here for msdos table :param int entries: unused """ pass def set_uuid(self, partition_id: Union[int, str], uuid: str) -> None: """ Set partition UUID Nothing to be done here for MSDOS devices :param int partition_id: unused :param string uuid: unused """ pass # pragma: nocover def set_start_sector(self, start_sector: int) -> None: """ Set start sector of first partition as configured. fdisk and friends are not able to work correctly if the start sector of the first partition is any different from 2048. :param int start_sector: sector size """ block_operation = BlockID(self.disk_device) fdisk_input = Temporary().new_file() with open(fdisk_input.name, 'w') as partition: if block_operation.get_partition_count() >= 4: # if the partition table is full fdisk does not ask # for the partition number when there is only one choice log.debug(f'fdisk: d 1 n p {start_sector} w q') partition.write( 'd\n1\nn\np\n{0}\n\nw\nq\n'.format(start_sector) ) else: # if the partition table has less than 4 partitions # fdisk will ask for the partition number to change log.debug(f'fdisk: d 1 n p 1 {start_sector} w q') partition.write( 'd\n1\nn\np\n1\n{0}\n\nw\nq\n'.format(start_sector) ) self._call_fdisk(fdisk_input.name) def _create_primary( self, name: str, mbsize: Union[int, str], type_name: str, flags: List[str] = [], partition_id: Optional[int] = None, ) -> None: """ Create primary msdos partition """ self.partition_id = ( partition_id if partition_id else self.partition_id + 1 ) self.partition_count += 1 fdisk_input = Temporary().new_file() if self.partition_id == 1 and self.start_sector: if self.start_sector > self.default_start and mbsize != 'all_free': # fdisk default start sector is self.default_start, increase # the partition size such that after set_start_sector() # the requested partition size is present. The size # can also be given as numeric string, e.g for clones mbsize = int(mbsize) + int( (self.start_sector - self.default_start) * self.sector_size / (1024 * 1024) ) with open(fdisk_input.name, 'w') as partition: log.debug( '%s: fdisk: n p %d cur_position +%sM w q', name, self.partition_id, format(mbsize), ) partition.write( 'n\np\n{0}\n\n{1}\nw\nq\n'.format( self.partition_id, '' if mbsize == 'all_free' else '+{0}M'.format(mbsize), ) ) self._call_fdisk(fdisk_input.name) self._set_all_flags(type_name, flags) def _create_extended( self, name: str, partition_id: Optional[int] = None ) -> None: """ Create extended msdos partition """ self.partition_id = ( partition_id if partition_id else self.partition_id + 1 ) self.partition_count += 1 fdisk_input = Temporary().new_file() with open(fdisk_input.name, 'w') as partition: log.debug( '%s: fdisk: n e %d cur_position +all_freeM w q', name, self.partition_id, ) partition.write( 'n\ne\n{0}\n{1}\n{2}\nw\nq\n'.format(self.partition_id, '', '') ) self._call_fdisk(fdisk_input.name) def _create_logical( self, name: str, mbsize: Union[int, str], type_name: str, flags: List[str] = [], partition_id: Optional[int] = None, ) -> None: """ Create logical msdos partition """ self.partition_id = ( partition_id if partition_id else self.partition_id + 1 ) self.partition_count += 1 fdisk_input = Temporary().new_file() with open(fdisk_input.name, 'w') as partition: log.debug( '%s: fdisk: n %d cur_position +%sM w q', name, self.partition_id, format(mbsize), ) partition.write( 'n\n{0}\n{1}\n{2}\nw\nq\n'.format( self.partition_id, '', '' if mbsize == 'all_free' else '+{0}M'.format(mbsize), ) ) self._call_fdisk(fdisk_input.name) self._set_all_flags(type_name, flags) def _set_all_flags(self, type_name: str, flags: List[str]) -> None: self.set_flag(self.partition_id, type_name) if flags: for flag_name in flags: self.set_flag(self.partition_id, flag_name) def _call_fdisk(self, fdisk_config_file_path: str) -> None: bash_command = ' '.join( ['cat', fdisk_config_file_path, '|', 'fdisk', self.disk_device] ) try: Command.run(['bash', '-c', bash_command]) except Exception: # unfortunately fdisk reports that it can't read in the partition # table which I consider a bug in fdisk. However the table was # correctly created and therefore we continue. Problem is that we # are not able to detect real errors with the fdisk operation at # that point. log.debug('potential fdisk errors were ignored') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7472916 kiwi-11.1.8/kiwi/path.py0000644000000000000000000002014515273675667011776 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging import collections import pathlib import shutil from typing import Any, Dict, List, MutableMapping, Optional # project from kiwi.command import Command from kiwi.exceptions import KiwiFileAccessError log = logging.getLogger('kiwi') class Path: """ **Directory path helpers** """ @staticmethod def sort_by_hierarchy(path_list: List[str]) -> List[str]: """ Sort given list of path names by their hierachy in the tree Example: .. code:: python result = Path.sort_by_hierarchy(['/var/lib', '/var']) :param list path_list: list of path names :return: hierachy sorted path_list :rtype: list """ paths_at_depth: Dict[int, List[str]] = {} for path in path_list: path_elements = path.split('/') path_depth = len(path_elements) if path_depth not in paths_at_depth: paths_at_depth[path_depth] = [] paths_at_depth[path_depth].append(path) ordered_paths_at_depth = collections.OrderedDict( sorted(paths_at_depth.items()) ) ordered_paths = [] for path_depth in ordered_paths_at_depth: for path in ordered_paths_at_depth[path_depth]: ordered_paths.append(path) return ordered_paths @staticmethod def access(path: str, mode: int, **kwargs: Any) -> bool: """ Check whether path can be accessed with the given mode. :param str path: The path that should be checked for access. :param int mode: Which access mode should be checked. This value must be a bit-wise or of one or more of the following constants: :py:const:`os.F_OK` (note that this one is zero), :py:const:`os.X_OK`, :py:const:`os.R_OK` and :py:const:`os.W_OK` :param kwargs: further keyword arguments are forwarded to :func:`os.access` :return: Boolean value whether this access mode is allowed :rtype: bool :raises ValueError: if the supplied mode is invalid :raises kiwi.exceptions.KiwiFileNotFound: if the path does not exist or is not accessible by the current user """ if mode & ~(os.F_OK | os.X_OK | os.R_OK | os.W_OK) != 0: raise ValueError('Invalid mode 0x{:X}'.format(mode)) try: os.stat(path) except Exception as exc: raise KiwiFileAccessError( 'Error accessing path {0} failed with: {1}'.format(path, exc) ) return os.access(path, mode, **kwargs) @staticmethod def create(path: str) -> None: """ Create path and all sub directories to target :param string path: path name """ log.debug("Creating directory %s", path) try: pathlib.Path(path).mkdir(parents=True, exist_ok=True) except Exception as issue: raise KiwiFileAccessError( f'Cannot create directory: {path}: {issue}' ) @staticmethod def wipe(path: str) -> None: """ Delete path and all contents :param string path: path name """ if os.path.exists(path): Command.run(['rm', '-r', '-f', path]) @staticmethod def remove_hierarchy(root: str, path: str) -> None: """ Recursively remove an empty path and its sub directories starting at a given root directory. Ignore non empty or protected paths and leave them untouched :param string root: start at directory :param string path: path name below root """ Command.run( [ 'rmdir', '--ignore-fail-on-non-empty', os.path.normpath(os.sep.join([root, path])), ] ) path_elements = path.split(os.sep) protected_elements = [ 'boot', 'dev', 'proc', 'run', 'sys', 'tmp', 'home', 'mnt', ] for path_index in reversed(range(0, len(path_elements))): sub_path = os.sep.join(path_elements[0:path_index]) if sub_path: if path_elements[path_index - 1] in protected_elements: log.warning( 'remove_hierarchy: path {0} is protected'.format( os.path.normpath(os.sep.join([root, sub_path])) ) ) return Command.run( [ 'rmdir', '--ignore-fail-on-non-empty', os.path.normpath(os.sep.join([root, sub_path])), ] ) @staticmethod def move_to_root(root: str, elements: List[str]) -> List[str]: """ Change the given path elements to a new root directory :param str root: the root path to trim :param list elements: list of path names :return: changed elements :rtype: list """ result = [] for element in elements: normalized_element = os.path.normpath(element) result.append( normalized_element.replace( os.path.normpath(root), os.sep ).replace('{0}{0}'.format(os.sep), os.sep) ) return result @staticmethod def rebase_to_root(root: str, elements: List[str]) -> List[str]: """ Include the root prefix for the given paths elements :param str root: the new root path :param list elements: list of path names :return: changed elements :rtype: list """ result = [] for element in elements: result.append(os.path.normpath(os.sep.join([root, element]))) return result @staticmethod def which( filename: str, custom_env: Optional[MutableMapping[str, str]] = None, access_mode: int = os.F_OK | os.X_OK, root_dir: Optional[str] = None, ) -> Optional[str]: """ Lookup file name in PATH :param string filename: file base name :param list alternative_lookup_paths: list of additional lookup paths :param list custom_env: a custom os.environ used to obtain ``$PATH`` :param int access_mode: one of the os access modes or a combination of them (os.R_OK, os.W_OK and os.X_OK). If the provided access mode does not match the file is considered not existing :param str root_dir: the root path to look at :return: absolute path to file or None :rtype: str """ system_path = ( custom_env.get("PATH") if custom_env else os.environ.get("PATH") ) or os.defpath lookup_paths = system_path.split(os.pathsep) if root_dir: lookup_paths = Path.rebase_to_root(root_dir, lookup_paths) log.debug(f"Looking for {filename} in {os.pathsep.join(lookup_paths)}") return shutil.which( filename, access_mode, path=os.pathsep.join(lookup_paths) ) @staticmethod def first_exists(path: str) -> str: """ Lookup first path that exists in the given path hierarchy """ p = pathlib.Path(path) if p.exists(): return path else: return Path.first_exists(format(p.parent)) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7472916 kiwi-11.1.8/kiwi/privileges.py0000644000000000000000000000231315273675667013210 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os # project from .exceptions import KiwiPrivilegesError class Privileges: """ **Implements check for root privileges** """ @staticmethod def check_for_root_permissions() -> bool: """ Check if we are effectively root on the system. If not an exception is thrown :return: True or raise an Exception :rtype: bool """ if os.geteuid() != 0: raise KiwiPrivilegesError('operation requires root permissions') return True ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7472916 kiwi-11.1.8/kiwi/repository/__init__.py0000644000000000000000000000463115273675667015022 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from typing import TYPE_CHECKING, List, Optional from abc import ABCMeta, abstractmethod # project from kiwi.exceptions import KiwiRepositorySetupError if TYPE_CHECKING: # pragma: nocover from kiwi.repository.base import RepositoryBase class Repository(metaclass=ABCMeta): """ **Repository factory** :param object root_bind: instance of RootBind :param str package_manager: package manager name :param list custom_args: list of custom package manager arguments to setup the repository :raises KiwiRepositorySetupError: if package_manager is not supported """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( root_bind: object, package_manager: str, custom_args: Optional[List] = None, ) -> 'RepositoryBase': name_map = { 'zypper': ['zypper', 'Zypper'], 'dnf': ['dnf', 'Dnf'], 'dnf5': ['dnf5', 'Dnf5'], 'dnf4': ['dnf4', 'Dnf4'], 'microdnf': ['dnf4', 'Dnf4'], 'apt': ['apt', 'Apt'], 'pacman': ['pacman', 'Pacman'], 'apk': ['apk', 'Apk'], } try: repository = importlib.import_module( 'kiwi.repository.{0}'.format(name_map[package_manager][0]) ) module_name = 'Repository{0}'.format(name_map[package_manager][1]) return repository.__dict__[module_name](root_bind, custom_args) except Exception as issue: raise KiwiRepositorySetupError( 'Support for {0} repository not implemented: {1}'.format( package_manager, issue ) ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.747587 kiwi-11.1.8/kiwi/repository/apk.py0000644000000000000000000001173115273675667014035 0ustar00# Copyright (c) 2025 SUSE LLC. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from typing import List, Dict, Optional # project from kiwi.defaults import Defaults from kiwi.repository.base import RepositoryBase from kiwi.path import Path from kiwi.utils.proxy import HostProxy log = logging.getLogger('kiwi') class RepositoryApk(RepositoryBase): """ **Implements repository handling for apk (Alpine) package manager** """ def post_init(self, custom_args: List = []) -> None: """ Post initialization method Store custom apk arguments and create runtime configuration and environment :param list custom_args: apk arguments """ self.bootstrap_repo = '' self.custom_args = custom_args self.repo_dict: Dict[str, str] = {} self.signing_keys: List = [] self.repo_config = os.sep.join( [self.root_dir, Defaults.get_apk_repo_config()] ) self.command_env = self._create_apk_get_runtime_environment() Path.create(os.path.dirname(self.repo_config)) def setup_package_database_configuration(self) -> None: """ Setup package database configuration No special database configuration required for apk """ pass def use_default_location(self) -> None: """ Call repository operations with default repository manager setup No special database configuration required for apk """ pass def runtime_config(self) -> Dict: """ apk runtime configuration and environment """ return { 'bootstrap_repo': self.bootstrap_repo, 'command_env': self.command_env, } def add_repo( self, name: str, uri: str, repo_type: str = 'apk', prio: Optional[int] = None, dist: Optional[str] = None, components: Optional[str] = None, user: Optional[str] = None, secret: Optional[str] = None, credentials_file: Optional[str] = None, repo_gpgcheck: Optional[bool] = None, pkg_gpgcheck: Optional[bool] = None, sourcetype: Optional[str] = None, customization_script: Optional[str] = None, architectures: Optional[str] = None, ) -> None: """ Add apk repository :param str name: repository name :param str uri: repository URI :param str repo_type: unused :param int prio: unused :param str dist: unused :param str components: unused :param str user: unused :param str secret: unused :param str credentials_file: unused :param bool repo_gpgcheck: unused :param bool pkg_gpgcheck: unused :param str sourcetype: unused :param str customization_script: unused :param str architectures: unused """ self.repo_dict[name] = uri if not self.bootstrap_repo: # The first repo added is used for bootstrap self.bootstrap_repo = uri with open(self.repo_config, 'a') as repos: repos.write(f'{uri}{os.linesep}') def import_trusted_keys(self, signing_keys: List) -> None: """ Imports trusted keys into the image :param list signing_keys: list of the key files to import """ pass def delete_repo(self, name: str) -> None: """ Delete apk repository :param str name: repository base file name """ if self.repo_dict.get(name): self.delete_all_repos() del self.repo_dict[name] for name in self.repo_dict: self.add_repo(name, self.repo_dict[name]) def delete_all_repos(self) -> None: """ Delete all apk repositories """ if os.path.isfile(self.repo_config): os.unlink(self.repo_config) def delete_repo_cache(self, name: str) -> None: """ Delete repository cache No special cache cleanup required for apk :param str name: unused """ pass def cleanup_unused_repos(self) -> None: """ Cleanup/Delete unused repositories No special cleanup required for apk """ pass def _create_apk_get_runtime_environment(self) -> Dict: return dict(os.environ, **HostProxy().get_env(), LANG='C') ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.747587 kiwi-11.1.8/kiwi/repository/apt.py0000644000000000000000000005424715273675667014057 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import glob import shutil import hashlib import logging from base64 import b64encode from urllib.parse import urlparse, unquote from urllib.request import Request, urlopen from typing import List, Dict, Optional # project import kiwi.defaults as defaults from kiwi.utils.temporary import Temporary, TmpT from kiwi.repository.template.apt import PackageManagerTemplateAptGet from kiwi.repository.base import RepositoryBase from kiwi.path import Path from kiwi.utils.toenv import ToEnv from kiwi.system.uri import Uri from kiwi.utils.proxy import HostProxy from kiwi.exceptions import KiwiUriOpenError log = logging.getLogger('kiwi') class RepositoryApt(RepositoryBase): """ **Implements repository handling for apt-get package manager** :param str shared_apt_get_dir: shared directory between image root and build system root :param str runtime_apt_get_config_file: apt-get runtime config file name :param list apt_get_args: apt-get caller arguments :param dict command_env: customized os.environ for apt-get :param manager_base: shared location for apt-get repodata between host and image :param str keyrings_dir: location of the repository keyring files :param str keyring_prefix: build specific keyring file name prefix :param list keyrings: keyring files referenced via Signed-By :param str image_keyrings_dir: location of the keyring files permanently stored in the image :param dict repository_keyrings: keyring files referenced via Signed-By per repository name :param list repo_files: sources, auth and preferences files written for this build """ def post_init(self, custom_args: List = []) -> None: """ Post initialization method Store custom apt-get arguments and create runtime configuration and environment :param list custom_args: apt-get arguments """ self.runtime_apt_get_config_file = TmpT(name='') self.custom_args = custom_args self.exclude_docs = False # delete custom arguments not used for apt for argument in self.custom_args: if '_install_langs' in argument or '_target_arch' in argument: log.warning( f'Custom argument {argument} will be ignored for apt' ) self.custom_args.remove(argument) # extract custom arguments used for apt config only if 'exclude_docs' in self.custom_args: self.custom_args.remove('exclude_docs') self.exclude_docs = True if 'check_signatures' in self.custom_args: self.custom_args.remove('check_signatures') self.unauthenticated = 'false' else: self.unauthenticated = 'true' self.distribution: str = '' self.distribution_path: str = '' self.repo_files: List[str] = [] self.components: List = [] # apt-get support is based on creating a sources file which # contains path names to the repo and its cache. In order to # allow a persistent use of the files in and outside of a chroot # call an active bind mount from RootBind::mount_shared_directory # is expected and required self.manager_base = self.shared_location + '/apt-get' self.shared_apt_get_dir = { 'sources-dir': self.manager_base + '/sources.list.d', 'netrcparts-dir': self.manager_base + '/auth.conf.d', 'preferences-dir': self.manager_base + '/preferences.d', } # Each signing key is stored as keyring file in keyrings_dir # and referenced via Signed-By from the repository sources # files. apt is called on the host for the bootstrap phase and # chrooted for the image build phase. Thus the keyring files # must exist at the same location on the host and in the image # root. The build specific prefix prevents concurrent builds # from using each others keyring files on the host self.keyrings_dir = '/etc/apt/keyrings' self.keyring_prefix = 'kiwi-{0}-'.format( hashlib.sha256( os.path.realpath(self.root_dir).encode() ).hexdigest()[:8] ) self.keyrings: List[str] = [] # Signing keys of repositories configured in the image are # stored permanently as recommended for third party repositories # in https://wiki.debian.org/DebianRepository/UseThirdParty self.image_keyrings_dir = '/usr/share/keyrings' self.repository_keyrings: Dict[str, List[str]] = {} # former kiwi versions created a global keyring in the # shared location, which would still be trusted by apt legacy_keyring = '{}/trusted.gpg'.format(self.manager_base) if os.path.exists(legacy_keyring): os.unlink(legacy_keyring) self.runtime_apt_get_config_file = Temporary( path=self.root_dir, prefix='kiwi_apt.config' ).unmanaged_file() self.apt_get_args = [ '-q', '-c', self.runtime_apt_get_config_file.name, '-y', ] + self.custom_args self.command_env = self._create_apt_get_runtime_environment() # config file for apt-get tool self.apt_conf = PackageManagerTemplateAptGet() self._write_runtime_config() def setup_package_database_configuration(self) -> None: """ Setup package database configuration No special database configuration required for apt """ pass def use_default_location(self) -> None: """ Setup apt-get repository operations to store all data in the default places """ self.manager_base = os.sep.join([self.root_dir, 'etc/apt']) self.shared_apt_get_dir['sources-dir'] = os.sep.join( [self.manager_base, 'sources.list.d'] ) self.shared_apt_get_dir['preferences-dir'] = os.sep.join( [self.manager_base, 'preferences.d'] ) self.shared_apt_get_dir['netrcparts-dir'] = os.sep.join( [self.manager_base, 'auth.conf.d'] ) self._write_runtime_config(system_default=True) def runtime_config(self) -> Dict: """ apt-get runtime configuration and environment """ return { 'apt_get_args': self.apt_get_args, 'command_env': self.command_env, 'distribution': self.distribution, 'distribution_path': self.distribution_path, } def add_repo( self, name: str, uri: str, repo_type: str = 'deb', prio: Optional[int] = None, dist: Optional[str] = None, components: Optional[str] = None, user: Optional[str] = None, secret: Optional[str] = None, credentials_file: Optional[str] = None, repo_gpgcheck: Optional[bool] = None, pkg_gpgcheck: Optional[bool] = None, sourcetype: Optional[str] = None, customization_script: Optional[str] = None, architectures: Optional[str] = None, ) -> None: """ Add apt_get repository :param str name: repository base file name :param str uri: repository URI :param str repo_type: unused :param int prio: apt Pin-Priority of the repository, see apt_preferences(5) :param str dist: distribution name for non flat deb repos :param str components: distribution categories :param str user: username :param str secret: password_or_token :param str credentials_file: unused :param bool repo_gpgcheck: enable repository signature validation :param bool pkg_gpgcheck: unused :param str sourcetype: unused :param str customization_script: custom script called after the repo file was created :param str architectures: identifies which architectures are supported by this repository """ sources_file = '/'.join( [self.shared_apt_get_dir['sources-dir'], name + '.sources'] ) auth_file = '/'.join( [self.shared_apt_get_dir['netrcparts-dir'], name + '.conf'] ) pref_file = '/'.join( [self.shared_apt_get_dir['preferences-dir'], name + '.pref'] ) self.repo_files.append(sources_file) if os.path.exists(uri): # apt-get requires local paths to take the file: type uri = 'file:/' + uri uri = uri.replace('file://', 'file:/') if not components: components = 'main' self._add_components(components) with open(sources_file, 'w') as repo: repo_details = 'Types: deb' + os.linesep repo_details += 'URIs: ' + uri + os.linesep if architectures: repo_details += 'Architectures: {}{}'.format( architectures.replace(',', ' '), os.linesep ) if not dist: # create a debian flat repository setup. We consider the # repository metadata to exist on the toplevel of the # specified uri. This applies to the way the open build # service creates debian repositories and should be # done in the same way for other repositories when used # with kiwi repo_details += 'Suites: ./' + os.linesep else: # create a debian distributon repository setup for the # specified distributon name and components self.distribution = dist self.distribution_path = uri repo_details += 'Suites: ' + dist + os.linesep repo_details += 'Components: ' + components + os.linesep keyrings = self.repository_keyrings.get(name) or self.keyrings if keyrings: repo_details += 'Signed-By: {0}{1}'.format( ' '.join(keyrings), os.linesep ) if repo_gpgcheck is False: repo_details += 'trusted: yes' + os.linesep repo_details += 'check-valid-until: no' + os.linesep repo.write(repo_details) if secret: self.repo_files.append(auth_file) with open(auth_file, 'w') as auth: if user: auth.write( 'machine {} login {} password {}{}'.format( uri, user, secret, os.linesep ) ) else: auth.write( 'machine {} login {}{}'.format(uri, secret, os.linesep) ) if customization_script: self.run_repo_customize(customization_script, sources_file) if prio: self.repo_files.append(pref_file) uri_parsed = urlparse(uri.replace('file://', 'file:/')) with open(pref_file, 'w') as pref: pref.write('Package: *{0}'.format(os.linesep)) if not uri_parsed.hostname: pref.write('Pin: origin ""{0}'.format(os.linesep)) else: pref.write( 'Pin: origin "{0}"{1}'.format( uri_parsed.hostname, os.linesep ) ) pref.write('Pin-Priority: {0}{1}'.format(prio, os.linesep)) if customization_script: self.run_repo_customize(customization_script, pref_file) def import_trusted_keys(self, signing_keys: List) -> None: """ Stores each provided key as keyring file in /etc/apt/keyrings on the host and in the image root. The keyring files are referenced via Signed-By from the repository sources files added afterwards :param list signing_keys: list of the key files to import. A key can be a local file path or a remote http, https or ftp location. Remote keys are downloaded prior to the import :raises KiwiUriOpenError: if the download of a remote key fails """ self.delete_trusted_keys() with Temporary(prefix='kiwi_apt_keys.').new_dir() as key_dir: for index, key in enumerate(signing_keys): key = self._fetch_key(key, key_dir, index) keyring_name = '{0}{1}.{2}'.format( self.keyring_prefix, index, self._get_keyring_extension(key) ) for keyrings_dir in self._get_keyrings_dirs(): self._install_keyring(key, keyrings_dir, keyring_name) keyring = os.sep.join([self.keyrings_dir, keyring_name]) self.keyrings.append(keyring) log.info(f'Keyring for APT created: {keyring}') def import_repository_signing_keys( self, name: str, signing_keys: List ) -> None: """ Permanently stores the signing keys of the repository with the given name as keyring files in /usr/share/keyrings of the image root. The keyring files are referenced via Signed-By from the sources file of this repository added afterwards :param str name: repository base file name :param list signing_keys: list of the key files to store. A key can be a local file path or a remote http, https or ftp location. Remote keys are downloaded prior to the import :raises KiwiUriOpenError: if the download of a remote key fails """ image_keyrings_dir = os.path.normpath( os.sep.join([self.root_dir, self.image_keyrings_dir]) ) keyring_basename = f'{name}-archive-keyring' # delete keyring files of a former import for this repository for keyring in glob.glob( os.sep.join([image_keyrings_dir, f'{keyring_basename}*']) ): os.unlink(keyring) keyrings = [] with Temporary(prefix='kiwi_apt_keys.').new_dir() as key_dir: for index, key in enumerate(signing_keys): key = self._fetch_key(key, key_dir, index) keyring_name = '{0}{1}.{2}'.format( keyring_basename, f'-{index}' if index else '', self._get_keyring_extension(key), ) self._install_keyring(key, image_keyrings_dir, keyring_name) keyring = os.sep.join([self.image_keyrings_dir, keyring_name]) keyrings.append(keyring) log.info(f'--> Keyring: {keyring}') self.repository_keyrings[name] = keyrings def delete_trusted_keys(self) -> None: """ Delete the keyring files created by import_trusted_keys on the host and in the image root """ for keyrings_dir in self._get_keyrings_dirs(): self._delete_keyrings(keyrings_dir) self.keyrings = [] def _fetch_key(self, key: str, key_dir: str, index: int) -> str: if urlparse(key).scheme in ('http', 'https', 'ftp'): key = self._download_key( key, os.sep.join([key_dir, f'key.{index}']) ) return key @staticmethod def _get_keyring_extension(key: str) -> str: # apt expects ASCII armored keys to use the .asc # extension, any other key file is used as binary keyring with open(key, 'rb') as key_file: is_armored = ( b'-----BEGIN PGP PUBLIC KEY BLOCK-----' in key_file.read() ) return 'asc' if is_armored else 'gpg' @staticmethod def _install_keyring( key: str, keyrings_dir: str, keyring_name: str ) -> None: Path.create(keyrings_dir) target = os.sep.join([keyrings_dir, keyring_name]) shutil.copy(key, target) # apt verifies signatures as _apt user os.chmod(target, 0o644) @staticmethod def _download_key(key_url: str, target: str) -> str: log.info(f'Downloading signing key: {Uri.print_sensitive(key_url)}') uri = urlparse(key_url) request = Request(key_url) if uri.username and uri.scheme != 'ftp': # urllib handles credentials as part of the URL for # ftp only, pass them as basic auth header for http(s) netloc = uri.netloc.rpartition('@')[2] request = Request(uri._replace(netloc=netloc).geturl()) credentials = b64encode( ':'.join( [unquote(uri.username), unquote(uri.password or '')] ).encode() ).decode() request.add_header('Authorization', f'Basic {credentials}') try: with urlopen(request) as location: with open(target, 'wb') as key_file: key_file.write(location.read()) except Exception as issue: raise KiwiUriOpenError( 'Failed to download signing key {0}: {1}: {2}'.format( Uri.print_sensitive(key_url), type(issue).__name__, issue ) ) return target def delete_repo(self, name: str) -> None: """ Delete apt-get repository :param str name: repository base file name """ Path.wipe( self.shared_apt_get_dir['sources-dir'] + '/' + name + '.sources' ) Path.wipe( self.shared_apt_get_dir['netrcparts-dir'] + '/' + name + '.conf' ) Path.wipe( self.shared_apt_get_dir['preferences-dir'] + '/' + name + '.pref' ) def delete_all_repos(self) -> None: """ Delete all apt-get repositories """ for dirname in ['sources-dir', 'netrcparts-dir', 'preferences-dir']: Path.wipe(self.shared_apt_get_dir[dirname]) Path.create(self.shared_apt_get_dir[dirname]) def delete_repo_cache(self, name: str) -> None: """ Delete apt-get repository cache Apt stores the package cache in a collection of binary files and deb archives. As of now I couldn't came across a solution which allows for deleting only the cache data for a specific repository. Thus the repo cache cleanup affects all cache data :param str name: unused """ for cache_file in ['archives', 'pkgcache.bin', 'srcpkgcache.bin']: Path.wipe(os.sep.join([self.manager_base, cache_file])) def cleanup_unused_repos(self) -> None: """ Delete unused apt_get repositories Repository sources, auth and preferences files which were not written for this build must be removed otherwise they are taken into account for the package installations. This also applies to e.g. a preferences file of a repository which was set up with a priority in a former build but is set up without a priority in this build """ for dirname in ['sources-dir', 'netrcparts-dir', 'preferences-dir']: config_dir = self.shared_apt_get_dir[dirname] for config_file in list(os.walk(config_dir))[0][2]: config_file = '/'.join([config_dir, config_file]) if config_file not in self.repo_files: Path.wipe(config_file) def _add_components(self, components: str) -> None: for component in components.split(): if component not in self.components: self.components.append(component) def _create_apt_get_runtime_environment(self) -> Dict: for apt_get_dir in list(self.shared_apt_get_dir.values()): Path.create(apt_get_dir) ToEnv(self.root_dir, defaults.PACKAGE_MANAGER_ENV_VARS) return dict( os.environ, **HostProxy().get_env(), LANG='C', DEBIAN_FRONTEND='noninteractive', ) def _write_runtime_config(self, system_default: bool = False) -> None: parameters = { 'apt_shared_base': self.manager_base, 'unauthenticated': self.unauthenticated, } if not system_default: template = self.apt_conf.get_host_template(self.exclude_docs) apt_conf_data = template.substitute(parameters) else: template = self.apt_conf.get_image_template(self.exclude_docs) apt_conf_data = template.substitute(parameters) # The runtime config redirects Dir::Etc away from the host # apt configuration. Thus a proxy setup in the host apt # configuration needs to be added explicitly for proxy_config in HostProxy.get_apt_config(): apt_conf_data += proxy_config + os.linesep with open(self.runtime_apt_get_config_file.name, 'w') as config: config.write(apt_conf_data) def _get_keyrings_dirs(self) -> List[str]: return [ self.keyrings_dir, os.path.normpath(os.sep.join([self.root_dir, self.keyrings_dir])), ] def _delete_keyrings(self, keyrings_dir: str) -> None: for keyring in glob.glob( os.sep.join([keyrings_dir, f'{self.keyring_prefix}*']) ): os.unlink(keyring) def cleanup(self) -> None: """ Delete intermediate apt config file and the keyring files on the host. The keyring files in the image root are still referenced by the repository sources files and are deleted via delete_trusted_keys at the end of the build """ if os.path.isfile(self.runtime_apt_get_config_file.name): os.unlink(self.runtime_apt_get_config_file.name) self._delete_keyrings(self.keyrings_dir) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.747587 kiwi-11.1.8/kiwi/repository/base.py0000644000000000000000000001367015273675667014200 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from types import TracebackType from typing import List, Dict, Optional, Type from kiwi.system.root_bind import RootBind from kiwi.command import Command class RepositoryBase: """ Implements base class for package manager repository handling Attributes :param object root_bind: instance of :class:`RootBind` :param str root_dir: root directory path name :param str shared_location: shared directory between image root and build system root """ def __init__(self, root_bind: RootBind, custom_args: List = []) -> None: self.root_bind = root_bind self.root_dir = root_bind.root_dir self.shared_location = root_bind.shared_location self.post_init(custom_args or []) def __enter__(self) -> 'RepositoryBase': return self def post_init(self, custom_args: List = []) -> None: """ Post initialization method Implementation in specialized repository class :param list custom_args: unused """ pass def use_default_location(self) -> None: """ Call repository operations with default repository manager setup Implementation in specialized repository class """ raise NotImplementedError def runtime_config(self) -> Dict: """ Repository runtime configuration and environment Implementation in specialized repository class """ raise NotImplementedError def add_repo( self, name: str, uri: str, repo_type: str, prio: int, dist: str, components: str, user: str, secret: str, credentials_file: str, repo_gpgcheck: bool, pkg_gpgcheck: bool, sourcetype: str, customization_script: Optional[str] = None, architectures: Optional[str] = None, ) -> None: """ Add repository Implementation in specialized repository class :param str name: unused :param str uri: unused :param str repo_type: unused :param int prio: unused :param str dist: unused :param str components: unused :param str user: unused :param str secret: unused :param str credentials_file: unused :param bool repo_gpgcheck: unused :param bool pkg_gpgcheck: unused :param str sourcetype: unused :param str customization_script: unused :param str architectures: unused """ raise NotImplementedError def setup_package_database_configuration(self) -> None: """ Setup package database configuration Implementation in specialized repository class """ raise NotImplementedError def import_trusted_keys(self, signing_keys: List) -> None: """ Imports trusted keys into the image Implementation in specialized repository class :param list signing_keys: list of the key files to import """ raise NotImplementedError def import_repository_signing_keys( self, name: str, signing_keys: List ) -> None: """ Permanently stores the signing keys of the repository with the given name in the image, such that the repository added afterwards via add_repo can be validated in the image. The default implementation does nothing. Package managers which keep the keys imported via import_trusted_keys as part of the image, e.g. in the rpm database, don't need this. :param str name: repository base file name :param list signing_keys: list of the key files to store """ pass def cleanup_unused_repos(self) -> None: """ Cleanup/Delete unused repositories Only configured repositories according to the image configuration are allowed to be active when building Implementation in specialized repository class """ raise NotImplementedError def delete_repo(self, name: str) -> None: """ Delete repository Implementation in specialized repository class :param str name: unused """ raise NotImplementedError def delete_all_repos(self) -> None: """ Delete all repositories Implementation in specialized repository class """ raise NotImplementedError def delete_repo_cache(self, name: str) -> None: """ Delete repository cache Implementation in specialized repository class :param str name: unused """ raise NotImplementedError @staticmethod def run_repo_customize(script_path: str, repo_file: str) -> None: """ Run an optional customization script :param str script_path: unused :param str repo_file: unused """ Command.run(['bash', '--norc', script_path, repo_file]) def cleanup(self) -> None: """ Cleanup method Implementation in specialized repository class """ pass # pragma: no cover def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: pass # pragma: no cover ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.747587 kiwi-11.1.8/kiwi/repository/dnf.py0000644000000000000000000000553515273675667014036 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import List, Dict, no_type_check, Optional # project from kiwi.repository.base import RepositoryBase from kiwi.api_helper import decommissioned class RepositoryDnf(RepositoryBase): """ decommissioned """ @decommissioned def post_init(self, custom_args: List = []) -> None: pass # pragma: no cover @decommissioned def setup_package_database_configuration(self) -> None: pass # pragma: no cover @decommissioned def use_default_location(self) -> None: pass # pragma: no cover @no_type_check @decommissioned def runtime_config(self) -> Dict: pass # pragma: no cover @decommissioned def add_repo( self, name: str, uri: str, repo_type: str = 'rpm-md', prio: Optional[int] = None, dist: Optional[str] = None, components: Optional[str] = None, user: Optional[str] = None, secret: Optional[str] = None, credentials_file: Optional[str] = None, repo_gpgcheck: bool = False, pkg_gpgcheck: bool = False, sourcetype: Optional[str] = None, customization_script: Optional[str] = None, ) -> None: pass # pragma: no cover @decommissioned def import_trusted_keys(self, signing_keys: List) -> None: pass # pragma: no cover @decommissioned def delete_repo(self, name: str) -> None: pass # pragma: no cover @decommissioned def delete_all_repos(self) -> None: pass # pragma: no cover @decommissioned def delete_repo_cache(self, name: str) -> None: pass # pragma: no cover @decommissioned def cleanup_unused_repos(self) -> None: pass # pragma: no cover @no_type_check @decommissioned def _create_dnf_runtime_environment(self) -> Dict: pass # pragma: no cover @decommissioned def _create_runtime_config_parser(self) -> None: pass # pragma: no cover @decommissioned def _create_runtime_plugin_config_parsers(self) -> None: pass # pragma: no cover @decommissioned def _write_runtime_config(self) -> None: pass # pragma: no cover ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.747587 kiwi-11.1.8/kiwi/repository/dnf4.py0000644000000000000000000003252215273675667014116 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import glob from configparser import ConfigParser from typing import List, Dict, Optional # project import kiwi.defaults as defaults from kiwi.utils.temporary import Temporary, TmpT from kiwi.defaults import Defaults from kiwi.command import Command from kiwi.repository.base import RepositoryBase from kiwi.path import Path from kiwi.utils.rpm_database import RpmDataBase from kiwi.utils.toenv import ToEnv from kiwi.utils.proxy import HostProxy class RepositoryDnf4(RepositoryBase): """ **Implements repository handling for dnf package manager** :param str shared_dnf_dir: shared directory between image root and build system root :param str runtime_dnf_config_file: dnf runtime config file name :param dict command_env: customized os.environ for dnf :param str runtime_dnf_config: instance of :class:`ConfigParser` """ def post_init(self, custom_args: List = []) -> None: """ Post initialization method Store custom dnf arguments and create runtime configuration and environment :param list custom_args: dnf arguments """ self.runtime_dnf_config_file = TmpT(name='') self.custom_args = custom_args self.exclude_docs = False self.locale = None self.target_arch = None # extract custom arguments not used in dnf call if 'exclude_docs' in self.custom_args: self.custom_args.remove('exclude_docs') self.exclude_docs = True if 'check_signatures' in self.custom_args: self.custom_args.remove('check_signatures') self.gpg_check = '1' else: self.gpg_check = '0' for argument in self.custom_args: if '_install_langs' in argument: self.locale = argument elif '_target_arch' in argument: self.target_arch = argument if self.locale: self.custom_args.remove(self.locale) if self.target_arch: self.custom_args.remove(self.target_arch) self.target_arch = self.target_arch.split('%')[1] self.repo_names: List = [] # dnf support is based on creating repo files which contains # path names to the repo and its cache. In order to allow a # persistent use of the files in and outside of a chroot call # an active bind mount from RootBind::mount_shared_directory # is expected and required manager_base = self.shared_location + '/dnf' self.shared_dnf_dir = { 'reposd-dir': manager_base + '/repos', 'cache-dir': manager_base + '/cache', 'pluginconf-dir': manager_base + '/pluginconf', 'vars-dir': manager_base + '/vars', } self.runtime_dnf_config_file = Temporary( path=self.root_dir, prefix='kiwi_dnf4.config' ).unmanaged_file() self.dnf_args = [ '--config', self.runtime_dnf_config_file.name, '-y', '--enableplugin=priorities', '--disableplugin=versionlock', ] + self.custom_args self.command_env = self._create_dnf_runtime_environment() # config file parameters for dnf tool self._create_runtime_config_parser() self._write_runtime_config() def setup_package_database_configuration(self) -> None: """ Setup rpm macros for bootstrapping and image building 1. Create the rpm image macro which persists during the build 2. Create the rpm bootstrap macro to make sure for bootstrapping the rpm database location matches the host rpm database setup. This macro only persists during the bootstrap phase. If the image was already bootstrapped a compat link is created instead. """ rpmdb = RpmDataBase( self.root_dir, Defaults.get_custom_rpm_image_macro_name() ) if self.locale: rpmdb.set_macro_from_string(self.locale) rpmdb.write_config() rpmdb = RpmDataBase(self.root_dir) if rpmdb.has_rpm(): rpmdb.link_database_to_host_path() else: rpmdb.set_database_to_host_path() # SUSE compat code: # # Manually adding the compat link /var/lib/rpm that points to the # rpmdb location as it is configured in the host rpm setup. DNF makes # use of the host setup to bootstrap or to read the signing keys # from the rpm database setup provisioned by rpm itself (macro level). # It assumes the host setup is the default for the system being built. # # For SUSE this is causing a mismatch as the host setup is not the RPM # default (/var/lib/rpm) and SUSE distros proactively relocate the rpm # database from the default location to a custom one when the # rpm package and related macros are installed for the first time. rpmdb.init_database() image_rpm_compat_link = '/var/lib/rpm' host_rpm_dbpath = rpmdb.rpmdb_host.expand_query('%_dbpath') if host_rpm_dbpath != image_rpm_compat_link: Path.create(self.root_dir + os.path.dirname(image_rpm_compat_link)) Command.run( [ 'ln', '-s', '--no-target-directory', ''.join(['../..', host_rpm_dbpath]), self.root_dir + image_rpm_compat_link, ], raise_on_error=False, ) def use_default_location(self) -> None: """ Setup dnf repository operations to store all data in the default places """ self.shared_dnf_dir['reposd-dir'] = self.root_dir + '/etc/yum.repos.d' self.shared_dnf_dir['cache-dir'] = self.root_dir + '/var/cache/dnf' self.shared_dnf_dir['pluginconf-dir'] = ( self.root_dir + '/etc/dnf/plugins' ) self.shared_dnf_dir['vars-dir'] = self.root_dir + '/etc/dnf/vars' self._create_runtime_config_parser() self._write_runtime_config() def runtime_config(self) -> Dict: """ dnf runtime configuration and environment :return: dnf_args:list, command_env:dict :rtype: dict """ return {'dnf_args': self.dnf_args, 'command_env': self.command_env} def add_repo( self, name: str, uri: str, repo_type: str = 'rpm-md', prio: Optional[int] = None, dist: Optional[str] = None, components: Optional[str] = None, user: Optional[str] = None, secret: Optional[str] = None, credentials_file: Optional[str] = None, repo_gpgcheck: bool = False, pkg_gpgcheck: bool = False, sourcetype: Optional[str] = None, customization_script: Optional[str] = None, architectures: Optional[str] = None, ) -> None: """ Add dnf repository :param str name: repository base file name :param str uri: repository URI :param str repo_type: repostory type name :param int prio: dnf repostory priority :param str dist: unused :param str components: unused :param str user: unused :param str secret: unused :param str credentials_file: unused :param bool repo_gpgcheck: enable repository signature validation :param bool pkg_gpgcheck: enable package signature validation :param str sourcetype: source type, one of 'baseurl', 'metalink' or 'mirrorlist' :param str customization_script: custom script called after the repo file was created :param str architectures: unused """ repo_file = self.shared_dnf_dir['reposd-dir'] + '/' + name + '.repo' self.repo_names.append(name + '.repo') if os.path.exists(uri): # dnf requires local paths to take the file: type uri = 'file://' + uri repo_config = ConfigParser(interpolation=None) repo_config.add_section(name) repo_config.set(name, 'name', name) repo_config.set(name, sourcetype if sourcetype else 'baseurl', uri) if prio: repo_config.set(name, 'priority', format(prio)) repo_config.set(name, 'repo_gpgcheck', '1' if repo_gpgcheck else '0') repo_config.set(name, 'gpgcheck', '1' if pkg_gpgcheck else '0') if Defaults.is_buildservice_worker(): # when building in the build service, modular metadata is # inaccessible. In order to use modular content in the build # service, we need to disable modular filtering, which is # done with module_hotfixes option repo_config.set(name, 'module_hotfixes', '1') if not os.path.isdir(self.shared_dnf_dir['reposd-dir']): Path.create(self.shared_dnf_dir['reposd-dir']) with open(repo_file, 'w') as repo: repo_config.write(repo) if customization_script: self.run_repo_customize(customization_script, repo_file) def import_trusted_keys(self, signing_keys: List) -> None: """ Imports trusted keys into the image :param list signing_keys: list of the key files to import """ rpmdb = RpmDataBase(self.root_dir) for key in signing_keys: rpmdb.import_signing_key_to_image(key) def delete_repo(self, name: str) -> None: """ Delete dnf repository :param str name: repository base file name """ Path.wipe(self.shared_dnf_dir['reposd-dir'] + '/' + name + '.repo') def delete_all_repos(self) -> None: """ Delete all dnf repositories """ Path.wipe(self.shared_dnf_dir['reposd-dir']) Path.create(self.shared_dnf_dir['reposd-dir']) def delete_repo_cache(self, name: str) -> None: """ Delete dnf repository cache The cache data for each repository is stored in a directory and additional files all starting with the repository name. The method glob deletes all files and directories matching the repository name followed by any characters to cleanup the cache information :param str name: repository name """ dnf_cache_glob_pattern = ''.join( [self.shared_dnf_dir['cache-dir'], os.sep, name, '*'] ) for dnf_cache_file in glob.iglob(dnf_cache_glob_pattern): Path.wipe(dnf_cache_file) def cleanup_unused_repos(self) -> None: """ Delete unused dnf repositories Repository configurations which are not used for this build must be removed otherwise they are taken into account for the package installations """ repos_dir = self.shared_dnf_dir['reposd-dir'] repo_files = list(os.walk(repos_dir))[0][2] for repo_file in repo_files: if repo_file not in self.repo_names: Path.wipe(repos_dir + '/' + repo_file) def _create_dnf_runtime_environment(self) -> Dict: for dnf_dir in list(self.shared_dnf_dir.values()): Path.create(dnf_dir) ToEnv(self.root_dir, defaults.PACKAGE_MANAGER_ENV_VARS) return dict(os.environ, **HostProxy().get_env(), LANG='C') def _create_runtime_config_parser(self) -> None: self.runtime_dnf_config = ConfigParser(interpolation=None) self.runtime_dnf_config["main"] = { "cachedir": self.shared_dnf_dir['cache-dir'], "reposdir": self.shared_dnf_dir['reposd-dir'], "varsdir": self.shared_dnf_dir['vars-dir'], "pluginconfpath": self.shared_dnf_dir['pluginconf-dir'], "keepcache": "1", "debuglevel": "2", "best": "1", "obsoletes": "1", "plugins": "1", "gpgcheck": self.gpg_check, } # The runtime config replaces the host dnf configuration. # Thus a proxy setup in the host dnf configuration needs # to be added explicitly self.runtime_dnf_config["main"].update(HostProxy.get_dnf_config()) if self.exclude_docs: self.runtime_dnf_config["main"]["tsflags"] = "nodocs" if self.target_arch: self.runtime_dnf_config["main"].update( { "arch": self.target_arch, "ignorearch": "1", } ) def _write_runtime_config(self) -> None: with open(self.runtime_dnf_config_file.name, 'w') as config: self.runtime_dnf_config.write(config) def cleanup(self) -> None: """ Delete intermediate dnf config file """ if os.path.isfile(self.runtime_dnf_config_file.name): os.unlink(self.runtime_dnf_config_file.name) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.747587 kiwi-11.1.8/kiwi/repository/dnf5.py0000644000000000000000000003253115273675667014117 0ustar00# Copyright (c) 2023 Marcus Schäfer. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import glob from configparser import ConfigParser from typing import List, Dict, Optional # project import kiwi.defaults as defaults from kiwi.utils.temporary import Temporary, TmpT from kiwi.defaults import Defaults from kiwi.command import Command from kiwi.repository.base import RepositoryBase from kiwi.path import Path from kiwi.utils.rpm_database import RpmDataBase from kiwi.utils.toenv import ToEnv from kiwi.utils.proxy import HostProxy class RepositoryDnf5(RepositoryBase): """ **Implements repository handling for next generation dnf5 package manager** :param str shared_dnf_dir: shared directory between image root and build system root :param str runtime_dnf_config_file: dnf runtime config file name :param dict command_env: customized os.environ for dnf :param str runtime_dnf_config: instance of :class:`ConfigParser` """ def post_init(self, custom_args: List = []) -> None: """ Post initialization method Store custom dnf arguments and create runtime configuration and environment :param list custom_args: dnf arguments """ self.runtime_dnf_config_file = TmpT(name='') self.custom_args = custom_args self.exclude_docs = False self.locale = None self.target_arch = None # extract custom arguments not used in dnf call if 'exclude_docs' in self.custom_args: self.custom_args.remove('exclude_docs') self.exclude_docs = True if 'check_signatures' in self.custom_args: self.custom_args.remove('check_signatures') self.gpg_check = '1' else: self.gpg_check = '0' for argument in self.custom_args: if '_install_langs' in argument: self.locale = argument elif '_target_arch' in argument: self.target_arch = argument if self.locale: self.custom_args.remove(self.locale) if self.target_arch: self.custom_args.remove(self.target_arch) self.target_arch = self.target_arch.split('%')[1] self.repo_names: List = [] # dnf support is based on creating repo files which contains # path names to the repo and its cache. In order to allow a # persistent use of the files in and outside of a chroot call # an active bind mount from RootBind::mount_shared_directory # is expected and required manager_base = self.shared_location + '/dnf' self.shared_dnf_dir = { 'reposd-dir': manager_base + '/repos', 'cache-dir': manager_base + '/cache', 'pluginconf-dir': manager_base + '/pluginconf', 'vars-dir': manager_base + '/vars', } self.runtime_dnf_config_file = Temporary( path=self.root_dir, prefix='kiwi_dnf5.config' ).unmanaged_file() self.dnf_args = [ '--config', self.runtime_dnf_config_file.name, '-y', '--disable-plugin=priorities,versionlock', ] + self.custom_args self.command_env = self._create_dnf_runtime_environment() # config file parameters for dnf tool self._create_runtime_config_parser() self._write_runtime_config() def setup_package_database_configuration(self) -> None: """ Setup rpm macros for bootstrapping and image building 1. Create the rpm image macro which persists during the build 2. Create the rpm bootstrap macro to make sure for bootstrapping the rpm database location matches the host rpm database setup. This macro only persists during the bootstrap phase. If the image was already bootstrapped a compat link is created instead. """ rpmdb = RpmDataBase( self.root_dir, Defaults.get_custom_rpm_image_macro_name() ) if self.locale: rpmdb.set_macro_from_string(self.locale) rpmdb.write_config() rpmdb = RpmDataBase(self.root_dir) if rpmdb.has_rpm(): rpmdb.link_database_to_host_path() else: rpmdb.set_database_to_host_path() # SUSE compat code: # # Manually adding the compat link /var/lib/rpm that points to the # rpmdb location as it is configured in the host rpm setup. DNF makes # use of the host setup to bootstrap or to read the signing keys # from the rpm database setup provisioned by rpm itself (macro level). # It assumes the host setup is the default for the system being built. # # For SUSE this is causing a mismatch as the host setup is not the RPM # default (/var/lib/rpm) and SUSE distros proactively relocate the rpm # database from the default location to a custom one when the # rpm package and related macros are installed for the first time. rpmdb.init_database() image_rpm_compat_link = '/var/lib/rpm' host_rpm_dbpath = rpmdb.rpmdb_host.expand_query('%_dbpath') if host_rpm_dbpath != image_rpm_compat_link: Path.create(self.root_dir + os.path.dirname(image_rpm_compat_link)) Command.run( [ 'ln', '-s', '--no-target-directory', ''.join(['../..', host_rpm_dbpath]), self.root_dir + image_rpm_compat_link, ], raise_on_error=False, ) def use_default_location(self) -> None: """ Setup dnf repository operations to store all data in the default places """ self.shared_dnf_dir['reposd-dir'] = self.root_dir + '/etc/yum.repos.d' self.shared_dnf_dir['cache-dir'] = self.root_dir + '/var/cache/libdnf5' self.shared_dnf_dir['pluginconf-dir'] = ( self.root_dir + '/etc/dnf/libdnf5-plugins' ) self.shared_dnf_dir['vars-dir'] = self.root_dir + '/etc/dnf/vars' self._create_runtime_config_parser() self._write_runtime_config() def runtime_config(self) -> Dict: """ dnf runtime configuration and environment :return: dnf_args:list, command_env:dict :rtype: dict """ return {'dnf_args': self.dnf_args, 'command_env': self.command_env} def add_repo( self, name: str, uri: str, repo_type: str = 'rpm-md', prio: Optional[int] = None, dist: Optional[str] = None, components: Optional[str] = None, user: Optional[str] = None, secret: Optional[str] = None, credentials_file: Optional[str] = None, repo_gpgcheck: bool = False, pkg_gpgcheck: bool = False, sourcetype: Optional[str] = None, customization_script: Optional[str] = None, architectures: Optional[str] = None, ) -> None: """ Add dnf repository :param str name: repository base file name :param str uri: repository URI :param str repo_type: repostory type name :param int prio: dnf repostory priority :param str dist: unused :param str components: unused :param str user: unused :param str secret: unused :param str credentials_file: unused :param bool repo_gpgcheck: enable repository signature validation :param bool pkg_gpgcheck: enable package signature validation :param str sourcetype: source type, one of 'baseurl', 'metalink' or 'mirrorlist' :param str customization_script: custom script called after the repo file was created :param str architectures: unused """ repo_file = self.shared_dnf_dir['reposd-dir'] + '/' + name + '.repo' self.repo_names.append(name + '.repo') if os.path.exists(uri): # dnf requires local paths to take the file: type uri = 'file://' + uri repo_config = ConfigParser(interpolation=None) repo_config.add_section(name) repo_config.set(name, 'name', name) repo_config.set(name, sourcetype if sourcetype else 'baseurl', uri) if prio: repo_config.set(name, 'priority', format(prio)) repo_config.set(name, 'repo_gpgcheck', '1' if repo_gpgcheck else '0') repo_config.set(name, 'gpgcheck', '1' if pkg_gpgcheck else '0') if Defaults.is_buildservice_worker(): # when building in the build service, modular metadata is # inaccessible. In order to use modular content in the build # service, we need to disable modular filtering, which is # done with module_hotfixes option repo_config.set(name, 'module_hotfixes', '1') if not os.path.isdir(self.shared_dnf_dir['reposd-dir']): Path.create(self.shared_dnf_dir['reposd-dir']) with open(repo_file, 'w') as repo: repo_config.write(repo) if customization_script: self.run_repo_customize(customization_script, repo_file) def import_trusted_keys(self, signing_keys: List) -> None: """ Imports trusted keys into the image :param list signing_keys: list of the key files to import """ rpmdb = RpmDataBase(self.root_dir) for key in signing_keys: rpmdb.import_signing_key_to_image(key) def delete_repo(self, name: str) -> None: """ Delete dnf repository :param str name: repository base file name """ Path.wipe(self.shared_dnf_dir['reposd-dir'] + '/' + name + '.repo') def delete_all_repos(self) -> None: """ Delete all dnf repositories """ Path.wipe(self.shared_dnf_dir['reposd-dir']) Path.create(self.shared_dnf_dir['reposd-dir']) def delete_repo_cache(self, name: str) -> None: """ Delete dnf repository cache The cache data for each repository is stored in a directory and additional files all starting with the repository name. The method glob deletes all files and directories matching the repository name followed by any characters to cleanup the cache information :param str name: repository name """ dnf_cache_glob_pattern = ''.join( [self.shared_dnf_dir['cache-dir'], os.sep, name, '*'] ) for dnf_cache_file in glob.iglob(dnf_cache_glob_pattern): Path.wipe(dnf_cache_file) def cleanup_unused_repos(self) -> None: """ Delete unused dnf repositories Repository configurations which are not used for this build must be removed otherwise they are taken into account for the package installations """ repos_dir = self.shared_dnf_dir['reposd-dir'] repo_files = list(os.walk(repos_dir))[0][2] for repo_file in repo_files: if repo_file not in self.repo_names: Path.wipe(repos_dir + '/' + repo_file) def _create_dnf_runtime_environment(self) -> Dict: for dnf_dir in list(self.shared_dnf_dir.values()): Path.create(dnf_dir) ToEnv(self.root_dir, defaults.PACKAGE_MANAGER_ENV_VARS) return dict(os.environ, **HostProxy().get_env(), LANG='C') def _create_runtime_config_parser(self) -> None: self.runtime_dnf_config = ConfigParser(interpolation=None) self.runtime_dnf_config["main"] = { "system_cachedir": self.shared_dnf_dir['cache-dir'], "reposdir": self.shared_dnf_dir['reposd-dir'], "varsdir": self.shared_dnf_dir['vars-dir'], "pluginconfpath": self.shared_dnf_dir['pluginconf-dir'], "keepcache": "1", "debuglevel": "2", "best": "1", "obsoletes": "1", "plugins": "0", "gpgcheck": self.gpg_check, } # The runtime config replaces the host dnf configuration. # Thus a proxy setup in the host dnf configuration needs # to be added explicitly self.runtime_dnf_config["main"].update(HostProxy.get_dnf_config()) if self.exclude_docs: self.runtime_dnf_config["main"]["tsflags"] = "nodocs" if self.target_arch: self.runtime_dnf_config["main"].update( { "arch": self.target_arch, "ignorearch": "1", } ) def _write_runtime_config(self) -> None: with open(self.runtime_dnf_config_file.name, 'w') as config: self.runtime_dnf_config.write(config) def cleanup(self) -> None: """ Delete intermediate dnf config file """ if os.path.isfile(self.runtime_dnf_config_file.name): os.unlink(self.runtime_dnf_config_file.name) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.747587 kiwi-11.1.8/kiwi/repository/pacman.py0000644000000000000000000002316715273675667014527 0ustar00# Copyright (c) 2019 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from configparser import ConfigParser from typing import List, Dict, Optional # project import kiwi.defaults as defaults from kiwi.utils.temporary import Temporary, TmpT from kiwi.repository.base import RepositoryBase from kiwi.path import Path from kiwi.command import Command from kiwi.utils.toenv import ToEnv from kiwi.utils.proxy import HostProxy log = logging.getLogger('kiwi') class RepositoryPacman(RepositoryBase): """ **Implements repo handling for pacman package manager** :param str shared_pacman_dir: shared directory between image root and build system root :param str runtime_pacman_config_file: pacman runtime config file name :param list pacman_args: pacman caller args plus additional custom args :param dict command_env: customized os.environ for pacman """ def post_init(self, custom_args: List = []) -> None: """ Post initialization method Store custom pacman arguments and create runtime configuration and environment :param list custom_args: pacman arguments """ self.runtime_pacman_config_file = TmpT(name='') self.custom_args = custom_args self.check_signatures = False self.repo_names: List = [] # delete custom arguments not used for pacman for argument in self.custom_args: if ( '_install_langs' in argument or '_target_arch' in argument or 'exclude_docs' in argument ): log.warning( f'Custom argument {argument} will be ignored for pacman' ) self.custom_args.remove(argument) self.runtime_pacman_config_file = Temporary( path=self.root_dir, prefix='kiwi_pacman.config' ).unmanaged_file() if 'check_signatures' in self.custom_args: self.custom_args.remove('check_signatures') self.check_signatures = True manager_base = self.shared_location + '/pacman' self.shared_pacman_dir = { 'cache-dir': manager_base + '/cache', 'repos-dir': manager_base + '/repos', } Path.create(self.shared_pacman_dir['repos-dir']) self.pacman_args = [ '--config', self.runtime_pacman_config_file.name, '--noconfirm', ] self._write_runtime_config() def use_default_location(self) -> None: """ Setup pacman repository operations to store all data in the default places """ self.shared_pacman_dir['repos-dir'] = self.root_dir + '/etc/pacman.d' def runtime_config(self) -> Dict: """ pacman runtime configuration and environment """ ToEnv(self.root_dir, defaults.PACKAGE_MANAGER_ENV_VARS) return { 'pacman_args': self.pacman_args, 'command_env': dict(os.environ, **HostProxy().get_env()), } def _add_repo_section( self, config_parser: ConfigParser, name: str, uri: str, repo_gpgcheck: bool = False, pkg_gpgcheck: bool = False, ) -> None: config_parser.add_section(name) if uri.startswith(os.sep) and os.path.exists(uri): uri = 'file://{}'.format(uri) config_parser.set(name, 'Server', uri) config_parser.set( name, 'SigLevel', '{0} {1}'.format( 'Required' if pkg_gpgcheck else 'Never', 'DatabaseRequired' if repo_gpgcheck else 'DatabaseNever', ), ) def add_repo( self, name: str, uri: str, repo_type: Optional[str] = None, prio: Optional[int] = None, dist: Optional[str] = None, components: Optional[str] = None, user: Optional[str] = None, secret: Optional[str] = None, credentials_file: Optional[str] = None, repo_gpgcheck: bool = False, pkg_gpgcheck: bool = False, sourcetype: Optional[str] = None, customization_script: Optional[str] = None, architectures: Optional[str] = None, ) -> None: """ Add pacman repository :param str name: repository base file name :param str uri: repository URI :param str repo_type: unused :param int prio: :param dist: unused :param str components: components to be used from this repository :param str user: unused :param str secret: unused :param credentials_file: unused :param bool repo_gpgcheck: enable database signature validation :param bool pkg_gpgcheck: enable package signature validation :param str sourcetype: unused :param str customization_script: custom script called after the repo file was created :param str architectures: unused """ repo_file = '{0}/{1}.repo'.format( self.shared_pacman_dir['repos-dir'], name ) self.repo_names.append(name + '.repo') repo_config = ConfigParser() repo_config.optionxform = str # type: ignore[method-assign, assignment] if not components: self._add_repo_section( repo_config, name, uri, repo_gpgcheck, pkg_gpgcheck ) else: for component in components.split(): self._add_repo_section( repo_config, component, uri, repo_gpgcheck, pkg_gpgcheck ) with open(repo_file, 'w') as config: repo_config.write(config) if customization_script: self.run_repo_customize(customization_script, repo_file) def import_trusted_keys(self, signing_keys: List) -> None: """ pacman runtime configuration and environment """ for signing_key in signing_keys: if os.path.exists(signing_key): Command.run(['pacman-key', '--recv-keys', signing_key]) else: Command.run(['pacman-key', '--add', signing_key]) def delete_repo(self, name: str) -> None: """ Delete pacman repository :param str name: repository name """ Path.wipe( '{0}/{1}.repo'.format(self.shared_pacman_dir['repos-dir'], name) ) def delete_all_repos(self) -> None: """ Delete all pacman repositories """ Path.wipe(self.shared_pacman_dir['repos-dir']) Path.create(self.shared_pacman_dir['repos-dir']) def delete_repo_cache(self, name: str) -> None: """ Delete pacman repository cache The method deletes these directories to cleanup the cache information :param str name: repository name """ Path.wipe(self.shared_pacman_dir['cache-dir']) def setup_package_database_configuration(self) -> None: """ Creates the folder that will contain the package manager database """ Path.create(os.sep.join([self.root_dir, 'var/lib/pacman'])) def cleanup_unused_repos(self) -> None: """ Delete unused pacman repositories Repository configurations which are not used for this build must be removed otherwise they are taken into account for the package installations """ repos_dir = self.shared_pacman_dir['repos-dir'] repo_files = list(os.walk(repos_dir))[0][2] for repo_file in repo_files: if repo_file not in self.repo_names: Path.wipe(repos_dir + '/' + repo_file) def _write_runtime_config(self) -> None: runtime_pacman_config = ConfigParser() runtime_pacman_config.optionxform = str # type: ignore[method-assign, assignment] runtime_pacman_config.add_section('options') runtime_pacman_config.set('options', 'Architecture', 'auto') runtime_pacman_config.set( 'options', 'CacheDir', self.shared_pacman_dir['cache-dir'] ) if self.check_signatures: runtime_pacman_config.set( 'options', 'SigLevel', 'Required DatabaseRequired' ) runtime_pacman_config.set( 'options', 'LocalFileSigLevel', 'Required DatabaseRequired' ) else: runtime_pacman_config.set( 'options', 'SigLevel', 'Never DatabaseNever' ) runtime_pacman_config.set( 'options', 'LocalFileSigLevel', 'Never DatabaseNever' ) runtime_pacman_config.set( 'options', 'Include', '{0}/*.repo'.format(self.shared_pacman_dir['repos-dir']), ) with open(self.runtime_pacman_config_file.name, 'w') as config: runtime_pacman_config.write(config) def cleanup(self) -> None: """ Delete intermediate pacman config file """ if os.path.isfile(self.runtime_pacman_config_file.name): os.unlink(self.runtime_pacman_config_file.name) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.747587 kiwi-11.1.8/kiwi/repository/template/__init__.py0000644000000000000000000000000015273675667016617 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7479773 kiwi-11.1.8/kiwi/repository/template/apt.py0000644000000000000000000000602515273675667015661 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from string import Template from textwrap import dedent class PackageManagerTemplateAptGet: """ apt-get configuration file template """ def __init__(self) -> None: self.host_header = ( dedent( ''' # kiwi generated apt-get config file Dir "/"; Dir::State "${apt_shared_base}/"; Dir::State::status "/var/lib/dpkg/status.kiwi"; Dir::Cache "${apt_shared_base}/"; Dir::Etc "${apt_shared_base}/"; ''' ).strip() + os.linesep ) self.image_header = ( dedent( ''' # kiwi generated apt-get config file Dir "/"; ''' ).strip() + os.linesep ) self.apt = ( dedent( ''' APT { Get { AllowDowngrades "true"; AllowRemoveEssential "true"; AllowChangeHeldPackages "true"; AllowUnauthenticated "${unauthenticated}"; } }; ''' ).strip() + os.linesep ) self.dpkg_exclude_docs = ( dedent( ''' DPkg::Options { "--path-exclude=/usr/share/man/*"; "--path-exclude=/usr/share/doc/*"; "--path-include=/usr/share/doc/*/copyright"; }; ''' ).strip() + os.linesep ) def get_host_template(self, exclude_docs: bool = False) -> Template: """ apt-get package manager template for apt-get called outside of the image, not chrooted :rtype: Template """ template_data = self.host_header + self.apt if exclude_docs: template_data += self.dpkg_exclude_docs return Template(template_data) def get_image_template(self, exclude_docs: bool = False) -> Template: """ apt-get package manager template for apt-get called inside of the image, chrooted :rtype: Template """ template_data = self.image_header + self.apt if exclude_docs: template_data += self.dpkg_exclude_docs return Template(template_data) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7479773 kiwi-11.1.8/kiwi/repository/zypper.py0000644000000000000000000004630115273675667014614 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import re import logging from configparser import ConfigParser from types import TracebackType from typing import List, Dict, Optional, Type # project import kiwi.defaults as defaults from kiwi.utils.temporary import Temporary, TmpT from kiwi.defaults import Defaults from kiwi.command import Command from kiwi.repository.base import RepositoryBase from kiwi.system.uri import Uri from kiwi.path import Path from kiwi.utils.rpm_database import RpmDataBase from kiwi.utils.toenv import ToEnv from kiwi.utils.proxy import HostProxy log = logging.getLogger('kiwi') class RepositoryZypper(RepositoryBase): """ **Implements repo handling for zypper package manager** :param str shared_zypper_dir: shared directory between image root and build system root :param str runtime_zypper_config_file: zypper runtime config file name :param str runtime_zypp_config_file: libzypp runtime config file name :param list zypper_args: zypper caller args plus additional custom args :param dict command_env: customized os.environ for zypper :param object runtime_zypper_config: instance of :class:`ConfigParser` """ def post_init(self, custom_args: List = []) -> None: """ Post initialization method Store custom zypper arguments and create runtime configuration and environment :param list custom_args: zypper arguments """ self.runtime_zypper_config_file = TmpT(name='') self.runtime_zypp_config_file = TmpT(name='') self.custom_args = custom_args self.exclude_docs = False self.gpgcheck = False self.locale = None self.target_arch = None # extract custom arguments used for zypp config only if 'exclude_docs' in self.custom_args: self.custom_args.remove('exclude_docs') self.exclude_docs = True if 'check_signatures' in self.custom_args: self.custom_args.remove('check_signatures') self.gpgcheck = True for argument in self.custom_args: if '_install_langs' in argument: self.locale = argument elif '_target_arch' in argument: self.target_arch = argument if self.locale: self.custom_args.remove(self.locale) if self.target_arch: self.custom_args.remove(self.target_arch) self.target_arch = self.target_arch.split('%')[1] self.repo_names: List = [] # zypper support by default point all actions into the root # directory of the image system. This information is passed # as arguments to zypper and adapted if the call runs as # chrooted operation. Therefore the use of the shared location # via RootBind::mount_shared_directory is optional but # recommended to make use of the repo cache manager_base = self.root_dir + self.shared_location self.shared_zypper_dir = { 'pkg-cache-dir': os.sep.join([manager_base, 'packages']), 'reposd-dir': os.sep.join([manager_base, 'zypper/repos']), 'credentials-dir': os.sep.join( [manager_base, 'zypper/credentials'] ), 'solv-cache-dir': os.sep.join([manager_base, 'zypper/solv']), 'raw-cache-dir': os.sep.join([manager_base, 'zypper/raw']), 'cache-dir': os.sep.join([manager_base, 'zypper']), } self.runtime_zypper_config_file = Temporary( path=self.root_dir, prefix='kiwi_zypper.config' ).unmanaged_file() self.runtime_zypp_config_file = Temporary( path=self.root_dir, prefix='kiwi_zypp.config' ).unmanaged_file() self.zypper_args = [ '--non-interactive', '--gpg-auto-import-keys', '--pkg-cache-dir', self.shared_zypper_dir['pkg-cache-dir'], '--reposd-dir', self.shared_zypper_dir['reposd-dir'], '--solv-cache-dir', self.shared_zypper_dir['solv-cache-dir'], '--cache-dir', self.shared_zypper_dir['cache-dir'], '--raw-cache-dir', self.shared_zypper_dir['raw-cache-dir'], '--config', self.runtime_zypper_config_file.name, ] + self.custom_args self.command_env = self._create_zypper_runtime_environment() self._setup_intermediate_proxy_config() # config file parameters for zypper tool self.runtime_zypper_config = ConfigParser(interpolation=None) self.runtime_zypper_config.add_section('main') # config file parameters for libzypp library self.runtime_zypp_config = ConfigParser(interpolation=None) self.runtime_zypp_config.add_section('main') self.runtime_zypp_config.set( 'main', 'credentials.global.dir', self.shared_zypper_dir['credentials-dir'], ) if self.target_arch: self.runtime_zypp_config.set('main', 'arch', self.target_arch) if self.exclude_docs: self.runtime_zypp_config.set( 'main', 'rpm.install.excludedocs', 'yes' ) if self.gpgcheck: self.runtime_zypp_config.set('main', 'gpgcheck', '1') else: self.runtime_zypp_config.set('main', 'gpgcheck', '0') self._write_runtime_config() def setup_package_database_configuration(self) -> None: """ Setup rpm macros for bootstrapping and image building 1. Create the rpm image macro which persists during the build 2. Create the rpm bootstrap macro to make sure for bootstrapping the rpm database location matches the host rpm database setup. This macro only persists during the bootstrap phase. If the image was already bootstrapped a compat link is created instead. 3. Create zypper compat link """ rpmdb = RpmDataBase( self.root_dir, Defaults.get_custom_rpm_image_macro_name() ) if self.locale: rpmdb.set_macro_from_string(self.locale) rpmdb.write_config() rpmdb = RpmDataBase(self.root_dir) if rpmdb.has_rpm(): rpmdb.link_database_to_host_path() else: rpmdb.set_database_to_host_path() # Zypper compat code: # # Manually adding the compat link /var/lib/rpm that points to the # rpmdb location as it is configured in the host rpm setup. The # host rpm setup is taken into account because import_trusted_keys # is called during the bootstrap phase where rpm (respectively zypper) # is called from the host # # Usually it is expected that the package manager reads the # signing keys from the rpm database setup provisioned by rpm # itself (macro level) but zypper doesn't take the rpm macro # setup into account and relies on a hard coded path which we # can only provide as a symlink. # # That symlink is usually created by the rpm package when it gets # installed. However at that early phase when we import the # signing keys no rpm is installed yet nor any symlink exists. # Thus we have to create it here and hope to get rid of it in the # future. # # For further details on the motivation in zypper please # refer to bsc#1112357 rpmdb.init_database() image_rpm_compat_link = '/var/lib/rpm' host_rpm_dbpath = rpmdb.rpmdb_host.expand_query('%_dbpath') if host_rpm_dbpath != image_rpm_compat_link: Path.create(self.root_dir + os.path.dirname(image_rpm_compat_link)) Command.run( [ 'ln', '-s', '--no-target-directory', ''.join(['../..', host_rpm_dbpath]), self.root_dir + image_rpm_compat_link, ], raise_on_error=False, ) def use_default_location(self) -> None: """ Setup zypper repository operations to store all data in the default places """ self.shared_zypper_dir['reposd-dir'] = ( self.root_dir + '/etc/zypp/repos.d' ) self.shared_zypper_dir['credentials-dir'] = ( self.root_dir + '/etc/zypp/credentials.d' ) self.zypper_args = [ '--non-interactive', ] + self.custom_args self.command_env = dict(os.environ, **HostProxy().get_env(), LANG='C') def runtime_config(self) -> Dict: """ zypper runtime configuration and environment """ return { 'zypper_args': self.zypper_args, 'command_env': self.command_env, } def add_repo( self, name: str, uri: str, repo_type: str = 'rpm-md', prio: Optional[int] = None, dist: Optional[str] = None, components: Optional[str] = None, user: Optional[str] = None, secret: Optional[str] = None, credentials_file: Optional[str] = None, repo_gpgcheck: bool = False, pkg_gpgcheck: bool = False, sourcetype: Optional[str] = None, customization_script: Optional[str] = None, architectures: Optional[str] = None, ) -> None: """ Add zypper repository :param str name: repository name :param str uri: repository URI :param str repo_type: repostory type name :param int prio: zypper repostory priority :param str dist: unused :param str components: unused :param str user: credentials username :param str secret: credentials password :param str credentials_file: zypper credentials file :param bool repo_gpgcheck: enable repository signature validation :param bool pkg_gpgcheck: enable package signature validation :param str sourcetype: unused :param str customization_script: custom script called after the repo file was created :param str architectures: unused """ if credentials_file: repo_secret = os.sep.join( [self.shared_zypper_dir['credentials-dir'], credentials_file] ) if os.path.exists(repo_secret): Path.wipe(repo_secret) if user and secret: uri = ''.join([uri, '?credentials=', credentials_file]) with open(repo_secret, 'w') as credentials: credentials.write( 'username={0}{1}'.format(user, os.linesep) ) credentials.write( 'password={0}{1}'.format(secret, os.linesep) ) repo_file = ''.join( [self.shared_zypper_dir['reposd-dir'], '/', name, '.repo'] ) self.repo_names.append(''.join([name, '.repo'])) if os.path.exists(repo_file): Path.wipe(repo_file) self._backup_package_cache() zypper_addrepo_command = ( ['zypper'] + self.zypper_args + [ '--root', self.root_dir, 'addrepo', '--refresh', ( '--keep-packages' if Uri(uri).is_remote() else '--no-keep-packages' ), '--no-check', uri, name, ] ) try: Command.run(zypper_addrepo_command, self.command_env) except Exception: # for whatever reason zypper sometimes failes with # a 'failed to cache rpm database' error. I could not # find any reason why and a simple recall of the exact # same command in the exact same environment works. # Thus the stupid but simple workaround to this problem # is try one recall before really failing Command.run(zypper_addrepo_command, self.command_env) repo_config = ConfigParser(interpolation=None) repo_config.read(repo_file) baseurl = uri uri_with_credentials_pattern = '^(.*):(.*)@(.*)$' sensitive_match = re.match(uri_with_credentials_pattern, baseurl) if sensitive_match: # rewrite baseurl with credentials information because zypper # addrepo does strange things with the provided url encoded data repo_config.set(name, 'baseurl', baseurl) repo_config.set(name, 'repo_gpgcheck', '1' if repo_gpgcheck else '0') repo_config.set(name, 'pkg_gpgcheck', '1' if pkg_gpgcheck else '0') if prio: repo_config.set(name, 'priority', format(prio)) with open(repo_file, 'w') as repo: repo_config.write(repo) if customization_script: self.run_repo_customize(customization_script, repo_file) self._restore_package_cache() def import_trusted_keys(self, signing_keys: List) -> None: """ Imports trusted keys into the image :param list signing_keys: list of the key files to import """ rpmdb = RpmDataBase(self.root_dir) for key in signing_keys: rpmdb.import_signing_key_to_image(key) def delete_repo(self, name: str) -> None: """ Delete zypper repository :param str name: repository name """ Command.run( ['zypper'] + self.zypper_args + ['--root', self.root_dir, 'removerepo', name], self.command_env, ) def delete_all_repos(self) -> None: """ Delete all zypper repositories """ Path.wipe(self.shared_zypper_dir['reposd-dir']) Path.create(self.shared_zypper_dir['reposd-dir']) def delete_repo_cache(self, name: str) -> None: """ Delete zypper repository cache The cache data for each repository is stored in a list of directories of the same name as the repository name. The method deletes these directories to cleanup the cache information :param str name: repository name """ Path.wipe(os.sep.join([self.shared_zypper_dir['pkg-cache-dir'], name])) Path.wipe(os.sep.join([self.shared_zypper_dir['solv-cache-dir'], name])) Path.wipe(os.sep.join([self.shared_zypper_dir['raw-cache-dir'], name])) def cleanup_unused_repos(self) -> None: """ Delete unused zypper repositories zypper creates a system solvable which is unwanted for the purpose of building images. In addition zypper fails with an error message 'Failed to cache rpm database' if such a system solvable exists and a new root system is created All other repository configurations which are not used for this build must be removed too, otherwise they are taken into account for the package installations """ solv_dir = self.shared_zypper_dir['solv-cache-dir'] Path.wipe(solv_dir + '/@System') repos_dir = self.shared_zypper_dir['reposd-dir'] repo_files = list(os.walk(repos_dir))[0][2] for repo_file in repo_files: if repo_file not in self.repo_names: Path.wipe(repos_dir + '/' + repo_file) def _create_zypper_runtime_environment(self) -> Dict: for zypper_dir in list(self.shared_zypper_dir.values()): Path.create(zypper_dir) ToEnv(self.root_dir, defaults.PACKAGE_MANAGER_ENV_VARS) return dict( os.environ, **HostProxy().get_env(), LANG='C', ZYPP_CONF=self.runtime_zypp_config_file.name, ) def _setup_intermediate_proxy_config(self) -> None: """ libzypp reads the proxy setup from /etc/sysconfig/proxy only and ignores proxy environment variables. If the host does not provide this file, RootBind could not copy it as intermediate config into the image root. Thus a host proxy setup from the environment would not be taken into account by zypper calls inside of the image root. For this case create the intermediate config file from the host proxy setup """ sysconfig_proxy = '/etc/sysconfig/proxy' if os.path.exists(defaults.HOST_SYSCONFIG_PROXY): return if os.path.islink(self.root_dir + sysconfig_proxy): # intermediate config already created return host_proxy = HostProxy() if host_proxy.has_proxy(): log.info( f'Creating intermediate {sysconfig_proxy} from host proxy setup' ) self.root_bind.add_intermediate_config( sysconfig_proxy, host_proxy.get_sysconfig_data() ) def _write_runtime_config(self) -> None: with open(self.runtime_zypper_config_file.name, 'w') as config: self.runtime_zypper_config.write(config) with open(self.runtime_zypp_config_file.name, 'w') as config: self.runtime_zypp_config.write(config) def _backup_package_cache(self) -> None: """ preserve package cache which otherwise will be removed by zypper if no repo file is found. But this situation is normal for an image build process which setup and remove repos for building at runtime """ self._move_package_cache(backup=True) def _restore_package_cache(self) -> None: """ restore preserved package cache at the location passed to zypper """ self._move_package_cache(restore=True) def _move_package_cache( self, backup: bool = False, restore: bool = False ) -> None: package_cache = self.shared_location + '/packages' package_cache_moved = package_cache + '.moved' if backup and os.path.exists(package_cache): Command.run(['mv', '-f', package_cache, package_cache_moved]) elif restore and os.path.exists(package_cache_moved): Command.run(['mv', '-f', package_cache_moved, package_cache]) def cleanup(self) -> None: """ Delete intermediate zypp and zypper config files """ if os.path.isfile(self.runtime_zypper_config_file.name): os.unlink(self.runtime_zypper_config_file.name) if os.path.isfile(self.runtime_zypp_config_file.name): os.unlink(self.runtime_zypp_config_file.name) def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: self._restore_package_cache() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7479773 kiwi-11.1.8/kiwi/runtime_checker.py0000644000000000000000000014346715273675667014226 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import json import re import logging from textwrap import dedent from typing import NamedTuple, Dict, List, Any # project from kiwi.version import __version__ from io import StringIO from kiwi.xml_description import XMLDescription from kiwi.firmware import FirmWare from kiwi.xml_state import XMLState from kiwi.system.uri import Uri from kiwi.defaults import Defaults from kiwi.command import Command from kiwi.path import Path from kiwi.system.kernel import Kernel from kiwi.utils.command_capabilities import CommandCapabilities from kiwi.runtime_config import RuntimeConfig from kiwi.exceptions import KiwiRuntimeError import kiwi.defaults as defaults dracut_module_type = NamedTuple( 'dracut_module_type', [('package', str), ('min_version', str)] ) log = logging.getLogger('kiwi') class RuntimeChecker: """ **Implements build consistency checks at runtime** """ def __init__(self, xml_state: XMLState) -> None: """ The schema of an image description covers structure and syntax of the provided data. The RuntimeChecker provides methods to perform further semantic checks which allows to recognize potential build or boot problems early. :param object xml_state: Instance of XMLState """ self.xml_state = xml_state def check_repositories_configured(self) -> None: """ Verify that there are repositories configured """ if not self.xml_state.get_repository_sections(): raise KiwiRuntimeError('No repositories configured') @staticmethod def check_target_dir_on_unsupported_filesystem(target_dir: str) -> None: """ Raise if the given target dir does not reside on a filesystem that supports all important features like extended permissions(fscaps), ACLs or xattrs. """ message = dedent( '''\n Target root/image directory is lacking filesystem features The filesystem {0} in the target path {1} does not support important features like extended permissions, ACLs or xattrs. The image build may fail or the resulting image misbehave. ''' ) target_dir = Path.first_exists(target_dir) stat = Command.run(['stat', '-f', '-c', '%T', target_dir]) if stat: target_fs = stat.output.strip() supported_target_filesystem = ( 'btrfs', 'ext2', 'ext2/ext3', 'ext3', 'ext4', 'overlayfs', 'tmpfs', 'xfs', ) if target_fs not in supported_target_filesystem: raise KiwiRuntimeError(message.format(target_fs, target_dir)) def check_include_references_unresolvable(self) -> None: """ Raise for still included statements as not resolvable. The KIWI XSLT processing replaces the specified include directive(s) with the given file reference(s). If this action did not happen for example on nested includes, it can happen that they stay in the document as sort of waste. """ message = dedent( '''\n One ore more statements are unresolvable The following include references could not be resolved. Please verify the specified location(s) and/or delete the broken include directive(s) from the description. Please also note, nested includes from other include files are not supported: {0} ''' ) include_files = ( self.xml_state.get_include_section_reference_file_names() ) if include_files: raise KiwiRuntimeError( message.format(json.dumps(include_files, indent=4)) ) def check_image_include_repos_publicly_resolvable(self) -> None: """ Verify that all repos marked with the imageinclude attribute can be resolved into a http based web URL """ message = dedent( '''\n The use of imageinclude="true" in the repository definition for the Repository: {0} requires the repository to by publicly available. The source locator of the repository however indicates it is private to your local system. Therefore it can't be included into the system image repository configuration. Please define a publicly available repository in your image XML description. ''' ) repository_sections = self.xml_state.get_repository_sections() for xml_repo in repository_sections: repo_marked_for_image_include = xml_repo.get_imageinclude() if repo_marked_for_image_include: repo_source = xml_repo.get_source().get_path() repo_type = xml_repo.get_type() uri = Uri(repo_source, repo_type) if not uri.is_public(): raise KiwiRuntimeError(message.format(repo_source)) @staticmethod def check_target_directory_not_in_shared_cache(target_dir: str) -> None: """ The target directory must be outside of the kiwi shared cache directory in order to avoid busy mounts because kiwi bind mounts the cache directory into the image root tree to access host caching information :param string target_dir: path name """ message = dedent( '''\n Target directory %s conflicts with kiwi's shared cache directory %s. This is going to create a busy loop mount. Please choose another target directory. ''' ) shared_cache_location = Defaults.get_shared_cache_location() target_dir_stack = ( os.path.abspath(os.path.normpath(target_dir)) .replace(os.sep + os.sep, os.sep) .split(os.sep) ) if target_dir_stack[1:4] == shared_cache_location.split(os.sep): raise KiwiRuntimeError( message % (target_dir, shared_cache_location) ) def check_volume_label_used_with_lvm(self) -> None: """ The optional volume label in a systemdisk setup is only effective if the LVM, logical volume manager system is used. In any other case where the filesystem itself offers volume management capabilities there are no extra filesystem labels which can be applied per volume """ message = dedent( '''\n Custom volume label setup used without LVM The optional volume label in a systemdisk setup is only effective if the LVM, logical volume manager system is used. Your setup uses the {0} filesystem which itself offers volume management capabilities. Extra filesystem labels cannot be applied in this case. If you want to force LVM over the {0} volume management system you can do so by specifying the following in your KIWI XML description: ''' ) volume_management = self.xml_state.get_volume_management() if volume_management != 'lvm': for volume in self.xml_state.get_volumes(): if volume.label and volume.label != 'SWAP': raise KiwiRuntimeError(message.format(volume_management)) def check_partuuid_persistency_type_used_with_mbr(self) -> None: """ The devicepersistency setting by-partuuid can only be used in combination with a partition table type that supports UUIDs. In any other case Linux creates artificial values for PTUUID and PARTUUID from the disk signature which can change without touching the actual partition table. We consider this unsafe and only allow the use of by-partuuid in combination with partition tables that actually supports it properly. """ message = dedent( '''\n devicepersistency={0!r} used with non UUID capable partition table PTUUID and PARTUUID exists in the GUID (GPT) partition table. According to the firmware setting: {1!r}, the selected partition table type is: {2!r}. This table type does not natively support UUIDs. In such a case Linux creates artificial values for PTUUID and PARTUUID from the disk signature which can change without touching the actual partition table. This is considered unsafe and KIWI only allows the use of by-partuuid in combination with partition tables that actually supports UUIDs properly. Please make sure to use one of the following firmware settings which leads to an image using an UUID capable partition table and therefore supporting consistent by-partuuid device names: ''' ) persistency_type = self.xml_state.build_type.get_devicepersistency() if persistency_type and persistency_type == 'by-partuuid': supported_table_types = ['gpt'] firmware = FirmWare(self.xml_state) table_type = firmware.get_partition_table_type() if table_type not in supported_table_types: raise KiwiRuntimeError( message.format( persistency_type, firmware.firmware, table_type ) ) def check_swap_name_used_with_lvm(self) -> None: """ The optional oem-swapname is only effective if used together with the LVM volume manager. A name for the swap space can only be set if it is created as a LVM volume. In any other case the name does not apply to the system """ message = dedent( '''\n Specified swap space name: {0} will not be used The specified oem-swapname is used without the LVM volume manager. This means the swap space will be created as simple partition for which no name assignment can take place. The name specified in oem-swapname is used to give the LVM swap volume a name. Outside of LVM the setting is meaningless and should be removed. Please delete the following setting from your image description: {0} ''' ) volume_management = self.xml_state.get_volume_management() if volume_management != 'lvm': oemconfig = self.xml_state.get_build_type_oemconfig_section() if oemconfig and oemconfig.get_oem_swapname(): raise KiwiRuntimeError( message.format(oemconfig.get_oem_swapname()[0]) ) def check_volume_setup_defines_reserved_labels(self) -> None: message = dedent( '''\n Reserved label name used in LVM volume setup The label setup for volume {0} uses the reserved label {1}. Reserved labels used by KIWI internally are {2}. Please choose another label name for this volume. ''' ) reserved_labels = [ self.xml_state.build_type.get_rootfs_label() or 'ROOT', 'SWAP', 'SPARE', ] volume_management = self.xml_state.get_volume_management() if volume_management == 'lvm': for volume in self.xml_state.get_volumes(): # A swap volume is created implicitly if oem-swap is # requested. This volume detected via realpath set to # swap is skipped from the reserved label check as it # intentionally uses the reserved label named SWAP if volume.realpath != 'swap': if volume.label and volume.label in reserved_labels: raise KiwiRuntimeError( message.format( volume.name, volume.label, reserved_labels ) ) def check_volume_setup_defines_multiple_fullsize_volumes(self) -> None: """ The volume size specification 'all' makes this volume to take the rest space available on the system. It's only allowed to specify one all size volume """ message = dedent( '''\n Multiple all size volumes found but only one is allowed The volume size specification 'all' makes this volume to take the rest space available on the system. It's only allowed to specify one all size volume ''' ) systemdisk_section = self.xml_state.get_build_type_system_disk_section() if systemdisk_section: all_size_volume_count = 0 volumes = systemdisk_section.get_volume() or [] for volume in volumes: size = volume.get_size() or volume.get_freespace() if size and 'all' in size: all_size_volume_count += 1 if all_size_volume_count > 1: raise KiwiRuntimeError(message) def check_volume_setup_has_no_root_definition(self) -> None: """ The root volume in a systemdisk setup is handled in a special way. It is not allowed to setup a custom name or mountpoint for the root volume. Therefore the size of the root volume can be setup via the @root volume name. This check looks up the volume setup and searches if there is a configuration for the '/' mountpoint which would cause the image build to fail """ message = dedent( '''\n Volume setup for "/" found. The size of the root volume must be specified via the @root volume name like the following example shows: A custom name or mountpoint for the root volume is not allowed. ''' ) for volume in self.xml_state.get_volumes(): if volume.mountpoint == '/': raise KiwiRuntimeError(message) def check_container_tool_chain_installed(self) -> None: """ When creating container images the specific tools are used in order to import and export OCI or Docker compatible images. This check searches for those tools to be installed in the build system and fails if it can't find them """ message_tool_not_found = dedent( '''\n Required tool {name} not found in caller environment Creation of OCI or Docker images requires the tools {name} and skopeo to be installed on the build system. For SUSE based systems you can find the tools at: http://download.opensuse.org/repositories/Virtualization:/containers ''' ) message_version_unsupported = dedent( '''\n {name} tool found with unknown version ''' ) message_unknown_tool = dedent( '''\n Unknown tool: {0}. Please configure KIWI with an appropriate value (umoci or buildah). Consider this runtime configuration file syntax (/etc/kiwi.yml): oci: - archive_tool: umoci | buildah ''' ) expected_version = (0, 1, 0) if self.xml_state.get_build_type_name() in ['docker', 'oci']: runtime_config = RuntimeConfig() tool_name = runtime_config.get_oci_archive_tool() if tool_name == 'buildah': oci_tools = ['buildah', 'skopeo'] elif tool_name == 'umoci': oci_tools = ['umoci', 'skopeo'] else: raise KiwiRuntimeError(message_unknown_tool.format(tool_name)) for tool in oci_tools: if not Path.which(filename=tool, access_mode=os.X_OK): raise KiwiRuntimeError( message_tool_not_found.format(name=tool) ) elif not CommandCapabilities.check_version( tool, expected_version, raise_on_error=False ): raise KiwiRuntimeError( message_version_unsupported.format(name=tool) ) self._check_multitag_support() def _check_multitag_support(self) -> None: message = dedent( '''\n Using additionaltags attribute requires skopeo tool to be capable to handle it, it must include the '--additional-tag' option for copy subcommand (check it running 'skopeo copy --help').\n It is known to be present since v0.1.30 ''' ) if 'additional_names' in self.xml_state.get_container_config(): if not CommandCapabilities.has_option_in_help( 'skopeo', '--additional-tag', ['copy', '--help'], raise_on_error=False, ): raise KiwiRuntimeError(message) def check_luksformat_options_valid(self) -> None: """ Options set via the luksformat element are passed along to the cryptsetup tool. Only options that are known to the tool should be allowed. Thus this runtime check looks up the provided option names if they exist in the cryptsetup version used on the build host """ message = dedent( '''\n Option {0!r} not found in cryptsetup The Option {0!r} could not be found in the help output of the cryptsetup tool. ''' ) luksformat = self.xml_state.build_type.get_luksformat() if luksformat: for option in luksformat[0].get_option(): argument = option.get_name() if not CommandCapabilities.has_option_in_help( 'cryptsetup', argument, ['--help'], raise_on_error=False ): raise KiwiRuntimeError(message.format(argument)) def check_appx_naming_conventions_valid(self) -> None: """ When building wsl images there are some naming conventions that must be fulfilled to run the container on Microsoft Windows """ launcher_pattern = r'[^\\]+(\.[Ee][Xx][Ee])$' message_container_launcher_invalid = dedent( '''\n Invalid WSL launcher name: {0} WSL launcher name must match the pattern: {1} ''' ) id_pattern = r'^[a-zA-Z0-9]+$' message_container_id_invalid = dedent( '''\n Invalid WSL container application id: {0} WSL container id must match the pattern: {1} ''' ) build_type = self.xml_state.get_build_type_name() container_config = self.xml_state.get_container_config() container_history = container_config.get('history') or {} if build_type == 'appx' and container_config: launcher = container_history.get('launcher') if launcher and not re.match(launcher_pattern, launcher): raise KiwiRuntimeError( message_container_launcher_invalid.format( launcher, launcher_pattern ) ) application_id = container_history.get('application_id') if application_id and not re.match(id_pattern, application_id): raise KiwiRuntimeError( message_container_id_invalid.format( application_id, id_pattern ) ) def check_initrd_selection_required(self) -> None: """ If the boot attribute is used without selecting kiwi as the initrd_system, the setting of the boot attribute will not have any effect. We assume that configurations which explicitly specify the boot attribute wants to use the custom kiwi initrd system and not dracut. """ message_kiwi_initrd_system_not_selected = dedent( '''\n Missing initrd_system selection for boot attribute The selected boot="'{0}'" boot description indicates the custom kiwi initrd system should be used instead of dracut. If this is correct please explicitly request the kiwi initrd system as follows: If this is not want you want and dracut should be used as initrd system, please delete the boot attribute as it is obsolete in this case. ''' ) initrd_system = self.xml_state.get_initrd_system() boot_image_reference = self.xml_state.build_type.get_boot() if initrd_system != 'kiwi' and boot_image_reference: raise KiwiRuntimeError( message_kiwi_initrd_system_not_selected.format( boot_image_reference ) ) def check_boot_description_exists(self) -> None: """ If a kiwi initrd is used, a lookup to the specified boot description is done and fails early if it does not exist """ message_no_boot_reference = dedent( '''\n Boot description missing for '{0}' type The selected '{1}' initrd_system requires a boot description reference. Please update your type setup as follows A collection of custom boot descriptions can be found in the kiwi-boot-descriptions package ''' ) message_boot_description_not_found = dedent( '''\n Boot description '{0}' not found The selected boot description could not be found on the build host. A collection of custom boot descriptions can be found in the kiwi-boot-descriptions package ''' ) image_types_supporting_custom_boot_description = ['oem', 'pxe'] build_type = self.xml_state.get_build_type_name() initrd_system = self.xml_state.get_initrd_system() if ( initrd_system == 'kiwi' and build_type in image_types_supporting_custom_boot_description ): boot_image_reference = self.xml_state.build_type.get_boot() if not boot_image_reference: raise KiwiRuntimeError( message_no_boot_reference.format(build_type, initrd_system) ) if not boot_image_reference[0] == os.sep: boot_image_reference = os.sep.join( [ Defaults.get_boot_image_description_path(), boot_image_reference, ] ) if not os.path.exists(boot_image_reference): raise KiwiRuntimeError( message_boot_description_not_found.format( boot_image_reference ) ) def check_consistent_kernel_in_boot_and_system_image(self) -> None: """ If a kiwi initrd is used, the kernel used to build the kiwi initrd and the kernel used in the system image must be the same in order to avoid an inconsistent boot setup """ message = dedent( '''\n Possible kernel mismatch between kiwi initrd and system image The selected '{0}' boot image kernel is '{1}'. However this kernel package was not explicitly listed in the package list of the system image. Please fixup your system image description: 1) Add to your system XML description 2) Inherit kernel from system description to initrd via the custom kernel profile: ''' ) boot_image_reference = self.xml_state.build_type.get_boot() boot_kernel_package_name = None if boot_image_reference: if not boot_image_reference[0] == '/': boot_image_reference = os.sep.join( [ Defaults.get_boot_image_description_path(), boot_image_reference, ] ) boot_config_file = os.sep.join([boot_image_reference, 'config.xml']) if os.path.exists(boot_config_file): boot_description = XMLDescription( description=boot_config_file, derived_from=self.xml_state.xml_data.description_dir, ) boot_kernel_profile = self.xml_state.build_type.get_bootkernel() if not boot_kernel_profile: boot_kernel_profile = 'std' boot_xml_state = XMLState( boot_description.load(), [boot_kernel_profile] ) kernel_package_sections = [] for packages_section in boot_xml_state.xml_data.get_packages(): # lookup package sections matching kernel profile in kiwi # boot description. By definition this must be a packages # section with a single profile name whereas the default # profile name is 'std'. The section itself must contain # one matching kernel package name for the desired # architecture if packages_section.get_profiles() == boot_kernel_profile: for package in packages_section.get_package(): kernel_package_sections.append(package) for package in kernel_package_sections: if boot_xml_state.package_matches_host_architecture( package ): boot_kernel_package_name = package.get_name() if boot_kernel_package_name: # A kernel package name was found in the kiwi boot image # description. Let's check if this kernel is also used # in the system image image_package_names = self.xml_state.get_system_packages() if boot_kernel_package_name not in image_package_names: raise KiwiRuntimeError( message.format( self.xml_state.build_type.get_boot(), boot_kernel_package_name, ) ) def check_dracut_module_versions_compatible_to_kiwi( self, root_dir: str ) -> None: """ KIWI images which makes use of kiwi dracut modules has to use module versions compatible with the version of this KIWI builder code base. This is important to avoid inconsistencies between the way how kiwi includes its own dracut modules and former version of those dracut modules which could be no longer compatible with the builder. Therefore this runtime check maintains a min_version constraint for which we know this KIWI builder to be compatible with. """ message = dedent( '''\n Incompatible dracut-kiwi module(s) found The image was build with KIWI version={0}. The system root tree has the following dracut-kiwi-* module packages installed which are too old to work with this version of KIWI. Please make sure to use dracut-kiwi-* module packages which are >= than the versions listed below. {1} ''' ) kiwi_dracut_modules = { '55kiwi-dump': dracut_module_type('dracut-kiwi-oem-dump', '9.20.1'), '55kiwi-live': dracut_module_type('dracut-kiwi-live', '9.20.1'), '55kiwi-overlay': dracut_module_type( 'dracut-kiwi-overlay', '9.20.1' ), '55kiwi-repart': dracut_module_type( 'dracut-kiwi-oem-repart', '9.20.1' ), '59kiwi-dump-reboot': dracut_module_type( 'dracut-kiwi-oem-dump', '9.20.1' ), '59kiwi-lib': dracut_module_type('dracut-kiwi-lib', '9.20.1'), } dracut_module_dir = os.sep.join([root_dir, '/usr/lib/dracut/modules.d']) if not os.path.isdir(dracut_module_dir): # no dracut module dir present return incompatible_modules = {} for module in os.listdir(dracut_module_dir): module_meta = kiwi_dracut_modules.get(module) if module_meta: module_version = self._get_dracut_module_version_from_pdb( self.xml_state.get_package_manager(), module_meta.package, root_dir, ) if module_version: module_version_nr = tuple( int(it) for it in module_version.split('.') ) module_min_version_nr = tuple( int(it) for it in module_meta.min_version.split('.') ) if module_version_nr < module_min_version_nr: incompatible_modules[module_meta.package] = ( 'got:{0}, need:>={1}'.format( module_version, module_meta.min_version ) ) if incompatible_modules: raise KiwiRuntimeError( message.format(__version__, incompatible_modules) ) def check_dracut_module_for_oem_install_in_package_list(self) -> None: """ OEM images if configured to use dracut as initrd system and configured with one of the installiso, installstick or installpxe attributes requires the KIWI provided dracut-kiwi-oem-dump module to be installed at the time dracut is called. Thus this runtime check examines if the required package is part of the package list in the image description. """ message = dedent( '''\n Required dracut module package missing in package list One of the packages '{0}' is required to build an installation image for the selected oem image type. Depending on your distribution, add the following in the section: ''' ) meta = Defaults.get_runtime_checker_metadata() required_dracut_packages = meta['package_names']['dracut_oem_dump'] initrd_system = self.xml_state.get_initrd_system() build_type = self.xml_state.get_build_type_name() if build_type == 'oem' and initrd_system == 'dracut': install_iso = self.xml_state.build_type.get_installiso() install_stick = self.xml_state.build_type.get_installstick() install_pxe = self.xml_state.build_type.get_installpxe() if install_iso or install_stick or install_pxe: package_names = ( self.xml_state.get_bootstrap_packages() + self.xml_state.get_system_packages() ) if not RuntimeChecker._package_in_list( package_names, required_dracut_packages ): raise KiwiRuntimeError( message.format(required_dracut_packages) ) def check_dracut_module_for_disk_oem_in_package_list(self) -> None: """ OEM images if configured to use dracut as initrd system requires the KIWI provided dracut-kiwi-oem-repart module to be installed at the time dracut is called. Thus this runtime check examines if the required package is part of the package list in the image description. """ message = dedent( '''\n Required dracut module package missing in package list One of the packages '{0}' is required for the selected oem image type. Depending on your distribution, add the following in the section: ''' ) meta = Defaults.get_runtime_checker_metadata() required_dracut_packages = meta['package_names']['dracut_oem_repart'] initrd_system = self.xml_state.get_initrd_system() disk_resize_requested = self.xml_state.get_oemconfig_oem_resize() build_type = self.xml_state.get_build_type_name() if ( build_type == 'oem' and initrd_system == 'dracut' and disk_resize_requested ): package_names = ( self.xml_state.get_bootstrap_packages() + self.xml_state.get_system_packages() ) if not RuntimeChecker._package_in_list( package_names, required_dracut_packages ): raise KiwiRuntimeError(message.format(required_dracut_packages)) def check_dracut_module_for_live_iso_in_package_list(self) -> None: """ Live ISO images uses a dracut initrd to boot and requires the KIWI provided kiwi-live dracut module to be installed at the time dracut is called. Thus this runtime check examines if the required package is part of the package list in the image description. """ message = dedent( '''\n Required dracut module package missing in package list One of the packages '{0}' is required for the selected live iso image type. Depending on your distribution, add the following in your section: ''' ) meta = Defaults.get_runtime_checker_metadata() required_dracut_packages = meta['package_names']['dracut_live'] type_name = self.xml_state.get_build_type_name() type_flag = self.xml_state.build_type.get_flags() if type_name == 'iso' and type_flag != 'dmsquash': package_names = ( self.xml_state.get_bootstrap_packages() + self.xml_state.get_system_packages() ) if not RuntimeChecker._package_in_list( package_names, required_dracut_packages ): raise KiwiRuntimeError(message.format(required_dracut_packages)) def check_dracut_module_for_disk_overlay_in_package_list(self) -> None: """ Disk images configured to use a root filesystem overlay requires the KIWI provided kiwi-overlay dracut module to be installed at the time dracut is called. Thus this runtime check examines if the required package is part of the package list in the image description. """ message = dedent( '''\n Required dracut module package missing in package list The package '{0}' is required for the selected overlayroot activated image type. Depending on your distribution, add the following in your section: ''' ) initrd_system = self.xml_state.get_initrd_system() meta = Defaults.get_runtime_checker_metadata() required_dracut_packages = meta['package_names']['dracut_overlay'] if ( initrd_system == 'dracut' and self.xml_state.build_type.get_overlayroot() ): package_names = ( self.xml_state.get_bootstrap_packages() + self.xml_state.get_system_packages() ) if not RuntimeChecker._package_in_list( package_names, required_dracut_packages ): raise KiwiRuntimeError(message.format(required_dracut_packages)) def check_xen_uniquely_setup_as_server_or_guest(self) -> None: """ If the image is classified to be used as Xen image, it can be either a Xen Server(dom0) or a Xen guest. The image configuration is checked if the information uniquely identifies the image as such """ xen_message = dedent( '''\n Inconsistent Xen setup found: The use of the 'xen_server' or 'xen_loader' attributes indicates the target system for this image is Xen. However the image specifies both attributes at the same time which classifies the image to be both, a Xen Server(dom0) and a Xen guest at the same time, which is not supported. Please cleanup your image description. Setup only one of 'xen_server' or 'xen_loader'. ''' ) ec2_message = dedent( '''\n Inconsistent Amazon EC2 setup found: The firmware setup indicates the target system for this image is Amazon EC2, which uses a Xen based virtualisation technology. Therefore the image must be classified as a Xen guest and can not be a Xen server as indicated by the 'xen_server' attribute Please cleanup your image description. Delete the 'xen_server' attribute for images used with Amazon EC2. ''' ) if self.xml_state.is_xen_server() and self.xml_state.is_xen_guest(): firmware = self.xml_state.build_type.get_firmware() ec2_firmware_names = Defaults.get_ec2_capable_firmware_names() if firmware and firmware in ec2_firmware_names: raise KiwiRuntimeError(ec2_message) else: raise KiwiRuntimeError(xen_message) def check_mediacheck_installed(self) -> None: """ If the image description enables the mediacheck attribute the required tools to run this check must be installed on the image build host """ message_tool_not_found = dedent( '''\n Required tool {name} not found in caller environment The attribute 'mediacheck' is set to 'true' which requires the above tool to be installed on the build system ''' ) if self.xml_state.build_type.get_mediacheck() is True: tool = 'tagmedia' media_tagger = RuntimeConfig().get_iso_media_tag_tool() if media_tagger == 'checkmedia': tool = 'tagmedia' elif media_tagger == 'isomd5sum': tool = 'implantisomd5' if not Path.which(filename=tool, access_mode=os.X_OK): raise KiwiRuntimeError(message_tool_not_found.format(name=tool)) def check_checkmedia_used_with_msdos_table(self) -> None: """ The checkmedia/tagmedia tools in versions < v6.6 only supports plain MBR partition tables. """ message = dedent( '''\n ISO media tag tool tagmedia < v6.6 does not support {table} partition tables The attribute 'mediacheck' is set to 'true' and the selected media tag tool only supports plain MBR (msdos) partition tables. Attributes influencing the partition table type are firmware, efiparttable and targettype. Please check your image description for the setup of these attributes. ''' ) if self.xml_state.build_type.get_mediacheck() is True: media_tagger = RuntimeConfig().get_iso_media_tag_tool() firmware = FirmWare(self.xml_state) table_type = firmware.get_partition_table_type() if media_tagger == 'checkmedia' and table_type != 'msdos': self.check_mediacheck_installed() # checkmedia in versions >= 6.6 supports GPT, only for # older versions the runtime check applies expected_version = (6, 6) if not CommandCapabilities.check_version( media_tagger, expected_version, raise_on_error=False ): raise KiwiRuntimeError( message.format(tool=media_tagger, table=table_type) ) def check_image_version_provided(self) -> None: """ Kiwi requires a element to be specified as part of at least one section. """ message_missing_version = dedent( '''\n No version is defined in any of the sections. Please add image_version inside the section. ''' ) if not self.xml_state.get_image_version(): raise KiwiRuntimeError(message_missing_version) def check_image_type_unique(self) -> None: """ Verify that the selected image type is unique within the range of the configured types and profiles. """ message = dedent( '''\n Conflicting image type setup detected The selected image type '{0}' in the {1} profile selection is not unique. There are the following type settings which overrides each other: {2} To solve this conflict please move the image type setup into its own profile and select them using the --profile option at call time. ''' ) image_type_sections = [] type_dict: Dict[str, List[Any]] = {} for preferences in self.xml_state.get_preferences_sections(): image_type_sections += preferences.get_type() for image_type in image_type_sections: type_name = image_type.get_image() if type_dict.get(type_name): type_dict[type_name].append(image_type) else: type_dict[type_name] = [image_type] for type_name, type_list in list(type_dict.items()): if len(type_list) > 1: type_export = StringIO() for image_type in type_list: type_export.write(os.linesep) image_type.export(type_export, 0) raise KiwiRuntimeError( message.format( type_name, self.xml_state.profiles or ['Default'], type_export.getvalue(), ) ) def check_efi_fat_image_has_correct_size(self) -> None: """ Verify that the efifatimagesize does not exceed the max El Torito load size of 65535 * 512 bytes """ message = dedent( '''\n El Torito max load size exceeded The configured efifatimagesize of '{0}MB' exceeds the El Torito max load size of 65535 * 512 bytes (~31MB). ''' ) fat_image_mbsize = int( self.xml_state.build_type.get_efifatimagesize() or defaults.EFI_FAT_IMAGE_SIZE ) if fat_image_mbsize > 31: raise KiwiRuntimeError(message.format(fat_image_mbsize)) def check_bootloader_env_compatible_with_loader(self) -> None: """ If there is an environment section as part of the bootloader section, check if the selected loader supports custom environment blobs """ message = dedent( '''\n Selected loader does not support custom environments The selected bootloader {} does not support custom environment settings. Please drop the setting from for this loader ''' ) env_supported_loaders = ['grub2', 'grub2_s390x_emu', 'custom'] bootloader = self.xml_state.get_build_type_bootloader_name() variable_list = ( self.xml_state.get_build_type_bootloader_environment_variables() ) if variable_list and bootloader not in env_supported_loaders: raise KiwiRuntimeError(message.format(bootloader)) def check_kernel_flavor_supported(self) -> None: """ If kernel flavors are configured in the bootloader section, check that the image setup can provide a boot menu entry for the kernel of each flavor. This requires an initrd for each kernel, which is only created with the dracut initrd system, and separate kernel and initrd files, which are not used if the kernel and the initrd are combined into one UKI binary """ message_initrd_system = dedent( '''\n Kernel flavors require the dracut initrd system The bootloader kernel_flavor setting creates an initrd for the kernel of each flavor. This is only supported with the dracut initrd system but the selected initrd system is {} ''' ) message_uki = dedent( '''\n Kernel flavors are not supported with UKI The bootloader kernel_flavor setting creates a boot menu entry for the kernel of each flavor. This is not supported in combination with a UKI binary as configured by the setting ''' ) message_secure_execution = dedent( '''\n Kernel flavors are not supported with zipl secure execution The bootloader kernel_flavor setting creates a boot menu entry for the kernel of each flavor. This is not supported in combination with the zipl secure execution image as configured by the setting ''' ) if self.xml_state.get_build_type_bootloader_kernel_flavors(): if ( self.xml_state.get_build_type_bootloader_name() == 'zipl' and self.xml_state.get_host_key_certificates() ): raise KiwiRuntimeError(message_secure_execution) initrd_system = self.xml_state.get_initrd_system() if initrd_system != 'dracut': raise KiwiRuntimeError( message_initrd_system.format(initrd_system) ) if self.xml_state.get_dracut_config('setup').uefi: raise KiwiRuntimeError(message_uki) def check_kernel_flavors_installed(self, root_dir: str) -> None: """ If kernel flavors are configured in the bootloader section, check that a kernel of each flavor is installed in the given root tree :param str root_dir: root directory path name """ message = dedent( '''\n No kernel installed for kernel flavor(s): {0} The bootloader kernel_flavor setting requires a kernel of each flavor to be installed. Please add the package providing the kernel of the missing flavor(s) to the image description. The installed kernel versions are: {1} ''' ) kernel_flavors = ( self.xml_state.get_build_type_bootloader_kernel_flavors() ) if kernel_flavors: kernel = Kernel(root_dir) missing_flavors = [ flavor for flavor in kernel_flavors if not kernel.get_kernel(flavor=flavor) ] if missing_flavors: raise KiwiRuntimeError( message.format( ', '.join(missing_flavors), ', '.join(kernel.get_kernel_versions()) or 'none', ) ) @staticmethod def _package_in_list( package_list: List[str], search_list: List[str] ) -> str: result = '' for search in search_list: if search in package_list: result = search break return result @staticmethod def _get_dracut_module_version_from_pdb( package_manager: str, package_name: str, root_dir: str ) -> str: tool = Defaults.get_default_packager_tool(package_manager) package_query = None package_manager_query = None package_version = '' if tool == 'rpm': package_manager_query = [ 'chroot', root_dir, tool, '-q', '--qf', '%{VERSION}', package_name, ] elif tool == 'dpkg': package_manager_query = [ 'chroot', root_dir, 'dpkg-query', '-W', '-f', '${Version}', package_name, ] if package_manager_query: try: package_query = Command.run(package_manager_query) if package_query: package_version = package_query.output.split('-', 1)[0] except Exception as issue: log.debug(f'Package manager query failed with: {issue}') return package_version ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7479773 kiwi-11.1.8/kiwi/runtime_checker_metadata.yml0000644000000000000000000000045215273675667016221 0ustar00package_names: dracut_oem_dump: - dracut-kiwi-oem-dump - kiwi-dracut-oem-dump dracut_oem_repart: - dracut-kiwi-oem-repart - kiwi-dracut-oem-repart dracut_live: - dracut-kiwi-live - kiwi-dracut-live dracut_overlay: - dracut-kiwi-overlay - kiwi-dracut-overlay ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7479773 kiwi-11.1.8/kiwi/runtime_config.py0000644000000000000000000004726315273675667014064 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging import functools from typing import Literal, List, Optional, NamedTuple, Callable, Dict, Any import yaml # project import kiwi.defaults as defaults from kiwi.defaults import Defaults from kiwi.utils.size import StringToSize from kiwi.utils.checksum import Checksum from kiwi.exceptions import ( KiwiRuntimeConfigFormatError, KiwiRuntimeConfigFileError, ) log = logging.getLogger('kiwi') RUNTIME_CONFIG: Optional[Dict[str, Any]] = None # Maximum nesting level the merge of two runtime config files # is allowed to descend into. The runtime config format only # uses a nesting of element -> attribute. The limit prevents an # endless recursion in _merge() on config data that references # itself, which the yaml anchor and alias syntax allows to create MERGE_MAX_DEPTH = 20 class ShasumT(NamedTuple): suffix: str digest: Callable class RuntimeConfig: """ **Implements reading of runtime configuration files:** 1. vendor: /usr/share/kiwi/kiwi.yml + /usr/share/kiwi/kiwi.yml.d/*.yml 2. admin: /etc/kiwi.yml + /etc/kiwi.yml.d/*.yml 3. ~/.config/kiwi/config.yml 4. Check for --config provided from the CLI The KIWI runtime configuration file is a yaml formatted file containing information to control the behavior of the tools used by KIWI on the build host. :param bool reread: reread runtime config """ def __init__(self, reread: bool = False): global RUNTIME_CONFIG if RUNTIME_CONFIG is None or reread: custom_config_file = defaults.CUSTOM_RUNTIME_CONFIG_FILE config_files = [] # 1. vendor config_file = defaults.USR_RUNTIME_CONFIG_FILE if os.path.isfile(config_file): config_files.append(config_file) config_files += self._read_drop_ins_dir( defaults.USR_RUNTIME_CONFIG_DIR ) # 2. admin config_file = defaults.ETC_RUNTIME_CONFIG_FILE if os.path.isfile(config_file): config_files.append(config_file) config_files += self._read_drop_ins_dir( defaults.ETC_RUNTIME_CONFIG_DIR ) # 3. home if self._home_path(): config_file = os.sep.join( [self._home_path(), '.config', 'kiwi', 'config.yml'] ) if os.path.isfile(config_file): config_files.append(config_file) # 4. cmdline if custom_config_file: config_file = custom_config_file if not os.path.isfile(config_file): raise KiwiRuntimeConfigFileError( f'Custom config file {config_file!r} not found' ) config_files.append(config_file) # read and merge all config files... RUNTIME_CONFIG = {} for config_file in config_files: log.info(f'Reading runtime config file: {config_file!r}') with open(config_file, 'r') as config: next_config = yaml.safe_load(config) or {} RUNTIME_CONFIG = RuntimeConfig._merge( RUNTIME_CONFIG, next_config ) def get_credentials_verification_metadata_signing_key_file(self) -> str: """ Return verification metadata signing key file, used for signature creation of rootfs verification metadata: credentials: verification_metadata_signing_key_file: ... There is no default value for this setting available :return: file path name or '' :rtype: str """ signing_key_file = self._get_attribute( element='credentials', attribute='verification_metadata_signing_key_file', ) return signing_key_file if signing_key_file else '' def get_obs_download_server_url(self) -> str: """ Return URL of buildservice download server in: obs: download_url: ... if no configuration exists the downloadserver from the Defaults class is returned :return: URL type data :rtype: str """ obs_download_server_url = self._get_attribute( element='obs', attribute='download_url' ) return ( obs_download_server_url if obs_download_server_url else Defaults.get_obs_download_server_url() ) def get_obs_api_server_url(self) -> str: """ Return URL of buildservice API server in: obs: api_url: ... if no configuration exists the API server from the Defaults class is returned :return: URL type data :rtype: str """ obs_api_server_url = self._get_attribute( element='obs', attribute='api_url' ) return ( obs_api_server_url if obs_api_server_url else Defaults.get_obs_api_server_url() ) def is_obs_public(self) -> bool: """ Check if the buildservice configuration is public or private in: obs: public: true|false if no configuration exists we assume to be public :return: True or False :rtype: bool """ obs_public = self._get_attribute(element='obs', attribute='public') if obs_public is None: # if the privacy attribute is not set we assume to be public obs_public = True return bool(obs_public) def get_package_changes(self, default: bool = True) -> bool: """ Return boolean value to express if the image build and bundle should contain a .changes file. The .changes file contains the package changelog information from all packages installed into the image. bundle: has_package_changes: true|false By default the creation is switched on. When building in the Open Build Service the default is switched off because obs provides a .report file containing the same information. :param bool default: Default value :return: True or False :rtype: bool """ bundle_package_changes = self._get_attribute( element='bundle', attribute='has_package_changes' ) if bundle_package_changes is None: if Defaults.is_buildservice_worker(): bundle_package_changes = False else: bundle_package_changes = default return bool(bundle_package_changes) def get_bundle_compression(self, default: bool = True) -> bool: """ Return boolean value to express if the image bundle should contain XZ compressed image results or not. bundle: compress: true|false If compression of image build results is activated the size of the bundle is smaller and the download speed increases. However the image must be uncompressed before use If no compression is explicitly configured, the provided default value applies :param bool default: Default value :return: True or False :rtype: bool """ bundle_compress = self._get_attribute( element='bundle', attribute='compress' ) if bundle_compress is None: bundle_compress = default return bool(bundle_compress) def get_checksum_handler( self, source_filename: str, target_filename: Optional[str] = None, default: str = '256', bundle_lookup: bool = False, ) -> ShasumT: """ Return a ShasumT with information about the configured shasum suffix name and the digest(Checksum) callable. The following configuration setting allows to configure the size of the checksum: shasum: size: 256 bundle: shasum_size: "256" Instructs kiwi to use the provided shasum size. Supported values are 256 (default) and 512. In case of an unsupported value the default is used. A value from the bundle section takes precedence over the global shasum size specified in the shasum section for creating bundle results. If no information for bundle results is specified, the global shasum size or the default applies. :param str source_filename: filename to calculate checksum for :param str target_filename: filename to write checksum to :param str default: default size set to 256 :rtype: ShasumT """ supported_shasums = { '256': ShasumT( suffix='.sha256', digest=functools.partial( Checksum(source_filename).sha256, target_filename ), ), '512': ShasumT( suffix='.sha512', digest=functools.partial( Checksum(source_filename).sha512, target_filename ), ), } shasum_size = self._get_attribute(element='shasum', attribute='size') if bundle_lookup: bundle_shasum_size = self._get_attribute( element='bundle', attribute='shasum_size' ) if bundle_shasum_size: shasum_size = bundle_shasum_size if supported_shasums.get(shasum_size): return supported_shasums[shasum_size] return supported_shasums['256'] def get_xz_options(self) -> Optional[List[str]]: """ Return list of XZ compression options in: xz: options: ... if no configuration exists None is returned :return: Contains list of options .. code:: python ['--option=value'] :rtype: list """ xz_options = self._get_attribute(element='xz', attribute='options') return xz_options.split() if xz_options else None def get_sync_sparse(self) -> bool: """ Return if data sync operations should turn sequences of null bytes into holes on the target. sync: sparse: true|false If no configuration exists the default from the Defaults class is returned. Enabling this adds the --sparse option to the rsync call used to install the image payload. On filesystems that perform speculative preallocation the option alone does not reclaim the space, because the skipped range is recorded as an allocated but unwritten extent rather than as a hole. Such filesystems can declare additional install time mount options via the sparse_install_mount_options attribute of their FileSystemBase implementation. :return: True or False :rtype: bool """ sync_sparse = self._get_attribute(element='sync', attribute='sparse') if sync_sparse is None: return Defaults.get_sync_sparse() return bool(sync_sparse) def get_container_compression(self) -> bool: """ Return compression for container images container: compress: xz|none|true|false if no or invalid configuration data is provided, the default compression from the Defaults class is returned :return: True or False :rtype: bool """ container_compression = self._get_attribute( element='container', attribute='compress' ) if container_compression is None: return Defaults.get_container_compression() elif 'xz' == container_compression or container_compression is True: return True elif 'none' == container_compression or container_compression is False: return False else: log.warning( 'Skipping invalid container compression: {0}'.format( container_compression ) ) return Defaults.get_container_compression() def get_iso_tool_category(self) -> str: """ Return tool category which should be used to build iso images iso: tool_category: xorriso if no or invalid configuration exists the default tool category from the Defaults class is returned :return: A name :rtype: str """ iso_tool_category = self._get_attribute( element='iso', attribute='tool_category' ) if not iso_tool_category: return Defaults.get_iso_tool_category() elif 'xorriso' in iso_tool_category: return iso_tool_category else: log.warning( 'Skipping invalid iso tool category: {0}'.format( iso_tool_category ) ) return Defaults.get_iso_tool_category() def get_iso_media_tag_tool(self) -> Literal['checkmedia', 'isomd5sum']: """ Return media tag tool used to checksum iso images iso: media_tag_tool: checkmedia if no or invalid configuration exists the default media tagger from the Defaults class is returned :return: A name :rtype: str """ iso_media_tag_tool = self._get_attribute( element='iso', attribute='media_tag_tool' ) if not iso_media_tag_tool: return Defaults.get_iso_media_tag_tool() elif 'checkmedia' in iso_media_tag_tool: return iso_media_tag_tool elif 'isomd5sum' in iso_media_tag_tool: return iso_media_tag_tool else: log.warning( 'Skipping invalid iso media tag tool: {0}'.format( iso_media_tag_tool ) ) return Defaults.get_iso_media_tag_tool() def get_oci_archive_tool(self) -> str: """ Return OCI archive tool which should be used on creation of container archives for OCI compliant images, e.g docker oci: archive_tool: umoci if no configuration exists the default tool from the Defaults class is returned :return: A name :rtype: str """ oci_archive_tool = self._get_attribute( element='oci', attribute='archive_tool' ) return oci_archive_tool or Defaults.get_oci_archive_tool() def get_mapper_tool(self) -> str: """ Return partition mapper tool mapper: part_mapper: partx if no configuration exists the default tool from the Defaults class is returned :return: A name :rtype: str """ part_mapper_tool = self._get_attribute( element='mapper', attribute='part_mapper' ) return part_mapper_tool or Defaults.get_part_mapper_tool() def get_max_size_constraint(self) -> Optional[int]: """ Returns the maximum allowed size of the built image. The value is returned in bytes and it is specified in build_constraints element with the max_size attribute. The value can be specified in bytes or it can be specified with m=MB or g=GB. build_constraints: max_size: 700m if no configuration exists None is returned :return: byte value or None :rtype: int """ max_size = self._get_attribute( element='build_constraints', attribute='max_size' ) return StringToSize.to_bytes(max_size) if max_size else None def get_disabled_runtime_checks(self) -> List[str]: """ Returns disabled runtime checks. Checks can be disabled with: runtime_checks: disable: - check_container_tool_chain_installed if the provided string does not match any RuntimeChecker method it is just ignored. """ disabled_checks = ( self._get_attribute(element='runtime_checks', attribute='disable') or [] ) for check in disabled_checks: log.warning(f'Runtime check: {check}: disabled') return disabled_checks def _get_attribute(self, element: str, attribute: str) -> Any: if RUNTIME_CONFIG: try: for key, value in RUNTIME_CONFIG.get(element, {}).items(): if key == attribute: return value except Exception as issue: raise KiwiRuntimeConfigFormatError( f'{type(issue).__name__}: {issue}' ) def _home_path(self) -> str: return os.environ.get('HOME') or '' def _read_drop_ins_dir(self, config_dir: str) -> List[str]: config_files = [] if os.path.isdir(config_dir): for config_file in sorted(os.listdir(config_dir)): if config_file.endswith('.yml'): config_file_path = os.path.normpath( os.sep.join([config_dir, config_file]) ) config_files.append(config_file_path) return config_files @staticmethod def _merge(master: Dict, slave: Dict, depth: int = 0) -> Dict: if depth > MERGE_MAX_DEPTH: # self referencing config data would let the merge # recurse forever, stop it with an error message raise KiwiRuntimeConfigFormatError( f'Nesting level of {MERGE_MAX_DEPTH} exceeded on merge. ' 'Please check the runtime config file(s) for data ' 'structures referencing themselves' ) if slave: if ( not master or isinstance(master, str) or isinstance(master, int) or isinstance(master, float) ): # border case for first run or if slave is a # primitive type in the recursive iteration master = slave elif isinstance(master, list): if isinstance(slave, list): # list on list gets a merged list master.extend(slave) else: raise NotImplementedError( 'No strategy for merge non-list into list' ) # no duplicates master = sorted(set(master)) elif isinstance(master, dict): # dict on dict gets a merged dict by copy # slave on master recursively if isinstance(slave, dict): for key in slave: if key in master: master[key] = RuntimeConfig._merge( master[key], slave[key], depth + 1 ) else: master[key] = slave[key] else: raise NotImplementedError( 'No strategy for merge non-dict into dict' ) else: # No merge strategy available pass return master ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7479773 kiwi-11.1.8/kiwi/schema/kiwi.rnc0000644000000000000000000045160215273675667013405 0ustar00#================ # FILE : kiwi.rnc #**************** # PROJECT : KIWI - Appliance Builder # COPYRIGHT : (c) 2006 SUSE LINUX Products GmbH, Germany # : # AUTHOR : Thomas Schraitle # AUTHOR : Marcus Schaefer # : # BELONGS TO : Operating System images # : # DESCRIPTION : This is the RELAX NG Schema for KIWI # : configuration files. The schema is maintained # : in the relax compact syntax. Any changes should # : made in !! *** kiwi.rnc *** !! # : # : # STATUS : Development #**************** namespace rng = "http://relaxng.org/ns/structure/1.0" namespace xsi = "http://www.w3.org/2001/XMLSchema-instance" datatypes xsd = "http://www.w3.org/2001/XMLSchema-datatypes" namespace db = "http://docbook.org/ns/docbook" namespace sch = "http://purl.oclc.org/dsdl/schematron" namespace nul = "" safe-posix-name = xsd:token {pattern = "[a-zA-Z0-9_\-\.]+"} safe-posix-short-name = xsd:token {pattern = "[a-zA-Z0-9_\-\.]{1,32}"} ecma-119-achar-128-text = xsd:token {pattern = "[a-zA-Z0-9!-/:-?_ ]{1,128}"} locale-name = xsd:token {pattern = "(C|POSIX|[a-z]{2,3}_[A-Z]{2})(,[a-z]{2,3}_[A-Z]{2})*"} mac-address-type = xsd:token {pattern = "([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}"} size-type = xsd:token {pattern = "(\d*|image)"} number-type = xsd:token {pattern = "\d+"} blocks-type = xsd:token {pattern = "(\d*|all)"} volume-size-type = xsd:token {pattern = "(\d+|\d+M|\d+G|all)"} partition-size-type = xsd:token {pattern = "(\d+|\d+M|\d+G)"} vhd-tag-type = xsd:token {pattern = "[0-9a-f]{8}-([0-9a-f]{4}-){3}[0-9a-f]{12}"} groups-list = xsd:token {pattern = "[a-zA-Z0-9_\-\.:]+(,[a-zA-Z0-9_\-\.:]+)*"} kernel-flavor-list = xsd:token {pattern = "[a-zA-Z0-9_\-\.]+(,[a-zA-Z0-9_\-\.]+)*"} arch-name = xsd:token {pattern = "(x86_64|i586|i686|ix86|aarch64|arm64|amd64|armv5el|armv5tel|armv6hl|armv6l|armv7hl|armv7l|ppc|ppc64|ppc64le|s390|s390x|riscv64)(,(x86_64|i586|i686|ix86|aarch64|arm64|amd64|armv5el|armv5tel|armv6hl|armv6l|armv7hl|armv7l|ppc|ppc64|ppc64le|s390|s390x|riscv64))*"} portnum-type = xsd:token {pattern = "(\d+|\d+/(udp|tcp))"} grub_console_output = xsd:token {pattern = "(none|console|gfxterm|serial|vga_text|mda_text|morse|spkmodem)( (console|gfxterm|serial|vga_text|mda_text|morse|spkmodem))*"} grub_console_input = xsd:token {pattern = "(none|console|serial|at_keyboard|usb_keyboard)( (console|serial|at_keyboard|usb_keyboard))*"} fs_attributes = xsd:token {pattern = "(no-copy-on-write|synchronous-updates)(,(no-copy-on-write|synchronous-updates))*"} package-version-type = xsd:token {pattern = "(0|[1-9][0-9]{0,3}|[1-5][0-9]{4}|6[0-4][0-9]{3}|65[0-4][0-9]{2}|655[0-2][0-9]|6553[0-5])(\.(0|[1-9][0-9]{0,3}|[1-5][0-9]{4}|6[0-4][0-9]{3}|65[0-4][0-9]{2}|655[0-2][0-9]|6553[0-5])){3}"} simple-uri-type = xsd:token {pattern = "(file:|this:|https:|http:|ftp:).*"} oci_format_type = xsd:token {pattern = "(oci|docker):(gce|ova|qcow2|vmdk|vdi|vhd|vhdx|vhd-fixed|raw)"} #========================================== # start with image description # start = ## The start pattern of an image k.image #========================================== # main block: # div { k.image.name.attribute = k.imagename.attribute k.image.displayname.attribute = k.displayname.attribute k.image.noNamespaceSchemaLocation.attribute = ## The location of the XSD Schema (not relevant for RELAX NG or DTD) attribute xsi:noNamespaceSchemaLocation { xsd:anyURI } k.image.schemaLocation.attribute = ## A pair of URI references: First is a namespace name, ## second the location of the XSD Schema ## (not relevant for RELAX NG or DTD) attribute xsi:schemaLocation { xsd:anyURI } k.image.schemaversion.attribute = ## The allowed Schema version (fixed value) attribute schemaversion { "8.5" } k.image.id = ## An identification number which is represented in a file ## named /etc/ImageID attribute id { text } k.image.attlist = k.image.name.attribute & k.image.displayname.attribute? & k.image.id? & k.image.schemaversion.attribute & ( k.image.noNamespaceSchemaLocation.attribute? | k.image.schemaLocation.attribute? )? k.image = ## The root element of the configuration file element image { k.image.attlist & k.include* & k.certificates? & k.description & k.preferences+ & k.profiles* & k.users* & k.drivers* & k.strip* & k.repository* & k.containers* & k.packages* & k.extension? } } #========================================== # common attributes # k.id.attribute = ## An ID attribute id { xsd:ID } k.name.attribute = ## A name attribute name { text } k.bootinclude.attribute = ## Indicates that this package should be part of ## the boot image (initrd) too. This attribute ## can be used to include for example branding packages ## specified in the system image description to become ## part of the boot image also attribute bootinclude { xsd:boolean } k.bootdelete.attribute = ## Indicates that this package should be removed from ## the boot image (initrd). the attribute is only ## evaluated if the bootinclude attribute is specified ## along with it too attribute bootdelete { xsd:boolean } k.displayname.attribute = ## A friendly display name. Used in the boot menu attribute displayname { text } k.arch.attribute = ## A system architecture name, matching the 'uname -m' information ## Multiple architectures can be combined as comma separated list ## e.g arch="x86_64,ix86" attribute arch { arch-name } k.description.attribute = ## A short description attribute description { text } k.path.attribute = ## A path attribute path { text } k.profiles.attribute = ## A profile name which binds the section to this name attribute profiles { text } k.password.attribute = ## The password attribute password { text } k.script.attribute = ## A script hook for meta files to be called after the ## file was fetched attribute script { text } k.source.attribute = ## A source location where a package or configuration file can be found attribute source { text } k.size.attribute = ## A partition size or optional image size attribute size { size-type } k.dest.attribute = ## Destination of a resource attribute dest { text } k.username.attribute = ## A name of a user attribute username { text } k.imagename.attribute = ## An image name without / and spaces attribute name { safe-posix-name } k.clear.attribute = ## Specifies to clear or not some data or configurations attribute clear { xsd:boolean } div { k._any.attribute = ## Any attribute including in any attribute in any namespace. attribute * { text } k._any = ## Any element from almost any namespace except empty ones element * - (nul:*) { (k._any.attribute | text | k._any)* } } #========================================== # common element # div { k.extension.attlist = empty k.extension = ## Define custom XML extensions element extension { k.extension.attlist, k._any+ } } #========================================== # common element # div { k.archive.name.attribute = k.name.attribute k.archive.bootinclude.attribute = k.bootinclude.attribute k.archive.target_dir.attribute = # Extract tarball to the specified target directory. # By default the target directory is the root(/) of # the image. attribute target_dir { text } k.archive.attlist = k.archive.name.attribute & k.archive.bootinclude.attribute? & k.archive.target_dir.attribute? k.archive = ## Name of an image archive file (tarball) element archive { k.archive.attlist, empty } } #========================================== # common element # div { k.author.attlist = empty k.author = ## Author of the image element author { k.author.attlist, text } } #========================================== # common element # div { k.license.attlist = empty k.license = ## License of the image element license { k.license.attlist, text } } #========================================== # common element # div { k.bootloader-theme.attlist = empty k.bootloader-theme = ## Image bootloader theme setup. element bootloader-theme { k.bootloader-theme.attlist, text } } #========================================== # common element # div { k.bootsplash-theme.attlist = empty k.bootsplash-theme = ## Image bootsplash theme setup. element bootsplash-theme { k.bootsplash-theme.attlist, text } } #========================================== # common element # div { k.contact.attlist = empty k.contact = ## Contact Information from the Author, like Email etc. element contact { k.contact.attlist, text } } #========================================== # common element # div { k.file.name.attribute = k.name.attribute k.file.arch.attribute = k.arch.attribute k.file.target.attribute = # include file as target to the root(/) of the image. attribute target { text } k.file.owner.attribute = # set ownership to the file. The value is passed to chown attribute owner { text } k.file.permissions.attribute = # set file permissions. The value is passed to chmod attribute permissions { text } k.file.attlist = k.file.name.attribute & k.file.target.attribute? & k.file.owner.attribute? & k.file.permissions.attribute? & k.file.arch.attribute? k.file = ## A Pointer to a File element file { k.file.attlist, empty } } #========================================== # common element # div { k.ignore.name.attribute = k.name.attribute k.ignore.arch.attribute = k.arch.attribute k.ignore.attlist = k.ignore.name.attribute & k.ignore.arch.attribute? k.ignore = ## Ignores a Package element ignore { k.ignore.attlist, empty } } #========================================== # common element # div { k.keytable.attlist = empty k.keytable = ## Image keytable setup. element keytable { k.keytable.attlist, text } } #========================================== # common element # div { # locale k.locale.attlist = empty k.locale = ## Image locale setup. element locale { k.locale.attlist, locale-name } } #========================================== # common element # div { k.rpm-locale-filtering.content = xsd:boolean k.rpm-locale-filtering.attlist = empty k.rpm-locale-filtering = # locale-filtering sets the install_lang macro for rpm based # installations to the configured locale list. This results # in language specific files to become filtered out by rpm # if they don't match the configured list. Please note it # depends on the package design if the install_lang macro # contents apply to the package or not. element rpm-locale-filtering { k.rpm-locale-filtering.attlist, k.rpm-locale-filtering.content } } #========================================== # common element # div { k.namedCollection.name.attribute = k.name.attribute k.namedCollection.arch.attribute = k.arch.attribute k.namedCollection.attlist = k.namedCollection.name.attribute & k.namedCollection.arch.attribute? k.namedCollection = ## Name of a Pattern for SUSE or a Group for RH element namedCollection { k.namedCollection.attlist, empty } } #========================================== # common element # div { sch:pattern [ id = "collection_module_scope" sch:rule [ context = "collectionModule" sch:assert [ test = "../@type='bootstrap'" "collectionModule is only available in the bootstrap "~ "packages section" ] ] ] sch:pattern [ id = "collection_module_disable_constraint" sch:rule [ context = "collectionModule" sch:assert [ test = "@enable='true' or not(@stream)" "@stream attribute is not allowed to disable a module" ] ] ] k.collectionModule.name.attribute = attribute name { safe-posix-name } k.collectionModule.stream.attribute = attribute stream { safe-posix-name } k.collectionModule.arch.attribute = k.arch.attribute k.collectionModule.enable.attribute = ## Specify the module to become enabled (for the optionally ## given stream) or disabled. attribute enable { xsd:boolean } k.collectionModule.attlist = k.collectionModule.name.attribute & k.collectionModule.enable.attribute & k.collectionModule.stream.attribute? & k.collectionModule.arch.attribute? k.collectionModule = element collectionModule { k.collectionModule.attlist, empty } } #========================================== # common element # div { k.oem-boot-title.attlist = empty k.oem-boot-title = ## For oemboot driven images: setup of the boot menu text ## displayed within the square brackets after first reboot ## of the OEM image element oem-boot-title { k.oem-boot-title.attlist, text } } #========================================== # common element # div { k.oem-bootwait.content = xsd:boolean k.oem-bootwait.attlist = empty k.oem-bootwait = ## For oemboot driven images: halt system after image dump true/false element oem-bootwait { k.oem-bootwait.attlist, k.oem-bootwait.content } } #========================================== # common element # div { k.oem-resize.content = xsd:boolean k.oem-resize.attlist = empty k.oem-resize = ## activate/deactivate disk resize on first boot: true/false ## By default the repart/resize is activated when creating ## an oem image. If the disk image should be more simple ## and should not react on storage geometry changes at all ## this option allows to switch off the use and inclusion ## of the kiwi oem dracut module that implements the resize element oem-resize { k.oem-resize.attlist, k.oem-resize.content } } #========================================== # common element # div { k.oem-resize-once.content = xsd:boolean k.oem-resize-once.attlist = empty k.oem-resize-once = ## For oem images: repart/resize only on first boot: true/false ## By default the repart/resize happens on every reboot and ## therefore also allows for disk geometry changes during the ## livetime of the machine. If set to false the repart/resize ## operation happens only once and then never again element oem-resize-once { k.oem-resize-once.attlist, k.oem-resize-once.content } } #========================================== # common element # div { k.oem-ramdisk-size.content = text k.oem-ramdisk-size.attlist = empty k.oem-ramdisk-size = ## For oemboot driven images: specify the size of the ramdisk ## The value is taken into account if the deployment of the ## image happens into a ramdisk. The value can be overwritten ## with the kernel boot parameter: ramdisk_size element oem-ramdisk-size { k.oem-ramdisk-size.attlist, k.oem-ramdisk-size.content } } #========================================== # common element # div { k.oem-device-filter.content = text k.oem-device-filter.attlist = empty k.oem-device-filter = ## For oemboot driven images: filter install devices by given ## regular expression. The expression is handled by the bash regexp ## operator element oem-device-filter { k.oem-device-filter.attlist, k.oem-device-filter.content } } #========================================== # common element # div { k.oem-nic-filter.content = text k.oem-nic-filter.attlist = empty k.oem-nic-filter = ## For oemboot driven images: filter network interface names by given ## regular expression. The expression is handled by the bash regexp ## operator. Interface names matching the rule will be skipped. All ## other interface names stay in the list. It is also possible to ## pass the variable kiwi_oemnicfilter as kernel command ## line in a netboot deployment element oem-nic-filter { k.oem-nic-filter.attlist, k.oem-nic-filter.content } } #========================================== # common element # div { k.oem-inplace-recovery.content = xsd:boolean k.oem-inplace-recovery.attlist = empty k.oem-inplace-recovery = ## For oemboot driven images: Specify whether the ## recovery archive should be stored as part of the image ## or not. If it's not stored it's created during install ## of the oem image element oem-inplace-recovery { k.oem-inplace-recovery.attlist, k.oem-inplace-recovery.content } } #========================================== # common element # div { k.oem-kiwi-initrd.content = xsd:boolean k.oem-kiwi-initrd.attlist = empty k.oem-kiwi-initrd = ## For oemboot driven images: use kiwi initrd in any case ## and don't replace it with mkinitrd created initrd element oem-kiwi-initrd { k.oem-kiwi-initrd.attlist, k.oem-kiwi-initrd.content } } #========================================== # common element # div { k.oem-partition-install.content = xsd:boolean k.oem-partition-install.attlist = empty k.oem-partition-install = ## For oemboot driven images: install the system not as ## disk but into a free partition. If this option is set ## all other oem-* options concerning the partition table ## will not have any effect element oem-partition-install { k.oem-partition-install.attlist, k.oem-partition-install.content } } #========================================== # common element # div { k.oem-reboot.content = xsd:boolean k.oem-reboot.attlist = empty k.oem-reboot = ## For oemboot driven images: reboot after first deployment true/false element oem-reboot { k.oem-reboot.attlist, k.oem-reboot.content } } #========================================== # common element # div { k.oem-reboot-interactive.content = xsd:boolean k.oem-reboot-interactive.attlist = empty k.oem-reboot-interactive = ## For oemboot driven images: reboot after first deployment ## with an interactive dialog true/false element oem-reboot-interactive { k.oem-reboot-interactive.attlist, k.oem-reboot-interactive.content } } #========================================== # common element # div { k.oem-recovery.content = xsd:boolean k.oem-recovery.attlist = empty k.oem-recovery = ## For oemboot driven images: create a recovery archive yes/no element oem-recovery { k.oem-recovery.attlist, k.oem-recovery.content } } #========================================== # common element # div { k.oem-recoveryID.attlist = empty k.oem-recoveryID = ## For oemboot driven images: Set the partition ID of ## recovery partition. Default value is 83 (Linux) element oem-recoveryID { k.oem-recoveryID.attlist, xsd:nonNegativeInteger } } #========================================== # common element # div { k.oem-recovery-part-size.attlist = empty k.oem-recovery-part-size = ## For oemboot driven images: Set the size of the ## recovery partition. Value is interpreted as MB element oem-recovery-part-size { k.oem-recovery-part-size.attlist, xsd:nonNegativeInteger } } #========================================== # common element # div { k.oem-shutdown.content = xsd:boolean k.oem-shutdown.attlist = empty k.oem-shutdown = ## For oemboot driven images: shutdown after first deployment ## true/false element oem-shutdown { k.oem-shutdown.attlist, k.oem-shutdown.content } } #========================================== # common element # div { k.oem-shutdown-interactive.content = xsd:boolean k.oem-shutdown-interactive.attlist = empty k.oem-shutdown-interactive = ## For oemboot driven images: shutdown after first deployment ## true/false element oem-shutdown-interactive { k.oem-shutdown-interactive.attlist, k.oem-shutdown-interactive.content } } #========================================== # common element # div { k.oem-silent-boot.content = xsd:boolean k.oem-silent-boot.attlist = empty k.oem-silent-boot = ## For oemboot driven images: boot silently during the initial boot ## true/false element oem-silent-boot { k.oem-silent-boot.attlist, k.oem-silent-boot.content } } #========================================== # common element # div { k.oem-silent-install.content = xsd:boolean k.oem-silent-install.attlist = empty k.oem-silent-install = ## For oemboot driven images: do not show progress of the image ## dump process, true/false element oem-silent-install { k.oem-silent-install.attlist, k.oem-silent-install.content } } #========================================== # common element # div { k.oem-skip-verify.content = xsd:boolean k.oem-skip-verify.attlist = empty k.oem-skip-verify = ## For oemboot driven images: do not perform the checksum ## verification process, true/false element oem-skip-verify { k.oem-skip-verify.attlist, k.oem-skip-verify.content } } #========================================== # common element # div { k.oem-vmcp-parmfile.content = text k.oem-vmcp-parmfile.attlist = empty k.oem-vmcp-parmfile = ## For oemboot driven images: provide the name of a parmfile ## which is loaded via cmsfscat on s390 systems. Default value ## is set to: PARM-S11 element oem-vmcp-parmfile { k.oem-vmcp-parmfile.attlist, k.oem-vmcp-parmfile.content } } #========================================== # common element # div { k.oem-multipath-scan.content = xsd:boolean k.oem-multipath-scan.attlist = empty k.oem-multipath-scan = ## For oemboot driven images: turn on or off the search ## for multipath devices: true/false (default is true) element oem-multipath-scan { k.oem-multipath-scan.attlist, k.oem-multipath-scan.content } } #========================================== # common element # div { k.oem-silent-verify.content = xsd:boolean k.oem-silent-verify.attlist = empty k.oem-silent-verify = ## For oemboot driven images: do not show progress of the image ## verification process, true/false element oem-silent-verify { k.oem-silent-verify.attlist, k.oem-silent-verify.content } } #========================================== # common element # div { k.oem-swap.content = xsd:boolean k.oem-swap.attlist = empty k.oem-swap = ## For oemboot driven images: use a swap partition yes/no element oem-swap { k.oem-swap.attlist, k.oem-swap.content } } #========================================== # common element # div { k.oem-swapsize.attlist = empty k.oem-swapsize = ## For oemboot driven images: Set the size of the swap ## partition in MB element oem-swapsize { k.oem-swapsize.attlist, xsd:nonNegativeInteger } } #========================================== # common element # div { k.oem-swapname.attlist = empty k.oem-swapname = ## For oem images: Set the name of the swap space ## The name of the swap space is used only if the ## image is configured to use the LVM volume manager. ## In this case swap is a volume and the volume takes ## a name. In any other case the given name will have ## no effect. element oem-swapname { k.oem-swapname.attlist, text } } #========================================== # common element # div { k.oem-systemsize.attlist = empty k.oem-systemsize = ## For oemboot driven images: Set the size of the system (root) ## partition or LVM partition in MB. If not provided the partition ## will grow to the maximum available free space on the disk element oem-systemsize { k.oem-systemsize.attlist, xsd:nonNegativeInteger } } #========================================== # common element # div { k.oem-unattended.content = xsd:boolean k.oem-unattended.attlist = empty k.oem-unattended = ## For oemboot driven images: don't ask questions if possible ## true/false element oem-unattended { k.oem-unattended.attlist, k.oem-unattended.content } } #========================================== # common element # div { k.oem-unattended-id.attlist = empty k.oem-unattended-id = ## For oemboot driven images: use the specified disk id ## the device is looked up in /dev/disk/by-* and /dev/mapper/* element oem-unattended-id { k.oem-unattended-id.attlist, text } } #========================================== # common element # div { k.product.name.attribute = k.name.attribute k.product.arch.attribute = k.arch.attribute k.product.attlist = k.product.name.attribute & k.product.arch.attribute? k.product = ## Name of a Product From openSUSE element product { k.product.attlist, empty } } #========================================== # common element

The location of the XSD Schema (not relevant for RELAX NG or DTD) A pair of URI references: First is a namespace name, second the location of the XSD Schema (not relevant for RELAX NG or DTD) The allowed Schema version (fixed value) 8.5 An identification number which is represented in a file named /etc/ImageID The root element of the configuration file
An ID A name Indicates that this package should be part of the boot image (initrd) too. This attribute can be used to include for example branding packages specified in the system image description to become part of the boot image also Indicates that this package should be removed from the boot image (initrd). the attribute is only evaluated if the bootinclude attribute is specified along with it too A friendly display name. Used in the boot menu A system architecture name, matching the 'uname -m' information Multiple architectures can be combined as comma separated list e.g arch="x86_64,ix86" A short description A path A profile name which binds the section to this name The password A script hook for meta files to be called after the file was fetched A source location where a package or configuration file can be found A partition size or optional image size Destination of a resource A name of a user An image name without / and spaces Specifies to clear or not some data or configurations
Any attribute including in any attribute in any namespace. Any element from almost any namespace except empty ones
Define custom XML extensions
Name of an image archive file (tarball)
Author of the image
License of the image
Image bootloader theme setup.
Image bootsplash theme setup.
Contact Information from the Author, like Email etc.
A Pointer to a File
Ignores a Package
Image keytable setup.
Image locale setup.
Name of a Pattern for SUSE or a Group for RH
collectionModule is only available in the bootstrap packages section @stream attribute is not allowed to disable a module Specify the module to become enabled (for the optionally given stream) or disabled.
For oemboot driven images: setup of the boot menu text displayed within the square brackets after first reboot of the OEM image
For oemboot driven images: halt system after image dump true/false
activate/deactivate disk resize on first boot: true/false By default the repart/resize is activated when creating an oem image. If the disk image should be more simple and should not react on storage geometry changes at all this option allows to switch off the use and inclusion of the kiwi oem dracut module that implements the resize
For oem images: repart/resize only on first boot: true/false By default the repart/resize happens on every reboot and therefore also allows for disk geometry changes during the livetime of the machine. If set to false the repart/resize operation happens only once and then never again
For oemboot driven images: specify the size of the ramdisk The value is taken into account if the deployment of the image happens into a ramdisk. The value can be overwritten with the kernel boot parameter: ramdisk_size
For oemboot driven images: filter install devices by given regular expression. The expression is handled by the bash regexp operator
For oemboot driven images: filter network interface names by given regular expression. The expression is handled by the bash regexp operator. Interface names matching the rule will be skipped. All other interface names stay in the list. It is also possible to pass the variable kiwi_oemnicfilter as kernel command line in a netboot deployment
For oemboot driven images: Specify whether the recovery archive should be stored as part of the image or not. If it's not stored it's created during install of the oem image
For oemboot driven images: use kiwi initrd in any case and don't replace it with mkinitrd created initrd
For oemboot driven images: install the system not as disk but into a free partition. If this option is set all other oem-* options concerning the partition table will not have any effect
For oemboot driven images: reboot after first deployment true/false
For oemboot driven images: reboot after first deployment with an interactive dialog true/false
For oemboot driven images: create a recovery archive yes/no
For oemboot driven images: Set the partition ID of recovery partition. Default value is 83 (Linux)
For oemboot driven images: Set the size of the recovery partition. Value is interpreted as MB
For oemboot driven images: shutdown after first deployment true/false
For oemboot driven images: shutdown after first deployment true/false
For oemboot driven images: boot silently during the initial boot true/false
For oemboot driven images: do not show progress of the image dump process, true/false
For oemboot driven images: do not perform the checksum verification process, true/false
For oemboot driven images: provide the name of a parmfile which is loaded via cmsfscat on s390 systems. Default value is set to: PARM-S11
For oemboot driven images: turn on or off the search for multipath devices: true/false (default is true)
For oemboot driven images: do not show progress of the image verification process, true/false
For oemboot driven images: use a swap partition yes/no
For oemboot driven images: Set the size of the swap partition in MB
For oem images: Set the name of the swap space The name of the swap space is used only if the image is configured to use the LVM volume manager. In this case swap is a volume and the volume takes a name. In any other case the given name will have no effect.
For oemboot driven images: Set the size of the system (root) partition or LVM partition in MB. If not provided the partition will grow to the maximum available free space on the disk
For oemboot driven images: don't ask questions if possible true/false
For oemboot driven images: use the specified disk id the device is looked up in /dev/disk/by-* and /dev/mapper/*
Name of a Product From openSUSE
A commandline option specification
A shim setup option specification
A install command option specification
A config command option specification
Name of an image Package
apk apt zypper dnf4 dnf5 microdnf pacman Name of the Package Manager
Name of the Package Manager
Description of how this profiles influences the image Import profile by default if no profile was set on the command line Profiles creates a namespace on an image description and thus can be used to have one description with different profiles for example KDE and GNOME including different packages.
The profile name required as part of the current profile definition. Requires is used to set profiles dependencies, with it a profile definition can be composed by other existing profiles.
Name of registry source server Use container with specified container backend podman docker container-snap
Container name Container path, default to '/' if not specified Container tag, defaults to 'latest' if not specified Only fetch the container but do not activate the loading of the container at first boot
suse redhat debian archlinux
$attr attribute is only available for the following repository types: $types Type of repository apk apt-deb apt-rpm deb-dir mirrors rpm-md Alias name to be used for this repository. This is an optional free-form text restricted to characters from the POSIX standard. If not set the source attribute value is used and builds the alias name by running a checksum digest of the defined URI of the repository. An alias name should be set if the source argument doesn't really explain what this repository contains. Distribution components, used for deb repositories. If not set it defaults to main Distribution name information, used for deb repositories Specify whether or not this repository should be configured in the resulting image. Boolean value true or false, the default is false. Specify whether or not this repository should be configured in the resulting image without using it at build time. Boolean value true or false, the default is false. Specify whether or not this specific repository values the result of the repository signature validation. The default value is false. Specify whether or not this specific repository values the result of the package signature validation for each package taken from this repository. The default value is false. Specify the path to a customization script. The script receives the repo file according to the used package manager as a parameter such that custom modifications can be placed when needed Channel priority assigned to all packages available in this channel (0 if not set). If the exact same package is available in more than one channel, the highest priority is used Channel password if required. It depends on the url type whether and how this information is passed Channel username if required. It depends on the url type whether and how this information is passed Specify the source type of the repository path. Depending on if the source path is a simple url or a pointer to a metadata file or mirror list, the configured package manager needs to be setup appropriately. By default the source is expected to be a simple repository url baseurl metalink mirrorlist Specifies for which architecture(s) this repository is supposed to provide packages. Multiple architecture names needs to be separated by a comma The Name of the Repository
Specify URI of a signing key for this repo. A local key file is specified as absolute file:/ or file:/// URI or as this:// URI relative to the image description directory The signing element holds information about repo/package signing keys
A Pointer to a data source. This can be a remote location as well as a path specification
Sets the used package manager to validate, or not, the repository and/or package signatures. The behavior can be slightly different depending on the used package manager. This is a system wide package manager option, so that, this value can be overwritten by repository specific configurations. The default value is false.
Setup if the package manager should exclude docs files during package installation. This option could be ignored according to the used package manager.
Image license setup. The specfied license name will be displayed in a dialog window on boot.
The unit of the image size M G Specifies the image empty space that will not be partitioned unpartitioned size must be smaller or equal to the defined size Specifies if the size value is absolute or added on top of the current data size Specifies the Size of an Image in (M)egabyte or (G)igabyte If the attribute additive is set the value will be added to the required size of the image
A detailed description of this image and what it can be used for.
Specify Volume group name, default is kiwiVG. This information is only used if the LVM volume management is used Prefer LVM even if the used filesystem has its own volume management system Specify volumes and size attributes
Setup Image Timezone setup
$attr attribute is only available for the following image types: $types $attr attribute must be set for the following image types: $types <vagrantconfig> section is required for the vagrant format Attribute $attr is not supported in combination with preferlvm Attribute $attr is only supported with filesystem=btrfs in oem images, derived_from can only be used in combination with format='oci:disk_format' or format='docker:disk_format' $attr attribute must be set for embed_verity_metadata $attr attribute must be set for embed_integrity_metadata Specifies the path of the boot image (initrd) description provided with KIWI Specifies the kernel boot profile defined in the boot image description. When kiwi builds the boot image the information is passed as add-profile option Specify the image is a Xen dom0 (Xen Server) image The information is used to create a correct bootloader configuration with regards to the required loading of the Xen Hypervisor activate the quota system if the filesystem is btrfs based. By default the quota system is inactive Tell kiwi to explicitly make a volume the default volume This can be either (/) or the root subvolume or the root snapshot depending on the specified btrfs configuration attributes. By default btrfs_set_default_volume is set to: true If no default volume should be set, this attribute can be used to turn it off Tell kiwi to create a root volume to host (/) inside. The name of this subvolume is by default set to: '@' The name of the subvolume can be changed via a volume entry of the form '<volume name="@root=NAME"/>' By default the creation of a root subvolume is set to: true Tell kiwi to install the system into a btrfs snapshot The snapshot layout is compatible with the snapper management toolkit and follows a concept by SUSE. By default no snapshots are used Tell kiwi to set the btrfs root filesystem snapshot read-only Once all data has been placed to the root filesystem snapshot it will be turned into read-only mode if this option is set to true. The option is only effective if btrfs_root_is_snapper_snapshot is also set to true. By default the root filesystem snapshot is writable Specifies the image blocksize in bytes which has to match the logical (SSZ) blocksize of the target storage device. By default 512 byte is used which works on many disks However 4096 byte disks are coming. You can check the desired target by calling: blockdev --report device Indicate if the target disk for oem images is deployed to a removable device e.g a USB stick or not. This only affects the EFI setup if requested and in the end avoids the creation of a custom boot menu entry in the firmware of the target machine. By default the target disk is expected to be non-removable On systems using selinux use the given policy. by default 'targeted' is used targeted mls minimum Request a spare partition right before the root partition of the requested size. The attribute takes a size value and allows a unit in MB or GB, e.g 200M. If no unit is given the value is considered to be mbytes. A spare partition can only be configured for the disk image type oem Specify mount point for spare partition in the system. Can only be configured for the disk image type oem Specify filesystem for spare partition in the system. Can only be configured for the disk image type oem btrfs ext2 ext3 ext4 xfs Specify filesystem attributes for the spare partition. Attributes can be specified as comma separated list. Can only be configured for the disk image type oem Specify if the spare partition should be the last one in the partition table. For images with a separate boot partition this attribute specifies the size in MB. If not set the min bootpart size is set to 200 MB For images with an EFI fat partition this attribute specifies the size in MB. If not set the min efipart size is set to 20 MB Specifies the mount options of the EFI partition which end up in fstab, e.g umask=0077,shortname=winnt For images with an EFI layout, specify if the legacy CSM (BIOS) mode should be supported or not. By default CSM mode is enabled For ISO images (live and install) the EFI boot requires an embedded FAT image. This attribute specifies the size in MB. If not set the min efifatimage size is set to 20 MB Specify to make use of logical partitions inside of an extended one. If set to true and if the msdos table type is active, this will cause the fourth partition to be an extended partition and all following partitions will be placed as logical partitions inside of that extended partition. This setting is useful if more than 4 primary partitions needs to be created in an msdos table For images with an EFI firmware specifies the partition table type to use. If not set defaults to gpt partition table type. msdos gpt Specifies the boot profile defined in the boot image description. When kiwi builds the boot image the information is passed as add-profile option Specifies whether the image output file should be compressed or not. This makes only sense for filesystem only images. Specifies which method to use in order to get persistent storage device names. By default by-uuid is used. by-uuid by-label by-partuuid Specifies the path to a script which is called right before the bootloader is installed. The script runs relative to the directory which contains the image structure Specifies the path to a script which is called right after the bootloader is installed. The script runs relative to the directory which contains the image structure Specifies the root filesystem type btrfs ext2 ext3 ext4 squashfs erofs xfs Specifies the compression type for erofs Specifies the compression type for mksquashfs uncompressed gzip lzo lz4 xz zstd Specifies to create a dm verity hash from the number of given blocks and placed at the end of the root filesystem If the verity hash should be calculated from the complete file the value 'all' can be specified. In combination with the verity_blocks attribute, embed a verification metadata block at the end of the partition serving the root filesystem Specifies to create a standalone dm integrity layer on top of the root filesystem In combination with the standalone_integrity attribute, embed an integrity metadata block at the end of the partition serving the root filesystem In combination with the standalone_integrity attribute, Allow to use old flawed HMAC calculation (does not protect superblock) In combination with the standalone_integrity attribute, protect access to the integrity map using the given key. In combination with the embed_integrity_metadata attribute, allows to specify a custom description of an integrity key as it is expected to be present in the kernel keyring. The information is placed in the integrity metadata block. If not specified kiwi creates a key argument string instead which is based on the given integrity_keyfile filename. The format of this key argument is: ':basename_of_integrity_keyfile_no_file_extension' Specifies to use an overlay root system consisting out of a squashfs or erofs compressed read-only root system overlayed using the overlayfs filesystem into an extra read-write partition. Available for the disk image type oem Specifies the filesystem type to use as read-only filesystem in an overlayroot setup. By default squashfs is used squashfs erofs Specifies to create an extra read-write partition in combination with the overlayroot attribute on the target disk. By default the partition is created and the kiwi-overlay dracut module also expect it to be present. However, the overlayroot feature could also be used without dracut (initrd_system="none") and under certain circumstances it is handy to configure if the partition table should contain the read-write partition or not. Available for the disk image type oem Specifies the size in MB of the partition which stores the squashfs compressed read-only root filesystem in an overlayroot setup. If not specified kiwi calculates the needed size by a preliminary creation of the squashfs compressed file. However this is only accurate if no changes to the root filesystem data happens after this calculation, which cannot be guaranteed as there is at least one optional script hook which is allowed and applied after the calculation. Specifies the boot firmware of the system. Most systems uses a standard BIOS but there are also other firmware systems like efi, coreboot, etc.. This attribute is used to differentiate the image according to the firmware which boots up the system. It mostly has an impact on the disk layout and the partition table type. The default firmware setting is based on the architecture. If no action should be taken on behalf of a firmware setting or kiwi's default selection, set the firmware to: custom bios ec2 efi uefi ofw opal custom specify if an extra boot partition should be used or not. This will overwrite kiwi's default layout if an extra boot partition is required this attribute specify which filesystem should be used for it. The type of the bootloader might overwrite this setting btrfs ext2 ext3 ext4 xfs fat32 fat16 Specifies live iso technology and dracut module to use. If set to overlay the kiwi-live dracut module will be used to support a live iso system based on squashfs+overlayfs. If set to dmsquash the dracut standard dmsquash-live module will be used to support a live iso system based on squashfs and the device mapper. Please note both modules supports a different set of live features. overlay dmsquash Specifies the format of the virtual disk. gce ova qcow2 vagrant vmdk vdi vhd vhdx vhd-fixed Specifies the format of the virtual disk. aws-nitro Specifies additional format options passed on to qemu-img formatoptions is a comma separated list of format specific options in a name=value format like qemu-img expects it. kiwi will take the information and pass it as parameter to the -o option in the qemu-img call Force use of MBR (msdos table) partition table even if the use of the GPT would be the natural choice. On e.g some arm systems an EFI partition layout is required but must not be stored in a GPT. For those rare cases this attribute allows to force the use of the msdos table including all its restrictions in max partition size and amount of partitions Apply the partition type codes of the Discoverable Partitions Specification (DPS) to the partitions which match a DPS partition type, e.g the root partition gets the root partition type of the architecture. By default the type codes are not applied Specifies the filesystem mount options which also ends up in fstab The string given here is passed as value to the -o option of mount Specifies options to create the filesystem Specifies extra creation options passed to the tool that builds the overlay read-only root filesystem (e.g. mkfs.erofs -C for a larger pcluster). Whitespace separated. Will trigger the creation of a partition for a COW file to keep data persistent over a reboot Set the filesystem to use for persistent writing if a hybrid image is used as disk on e.g a USB Stick. By default the ext4 filesystem is used ext4 xfs for gpt disk types only: create a hybrid GPT/MBR partition table specify which initrd builder to use, default is dracut initrd architecture. kiwi dracut none Specifies the image type btrfs cpio docker ext2 ext3 ext4 iso oem pxe kis squashfs erofs tbz xfs oci appx enclave wsl Specifies a path to additional metadata required for the selected image type or its tools used to create that image type Specifies the bootloader default boot entry for the initial boot of a kiwi install image. failsafe-install harddisk install Specifies the boot timeout handling for the KIWI install image. If set to "true" the configured timeout or its default value applies. If set to "false" no timeout applies in the boot menu of the install image. Specifies if the bootloader menu should provide an failsafe entry with special kernel parameters or not Specifies if a install iso should be created (oem only) Specifies if a install stick should be created (oem only) Specifies if all data for a pxe network installation should be created (oem only) Specifies if the bootloader menu should provide an mediacheck entry to verify ISO integrity or not. Disabled by default and only available for x86 arch family. The kernelcmdline element specifies additional kernel command line options Specify LUKS version. This can be either set to "luks", "luks1" or "luks2". By default "luks" is used. luks luks1 luks2 Setup cryptographic volume along with the given filesystem using the LUKS extension. The value of this attribute represents either the password string or the location of a key file if specified as file:// resource. When using a key file it is in the responsibility of the user how this key file is actually being used. By default any distribution will just open an interactive dialog asking for credentials at boot time. With the luksOS value a predefined set of cipher, keysize and hash format options is passed to the cryptsetup call in order to create a format compatible to the specified distribution sle12 By default, all blocks of a LUKS volume will be filled with pseudo-random data. If you're shipping an image with a well-known key, which is going to be re-encrypted at deployment time, you can decrease the size of the image by setting this attribute to false. When LUKS unlocks a key slot using a user provided password, it uses a so-called key derivation function to derive a symmetric encryption key from the password. Not all boot loaders support all KDF algorithms, hence this attribute can be used to select a specific algorithm. pbkdf2 argon2i argon2id Setup software raid in degraded mode with one disk Thus only mirroring and striping is possible mirroring striping Specifies the primary type (choose KIWI option type) for use with overlay filesystems only: will force any COW action to happen in RAM label to set for the root filesystem. By default ROOT is used Specifies the license tag in a GCE format Specifies the GUID in a fixed format VHD for the iso type only: Specifies the volume ID (volume name or label) to be written into the master block. There is space for 32 characters. for the iso/(oem install iso) type only: Specifies the Application ID to be written into the master block. There is space for 128 characters. Specifies the wait period in seconds after launching the multipath daemon to wait until all presented devices are available on the host. Default timeout is 3 seconds Specifies the image URI of the container image. The image created by KIWI will use the specified container as the base root to work on. Create a systemfiles metadata file containing the file list of all packages of the system Include an existing systemfiles metadata file Together with derived_from create a delta root tree Whether to ensure /run and /tmp directories are empty in the container image created by Kiwi. Default is true. Specifies to archive the image result files into a tarball. The option is only available for the kis image type Specifies the publisher name of the ISO. Specifies the first disk sector for the first partition. Default value is 2048 and it can't be set to any number below the default. 2048 Clone root partition N times Clone boot partition N times. If no boot partition is used, the attribute has no effect. The use of a boot partition can be enforced through the bootpartition attribute or is implicitly activated according to the combination of type settings that makes the use of an extra boot partition a requirement Specifies the bundle format pattern The format string can contain placeholders for the following elements %N : Image name %P : Concatenated profile name (_) %A : Architecture name %I : Bundle ID %T : Image build type name %M : Image Major version number %m : Image Minor version number %p : Image Patch version number The specified bundle_format will be used as base name for all target image files at call time of: kiwi-ng result bundle ... Set custom partition number for the EFI CSM (legacy BIOS) partition if present Set custom partition number for the EFI partition if present Set custom partition number for the root partition Set custom partition number for the boot partition if present Specifies the image type The Image Type of the Logical Extend
The user ID for this user The list of groups that the user belongs to. The first item in the list is used as the login group. If 'groups' is not present a default group is assigned to the user according to he specifing toolchain behaviour. The name of an user Format of the given password, encrypted is the default encrypted plain The home directory for this user The shell for this user A User with Name, Password, Path to Its Home And Shell
A Version Number for the Image, Consists of Major.Minor.Release
An entry for the VM configuration file
The type of the disk as it is internally handled by the VM (ova only) The disk controller used for the VM guest (vmdk and ova). sata and nvme are supported for ova only. lsisas1068 and legacyESX are supported for vmdk only. scsi, paravirtual and pvscsi select the VMware paravirtual SCSI controller ide sata nvme scsi buslogic lsilogic lsisas1068 legacyESX pvscsi paravirtual The disk ID / device for the VM disk (vmdk only) The disk device to appear in the guest (xen only) The disk mode (vmdk only) monolithicSparse monolithicFlat twoGbMaxExtentSparse twoGbMaxExtentFlat streamOptimized The VM disk definition.
The CD/DVD controller used for the VM guest ide scsi The CD/DVD ID for the VM CD rom drive The VM CD/DVD drive definition. You can setup either a scsi CD or an ide CD drive
The driver used for the VM network interface The interface ID for the VM network interface The VM network mode The VM mac address The VM network interface definition
partition(name) is reserved Reserved names are '$reserved' Partition map name. The name of the partition as handled by KIWI. Note, that there are the following reserved names which cannot be used because they are already represented by existing KIWI attributes: root, readonly, boot, prep, spare, swap, efi_csm and efi. The filesystem created on the partition will also use this name in uppercase as its label Absolute size of the partition. The value is used as MB by default but you can add "M" and/or "G" as postfix Partition type name in the context of kiwi Allowed values are: t.linux t.linux t.raid Partition name as it appears in the table Mountpoint below which this partition should be mounted to Filesystem which should be created on the partition btrfs ext2 ext3 ext4 squashfs xfs fat32 fat16 Clone this partition N times filesystem label custom partition number Specify custom partition in the partition table
quota attribute is only available for the following image filesystem: btrfs free space to be added to this volume. The value is used as MB by default but you can add "M" and/or "G" as postfix volume name. The name of the volume. if mountpoint is not specified the name specifies a path which has to exist inside the root directory. The name/path of the parent volume. Evaluated only for the btrfs volume manager to allow specifying the parent subvolume to nest this volume in. If not specified the parent is always the volume set as the default volume volume path. The mountpoint specifies a path which has to exist inside the root directory. absolute size of the volume. If the size value is too small to store all data kiwi will exit. The value is used as MB by default but you can add "M" and/or "G" as postfix Apply the filesystem copy-on-write attribute for this volume Apply quota value to filesystem volume if supported Indicate that this filesystem should perform the validation to become filesystem checked. The actual constraints if the check is performed or not depends on systemd and filesystem specific components. If not set or set to false no system component will be triggered to run an eventual filesystem check, which results in this filesystem to be never checked. The latter is the default. filesystem label name of the volume. Specify which parts of the filesystem should be on an extra volume.
include given file and replace the include statement with its contents
Kiwi distinguishes between two basic image description types which uses the same format but one is created and provided by the kiwi developers and the other is created by the users of kiwi. The type=boot specifies a boot image (initrd) which should be provided by the kiwi developers wheras type=system specifies a standard image description created by a kiwi user. boot system A Short Description
A Collection of Driver Files
Specifies the strip data type. `delete` references a list of custom files and directories to delete, `tools` references file names in linux bin/sbin directories to keep, `libs` references file names in linux lib directories to keep. delete tools libs A Collection of files to strip
bootloader($attr) is only available for the following image types: $types bootloader($attr) attribute is only available for the following bootloader types: $types Specifies the bootloader used for booting the image. At the moment grub2, systemd_boot(EFI only), zipl and the combination of zipl plus userspace grub2(grub2_s390x_emu) are supported. The special custom entry allows to skip the bootloader configuration and installation and leaves this up to the user which can be done by using the editbootinstall and editbootconfig custom scripts grub2 grub2_s390x_emu systemd_boot custom zipl Specifies a custom grub bootloader template file which will be used instead of the one provided with Kiwi. A static bootloader template to create the grub config file is only used in Kiwi if the native method via the grub mkconfig toolchain does not work properly. As of today, this is only the case for live and install ISO images. Thus, this setting only affects the oem and iso image types. Specifies if the GRUB2 bootloader uses the boot loader specification Specifies the bootloader output console. Specifies the bootloader input console. Specifies the bootloader serial line setup. The setup is effective if the bootloader console is set to use the serial line. The attribute is available for the grub bootloader Specifies the bootloader video mode. The attribute is available for the grub bootloader Specifies the boot timeout in seconds prior to launching the default boot option. By default the timeout is set to 10sec Specifies the boot timeout style to control the way in which the timeout interacts with displaying the menu. If set the display of the bootloader menu is delayed after the timeout expired. In countdown mode an indication of the remaining time is displayed. The attribute is available for the grub loader. countdown hidden menu The device type of the disk on s390. For zFCP devices use SCSI, for emulated DASD devices use FBA, for 4k DASD devices use CDL FBA SCSI CDL GPT Specifies one or more kernel flavors as a comma separated list, e.g kernel_flavor="rt,default". A boot menu entry is created for the latest installed kernel of each flavor, in the order of the list. The entry of the first flavor is the default entry. The flavor is the end of the kernel version, following the release, e.g rt for 6.4.0-150600.10-rt or rt-amd64 for 6.1.0-21-rt-amd64. The flavor none stands for kernels whose version does not end with a flavor, e.g 7.2.15-100.fc43.x86_64 of the Fedora kernel package. If not specified, the boot menu entry is created for the latest installed kernel When /boot is encrypted, make the boot loader store the password in its configuration file (in cleartext). This is useful for full disk encryption images The bootloader section is used to select the bootloader and to provide configuration parameters for it
containerconfig($attr) is only available for the following image types: $types in oem images, the <containerconfig> section is only available in combination with @format='oci:disk_format' or @format='docker:disk_format' Specifies a name for the container. This is usually the the repository name of the container as read if the container image is imported via the docker load command Specifies a tag for the container. This is usually the the tag name of the container as read if the container image is imported via the docker load command Specifies additional names for the container using a comma separated values string. It supports '<repo1>:<tag2>,<repo2:tag2>' format. If any of the names does not include the repository or tag in that case `name` or `tag` attribute values from containerconfig will be used to build a complete image referrence. Specifies a maintainer for the container. Specifies a user for the container. Specifies the default working directory of the container The containerconfig element provides metadata information to setup a container in order to be prepared for use with the container engine tool chain. container specific data should be provided in an additional subsection whereas this section provides globally useful container information.
Specifies the entry point program name to execute Provides details for the entry point command. This includes the execution name and its parameters. Arguments can be optionally specified
Specifies the subcommand program name to execute Provides details for the subcommand command. This includes the execution name and its parameters. Arguments can be optionally specified. The subcommand is appended the command information from the entrypoint. It is in the responsibility of the author to make sure the combination of entrypoint and subcommand forms a valid execution command
Specifies a command argument name Provides details about a command argument
Provides details about network ports which should be exposed from the container. At least one port must be configured
Specifies the port number and transport protocol to expose. If no protocol is defined OCI defaults are applied. Provides details about an exposed port.
Provides details about storage volumes in the container At least one volume must be configured
The stopsignal element sets the system call signal that will be sent to the container to exit. This signal can be a signal name in the format SIG<NAME>, for instance SIGKILL, or an unsigned number that matches a position in the kernel's syscall table, for instance 9. The default is SIGTERM if not defined.
Partition table entries within the custom area of the storage device
luks attribute must be set when using luksformat option(s) luksFormat option settings
Additional bootloader settings
<securelinux> section only available for the bootloader types: zipl and grub2-s390x-emu securelinux contains all elements to describe data required to setup a secure linux execution process for the individual architecture in the scope of the bootloader process
Provides details about the container/bootloader environment variables. At least one environment variable must be configured
Specifies the environment variable name Specifies the environment variable value Provides details about an environment variable
Provides details about container labels At least one label must be configured
Specifies the label name Specifies the label value Provides details about a container label
Specifies the 'created by' history record. By default set to 'KIWI' Specifies the 'author' history record. Specifies a custom application ID, used for WSL containers Specifies a version information, used for WSL containers. The version given here follows the package numbering rules as documented in: https://docs.microsoft.com/en-us/windows/uwp/publish/package-version-numbering Specifies name of the container launcher program Used for WSL containers Provides details about the container history. Includes the 'created by', 'author' as attributes and its content represents the 'comment' entry.
The oemconfig element specifies the OEM image configuration options which are used to repartition and setup the system disk.
$attr attribute is only available for the following vagrant providers: $providers The vagrant provider for this box libvirt virtualbox Guest additions are present in this box Path to a Vagrantfile that will be embedded in the box Kiwi cannot check the Vagrantfile for correctnes, therefore use this at your own risk! virtualsize provides the value of the virtual_size key which is embedded in the metadata.json hash inside the box file, as described in http://docs.vagrantup.com/v2/boxes/format.html This tells the Vagrant provider how big to make the virtual disk when it creates the VM. The boxname as it's written into the json file If not specified the image name is used The vagrantconfig element specifies the Vagrant meta configuration options which are used inside a vagrant box
installmedia is only available for the oem type with 'installiso' or 'installpxe' set to 'true' The installmedia element defined the configuration parameters for the installation media of OEM images.
Sets weather the dracut modules list are meant to be appended, omitted or they define the static list of modules for the installation initrd. omit add set setup The initrd element defines the dracut modules configuration for the installation media.
A module name A kernel driver name A dracut module
The OVF configuration type. The Open Virtualization Format is a standard for describing virtual appliances and distribute them in an archive also called Open Virtual Appliance(OVA). The standard describes major components associated with a disk image. The exact specification depends on the product using the format and is specified in KIWI as the OVF type. vmware The virtual HW version number for the VM configuration (vmdk and ova) the VM architecture type (vmdk only) ix86 x86_64 the Xen target loader which is expected to load this guest hvmloader pygrub pvgrub The virtual guestOS identification string for the VM (vmdk and ova, note the name designation is different for the two formats) The virtual machine min memory in MB (ova only) The virtual machine max memory in MB (ova only) The virtual machine min CPU count (ova only) The virtual machine max CPU count (ova only) The memory, in MB, setup for the guest VM (all formats) The number of virtual cpus for the guest VM (all formats) The machine element specifies VM guest configuration options which are used by the virtual machine when running the image.
$attr attribute is only available for the following packages type(s): $types Specifies package collection type. `bootstrap` packages gets installed in the very first phase of an image build in order to fill the empty root directory with bootstrap data. `image` packages are installed after the bootstrap phase as chroot operation. `delete` packages are uninstalled after the preparation phase is done. `image_type_name` packages are only installed if this build type is requested. bootstrap delete docker image iso oem pxe kis oci uninstall systemfiles Selection type for patterns. Can be onlyRequired or plusRecommended onlyRequired plusRecommended Specify bootstrap package providing a bootstrap tarball in /var/cache/kiwi/bootstrap/PACKAGE_NAME.ARCH.tar.xz The tarball will be unpacked and used as the bootstrap rootfs to begin with. The feature is currently only available with the apt package manager to allow an alternative bootstrap method bootstrap_package attribute only available for the apt packagemanager Specifies Packages/Patterns Used in Different Stages
Configuration Information Needed for Logical Extend All elements are optional since the combination of appropriate preference sections based on profiles combine to create on vaild definition
Namespace section which creates a namespace and the drivers can bind itself to one of the listed namespaces.
A List of Users
././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.748706 kiwi-11.1.8/kiwi/snapshot_manager/__init__.py0000644000000000000000000000461315273675667016134 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from typing import TYPE_CHECKING, Dict, Optional from abc import ABCMeta, abstractmethod # project from kiwi.exceptions import KiwiSnapshotManagerSetupError if TYPE_CHECKING: # pragma: nocover from kiwi.snapshot_manager.base import SnapshotManagerBase class SnapshotManager(metaclass=ABCMeta): """ **SnapshotManager factory** :param str name: snapshot management name :param str device: storage device node name :param str root_dir: root directory path :param str mountpoint: mountpoint of the filesystem to snapshot :param str root_volume_name: the name of the root volume in case snapshots are hosted in a subvolume. :param dict custom_args: dictionary of custom snapshot manager arguments """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( name: str, device: str, root_dir: str, mountpoint: str, root_volume_name: str, custom_args: Optional[Dict] = None, ) -> 'SnapshotManagerBase': name_map = { 'snapper': 'Snapper', } try: snapshot_manager = importlib.import_module( 'kiwi.snapshot_manager.{0}'.format(name) ) module_name = 'SnapshotManager{0}'.format(name_map[name]) return snapshot_manager.__dict__[module_name]( device, root_dir, mountpoint, root_volume_name, custom_args ) except Exception as issue: raise KiwiSnapshotManagerSetupError( 'Support for {0} snapshot manager not implemented: {1}'.format( name, issue ) ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.749242 kiwi-11.1.8/kiwi/snapshot_manager/base.py0000644000000000000000000000414415273675667015306 0ustar00# Copyright (c) 2025 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import List, Dict, Optional, Any # project from kiwi.mount_manager import MountManager class SnapshotManagerBase: """ **Implements base class for snapshots management inferface** :param str device: storage device node name :param str root_dir: root directory path :param str mountpoint: mountpoint of the filesystem to snapshot :param str root_volume_name: the name of the root volume in case snapshots are hosted in a subvolume. :param dict custom_args: dictionary of custom snapshot manager arguments """ def __init__( self, device: str, root_dir: str, mountpoint: str, root_volume_name: str, custom_args: Optional[Dict[str, Any]] = None, ) -> None: self.device = device self.root_dir = root_dir self.mountpoint = mountpoint self.root_volume_name = root_volume_name self.post_init(custom_args) def post_init(self, custom_args: Optional[Dict[str, Any]]) -> None: """ Post initialization method Implementation in specialized SnapshotManager class if required """ pass def create_first_snapshot(self) -> List[MountManager]: raise NotImplementedError def setup_first_snapshot(self) -> None: raise NotImplementedError def get_default_snapshot_name(self) -> str: raise NotImplementedError ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.749242 kiwi-11.1.8/kiwi/snapshot_manager/snapper.py0000644000000000000000000002127015273675667016043 0ustar00# Copyright (c) 2025 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import shutil import datetime from typing import Any, Dict, List, Optional from xml.etree import ElementTree from xml.dom import minidom # project from kiwi.command import Command from kiwi.utils.command_capabilities import CommandCapabilities from kiwi.path import Path from kiwi.defaults import Defaults from kiwi.snapshot_manager.base import SnapshotManagerBase from kiwi.mount_manager import MountManager from kiwi.utils.sysconfig import SysConfig from kiwi.chroot_manager import ChrootManager, ChrootMount from kiwi.exceptions import KiwiSnapshotManagerSetupError class SnapshotManagerSnapper(SnapshotManagerBase): """ **Implements the snapshots management for Snapper** :param str device: storage device node name :param str root_dir: root directory path :param str mountpoint: mountpoint of the filesystem to snapshot :param str root_volume_name: the name of the root volume in case snapshots are hosted in a subvolume. """ def post_init(self, custom_args: Optional[Dict[str, Any]]) -> None: """ Post initialization method Store custom snapper manager initialization arguments :param dict custom_args: custom snapper manager arguments """ self.default_snapshot_name = ( f'/{self.root_volume_name}/.snapshots/1/snapshot' ) if custom_args: self.custom_args = custom_args else: self.custom_args = {} if 'quota_groups' not in self.custom_args: self.custom_args['quota_groups'] = False def create_first_snapshot(self) -> List[MountManager]: """ Creates the first snapshot on an empty filesystem In fact it is essentially creating an empty subvolume following the snapper's structure and convetion to store snapshots :return: list of additional mountpoints added on top of the given root mountpoint :rtype: list """ snapshot_path = os.path.normpath( os.sep.join([self.mountpoint, self.default_snapshot_name]) ) snapshot_path = self.mountpoint + self.default_snapshot_name if CommandCapabilities.check_version( 'snapper', (0, 12, 1), root=self.root_dir ): with ChrootManager( self.root_dir, binds=[ChrootMount(self.mountpoint)] ) as chroot: chroot.run( [ '/usr/lib/snapper/installation-helper', '--root-prefix', os.sep.join([self.mountpoint, self.root_volume_name]), '--step', 'filesystem', ] ) else: # with snapper <= 0.12.0 the first snapshot subvolume # structure is crafted manually snapshot_volume = ( self.mountpoint + f'/{self.root_volume_name}/.snapshots' ) Command.run(['btrfs', 'subvolume', 'create', snapshot_volume]) os.chmod(snapshot_volume, 0o700) Path.create(snapshot_volume + '/1') Command.run(['btrfs', 'subvolume', 'create', snapshot_path]) Command.run(['btrfs', 'subvolume', 'set-default', snapshot_path]) # Mount /{some-name}/.snapshots as /.snapshots inside the root snapshots_mount = MountManager( device=self.device, attributes={ 'subvol_path': f'{self.root_volume_name}/.snapshots', 'subvol_name': f'{self.root_volume_name}/.snapshots', }, mountpoint=snapshot_path + '/.snapshots', ) return [snapshots_mount] def setup_first_snapshot(self) -> None: """ Arranges the snapshot configuration once the OS tree is synched. It uses the snapper and the data from the snapshot itself. """ snapshot_path = os.path.normpath( os.sep.join([self.mountpoint, self.default_snapshot_name]) ) if CommandCapabilities.check_version( 'snapper', (0, 12, 1), root=snapshot_path ): snapshots_prefix = os.sep.join([snapshot_path, '.snapshots']) with ChrootManager( self.root_dir, binds=[ ChrootMount(snapshot_path), ChrootMount(snapshots_prefix), ], ) as chroot: chroot.run( [ '/usr/lib/snapper/installation-helper', '--root-prefix', snapshot_path, '--step', 'config', '--description', 'first root filesystem', ] ) else: # with snapper <= 0.12.0 the snapshot configuration is # crafted manually date_info = datetime.datetime.now() snapshot = ElementTree.Element('snapshot') snapshot_type = ElementTree.SubElement(snapshot, 'type') snapshot_type.text = 'single' snapshot_number = ElementTree.SubElement(snapshot, 'num') snapshot_number.text = '1' snapshot_description = ElementTree.SubElement( snapshot, 'description' ) snapshot_description.text = 'first root filesystem' snapshot_date = ElementTree.SubElement(snapshot, 'date') snapshot_date.text = date_info.strftime("%Y-%m-%d %H:%M:%S") with open( os.path.join(snapshot_path, '../info.xml'), 'w' ) as snapshot_info_file: snapshot_info_file.write(self._xml_pretty(snapshot)) if self.custom_args['quota_groups']: snapper_default_conf = Defaults.get_snapper_config_template_file( snapshot_path ) if snapper_default_conf: # snapper requires an extra parent qgroup to operate with quotas Command.run( ['btrfs', 'qgroup', 'create', '1/0', self.mountpoint] ) config_file = self._set_snapper_sysconfig_file(snapshot_path) if not os.path.exists(config_file): shutil.copyfile(snapper_default_conf, config_file) with ChrootManager(snapshot_path) as chroot: chroot.run( ['snapper', '--no-dbus', 'set-config', 'QGROUP=1/0'] ) with ChrootManager(snapshot_path) as chroot: chroot.run(['snapper', '--no-dbus', 'modify', '--default', '1']) def get_default_snapshot_name(self) -> str: """ Gets the name of the default snapshot for snapper :return: default snapper snapshot path :rtype: string """ return self.default_snapshot_name def _xml_pretty(self, toplevel_element: ElementTree.Element) -> str: xml_data_unformatted = ElementTree.tostring(toplevel_element, 'utf-8') xml_data_domtree = minidom.parseString(xml_data_unformatted) return xml_data_domtree.toprettyxml(indent=" ") @staticmethod def _set_snapper_sysconfig_file(root_path: str) -> str: sysconf_file = SysConfig( os.sep.join([root_path, 'etc/sysconfig/snapper']) ) if ( not sysconf_file.get('SNAPPER_CONFIGS') or len(sysconf_file['SNAPPER_CONFIGS'].strip('\"')) == 0 ): sysconf_file['SNAPPER_CONFIGS'] = '"root"' sysconf_file.write() elif len(sysconf_file['SNAPPER_CONFIGS'].split()) > 1: raise KiwiSnapshotManagerSetupError( 'Unsupported SNAPPER_CONFIGS value: {0}'.format( sysconf_file['SNAPPER_CONFIGS'] ) ) return os.sep.join( [ root_path, 'etc/snapper/configs', sysconf_file['SNAPPER_CONFIGS'].strip('\"'), ] ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.749242 kiwi-11.1.8/kiwi/solver/__init__.py0000644000000000000000000000000015273675667014077 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7493753 kiwi-11.1.8/kiwi/solver/repository/__init__.py0000644000000000000000000000427715273675667016342 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from typing import TYPE_CHECKING, Optional from abc import ABCMeta, abstractmethod # project from kiwi.exceptions import KiwiSolverRepositorySetupError from kiwi.system.uri import Uri if TYPE_CHECKING: # pragma: nocover from kiwi.solver.repository.base import SolverRepositoryBase class SolverRepository(metaclass=ABCMeta): """ **Repository factory for creation of SAT solvables** * :param object uri: Instance of :class:`Uri` """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( uri: Uri, user: Optional[str] = None, secret: Optional[str] = None ) -> 'SolverRepositoryBase': name_map = { 'yast2': ['SolverRepositorySUSE', 'suse'], 'rpm-md': ['SolverRepositoryRpmMd', 'rpm_md'], 'rpm-dir': ['SolverRepositoryRpmDir', 'rpm_dir'], 'apt-deb': ['SolverRepositoryDeb', 'deb'], } try: module_name = name_map[uri.repo_type][0] module_namespace = name_map[uri.repo_type][1] repository = importlib.import_module( 'kiwi.solver.repository.{0}'.format(module_namespace) ) return repository.__dict__[module_name](uri, user, secret) except Exception as issue: raise KiwiSolverRepositorySetupError( 'Support for {0} solver repotype not implemented: {1}'.format( uri.repo_type, issue ) ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.749416 kiwi-11.1.8/kiwi/solver/repository/base.py0000644000000000000000000003274215273675667015513 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from base64 import b64encode from tempfile import TemporaryDirectory from typing import List, Optional from urllib.request import urlopen from urllib.request import Request from kiwi.utils.temporary import Temporary from lxml import etree import random import glob import os import re # project import kiwi.defaults as defaults from kiwi.exceptions import KiwiUriOpenError from kiwi.path import Path from kiwi.command import Command from kiwi.defaults import Defaults from kiwi.system.uri import Uri class SolverRepositoryBase: """ **Base class interface for SAT solvable creation.** :param object uri: Instance of :class:`Uri` :param string user: User name for uri authentication :param string secret: Secret token for uri authentication """ def __init__( self, uri: Uri, user: Optional[str] = None, secret: Optional[str] = None ) -> None: self.uri = uri # check if the URI string contains credentials and # extract/trim them from the uri object. The urlparse # class does not recognize this information as a valid # URI and throws an exception secret_format = re.match(r'^(.*)://(.*):(.*)@(.*)', uri.uri) if secret_format: self.user = secret_format.group(2) self.secret = secret_format.group(3) self.uri.uri = ( f'{secret_format.group(1)}://{secret_format.group(4)}' ) else: self.user = user self.secret = secret self.repository_metadata_dirs: List[TemporaryDirectory] = [] self.repository_solvable_dir: Optional[TemporaryDirectory] = None def create_repository_solvable( self, target_dir: str = Defaults.get_solvable_location() ) -> Optional[str]: """ Create SAT solvable for this repository from previously created intermediate solvables by merge and store the result solvable in the specified target_dir :param str target_dir: path name :return: file path to solvable :rtype: str """ Path.create(target_dir) solvable: Optional[str] = os.sep.join([target_dir, self.uri.alias()]) if not self.is_uptodate(target_dir): self._setup_repository_metadata() solvable = self._merge_solvables(target_dir) return solvable def timestamp(self) -> str: """ Return repository timestamp The retrieval of the repository timestamp depends on the type of the repository and is therefore supposed to be implemented in the specialized Solver Repository classes. If no such implementation exists the method returns the value 'static' to indicate there is no timestamp information available. :rtype: str """ return 'static' def is_uptodate( self, target_dir: str = Defaults.get_solvable_location() ) -> bool: """ Check if repository metadata is up to date :return: True or False :rtype: bool """ solvable_time_file = ''.join( [target_dir, os.sep, self.uri.alias(), '.timestamp'] ) if os.path.exists(solvable_time_file): with open(solvable_time_file) as solvable_time: saved_time = solvable_time.read() if saved_time == self.timestamp() and not saved_time == 'static': return True return False def download_from_repository(self, repo_source: str, target: str) -> None: """ Download given source file from the repository and store it as target file The repo_source location is used relative to the repository location and will be part of a mime type source like: `file://repo_path/repo_source` :param str repo_source: source file in the repo :param str target: file path :raises KiwiUriOpenError: if the download fails """ download_link = None try: download_link = os.sep.join( [self._get_mime_typed_uri(), repo_source] ) request = Request(download_link) if self.user and self.secret: credentials = b64encode( format(':'.join([self.user, self.secret])).encode() ) request.add_header( 'Authorization', 'Basic ' + credentials.decode() ) location = urlopen(request) except Exception as e: raise KiwiUriOpenError(f'{type(e).__name__}: {e} {download_link}') with open(target, 'wb') as target_file: target_file.write(location.read()) def get_repo_type(self) -> Optional[str]: try: if self._get_repomd_xml(): return 'rpm-md' except KiwiUriOpenError: pass try: if self._get_deb_packages(): return 'apt-deb' except KiwiUriOpenError: pass try: repo_listing = self._get_pacman_packages() if repo_listing and '.db.sig\"' in repo_listing: return 'pacman' except KiwiUriOpenError: pass return None def _get_pacman_packages(self) -> Optional[str]: """ Download Arch repository listing for the current architecture :return: html directory listing :rtype: str """ dir_listing_download = Temporary().new_file() self.download_from_repository( defaults.PLATFORM_MACHINE, dir_listing_download.name ) if os.path.isfile(dir_listing_download.name): with open(dir_listing_download.name) as listing: return listing.read() return None def _get_deb_packages( self, download_dir: Optional[str] = None ) -> Optional[str]: """ Download Packages.gz file from an apt repository and return its contents. If download_dir is set, download the file and return the file path name :param str download_dir: Download directory :return: Contents of Packages file or file path name :rtype: str """ repo_source = 'Packages.gz' if not download_dir: packages_download = Temporary().new_file() self.download_from_repository(repo_source, packages_download.name) if os.path.isfile(packages_download.name): with open(packages_download.name) as packages: return packages.read() else: packages_file = os.sep.join( [download_dir, repo_source.replace(os.sep, '_')] ) self.download_from_repository(repo_source, packages_file) return packages_file return None def _get_repomd_xml( self, lookup_path: str = 'repodata' ) -> etree._ElementTree: """ Parse repomd.xml file from lookup_path and return an etree This method only applies to rpm-md type repositories :param str lookup_path: relative path used to find repomd.xml file :return: Object with repomd.xml contents :rtype: XML etree """ xml_download = Temporary().new_file() xml_setup_file = os.sep.join([lookup_path, 'repomd.xml']) self.download_from_repository(xml_setup_file, xml_download.name) return etree.parse(xml_download.name) def _get_repomd_xpath( self, xml_data: etree._ElementTree, expression: str ) -> List[etree._Element]: """ Call the provided xpath expression on the root element of the xml_data which must be an XML etree parsed document and return the result. This method only applies to repomd.xml files of the correct namespaces: * http://linux.duke.edu/metadata/repo * http://linux.duke.edu/metadata/rpm :param object xml_data: An XML etree object of a parsed XML file. :param str expression: An xpath expression to filder xml_data. :return: Elements matching the xpath expression :rtype: list """ namespace_map = dict( repo='http://linux.duke.edu/metadata/repo', rpm='http://linux.duke.edu/metadata/rpm', ) return xml_data.getroot().xpath(expression, namespaces=namespace_map) def _setup_repository_metadata(self) -> None: """ Download all relevant repository metadata and create intermediate solvables from the result. The metadata structure depends on the type of the repository and must be implemented in the specialized Solver Repository classes. """ raise NotImplementedError def _create_solvables(self, metadata_dir: str, tool: str) -> None: """ Create intermediate (before merge) SAT solvables from the data given in the metadata_dir and store the result in the temporary repository_solvable_dir. The given tool must match the solvable data structure. There are the following tools to create a solvable from repository metadata: * rpmmd2solv solvable from repodata files * susetags2solv solvable from SUSE (yast2) repository files * comps2solv solvable from RHEL component files * rpms2solv solvable from rpm header files * deb2solv solvable from deb header files :param str metadata_dir: path name :param str tool: one of the above tools """ if not self.repository_solvable_dir: self.repository_solvable_dir = Temporary( prefix='kiwi_solvable_dir.' ).new_dir() if tool == 'rpms2solv': # solvable is created from a bunch of rpm files bash_command = [ tool, os.sep.join([metadata_dir, '*.rpm']), '>', self._get_random_solvable_name(), ] Command.run(['bash', '-c', ' '.join(bash_command)]) else: # each file in the metadata_dir is considered a valid # solvable for the selected solv tool tool_options = [] if tool == 'deb2solv': tool_options.append('-r') for source in glob.iglob('/'.join([metadata_dir, '*'])): bash_command = ['gzip', '-cd', '--force'] if source.endswith('.zst'): bash_command = ['zstd', '-dcf'] bash_command += ( [source, '|', tool] + tool_options + ['>', self._get_random_solvable_name()] ) Command.run(['bash', '-c', ' '.join(bash_command)]) def _merge_solvables(self, target_dir: str) -> Optional[str]: """ Merge all intermediate SAT solvables into one and store the result in the given target_dir. In addition an info file containing the repo url and a timestamp file is created :param str target_dir: path name """ if self.repository_solvable_dir: solvable = os.sep.join([target_dir, self.uri.alias()]) bash_command = [ 'mergesolv', '/'.join([self.repository_solvable_dir.name, '*']), '>', solvable, ] Command.run(['bash', '-c', ' '.join(bash_command)]) with open('.'.join([solvable, 'info']), 'w') as solvable_info: solvable_info.write(''.join([self.uri.uri, os.linesep])) with open('.'.join([solvable, 'timestamp']), 'w') as solvable_time: solvable_time.write(self.timestamp()) return solvable return None def _get_mime_typed_uri(self) -> str: """ Adds `file` scheme for local URIs :return: A mime typed URI as string :rtype: str """ return ( self.uri.translate() if self.uri.is_remote() else ''.join(['file://', self.uri.translate()]) ) def _create_temporary_metadata_dir(self) -> str: """ Create and manage a temporary metadata directory :return: the path of the temporary directory just created :rtype: str """ metadata_dir = Temporary(prefix='kiwi_metadata_dir.').new_dir() self.repository_metadata_dirs.append(metadata_dir) return metadata_dir.name def _get_random_solvable_name(self) -> str: # the solvable directory is created by _create_solvables() assert self.repository_solvable_dir is not None return '{0}/solvable-{1}{2}{3}{4}'.format( self.repository_solvable_dir.name, self._rand(), self._rand(), self._rand(), self._rand(), ) def _rand(self) -> str: return f'{random.randrange(1, 254):02x}' ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.749416 kiwi-11.1.8/kiwi/solver/repository/deb.py0000644000000000000000000000263415273675667015330 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # # project from kiwi.solver.repository.base import SolverRepositoryBase class SolverRepositoryDeb(SolverRepositoryBase): """ **Class for SAT solvable creation for apt-deb type repositories.** """ def _setup_repository_metadata(self) -> None: """ Download repo metadata for apt-deb specific repositories and create SAT solvables from all solver relevant files """ # Download Packages metadata for the deb2solv solvable # creation. This includes the files named Packages.gz in # the repo definition deb_dir = self._create_temporary_metadata_dir() self._get_deb_packages(download_dir=deb_dir) self._create_solvables(deb_dir, 'deb2solv') ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.749416 kiwi-11.1.8/kiwi/solver/repository/rpm_dir.py0000644000000000000000000000325015273675667016225 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import glob # project from kiwi.solver.repository.base import SolverRepositoryBase from kiwi.exceptions import KiwiRpmDirNotRemoteError class SolverRepositoryRpmDir(SolverRepositoryBase): """ **Class for SAT solvable creation for rpm_dir type repositories.** """ def _setup_repository_metadata(self) -> None: """ Download rpms from the repository and create a SAT solvable from the rpm header metadata """ if self.uri.is_remote(): raise KiwiRpmDirNotRemoteError( 'Only local rpm-dir repositories are supported' ) package_dir = self._create_temporary_metadata_dir() for package in glob.iglob('/'.join([self.uri.translate(), '*.rpm'])): package_name = os.path.basename(package) self.download_from_repository( package_name, os.sep.join([package_dir, package_name]) ) self._create_solvables(package_dir, 'rpms2solv') ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.749416 kiwi-11.1.8/kiwi/solver/repository/rpm_md.py0000644000000000000000000000746015273675667016056 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from collections import namedtuple from typing import Any, List # project from kiwi.solver.repository.base import SolverRepositoryBase class SolverRepositoryRpmMd(SolverRepositoryBase): """ **Class for SAT solvable creation for rpm-md type repositories.** """ def _setup_repository_metadata(self) -> None: """ Download repo metadata for rpm-md specific repositories and create SAT solvables from all solver relevant files """ # Download rpm-md metadata for the rpmmd2solv solvable # creation. This includes the files marked as primary # and pattern in the repo definition rpm_md_dir = self._create_temporary_metadata_dir() rpm_md_data = self._find_repomd_files( ['primary', 'patterns'], 'rpmmd2solv' ) for rpm_md_file in rpm_md_data.metadata_files: self.download_from_repository( rpm_md_file, os.sep.join([rpm_md_dir, os.path.basename(rpm_md_file)]), ) self._create_solvables(rpm_md_dir, rpm_md_data.solv_tool) # Download rpm-md metadata for the comps2solv solvable # creation. This includes the files marked as group_gz # This component information is like the SUSE pattern # information but for RHEL. In order to allow resolving # group id names this information needs to be present rpm_comps_dir = self._create_temporary_metadata_dir() rpm_comps_data = self._find_repomd_files(['group_gz'], 'comps2solv') for rpm_comps_file in rpm_comps_data.metadata_files: self.download_from_repository( rpm_comps_file, os.sep.join([rpm_comps_dir, os.path.basename(rpm_comps_file)]), ) self._create_solvables(rpm_comps_dir, rpm_comps_data.solv_tool) def timestamp(self) -> str: """ Get timestamp from the first primary metadata :return: time value as text :rtype: str """ return self._get_repomd_xpath( self._get_repomd_xml(), 'repo:data[@type="primary"]/repo:timestamp' )[0].text def _find_repomd_files(self, type_list: List[str], tool: str) -> Any: """ Lookup repodata/repomd.xml and the metadata files for the specified type list. Assign the found entries to the given tool :param list type_list: Value of type attribute in the repomd.xml definition :param str tool: Tool to create a solvable from this data :return: str:solv_tool, list:metadata_files :rtype: tuple """ result_type = namedtuple('result_type', ['solv_tool', 'metadata_files']) metadata_files = [] for metadata_type in type_list: metadata_locations = self._get_repomd_xpath( self._get_repomd_xml(), 'repo:data[@type="{0}"]/repo:location'.format(metadata_type), ) for location in metadata_locations: metadata_files.append(location.get('href')) return result_type(solv_tool=tool, metadata_files=metadata_files) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.749416 kiwi-11.1.8/kiwi/solver/repository/suse.py0000644000000000000000000000550415273675667015554 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from collections import namedtuple from typing import Any # project from kiwi.solver.repository.base import SolverRepositoryBase class SolverRepositorySUSE(SolverRepositoryBase): """ **Class for SAT solvable creation for SUSE type repositories.** """ def _setup_repository_metadata(self) -> None: """ Download repo metadata for SUSE specific repositories and create SAT solvables from all solver relevant files """ metadata_dir = self._create_temporary_metadata_dir() repo_data = self._find_primary_repository_files() for primary_file in repo_data.primary_files: self.download_from_repository( primary_file, os.sep.join([metadata_dir, os.path.basename(primary_file)]), ) self._create_solvables(metadata_dir, repo_data.solv_tool) def _find_primary_repository_files(self) -> Any: """ Lookup repodata/repomd.xml or alternative the packages.gz from the suse/setup/descr metadata. For online suse repos the repodata metadata exists and is preferred. On media like DVD there might be only the suse metadata. Depending on the result this also impacts which tool is required to create the solv data from the information :return: str:solv_tool, list:primary_files :rtype: tuple """ result_type = namedtuple('result_type', ['solv_tool', 'primary_files']) try: primary_files = [] primary_locations = self._get_repomd_xpath( self._get_repomd_xml('suse/repodata'), 'repo:data[@type="primary"]/repo:location', ) for location in primary_locations: primary_files.append( os.sep.join(['suse', location.get('href')]) ) return result_type( solv_tool='rpmmd2solv', primary_files=primary_files ) except Exception: return result_type( solv_tool='susetags2solv', primary_files=['suse/setup/descr/packages.gz'], ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.749416 kiwi-11.1.8/kiwi/solver/sat.py0000644000000000000000000002146015273675667013144 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib import logging from collections import namedtuple from typing import Any, Dict, List, Optional from xml.etree import ElementTree from xml.dom import minidom # project import kiwi.defaults as defaults from kiwi.solver.repository.base import SolverRepositoryBase from kiwi.exceptions import ( KiwiSatSolverPluginError, KiwiSatSolverJobError, KiwiSatSolverJobProblems, ) log = logging.getLogger('kiwi') class Sat: """ **Sat Solver class to run package solver operations** The class uses SUSE's libsolv sat plugin """ def __init__(self) -> None: """ An instance of Sat auto loads the python solv plugin which is a python binding to the libsolv C library. An exception is raised if the module failed to load. On success a new solver pool is initialized for this instance :raises KiwiSatSolverPluginError: if libsolv module can't be loaded """ try: self.solv = importlib.import_module('solv') except Exception as e: raise KiwiSatSolverPluginError( '{0}: {1}'.format(type(e).__name__, format(e)) ) self.pool = self.solv.Pool() self.pool.setarch() def set_dist_type( self, dist: str, arch: Optional[str] = None ) -> Optional[Dict[str, Any]]: if not arch: arch = defaults.PLATFORM_MACHINE dist_types = { 'deb-x86_64': { 'pool_dist': self.solv.Pool.DISTTYPE_DEB, 'arch': 'amd64', }, 'deb-aarch64': { 'pool_dist': self.solv.Pool.DISTTYPE_DEB, 'arch': 'arm64', }, } dist_type = dist_types.get(f'{dist}-{arch}') if dist_type: if self.pool.setdisttype(dist_type['pool_dist']) < 0: raise KiwiSatSolverPluginError( f'Failed to set dist type for distribution: {dist!r}' ) self.pool.setarch(dist_type['arch'] if dist_type else arch) return dist_type def add_repository(self, solver_repository: SolverRepositoryBase) -> None: """ Add a repository solvable to the pool. This basically add the required repository metadata which is needed to run a solver operation later. :param object solver_repository: Instance of :class:`SolverRepository` """ solvable = solver_repository.create_repository_solvable() pool_repository = self.pool.add_repo(solver_repository.uri.uri) pool_repository.add_solv(solvable) self.pool.addfileprovides() self.pool.createwhatprovides() def solve( self, job_names: List[str], skip_missing: bool = False, ignore_recommended: bool = True, ) -> Dict[str, Any]: """ Solve dependencies for the given job list. The list is allowed to contain element names of the following format: * name describes a package name * pattern:name describes a package collection name whose metadata type is called 'pattern' and stored as such in the repository metadata. Usually SUSE repos uses that * group:name describes a package collection name whose metadata type is called 'group' and stored as such in the repository metadata. Usually RHEL/CentOS/Fedora repos uses that :param list job_names: list of strings :param bool skip_missing: skip job if not found :param bool ignore_recommended: do not include recommended packages :raises KiwiSatSolverJobProblems: if solver reports solving problems :return: Transaction result information :rtype: dict """ solver = self.pool.Solver() if ignore_recommended: solver.set_flag(self.solv.Solver.SOLVER_FLAG_IGNORE_RECOMMENDED, 1) solver_problems = solver.solve( self._setup_jobs(job_names, skip_missing) ) solver_problem_info = self._evaluate_solver_problems(solver_problems) if solver_problem_info: raise KiwiSatSolverJobProblems(solver_problem_info) solver_transaction = solver.transaction() return self._evaluate_solver_result(solver_transaction) def _evaluate_solver_problems(self, solver_problems: Any) -> Optional[str]: """ Iterate over solver problems and their solutions The method creates a pretty print XML information and returns that as a UTF-8 encoded string :param object solver_problems: result of :class:`Pool::Solver::solve()` :return: solver problem info and solutions :rtype: str """ if solver_problems: problems = ElementTree.Element('problems') for problem in solver_problems: problem_detail = ElementTree.SubElement( problems, 'problem', id=format(problem.id), message=problem.findproblemrule().info().problemstr(), ) for solution in problem.solutions(): solution_detail = ElementTree.SubElement( problem_detail, 'solution', id=format(solution.id) ) for option in solution.elements(1): solution_option = ElementTree.SubElement( solution_detail, 'option' ) solution_option.text = option.str() xml_data_unformatted = ElementTree.tostring(problems, 'utf-8') xml_data_domtree = minidom.parseString(xml_data_unformatted) return xml_data_domtree.toprettyxml(indent=" ") return None def _evaluate_solver_result( self, solver_transaction: Any ) -> Dict[str, Any]: """ Iterate over solver result and return a data dictionary :param object solver_transaction: result of :class:`Pool::Solver::transaction()` :return: dict of packages and their details :rtype: dict """ result_type = namedtuple( 'result_type', ['uri', 'installsize_bytes', 'arch', 'version', 'checksum'], ) result = {} for solvable in solver_transaction.newpackages(): name = solvable.lookup_str(self.solv.SOLVABLE_NAME) result[name] = result_type( uri=solvable.repo.name, installsize_bytes=solvable.lookup_num( self.solv.SOLVABLE_INSTALLSIZE ), arch=solvable.lookup_str(self.solv.SOLVABLE_ARCH), version=solvable.lookup_str(self.solv.SOLVABLE_EVR), checksum=solvable.lookup_checksum(self.solv.SOLVABLE_CHECKSUM), ) return result def _setup_jobs( self, job_names: List[str], skip_missing: bool ) -> List[Any]: """ Create a solver job list from given list of job names :param list job_names: list of package,pattern,group names :param bool skip_missing: continue or raise if job selection failed :return: list of :class:`Pool.selection()` objects :rtype: list """ jobs = [] for job_name in job_names: selection_name = self.solv.Selection.SELECTION_NAME selection_provides = self.solv.Selection.SELECTION_PROVIDES selection = self.pool.select( job_name, selection_name | selection_provides ) if selection.flags & self.solv.Selection.SELECTION_PROVIDES: log.info('--> Using capability match for {0}'.format(job_name)) if selection.isempty(): if skip_missing: log.info( '--> Package {0} not found: skipped'.format(job_name) ) else: raise KiwiSatSolverJobError( 'Package {0} not found'.format(job_name) ) else: jobs += selection.jobs(self.solv.Job.SOLVER_INSTALL) return jobs ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.749416 kiwi-11.1.8/kiwi/stackbuild/__init__.py0000644000000000000000000000130015273675667014716 0ustar00# Copyright (c) 2021 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7497084 kiwi-11.1.8/kiwi/stackbuild/defaults.py0000644000000000000000000000513115273675667014774 0ustar00# Copyright (c) 2021 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re from typing import Dict, List # project from kiwi.defaults import Defaults class StackBuildDefaults: """ **Implements stackbuild default values** Provides static methods for default values and state information """ @staticmethod def get_stash_home() -> str: """ Provides the base directory to store stash containers :return: dir path name :rtype: str """ return '/var/tmp/kiwi-stash' @staticmethod def is_container_name_valid(name: str) -> bool: """ Check container if name follows container naming rules Container names must start or end with a letter or number, and can contain only letters, numbers, and the dash (-) character. """ return bool(re.match(r'^[0-9a-zA-Z][0-9a-zA-Z\-]*[0-9a-zA-Z]$', name)) @staticmethod def get_stash_exclude_list() -> List: """ Provides the list of folders that are not relevant for the image root stash :return: list of file and directory names :rtype: list """ return ['dev/*', 'sys/*', 'proc/*'] @staticmethod def get_container_config( container_name: str, tag: str, maintainer: str ) -> Dict: """ Provides the container config used for the stash created container :return: container config dict :rtype: dict """ preparer = Defaults.get_preparer() return { 'container_name': container_name, 'container_tag': tag, 'entry_command': ['/bin/sh'], 'labels': { 'io.osinside.kiwi.maintainer': maintainer, 'io.osinside.kiwi.meta': preparer, }, 'history': { 'created_by': preparer, 'comment': 'KIWI Root Tree Stash', 'author': maintainer, }, } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7497084 kiwi-11.1.8/kiwi/storage/__init__.py0000644000000000000000000000000015273675667014231 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7499177 kiwi-11.1.8/kiwi/storage/clone_device.py0000644000000000000000000001200315273675667015117 0ustar00# Copyright (c) 2022 Marcus Schäfer. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import uuid from typing import List from kiwi.storage.device_provider import DeviceProvider from kiwi.storage.mapped_device import MappedDevice from kiwi.filesystem import FileSystem from kiwi.command import Command from kiwi.utils.block import BlockID from kiwi.defaults import Defaults from kiwi.exceptions import KiwiRaidSetupError class CloneDevice(DeviceProvider): """ **Implements device cloning** """ def __init__(self, source_provider: DeviceProvider, root_dir: str): """ Construct a new CloneDevice layout object :param object source_provider: Instance of class based on DeviceProvider :param str root_dir: Path to image root directory """ self.source_provider = source_provider self.root_dir = root_dir def clone(self, target_devices: List[DeviceProvider]) -> None: """ Clone source device to target device(s) :param list target_devices: List of target DeviceProvider instances """ for target_device in target_devices: Command.run( [ 'dd', 'if={0}'.format(self.source_provider.get_device()), 'of={0}'.format(target_device.get_device()), 'bs=1M', ] ) clone_id = BlockID(target_device.get_device()) target_filesystem = clone_id.get_filesystem() if target_filesystem in Defaults.get_filesystem_image_types(): # Simple filesystem clones needs to be unique on the UUID # to avoid conflicts on the running system with FileSystem.new(target_filesystem, target_device) as fs: fs.set_uuid() elif target_filesystem == 'LVM2_member': # Volume Group clones requires to be unique on the vgroup # name to avoid conflicts on the running system Command.run(['vgimportclone', target_device.get_device()]) elif target_filesystem == 'crypto_LUKS': # Device mapper clones based on the LUKS header needs to be # unique in the LUKS UUID to avoid conflicts on the running # system Command.run( [ 'cryptsetup', '-q', 'luksUUID', target_device.get_device(), '--uuid', format(uuid.uuid4()), ] ) elif target_filesystem == 'linux_raid_member': # Device mapper clones based on the RAID superblock needs # to be unique in the UUID stored in the raid superblock # to avoid conflicts on the running system try: mdadm_conf = f'{self.root_dir}/etc/mdadm.conf' with open(mdadm_conf) as mdadm: raid_config = mdadm.readline().split(' ') md_device = raid_config[1] md_name = raid_config[3].split('=')[1] Command.run(['mdadm', '--stop', md_device]) Command.run( [ 'mdadm', '--assemble', '--update=uuid', '--name', md_name, md_device, target_device.get_device(), ] ) with FileSystem.new( BlockID(md_device).get_filesystem(), MappedDevice(md_device, target_device), ) as fs: fs.set_uuid() Command.run(['mdadm', '--stop', md_device]) Command.run( [ 'mdadm', '--assemble', md_device, self.source_provider.get_device(), ] ) except Exception as issue: raise KiwiRaidSetupError( f'Failed to update mdraid UUID: {issue}' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7499177 kiwi-11.1.8/kiwi/storage/device_provider.py0000644000000000000000000000417215273675667015661 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Any # project from kiwi.command import Command from kiwi.exceptions import KiwiDeviceProviderError class DeviceProvider: """ **Base class for any class providing storage devices** """ def get_device(self) -> Any: """ Representation of device nodes Could provide one ore more devices representing the storage Implementation in specialized device provider class """ raise KiwiDeviceProviderError('No storage device(s) provided') def get_uuid(self, device: str) -> str: """ UUID of device :param string device: node name :return: UUID from blkid :rtype: str """ uuid_call = Command.run(['blkid', device, '-s', 'UUID', '-o', 'value']) return uuid_call.output.rstrip('\n') def get_byte_size(self, device: str) -> int: """ Size of device in bytes :param string device: node name :return: byte value from blockdev :rtype: int """ blockdev_call = Command.run(['blockdev', '--getsize64', device]) return int(blockdev_call.output.rstrip('\n')) def is_loop(self) -> bool: """ Check if device provider is loop based By default this is always False and needs an implementation in the the specialized device provider class :return: True or False :rtype: bool """ return False ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7499177 kiwi-11.1.8/kiwi/storage/disk.py0000644000000000000000000006427715273675667013456 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from collections import OrderedDict from types import TracebackType from typing import Dict, NamedTuple, Tuple, Optional, Type, Union # project from kiwi.defaults import Defaults from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.storage.device_provider import DeviceProvider from kiwi.storage.mapped_device import MappedDevice from kiwi.partitioner import Partitioner from kiwi.runtime_config import RuntimeConfig from kiwi.exceptions import KiwiCustomPartitionConflictError, KiwiError class ptable_entry_type(NamedTuple): mbsize: int clone: int partition_name: str partition_type: str partition_id: Optional[int] mountpoint: str filesystem: str label: str log = logging.getLogger('kiwi') class Disk(DeviceProvider): """ **Implements storage disk and partition table setup** """ def __init__( self, table_type: str, storage_provider: DeviceProvider, start_sector: Optional[int] = None, extended_layout: bool = False, apply_dps_codes: bool = False, ): """ Construct a new Disk layout object :param string table_type: Partition table type name :param object storage_provider: Instance of class based on DeviceProvider :param int start_sector: sector number :param bool extended_layout: If set to true and on msdos table type when creating more than 4 partitions, this will cause the fourth partition to be an extended partition and all following partitions will be placed as logical partitions inside of that extended partition :param bool apply_dps_codes: If set to true, partitions which match a partition type of the Discoverable Partitions Specification (DPS) get the type code defined for it, e.g the root partition gets the root partition type of the architecture. By default partitions keep the type code of their partition type, e.g t.linux """ self.partition_mapper = RuntimeConfig().get_mapper_tool() #: the underlaying device provider self.storage_provider = storage_provider #: list of protected map ids. If used in a custom partitions #: setup this will lead to a raise conditition in order to #: avoid conflicts with the existing partition layout and its #: customizaton capabilities self.protected_map_ids = [ 'root', 'readonly', 'boot', 'prep', 'spare', 'swap', 'efi_csm', 'efi', ] #: Unified partition UUIDs according to systemd, only used #: if the Discoverable Partition type codes should be applied self.gUID: Dict[str, str] = ( self.get_discoverable_partition_ids() if apply_dps_codes else {} ) self.partition_map: Dict[str, str] = {} self.public_partition_id_map: Dict[str, Union[int, str]] = {} self.partition_id_map: Dict[str, str] = {} self.is_mapped = False self.partitioner = Partitioner.new( table_type, storage_provider, start_sector, extended_layout ) self.table_type = table_type def __enter__(self) -> "Disk": return self def get_device(self) -> Dict[str, MappedDevice]: """ Names of partition devices Note that the mapping requires an explicit map() call :return: instances of MappedDevice :rtype: dict """ device_map = {} for partition_name, device_node in list(self.partition_map.items()): device_map[partition_name] = MappedDevice( device=device_node, device_provider=self ) return device_map def is_loop(self) -> bool: """ Check if storage provider is loop based The information is taken from the storage provider. If the storage provider is loop based the disk is it too :return: True or False :rtype: bool """ return self.storage_provider.is_loop() def create_custom_partitions( self, table_entries: Dict[str, ptable_entry_type] ) -> None: """ Create partitions from custom data set .. code:: python table_entries = { map_name: ptable_entry_type } :param dict table: partition table spec """ for map_name in table_entries: if map_name in self.protected_map_ids: raise KiwiCustomPartitionConflictError( f'Cannot use reserved table entry name: {map_name!r}' ) entry = table_entries[map_name] if entry.clone: self._create_clones( map_name, entry.clone, entry.partition_type, format(entry.mbsize), entry.partition_id, ) id_name = f'kiwi_{map_name.title()}Part' self.partitioner.create( name=entry.partition_name, mbsize=entry.mbsize, type_name=entry.partition_type, partition_id=entry.partition_id, ) self._add_to_map(map_name) self._add_to_public_id_map(id_name) part_uuid = self.gUID.get(entry.partition_name) if part_uuid: self.partitioner.set_uuid( self.partition_id_map[map_name], part_uuid ) self.partitioner.set_flag( self.partition_id_map[map_name], entry.partition_type ) def create_root_partition( self, mbsize: Union[int, str], clone: int = 0, partition_id: Optional[int] = None, ) -> None: """ Create root partition Populates kiwi_RootPart(id) and kiwi_BootPart(id) if no extra boot partition is requested :param str mbsize: partition size string :param int clone: create [clone] cop(y/ies) of the root partition :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. When cloned, the clone ID is calculated from the given partition_id """ mbsize, mbsize_clone = Disk._parse_size(mbsize) if clone: self._create_clones( 'root', clone, 't.linux', mbsize_clone, partition_id ) self.partitioner.create( name='p.lxroot', mbsize=mbsize, type_name='t.linux', partition_id=partition_id, ) self._add_to_map('root') self._add_to_public_id_map('kiwi_RootPart') if 'kiwi_ROPart' in self.public_partition_id_map: self._add_to_public_id_map('kiwi_RWPart') if 'kiwi_BootPart' not in self.public_partition_id_map: self._add_to_public_id_map('kiwi_BootPart') root_uuid = self.gUID.get('root') if root_uuid: self.partitioner.set_uuid(self.partition_id_map['root'], root_uuid) def create_root_lvm_partition( self, mbsize: Union[int, str], clone: int = 0, partition_id: Optional[int] = None, ) -> None: """ Create root partition for use with LVM Populates kiwi_RootPart(id) :param str mbsize: partition size string :param int clone: create [clone] cop(y/ies) of the lvm roo partition :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. When cloned, the clone ID is calculated from the given partition_id """ mbsize, mbsize_clone = Disk._parse_size(mbsize) if clone: self._create_clones( 'root', clone, 't.lvm', mbsize_clone, partition_id ) self.partitioner.create( name='p.lxlvm', mbsize=mbsize, type_name='t.lvm', partition_id=partition_id, ) self._add_to_map('root') self._add_to_public_id_map('kiwi_RootPart') root_uuid = self.gUID.get('root') if root_uuid: self.partitioner.set_uuid(self.partition_id_map['root'], root_uuid) self.partitioner.set_flag(self.partition_id_map['root'], 't.lvm') def create_root_raid_partition( self, mbsize: Union[int, str], clone: int = 0, partition_id: Optional[int] = None, ) -> None: """ Create root partition for use with MD Raid Populates kiwi_RootPart(id) and kiwi_RaidPart(id) as well as the default raid device node at boot time which is configured to be kiwi_RaidDev(/dev/mdX) :param str mbsize: partition size string :param int clone: create [clone] cop(y/ies) of the raid root partition :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. When cloned, the clone ID is calculated from the given partition_id """ mbsize, mbsize_clone = Disk._parse_size(mbsize) if clone: self._create_clones( 'root', clone, 't.raid', mbsize_clone, partition_id ) self.partitioner.create( name='p.lxraid', mbsize=mbsize, type_name='t.raid', partition_id=partition_id, ) self._add_to_map('root') self._add_to_public_id_map('kiwi_RootPart') self._add_to_public_id_map('kiwi_RaidPart') root_uuid = self.gUID.get('root') if root_uuid: self.partitioner.set_uuid(self.partition_id_map['root'], root_uuid) self.partitioner.set_flag(self.partition_id_map['root'], 't.raid') def create_root_readonly_partition( self, mbsize: Union[int, str], clone: int = 0, partition_id: Optional[int] = None, ) -> None: """ Create root readonly partition for use with overlayfs Populates kiwi_ReadOnlyPart(id), the partition is meant to contain a squashfs readonly filesystem. The partition size should be the size of the squashfs filesystem in order to avoid wasting disk space :param str mbsize: partition size string :param int clone: create [clone] cop(y/ies) of the ro root partition :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. When cloned, the clone ID is calculated from the given partition_id """ mbsize, mbsize_clone = Disk._parse_size(mbsize) if clone: self._create_clones( 'root', clone, 't.linux', mbsize_clone, partition_id ) self.partitioner.create( name='p.lxreadonly', mbsize=mbsize, type_name='t.linux', partition_id=partition_id, ) self._add_to_map('readonly') self._add_to_public_id_map('kiwi_ROPart') root_uuid = self.gUID.get('root') if root_uuid: self.partitioner.set_uuid( self.partition_id_map['readonly'], root_uuid ) def create_boot_partition( self, mbsize: Union[int, str], clone: int = 0, partition_id: Optional[int] = None, ) -> None: """ Create boot partition Populates kiwi_BootPart(id) and optional kiwi_BootPartClone(id) :param str mbsize: partition size string :param int clone: create [clone] cop(y/ies) of the boot partition :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. When cloned, the clone ID is calculated from the given partition_id """ mbsize, mbsize_clone = Disk._parse_size(mbsize) if clone: self._create_clones( 'boot', clone, 't.linux', mbsize_clone, partition_id ) self.partitioner.create( name='p.lxboot', mbsize=mbsize, type_name='t.linux', partition_id=partition_id, ) self._add_to_map('boot') self._add_to_public_id_map('kiwi_BootPart') boot_uuid = self.gUID.get('xbootldr') if boot_uuid: self.partitioner.set_uuid(self.partition_id_map['boot'], boot_uuid) def create_prep_partition( self, mbsize: Union[int, str], partition_id: Optional[int] = None ) -> None: """ Create prep partition Populates kiwi_PrepPart(id) :param str mbsize: partition size string :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. """ mbsize, _ = Disk._parse_size(mbsize) self.partitioner.create( name='p.prep', mbsize=mbsize, type_name='t.prep', partition_id=partition_id, ) self._add_to_map('prep') self._add_to_public_id_map('kiwi_PrepPart') def create_spare_partition( self, mbsize: Union[int, str], partition_id: Optional[int] = None ) -> None: """ Create spare partition for custom use Populates kiwi_SparePart(id) :param str mbsize: partition size string :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. """ mbsize, _ = Disk._parse_size(mbsize) self.partitioner.create( name='p.spare', mbsize=mbsize, type_name='t.linux', partition_id=partition_id, ) self._add_to_map('spare') self._add_to_public_id_map('kiwi_SparePart') def create_swap_partition( self, mbsize: Union[int, str], partition_id: Optional[int] = None ) -> None: """ Create swap partition Populates kiwi_SwapPart(id) :param str mbsize: partition size string :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. """ mbsize, _ = Disk._parse_size(mbsize) self.partitioner.create( name='p.swap', mbsize=mbsize, type_name='t.swap', partition_id=partition_id, ) self._add_to_map('swap') self._add_to_public_id_map('kiwi_SwapPart') swap_uuid = self.gUID.get('swap') if swap_uuid: self.partitioner.set_uuid(self.partition_id_map['swap'], swap_uuid) self.partitioner.set_flag(self.partition_id_map['swap'], 't.swap') def create_efi_csm_partition( self, mbsize: Union[int, str], partition_id: Optional[int] = None ) -> None: """ Create EFI bios grub partition Populates kiwi_BiosGrub(id) :param str mbsize: partition size string :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. """ mbsize, _ = Disk._parse_size(mbsize) self.partitioner.create( name='p.legacy', mbsize=mbsize, type_name='t.csm', partition_id=partition_id, ) self._add_to_map('efi_csm') self._add_to_public_id_map('kiwi_BiosGrub') def create_efi_partition( self, mbsize: Union[int, str], partition_id: Optional[int] = None ) -> None: """ Create EFI partition Populates kiwi_EfiPart(id) :param str mbsize: partition size string :param int partition_id: If provided, use this exact partition ID instead of auto-incrementing. """ mbsize, _ = Disk._parse_size(mbsize) self.partitioner.create( name='p.UEFI', mbsize=mbsize, type_name='t.efi', partition_id=partition_id, ) self._add_to_map('efi') self._add_to_public_id_map('kiwi_EfiPart') esp_uuid = self.gUID.get('esp') if esp_uuid: self.partitioner.set_uuid(self.partition_id_map['efi'], esp_uuid) self.partitioner.set_flag(self.partition_id_map['efi'], 't.efi') def activate_boot_partition(self) -> None: """ Activate boot partition Note: not all Partitioner instances supports this """ partition_id = None if 'prep' in self.partition_id_map: partition_id = self.partition_id_map['prep'] elif 'boot' in self.partition_id_map: partition_id = self.partition_id_map['boot'] elif 'root' in self.partition_id_map: partition_id = self.partition_id_map['root'] if partition_id: self.partitioner.set_flag(partition_id, 'f.active') def create_hybrid_mbr(self) -> None: """ Turn partition table into a hybrid GPT/MBR table Note: only GPT tables supports this """ self.partitioner.set_hybrid_mbr() def create_mbr(self) -> None: """ Turn partition table into MBR (msdos table) Note: only GPT tables supports this """ self.partitioner.set_mbr() def set_start_sector(self, start_sector: int) -> None: """ Set start sector Note: only effective on DOS tables """ self.partitioner.set_start_sector(start_sector) def wipe(self) -> None: """ Zap (destroy) any GPT and MBR data structures if present For DASD disks create a new VTOC table """ if 'dasd' in self.table_type: log.debug('Initialize DASD disk with new VTOC table') fdasd_input = Temporary().new_file() with open(fdasd_input.name, 'w') as vtoc: vtoc.write('y\n\nw\nq\n') bash_command = ' '.join( [ 'cat', fdasd_input.name, '|', 'fdasd', '-f', self.storage_provider.get_device(), ] ) try: Command.run(['bash', '-c', bash_command]) except Exception: # unfortunately fdasd reports that it can't read in the # partition table which I consider a bug in fdasd. However # the table was correctly created and therefore we continue. # Problem is that we are not able to detect real errors # with the fdasd operation at that point. log.debug('potential fdasd errors were ignored') else: log.debug('Initialize %s disk', self.table_type) Command.run( ['sgdisk', '--zap-all', self.storage_provider.get_device()] ) def map_partitions(self) -> None: """ Map/Activate partitions In order to access the partitions through a device node it is required to map them if the storage provider is loop based """ if self.storage_provider.is_loop(): if self.partition_mapper == 'kpartx': Command.run( ['kpartx', '-s', '-a', self.storage_provider.get_device()] ) else: Command.run( ['partx', '--add', self.storage_provider.get_device()] ) self.is_mapped = True else: Command.run(['partprobe', self.storage_provider.get_device()]) def get_public_partition_id_map(self) -> Dict[str, Union[int, str]]: """ Populated partition name to number map """ return OrderedDict(sorted(self.public_partition_id_map.items())) def get_discoverable_partition_ids(self) -> Dict[str, str]: """ Ask systemd for a list of standardized GUIDs for the current architecture and return them in a dictionary. If there is no such information available an empty dictionary is returned :return: key:value dict from systemd-id128 :rtype: dict """ discoverable_ids = {} try: raw_lines = Command.run(['systemd-id128', 'show']).output.split( os.linesep )[1:] for line in raw_lines: if line: line = ' '.join(line.split()) partition_name, uuid = line.split(' ') discoverable_ids[partition_name] = uuid except KiwiError as issue: log.warning(f'Failed to obtain discoverable partition IDs: {issue}') log.warning('Using built-in table') discoverable_ids = Defaults.get_discoverable_partition_ids() return discoverable_ids def _create_clones( self, name: str, clone: int, type_flag: str, mbsize: Union[int, str], partition_id: Optional[int] = None, ) -> None: """ Create [clone] cop(y/ies) of the given partition name The name of a clone partition uses the following name policy: * {name}clone{id} for the partition name * kiwi_{name}PartClone{id} for the kiwi map name :param str name: basename to use for clone partition names :param int clone: number of clones, >= 1 :param str type_flag: partition type name :param str mbsize: partition size string :param int partition_id: If provided, use this exact partition ID to calculate the clone ID with. """ for clone_id in range(1, clone + 1): if partition_id: partition_id += 1 self.partitioner.create( name=f'p.lx{name}clone{partition_id or clone_id}', mbsize=mbsize, type_name=type_flag, partition_id=partition_id, ) self._add_to_map(f'{name}clone{partition_id or clone_id}') self._add_to_public_id_map( f'kiwi_{name}PartClone{partition_id or clone_id}' ) @staticmethod def _parse_size( value: Union[int, str], ) -> Tuple[Union[int, str], Union[int, str]]: """ parse size value. This can be one of the following * A number_string * The string named: 'all_free' * The string formatted as: clone:{number_string_origin}:{number_string_clone} The method returns a tuple for size and optional clone size If no clone size exists both tuple values are the same The given number_string for the size of the partition is passed along to the actually used partitioner object and expected to be valid there. In case invalid size information is passed to the partitioner an exception will be raised in the scope of the partitioner interface and the selected partitioner class :param str value: size value :return: Tuple of strings :rtype: tuple """ if not format(value).startswith('clone:'): return (value, value) else: size_list = format(value).split(':') return (size_list[1], size_list[2]) def _add_to_public_id_map( self, name: str, value: Optional[int] = None ) -> None: if not value: value = self.partitioner.get_id() self.public_partition_id_map[name] = value def _add_to_map(self, name: str) -> None: device_node = None partition_number = format(self.partitioner.get_id()) if self.storage_provider.is_loop(): device_base = os.path.basename(self.storage_provider.get_device()) if self.partition_mapper == 'kpartx': device_node = ''.join( ['/dev/mapper/', device_base, 'p', partition_number] ) else: device_node = ''.join( ['/dev/', device_base, 'p', partition_number] ) else: device = self.storage_provider.get_device() if device[-1].isdigit(): device_node = ''.join([device, 'p', partition_number]) else: device_node = ''.join([device, partition_number]) if device_node: self.partition_map[name] = device_node self.partition_id_map[name] = partition_number def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: if self.storage_provider.is_loop() and self.is_mapped: log.info('Cleaning up %s instance', type(self).__name__) try: if self.partition_mapper == 'kpartx': for device_node in self.partition_map.values(): Command.run(['dmsetup', 'remove', device_node]) Command.run( ['kpartx', '-d', self.storage_provider.get_device()] ) else: Command.run( [ 'partx', '--delete', self.storage_provider.get_device(), ] ) except Exception as issue: log.error( 'cleanup of partition maps on {} failed with: {}'.format( self.storage_provider.get_device(), issue ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7499177 kiwi-11.1.8/kiwi/storage/integrity_device.py0000644000000000000000000002757215273675667016056 0ustar00# Copyright (c) 2022 Marcus Schäfer. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from types import TracebackType from typing import Optional, List, Dict, IO, Union, NamedTuple, Type # project import kiwi.defaults as defaults from kiwi.command import Command from kiwi.utils.temporary import Temporary from kiwi.utils.signature import Signature from kiwi.utils.block import BlockID from kiwi.storage.device_provider import DeviceProvider from kiwi.storage.mapped_device import MappedDevice from kiwi.exceptions import KiwiOffsetError integrity_credentials_type = NamedTuple( 'integrity_credentials_type', [ ('keydescription', str), ('keyfile', str), ('keyfile_algorithm', str), ('options', List[str]), ], ) log = logging.getLogger('kiwi') class IntegrityDevice(DeviceProvider): """ **Implements dm_integrity setup on a storage device** :param object storage_provider: Instance of class based on DeviceProvider :param str integrity_algorithm: Default integrity algorithm used unless further credentials information is provided :param integrity_credentials_type credentials: Optional credentials specification to protect integrity blocks with security key(s) """ def __init__( self, storage_provider: DeviceProvider, integrity_algorithm: str, credentials: Optional[integrity_credentials_type] = None, ) -> None: #: the underlaying device provider self.storage_provider = storage_provider self.integrity_device: Optional[str] = None self.integrity_name = 'integrityRoot' self.integrity_algorithm = integrity_algorithm if ( credentials and credentials.keyfile and credentials.keyfile_algorithm ): self.integrity_algorithm = credentials.keyfile_algorithm self.integrity_format_options = [ '--integrity', self.integrity_algorithm, '--sector-size', format(defaults.INTEGRITY_SECTOR_SIZE), ] self.integrity_open_options = ['--integrity', self.integrity_algorithm] if credentials and credentials.options: if 'legacy_hmac' in credentials.options: self.integrity_format_options.append('--integrity-legacy-hmac') if credentials and credentials.keyfile: integrity_key_options = [ '--integrity-key-file', credentials.keyfile, '--integrity-key-size', format(os.path.getsize(credentials.keyfile)), ] self.integrity_format_options += integrity_key_options self.integrity_open_options += integrity_key_options self.integrity_metadata_file: Optional[IO[bytes]] = None self.credentials = credentials def __enter__(self) -> "IntegrityDevice": return self def get_device(self) -> Optional[MappedDevice]: """ Instance of MappedDevice providing the dm_integrity device :return: mapped integrity device :rtype: MappedDevice """ if self.integrity_device: return MappedDevice( device=self.integrity_device, device_provider=self ) return None def create_dm_integrity(self, options: List[str] = []) -> None: """ Create dm_integrity device. :param list options: further integritysetup format options """ storage_device = self.storage_provider.get_device() log.info(f'Creating dm_integrity on {storage_device}') Command.run( ['integritysetup', '-v', '--batch-mode', 'format'] + self.integrity_format_options + options + [storage_device] ) Command.run( ['integritysetup', '-v', '--batch-mode', 'open'] + self.integrity_open_options + options + [storage_device, self.integrity_name] ) self.integrity_device = '/dev/mapper/' + self.integrity_name def create_integrity_metadata(self) -> None: """ Create a metadata block containing information for dm_integrity device map in the following format: |header_string|0xFF|dm_integrity_meta|0xFF|0x0| header_string: '{version} {fstype} {ro|rw} integrity' dm_integrity_meta: '{provided_data_sectors} {sector_size} {parameter_count} {parameters}' The information for dm_integrity_meta is taken from the dm_integrity superblock. From the flags field of the superblock a list of space separated parameters is created. The first element of the parameter list contains information about the used hash algorithm and secret, which are not part of the superblock and provided according to the parameters passed along with the integritysetup call. The number of parameters in the resulting parameter list is provided as value in parameter_count and prepended to the actual list of parameters. Please note, writing of the metadata block can destroy the filesystem on the device_node if it was not created with a smaller size than the device_node ! """ metadata_format_version = defaults.DM_METADATA_FORMAT_VERSION # set by create_dm_integrity() assert self.integrity_device is not None filesystem = BlockID(self.integrity_device).get_filesystem() integrity_superblock = self._get_integrity_superblock() if filesystem and integrity_superblock: filesystem_mode = 'ro' if filesystem == 'squashfs' else 'rw' header_string = '{0} {1} {2} integrity'.format( metadata_format_version, filesystem, filesystem_mode ) if ( self.credentials and self.credentials.keyfile and self.integrity_algorithm == defaults.INTEGRITY_KEY_ALGORITHM ): # The internal_hash setup in case of a keyfile is currently # only done for the key based algorithm configured in the # kiwi defaults space. Thus the following split is safe as # we know the name. keyformat, algorithm = self.integrity_algorithm.split('-', 2) keytype = f'{keyformat}({algorithm})' keyfile_reference = ( self.credentials.keydescription or ':{0}'.format( os.path.basename(self.credentials.keyfile).replace( '.bin', '' ) ) ) parameters = [f'internal_hash:{keytype}:{keyfile_reference}'] else: parameters = [f'internal_hash:{self.integrity_algorithm}'] parameters += list(integrity_superblock['flags']) dm_integrity_meta = '{0} {1} {2} {3}'.format( integrity_superblock['provided_data_sectors'], integrity_superblock['sector_size'], len(parameters), ' '.join(parameters), ) self.integrity_metadata_file = Temporary().new_file() with open(self.integrity_metadata_file.name, 'wb') as meta: meta.write(header_string.encode("ascii")) meta.write(b'\xff') meta.write(dm_integrity_meta.encode("ascii")) meta.write(b'\xff') meta.write(b'\0') def sign_integrity_metadata(self) -> None: """ Create an openssl based signature from the metadata block and attach it at the end of the block. """ if self.integrity_metadata_file: Signature(self.integrity_metadata_file.name).sign() def write_integrity_metadata(self) -> None: """ Write metadata block beginning at getsize64() - defaults.DM_METADATA_OFFSET """ if self.integrity_metadata_file: meta_data_size = os.path.getsize(self.integrity_metadata_file.name) if meta_data_size > defaults.DM_METADATA_OFFSET: raise KiwiOffsetError( 'Metadata size of {0}b exceeds {1}b limit'.format( meta_data_size, defaults.DM_METADATA_OFFSET ) ) with open(self.integrity_metadata_file.name, 'rb') as meta: with open(self.storage_provider.get_device(), 'r+b') as target: # seek --defaults.DM_METADATA_OFFSET from the # end to reach the metadata start # Please note, writing of the metadata block can destroy # the filesystem on the device_node if it was not created # with a smaller size than the device_node, you have been # warned. target.seek(-defaults.DM_METADATA_OFFSET, 2) target.write(meta.read()) def create_integritytab(self, filename: str) -> None: """ Create integritytab, setting the UUID and options of the storage device :param string filename: file path name integrity UUID={0} - integrity-algorithm=foo """ storage_device = self.storage_provider.get_device() key_file = '-' if self.credentials and self.credentials.keyfile: key_file = self.credentials.keyfile with open(filename, 'w') as integritytab: block_operation = BlockID(storage_device) integritytab.write( '{0} PARTUUID={1} {2} integrity-algorithm={3}{4}'.format( self.integrity_name, block_operation.get_blkid('PARTUUID'), key_file, self.integrity_algorithm, os.linesep, ) ) def is_loop(self) -> bool: """ Check if storage provider is loop based Return loop status from base storage provider :return: True or False :rtype: bool """ return self.storage_provider.is_loop() def _get_integrity_superblock(self) -> Dict[str, Union[str, List[str]]]: integrity: Dict[str, Union[str, List[str]]] = {} dump_call = Command.run( ['integritysetup', 'dump', self.storage_provider.get_device()] ) for line in dump_call.output.strip().split(os.linesep): if line and not line.startswith('Info for'): entry = line.split(' ') if entry[0] == 'flags': integrity[entry[0]] = entry[1:] else: integrity[entry[0]] = entry[1] return integrity def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: if self.integrity_device: try: Command.run(['integritysetup', 'close', self.integrity_name]) except Exception as issue: log.error( 'Shutdown of integrity map {0}:{1} failed with {2}'.format( self.integrity_name, self.integrity_device, issue ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7499177 kiwi-11.1.8/kiwi/storage/loop_device.py0000644000000000000000000001113415273675667014774 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging import time import pathlib from types import TracebackType from typing import Optional, Type # project from kiwi.command import Command from kiwi.storage.device_provider import DeviceProvider from kiwi.utils.command_capabilities import CommandCapabilities from kiwi.utils.sparse import SparseFile from kiwi.exceptions import ( KiwiLoopSetupError, KiwiCommandNotFound, KiwiCommandError, ) log = logging.getLogger('kiwi') class LoopDevice(DeviceProvider): """ **Create and manage loop device file for block operations** :param string filename: loop file name to create :param int filesize_mbytes: size of the loop file :param int blocksize_bytes: blocksize used in loop driver """ def __init__( self, filename: str, filesize_mbytes: Optional[int] = None, blocksize_bytes: Optional[int] = None, ): self.node_name = '' if not os.path.exists(filename) and not filesize_mbytes: raise KiwiLoopSetupError('Can not create loop file without a size') self.filename = filename self.filesize_mbytes = filesize_mbytes self.blocksize_bytes = blocksize_bytes def __enter__(self) -> "LoopDevice": return self def get_device(self) -> str: """ Device node name :return: device node name :rtype: str """ return self.node_name def is_loop(self) -> bool: """ Always True :return: True :rtype: bool """ return True def create(self, overwrite: bool = True) -> None: """ Setup a loop device of the blocksize given in the constructor The file to loop is created with the size specified in the constructor unless an existing one should not be overwritten :param bool overwrite: overwrite existing file to loop """ if overwrite: qemu_img_size = format(self.filesize_mbytes) + 'M' SparseFile.create(self.filename, qemu_img_size) loop_options = [] if self.blocksize_bytes and self.blocksize_bytes != 512: if CommandCapabilities.has_option_in_help( 'losetup', '--sector-size', raise_on_error=False ): loop_options.append('--sector-size') else: loop_options.append('--logical-blocksize') loop_options.append(format(self.blocksize_bytes)) loop_call = Command.run( ['losetup'] + loop_options + ['-f', '--show', self.filename] ) self.node_name = loop_call.output.rstrip(os.linesep) def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: if self.node_name: try: Command.run(['losetup', '-d', self.node_name]) # loop detach is an async operation, re-use of the device # should not be done before the block device has been released loop_released = False sys_block_loop = pathlib.Path( '/sys/devices/virtual/block/{0}/loop'.format( os.path.basename(self.node_name) ) ) for busy in range(0, 100): if not sys_block_loop.is_block_device(): loop_released = True break time.sleep(0.1) if not loop_released: raise KiwiCommandError( f'Loop device {self.node_name} still attached' ) except (KiwiCommandError, KiwiCommandNotFound) as issue: log.error( 'loop cleanup on {0} failed with: {1}'.format( self.node_name, issue ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7499177 kiwi-11.1.8/kiwi/storage/luks_device.py0000644000000000000000000002355715273675667015015 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import uuid import logging import binascii from types import TracebackType from typing import Optional, Type # project from kiwi.runtime_config import RuntimeConfig from kiwi.utils.temporary import Temporary from kiwi.path import Path from kiwi.command import Command from kiwi.defaults import Defaults from kiwi.storage.device_provider import DeviceProvider from kiwi.storage.mapped_device import MappedDevice from kiwi.exceptions import KiwiLuksSetupError log = logging.getLogger('kiwi') class LuksDevice(DeviceProvider): """ **Implements luks setup on a storage device** :param object storage_provider: Instance of class based on DeviceProvider """ def __init__(self, storage_provider: DeviceProvider) -> None: self.runtime_config = RuntimeConfig() self.storage_provider = storage_provider self.luks_device: Optional[str] = None self.luks_keyfile: str = '' self.passphrase: str = '' # The device mapper name must be unique per build. Device mapper # names are global to the host kernel and are not namespaced by # the build chroot, so a fixed name makes concurrent builds on # one host fail with 'Device luksRoot already exists.' self.luks_name = 'luksRoot_{0}'.format(uuid.uuid4().hex) self.option_map = { 'sle12': [ '--cipher', 'aes-xts-plain64', '--key-size', '256', '--hash', 'sha1', ] } def __enter__(self) -> "LuksDevice": return self def get_device(self) -> Optional[MappedDevice]: """ Instance of MappedDevice providing the luks device :return: mapped luks device :rtype: MappedDevice """ if self.luks_device: return MappedDevice(device=self.luks_device, device_provider=self) return None def create_crypto_luks( self, passphrase: str, osname: Optional[str] = None, options: Optional[list] = None, keyfile: str = '', randomize: bool = True, root_dir: str = '', ) -> None: """ Create luks device. Please note the passphrase is readable at creation time of this image. Make sure your host system is secure while this process runs :param string passphrase: credentials :param string osname: distribution name to match distribution specific options for cryptsetup :param list options: further cryptsetup options :param string keyfile: file path name file path name which contains an alternative key to unlock the luks device :param string root_dir: root dir path """ keyslot = '0' self.passphrase = passphrase if not options: options = [] if osname: if osname in self.option_map: options += self.option_map[osname] else: raise KiwiLuksSetupError( f'no custom option configuration found for OS {osname}' ) extra_options = [] storage_device = self.storage_provider.get_device() log.info('Creating crypto LUKS on %s', storage_device) if not passphrase: log.warning('Using an empty passphrase for the key setup') if keyfile: self.luks_keyfile = keyfile keyfile_path = os.path.normpath( os.sep.join([root_dir, self.luks_keyfile]) ) random_passphrase = LuksDevice.create_random_keyfile(keyfile_path) if randomize: log.info('--> Randomizing...') storage_size_mbytes = ( self.storage_provider.get_byte_size(storage_device) / 1048576 ) Command.run( [ 'dd', 'if=/dev/urandom', 'bs=1M', 'count=%d' % storage_size_mbytes, f'of={storage_device}', ] ) log.info('--> Creating LUKS map') if passphrase and passphrase == 'random': # In random mode use the generated keyfile as the only # key to decrypt. This is only secure if the generated # initrd also gets protected, e.g through encryption # like it is done with the secure linux execution on # zSystems self.passphrase = random_passphrase passphrase_file = keyfile_path # Do not add an additional keyfile keyfile = '' elif passphrase: # Setup a passphrase file for which the system will # ask for in an interactive dialog passphrase_file_tmp = Temporary().new_file() with open(passphrase_file_tmp.name, 'w') as credentials: credentials.write(passphrase) passphrase_file = passphrase_file_tmp.name else: # Setup an empty passphrase, insecure and only useful # for initial deployment which then applies a process # to secure the image e.g reencrypt passphrase_file_zero = '/dev/zero' extra_options = ['--keyfile-size', '32'] passphrase_file = passphrase_file_zero Command.run( ['cryptsetup', '-q', '--key-file', passphrase_file] + options + extra_options + ['luksFormat', storage_device] ) if keyfile: Command.run( ['cryptsetup', '--key-file', passphrase_file] + extra_options + ['luksAddKey', storage_device, keyfile_path] ) # Create backup header checksum as reencryption reference master_checksum = f'{root_dir}/root/.luks.header' Path.wipe(master_checksum) Command.run( ['cryptsetup', '--key-file', passphrase_file] + extra_options + [ 'luksHeaderBackup', storage_device, '--header-backup-file', master_checksum, ] ) shasum = self.runtime_config.get_checksum_handler( source_filename=master_checksum ) # The digest is calculated lazily and reads the header backup # file at call time. It must therefore be created before the # same file gets opened for writing, as that truncates the # header backup and the digest would be taken over no data checksum = shasum.digest() with open(master_checksum, 'w') as sha_file: sha_file.write(checksum) # Create key slot number as reencryption reference master_slot = f'{root_dir}/root/.luks.slot' with open(master_slot, 'w') as slot: slot.write(keyslot) # Create slot passphrase as reencryption reference master_slotpass = f'{root_dir}/root/.slotpass' with open(master_slotpass, 'w') as slotpass: slotpass.write(self.passphrase) # open the pool Command.run( ['cryptsetup', '--key-file', passphrase_file] + extra_options + ['luksOpen', storage_device, self.luks_name] ) self.luks_device = '/dev/mapper/' + self.luks_name def create_crypttab(self, filename: str) -> None: """ Create crypttab, setting the UUID of the storage device :param string filename: file path name """ storage_device = self.storage_provider.get_device() with open(filename, 'w') as crypttab: luks_uuid = self.storage_provider.get_uuid(storage_device) if self.luks_keyfile: crypttab.write( 'luks UUID={0} /{1}{2}'.format( luks_uuid, self.luks_keyfile.lstrip(os.sep), os.linesep ) ) else: crypttab.write('luks UUID={0}{1}'.format(luks_uuid, os.linesep)) def is_loop(self) -> bool: """ Check if storage provider is loop based Return loop status from base storage provider :return: True or False :rtype: bool """ return self.storage_provider.is_loop() @staticmethod def create_random_keyfile(filename: str) -> str: """ Create keyfile with random data :param string filename: file path name """ random_data = binascii.hexlify( os.urandom(Defaults.get_luks_key_length()) ).decode() with open(filename, 'w') as keyfile: keyfile.write(random_data) os.chmod(filename, 0o600) return random_data def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: if self.luks_device: try: Command.run(['cryptsetup', 'luksClose', self.luks_name]) except Exception as issue: log.error( 'Shutdown of luks map {0}:{1} failed with: {2}'.format( self.luks_name, self.luks_device, issue ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7499177 kiwi-11.1.8/kiwi/storage/mapped_device.py0000644000000000000000000000331715273675667015275 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os # project from kiwi.storage.device_provider import DeviceProvider from kiwi.exceptions import KiwiMappedDeviceError class MappedDevice(DeviceProvider): """ **Hold a reference on a single device** :param object device_provider: Instance of class based on DeviceProvider :param string device: Device node name """ def __init__(self, device: str, device_provider: DeviceProvider): if not os.path.exists(device): raise KiwiMappedDeviceError(f'Device {device} does not exist') self.device_provider = device_provider self.device = device def get_device(self) -> str: """ Mapped device node name :return: device node name :rtype: str """ return self.device def is_loop(self) -> bool: """ Check if storage provider is loop based Return loop status from base storage provider :return: True or False :rtype: bool """ return self.device_provider.is_loop() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7499177 kiwi-11.1.8/kiwi/storage/raid_device.py0000644000000000000000000001063415273675667014746 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from types import TracebackType from typing import Optional, Type # project from kiwi.command import Command from kiwi.storage.device_provider import DeviceProvider from kiwi.storage.mapped_device import MappedDevice from kiwi.exceptions import KiwiRaidSetupError log = logging.getLogger('kiwi') class RaidDevice(DeviceProvider): """ **Implement raid setup on a storage device** :param object storage_provider: Instance of class based on DeviceProvider """ def __init__(self, storage_provider: DeviceProvider): #: the underlaying device provider self.storage_provider = storage_provider self.raid_level_map = {'mirroring': '1', 'striping': '0'} self.raid_device: Optional[str] = None def __enter__(self) -> "RaidDevice": return self def get_device(self) -> Optional[MappedDevice]: """ Instance of MappedDevice providing the raid device :return: mapped raid device :rtype: MappedDevice """ if self.raid_device: return MappedDevice(device=self.raid_device, device_provider=self) return None def create_degraded_raid(self, raid_level: str) -> None: """ Create a raid array in degraded mode with one device missing. This only works in the raid levels 0(striping) and 1(mirroring) :param string raid_level: raid level name """ if raid_level not in self.raid_level_map: raise KiwiRaidSetupError( 'Only raid levels 0(striping) and 1(mirroring) are supported' ) raid_device = None for raid_id in range(9): raid_device = '/dev/md' + format(raid_id) if os.path.exists(raid_device): raid_device = None else: break if not raid_device: raise KiwiRaidSetupError( 'Could not find free raid device in range md0-8' ) log.info( 'Creating raid array in %s mode as %s', raid_level, raid_device ) Command.run( [ 'mdadm', '--create', '--run', raid_device, '--level', self.raid_level_map[raid_level], '--raid-disks', '2', self.storage_provider.get_device(), 'missing', ] ) self.raid_device = raid_device def create_raid_config(self, filename: str) -> None: """ Create mdadm config file from mdadm request :param string filename: config file name """ if not self.raid_device: raise KiwiRaidSetupError( "No raid device defined, cannot create raid config!" ) mdadm_call = Command.run(['mdadm', '-Db', self.raid_device]) with open(filename, 'w') as mdadmconf: mdadmconf.write(mdadm_call.output) def is_loop(self) -> bool: """ Check if storage provider is loop based Return loop status from base storage provider :return: True or False :rtype: bool """ return self.storage_provider.is_loop() def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: if self.raid_device: try: Command.run(['mdadm', '--stop', self.raid_device]) except Exception as issue: log.error( 'Shutdown of raid device {0} failed with: {1}'.format( self.raid_device, issue ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7499177 kiwi-11.1.8/kiwi/storage/setup.py0000644000000000000000000004436115273675667013654 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from collections import namedtuple from textwrap import dedent from typing import Any, Optional # project from kiwi.firmware import FirmWare from kiwi.system.size import SystemSize from kiwi.defaults import Defaults from kiwi.xml_state import XMLState from kiwi.exceptions import KiwiVolumeTooSmallError, KiwiPartitionTooSmallError log = logging.getLogger('kiwi') class DiskSetup: """ **Implements disk setup methods** Methods from this class provides information required before building a disk image :param object xml_state: Instance of XMLState :param string root_dir: root directory path name """ def __init__(self, xml_state: XMLState, root_dir: str): self.root_filesystem_is_overlay = xml_state.build_type.get_overlayroot() self.swap_mbytes = xml_state.get_oemconfig_swap_mbytes() self.configured_size = xml_state.get_build_type_size() self.disk_resize_requested = xml_state.get_oemconfig_oem_resize() self.filesystem = xml_state.build_type.get_filesystem() self.bootpart_requested = xml_state.build_type.get_bootpartition() self.bootpart_mbytes = xml_state.build_type.get_bootpartsize() self.spare_part_mbytes = xml_state.get_build_type_spare_part_size() self.mdraid = xml_state.build_type.get_mdraid() self.luks = xml_state.get_luks_credentials() self.volume_manager = xml_state.get_volume_management() self.bootloader = xml_state.get_build_type_bootloader_name() self.oemconfig = xml_state.get_build_type_oemconfig_section() self.volumes = xml_state.get_volumes() self.custom_partitions = xml_state.get_partitions() self.firmware = FirmWare(xml_state) self.rootsize = SystemSize(root_dir) self.root_dir = root_dir self.xml_state = xml_state def get_disksize_mbytes( self, root_clone: int = 0, boot_clone: int = 0 ) -> int: """ Precalculate disk size requirements in mbytes :param int root_clone: root partition gets cloned, N+1 times the size is needed :param int boot_clone: boot partition gets cloned, N+1 times the size is needed :return: disk size mbytes :rtype: int """ log.info('Precalculating required disk size') calculated_disk_mbytes = 0 root_filesystem_mbytes = self.rootsize.customize( self.rootsize.accumulate_mbyte_file_sizes(), self.filesystem ) if root_clone: root_clone += 1 log.info( '--> root partition is clone: {0}*{1} MB'.format( root_clone, root_filesystem_mbytes ) ) root_filesystem_mbytes *= root_clone calculated_disk_mbytes += root_filesystem_mbytes log.info( '--> system data with filesystem overhead needs %s MB', root_filesystem_mbytes, ) if self.custom_partitions: partition_mbytes = self._accumulate_partitions_size() if partition_mbytes: calculated_disk_mbytes += partition_mbytes log.info( '--> partition(s) size setup adding %s MB', partition_mbytes ) if self.volume_manager and self.volume_manager == 'lvm': lvm_overhead_mbytes = Defaults.get_lvm_overhead_mbytes() log.info('--> LVM overhead adding %s MB', lvm_overhead_mbytes) calculated_disk_mbytes += lvm_overhead_mbytes volume_mbytes = self._accumulate_volume_size(root_filesystem_mbytes) if volume_mbytes: calculated_disk_mbytes += volume_mbytes log.info('--> volume(s) size setup adding %s MB', volume_mbytes) elif self.swap_mbytes: calculated_disk_mbytes += self.swap_mbytes log.info('--> swap partition adding %s MB', self.swap_mbytes) legacy_bios_mbytes = self.firmware.get_legacy_bios_partition_size() if legacy_bios_mbytes: calculated_disk_mbytes += legacy_bios_mbytes log.info( '--> legacy bios boot partition adding %s MB', legacy_bios_mbytes, ) boot_mbytes = self.boot_partition_size() if boot_mbytes: if boot_clone: boot_clone += 1 log.info( '--> boot partition is clone: {0}*{1} MB'.format( boot_clone, boot_mbytes ) ) boot_mbytes *= boot_clone calculated_disk_mbytes += boot_mbytes log.info('--> boot partition adding %s MB', boot_mbytes) if self.spare_part_mbytes: calculated_disk_mbytes += self.spare_part_mbytes log.info('--> spare partition adding %s MB', self.spare_part_mbytes) efi_mbytes = self.firmware.get_efi_partition_size() if efi_mbytes: calculated_disk_mbytes += efi_mbytes log.info('--> EFI partition adding %s MB', efi_mbytes) prep_mbytes = self.firmware.get_prep_partition_size() if prep_mbytes: calculated_disk_mbytes += prep_mbytes log.info('--> PReP partition adding %s MB', prep_mbytes) recovery_mbytes = self._inplace_recovery_partition_size() if recovery_mbytes: calculated_disk_mbytes += recovery_mbytes log.info( '--> In-place recovery partition adding: %s MB', recovery_mbytes ) if not self.configured_size: log.info( 'Using calculated disk size: %d MB', calculated_disk_mbytes ) return calculated_disk_mbytes elif self.configured_size.additive: result_disk_mbytes = ( self.configured_size.mbytes + calculated_disk_mbytes ) log.info( 'Using configured disk size: %d MB + %d MB calculated = %d MB', self.configured_size.mbytes, calculated_disk_mbytes, result_disk_mbytes, ) return result_disk_mbytes else: log.info( 'Using configured disk size: %d MB', self.configured_size.mbytes ) if self.configured_size.mbytes < calculated_disk_mbytes: log.warning( '--> Configured size smaller than calculated size: %d MB', calculated_disk_mbytes, ) return self.configured_size.mbytes def need_boot_partition(self) -> bool: """ Decide if an extra boot partition is needed. This is done with the bootpartition attribute from the type, however if it is not set it depends on some other type configuration parameters if we need a boot partition or not :return: True or False :rtype: bool """ if self.bootpart_requested is True: return True if self.bootpart_requested is False: return False if self.mdraid: return True if self.volume_manager == 'lvm': return True if self.volume_manager == 'btrfs': return False if self.root_filesystem_is_overlay: return True return False @staticmethod def get_boot_label() -> str: """ Filesystem Label to use for the boot partition :return: label name :rtype: str """ return 'BOOT' def get_root_label(self) -> str: """ Filesystem Label to use for the root partition If not specified in the XML configuration the default root label is set to 'ROOT' :return: label name :rtype: str """ root_label = self.xml_state.build_type.get_rootfs_label() if not root_label: root_label = 'ROOT' return root_label @staticmethod def get_efi_label() -> str: """ Filesystem Label to use for the EFI partition :return: label name :rtype: str """ return 'EFI' def boot_partition_size(self) -> int: """ Size of the boot partition in mbytes :return: boot size mbytes :rtype: int """ if self.need_boot_partition(): if self.bootpart_mbytes: return self.bootpart_mbytes return Defaults.get_default_boot_mbytes() return 0 def _inplace_recovery_partition_size(self) -> Optional[int]: """ In inplace recovery mode the recovery archive is created at install time. This requires free space on the disk. The amount of free space is specified with the oem-recovery-part-size attribute. If specified we add the given size to the disk. If not specified an inplace setup at install time will be moved to the first boot of an oem image when the recovery partition has been created """ if self.oemconfig and self.oemconfig.get_oem_inplace_recovery(): recovery_mbytes = self.oemconfig.get_oem_recovery_part_size() if recovery_mbytes: return int(recovery_mbytes[0] * 1.7) return None def _accumulate_partitions_size(self) -> int: """ Calculate number of mbytes to add to the disk to allow the creaton of the partitions with their configured size """ disk_partition_mbytes = 0 data_partition_mbytes = self._calculate_partition_mbytes() for map_name in sorted(self.custom_partitions.keys()): partition_mount_path = self.custom_partitions[map_name].mountpoint partition_filesystem = self.custom_partitions[map_name].filesystem partition_clone = self.custom_partitions[map_name].clone if partition_mount_path: partition_mbsize = self.custom_partitions[map_name].mbsize if partition_filesystem == 'squashfs': # cannot predict compressed size prior compressing # use size as configured disk_add_mbytes = int(partition_mbsize) else: disk_add_mbytes = ( int(partition_mbsize) - data_partition_mbytes.partition[partition_mount_path] ) if disk_add_mbytes > 0: if partition_clone: partition_clone += 1 log.info( '--> {0} partition is clone: {1}*{2} MB'.format( map_name, partition_clone, disk_add_mbytes ) ) disk_add_mbytes *= partition_clone disk_partition_mbytes += disk_add_mbytes else: message = dedent( '''\n Requested partition size {0}MB for {1!r} is too small The minimum byte value to store the data below the {1!r} path was calculated to be {2}MB ''' ) raise KiwiPartitionTooSmallError( message.format( partition_mbsize, partition_mount_path, data_partition_mbytes.partition[ partition_mount_path ], ) ) return disk_partition_mbytes def _accumulate_volume_size(self, root_mbytes: int) -> int: """ Calculate number of mbytes to add to the disk to allow the creaton of the volumes with their configured size """ disk_volume_mbytes = 0 data_volume_mbytes = self._calculate_volume_mbytes() root_volume = self._get_root_volume_configuration() # If disk resize is requested we only add the default min # volume size because their target size request is handled # on first boot of the disk image in oemboot/repart if self.disk_resize_requested: for volume in self.volumes: disk_volume_mbytes += Defaults.get_min_volume_mbytes( self.filesystem ) return disk_volume_mbytes # For static disk(no resize requested) we need to add the # configured volume sizes because the image is used directly # as it is without being deployed and resized on a target disk for volume in self.volumes: if volume.realpath and not volume.realpath == '/' and volume.size: [size_type, req_size] = volume.size.split(':') disk_add_mbytes = 0 if size_type == 'freespace': disk_add_mbytes += int(req_size) else: disk_add_mbytes += ( int(req_size) - data_volume_mbytes.volume[volume.realpath] ) if disk_add_mbytes > 0: disk_volume_mbytes += ( disk_add_mbytes + Defaults.get_min_volume_mbytes(self.filesystem) ) else: message = dedent( '''\n Requested volume size {0}MB for {1!r} is too small The minimum byte value to store the data below the {1!r} path was calculated to be {2}MB ''' ) raise KiwiVolumeTooSmallError( message.format( req_size, volume.realpath, data_volume_mbytes.volume[volume.realpath], ) ) if root_volume: if root_volume.size_type == 'freespace': disk_add_mbytes = root_volume.req_size else: disk_add_mbytes = ( root_volume.req_size - root_mbytes + data_volume_mbytes.total ) if disk_add_mbytes > 0: disk_volume_mbytes += ( disk_add_mbytes + Defaults.get_min_volume_mbytes(self.filesystem) ) else: log.warning( 'root volume size of %s MB is too small, skipped', root_volume.req_size, ) return disk_volume_mbytes def _get_root_volume_configuration(self) -> Optional[Any]: """ Provide root volume configuration if present and in use according to the selected volume management. So far this only affects the LVM volume manager """ root_volume_type = namedtuple( 'root_volume_type', ['size_type', 'req_size'] ) for volume in self.volumes: if volume.is_root_volume: if volume.size: [size_type, req_size] = volume.size.split(':') return root_volume_type( size_type=size_type, req_size=int(req_size) ) return None def _calculate_volume_mbytes(self) -> Any: """ Calculate the number of mbytes each volume path currently consumes and also provide a total number of these values. """ volume_mbytes_type = namedtuple( 'volume_mbytes_type', ['volume', 'total'] ) volume_mbytes = {} volume_total = 0 for volume in self.volumes: if volume.realpath and not volume.realpath == '/': path_to_volume = self.root_dir + '/' + volume.realpath if os.path.exists(path_to_volume): volume_size = SystemSize(path_to_volume) volume_mbytes[volume.realpath] = volume_size.customize( volume_size.accumulate_mbyte_file_sizes(), self.filesystem, ) else: volume_mbytes[volume.realpath] = 0 volume_total += volume_mbytes[volume.realpath] return volume_mbytes_type(volume=volume_mbytes, total=volume_total) def _calculate_partition_mbytes(self) -> Any: """ Calculate the number of mbytes each partition path consumes """ partition_mbytes_type = namedtuple( 'partition_mbytes_type', ['partition'] ) partition_mbytes = {} for map_name in sorted(self.custom_partitions.keys()): partition_mount_path = self.custom_partitions[map_name].mountpoint if partition_mount_path: partition_filesystem = self.custom_partitions[ map_name ].filesystem path_to_partition = os.path.normpath( os.sep.join([self.root_dir, partition_mount_path]) ) if os.path.exists(path_to_partition): partition_size = SystemSize(path_to_partition) partition_mbytes[partition_mount_path] = ( partition_size.customize( partition_size.accumulate_mbyte_file_sizes(), partition_filesystem, ) ) else: partition_mbytes[partition_mount_path] = 0 return partition_mbytes_type(partition=partition_mbytes) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7499177 kiwi-11.1.8/kiwi/storage/subformat/__init__.py0000644000000000000000000001051115273675667016243 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from typing import Dict, Optional, Tuple # project from kiwi.storage.subformat.base import DiskFormatBase from kiwi.xml_state import XMLState from kiwi.exceptions import KiwiDiskFormatSetupError class DiskFormat: """ **DiskFormat factory** :param string name: Format name :param object xml_state: Instance of XMLState :param string root_dir: root directory path name :param string target_dir: target directory path name """ @staticmethod def new( name: str, xml_state: XMLState, root_dir: str, target_dir: str ) -> DiskFormatBase: name_map = { 'oci': 'Oci', 'qcow2': 'Qcow2', 'vdi': 'Vdi', 'vhd': 'Vhd', 'vhdx': 'Vhdx', 'vhdfixed': 'VhdFixed', 'gce': 'Gce', 'vmdk': 'Vmdk', 'ova': 'Ova', 'vagrant_libvirt': 'VagrantLibVirt', 'vagrant_virtualbox': 'VagrantVirtualBox', 'base': 'Base', } module_namespace: Optional[str] = None try: custom_args, module_namespace = DiskFormat._custom_args_for_format( name, xml_state ) diskformat = importlib.import_module( f'kiwi.storage.subformat.{module_namespace}' ) module_name = f'DiskFormat{name_map[module_namespace]}' return diskformat.__dict__[module_name]( xml_state, root_dir, target_dir, custom_args ) except Exception as issue: raise KiwiDiskFormatSetupError( f'No support for {module_namespace} disk format: {issue}' ) @staticmethod def _custom_args_for_format( name: str, xml_state: XMLState ) -> Tuple[Dict, str]: custom_args = xml_state.get_build_type_format_options() module_namespace = name if name == 'vhd-fixed': disk_tag = xml_state.build_type.get_vhdfixedtag() if disk_tag: custom_args.update({'--tag': disk_tag}) module_namespace = 'vhdfixed' elif name == 'gce': gce_license_tag = xml_state.build_type.get_gcelicense() if gce_license_tag: custom_args.update({'--tag': gce_license_tag}) elif name == 'vmdk' or name == 'ova': vmdisk_section = xml_state.get_build_type_vmdisk_section() if vmdisk_section: disk_mode = vmdisk_section.get_diskmode() disk_controller = vmdisk_section.get_controller() if disk_mode: custom_args.update( {'subformat={0}'.format(disk_mode): None} ) if disk_controller: custom_args.update( {'adapter_type={0}'.format(disk_controller): None} ) elif name == 'vagrant': vagrant_config = xml_state.get_build_type_vagrant_config_section() if vagrant_config: custom_args.update({'vagrantconfig': vagrant_config}) module_namespace = '{0}_{1}'.format( name, vagrant_config.get_provider() ) elif name == 'raw': module_namespace = 'base' elif name.startswith('oci:') or name.startswith('docker:'): container_format, base_format = name.split(':', 1) module_namespace = 'oci' custom_args.update( { 'base_format': base_format, 'container_format': container_format, } ) return custom_args, module_namespace ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7504408 kiwi-11.1.8/kiwi/storage/subformat/base.py0000644000000000000000000001552015273675667015423 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from collections import OrderedDict from types import TracebackType from typing import Optional, Type # project from kiwi.command import Command from kiwi.runtime_config import RuntimeConfig from kiwi.defaults import Defaults from kiwi.path import Path from kiwi.xml_state import XMLState from kiwi.system.result import Result from kiwi.exceptions import KiwiFormatSetupError, KiwiResizeRawDiskError log = logging.getLogger('kiwi') class DiskFormatBase: """ **Base class to create disk formats from a raw disk image** :param object xml_state: Instance of XMLState :param string root_dir: root directory path name :param string arch: Defaults.get_platform_name :param string target_dir: target directory path name :param dict custom_args: custom format options dictionary """ def __init__( self, xml_state: XMLState, root_dir: str, target_dir: str, custom_args: Optional[dict] = None, ): self.xml_state = xml_state self.root_dir = root_dir self.arch = Defaults.get_platform_name() self.target_dir = target_dir self.temp_image_dir: str = '' self.image_format: str = '' self.diskname = self.get_target_file_path_for_format('raw') self.runtime_config = RuntimeConfig() self.post_init(custom_args or {}) def __enter__(self) -> "DiskFormatBase": return self def post_init(self, custom_args: dict) -> None: """ Post initialization method Implementation in specialized disk format class if required :param dict custom_args: unused """ pass def has_raw_disk(self) -> bool: """ Check if the base raw disk image exists :return: True or False :rtype: bool """ return os.path.exists(self.diskname) def resize_raw_disk(self, size_bytes: int, append: bool = False) -> bool: """ Resize raw disk image to specified size. If the request would actually shrink the disk an exception is raised. If the disk got changed the method returns True, if the new size is the same as the current size nothing gets resized and the method returns False :param int size: size in bytes :return: True or False :rtype: bool """ if not append: current_byte_size = os.path.getsize(self.diskname) size_bytes = int(size_bytes) if size_bytes < current_byte_size: raise KiwiResizeRawDiskError( 'shrinking {0} disk to {1} bytes corrupts the image'.format( self.diskname, size_bytes ) ) elif size_bytes == current_byte_size: return False Command.run( [ 'qemu-img', 'resize', self.diskname, '+{0}'.format(size_bytes) if append else format(size_bytes), ] ) return True def create_image_format(self) -> None: """ Create disk format Implementation in specialized disk format class required """ raise NotImplementedError @staticmethod def get_qemu_option_list(custom_args: dict) -> list: """ Create list of qemu options from custom_args dict :param dict custom_args: arguments :return: qemu option list :rtype: list """ options = [] if custom_args: ordered_args = OrderedDict(sorted(custom_args.items())) for key, value in list(ordered_args.items()): if ( key == 'adapter_type=pvscsi' or key == 'adapter_type=paravirtual' ): # Building for the pvscsi/paravirtual ddb.adapterType only # affects the guest configuration (vmx). For the # vmdk disk format this is the same as lsilogic key = 'adapter_type=lsilogic' options.append('-o') if value: options.append('{0}={1}'.format(key, value)) else: options.append(key) return options def get_target_file_path_for_format(self, format_name: str) -> str: """ Create target file path name for specified format :param string format_name: disk format name :return: file path name :rtype: str """ if format_name != 'raw': if format_name not in Defaults.get_disk_format_types(): raise KiwiFormatSetupError( f'unsupported disk format {format_name}' ) return ''.join( [ self.target_dir, '/', self.xml_state.xml_data.get_name(), '.' + self.arch, '-' + self.xml_state.get_image_version(), '.' + format_name, ] ) def store_to_result(self, result: Result) -> None: """ Store result file of the format conversion into the provided result instance. By default only the converted image file will be stored as compressed file. Subformats which creates additional metadata files or want to use other result flags needs to overwrite this method :param object result: Instance of Result """ compression = self.runtime_config.get_bundle_compression(default=True) if self.xml_state.get_luks_credentials() is not None: compression = False result.add( key='disk_format_image', filename=self.get_target_file_path_for_format(self.image_format), use_for_bundle=True, compress=compression, shasum=True, ) def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: if self.temp_image_dir and os.path.exists(self.temp_image_dir): Path.wipe(self.temp_image_dir) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7504408 kiwi-11.1.8/kiwi/storage/subformat/gce.py0000644000000000000000000001050515273675667015245 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from collections import OrderedDict # project from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.storage.subformat.base import DiskFormatBase from kiwi.archive.tar import ArchiveTar from kiwi.system.result import Result class DiskFormatGce(DiskFormatBase): """ **Create GCE - Google Compute Engine image format** """ def post_init(self, custom_args: dict) -> None: """ GCE disk format post initialization method Store disk tag from custom args :param dict custom_args: custom gce argument dictionary .. code:: python {'--tag': 'billing_code'} """ self.image_format = 'gce' self.tag = None if custom_args: ordered_args = OrderedDict(list(custom_args.items())) for key, value in list(ordered_args.items()): if key == '--tag': self.tag = value def create_image_format(self) -> None: """ Create GCE disk format and manifest """ gce_tar_ball_file_list = [] temp_image_dir = Temporary( prefix='kiwi_gce_subformat.', path=self.target_dir ).new_dir() diskname = ''.join( [ self.target_dir, '/', self.xml_state.xml_data.get_name(), '.' + self.arch, '-' + self.xml_state.get_image_version(), '.raw', ] ) if self.tag: with open(temp_image_dir.name + '/manifest.json', 'w') as manifest: manifest.write('{"licenses": ["%s"]}' % self.tag) gce_tar_ball_file_list.append('manifest.json') Command.run(['cp', diskname, temp_image_dir.name + '/disk.raw']) gce_tar_ball_file_list.append('disk.raw') archive_name = os.path.basename( self.get_target_file_path_for_format(self.image_format) ) # delete the '.gz' suffix from the name. The suffix is appended by # the archive creation method depending on the creation type. archive_name = archive_name.replace('.gz', '') archive = ArchiveTar( filename=self.target_dir + '/' + archive_name, file_list=gce_tar_ball_file_list, ) archive.create_gnu_gzip_compressed(temp_image_dir.name) def store_to_result(self, result: Result) -> None: """ Store result file of the gce format conversion into the provided result instance. In this case compression is unwanted because the gce tarball is already created as a compressed archive :param object result: Instance of Result """ result.add( key='disk_format_image', filename=self.get_target_file_path_for_format(self.image_format), use_for_bundle=True, compress=False, shasum=True, ) def get_target_file_path_for_format(self, format_name: str) -> str: """ Google requires the image name to follow their naming convetion. Therefore it's required to provide a suitable name by overriding the base class method :param string format_name: gce :return: file path name :rtype: str """ if format_name == 'gce': format_name = 'tar.gz' return ''.join( [ self.target_dir, '/', self.xml_state.xml_data.get_name(), '.' + self.arch, '-' + self.xml_state.get_image_version(), '.' + format_name, ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7504408 kiwi-11.1.8/kiwi/storage/subformat/oci.py0000644000000000000000000001434515273675667015267 0ustar00# Copyright (c) 2026 Marcus Schäfer. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from pathlib import Path # project from kiwi.storage.subformat.base import DiskFormatBase from kiwi.utils.temporary import Temporary from kiwi.system.root_init import RootInit from kiwi.system.root_import import RootImport from kiwi.system.result import Result from kiwi.command import Command from kiwi.storage.subformat import DiskFormat from kiwi.defaults import Defaults from kiwi.runtime_config import RuntimeConfig from kiwi.exceptions import KiwiContainerBuilderError from kiwi.utils.checksum import Checksum from kiwi.container import ContainerImage class DiskFormatOci(DiskFormatBase): """ **Create OCI container which includes the disk image** """ def post_init(self, custom_args: dict) -> None: """ oci disk format post initialization method :param dict custom_args: unused """ self.runtime_config = RuntimeConfig() self.ensure_empty_tmpdirs = True self.image_format: str = 'oci' self.container_config = self.xml_state.get_container_config() self.bundle_format = self.xml_state.get_build_type_bundle_format() self.base_container_uris = self.xml_state.get_derived_from_image_uri() self.base_format = custom_args.get('base_format', 'raw') self.requested_container_type = custom_args.get( 'container_format', 'docker' ) self.special_needs = ['appx', 'wsl'] self.filename = ''.join( [ self.target_dir, '/', self.xml_state.xml_data.get_name(), '.' + Defaults.get_platform_name(), '-' + self.xml_state.get_image_version(), '.', self.requested_container_type, ( '.tar' if self.requested_container_type not in self.special_needs else '' ), ] ) def create_image_format(self) -> None: """ Create oci container and store disk to it """ base_image = None container_rootdir = Temporary(prefix='kiwi_container_root.').new_dir() container_root = container_rootdir.name if self.base_container_uris: root = RootInit(container_root, allow_existing=True) root.create() root_import = RootImport.new( container_root, self.base_container_uris, self.requested_container_type, ) root_import.sync_data() base_image = Defaults.get_imported_root_image(container_root) # Create disk format and copy this format or the raw # disk to the imported container root dir. disk_target = os.sep.join([container_root, 'disk']) Path(disk_target).mkdir(parents=True, exist_ok=True) if self.bundle_format: result = Result(self.xml_state) result.add_bundle_format( self.xml_state.get_build_type_bundle_format() ) if result.get_name_for_pattern(): disk_target = '{}/{}.{}'.format( disk_target, result.get_name_for_pattern(), self.base_format ) if self.base_format != 'raw': with DiskFormat.new( self.base_format, self.xml_state, self.root_dir, self.target_dir ) as disk_format: disk_format.create_image_format() disk_format_file = disk_format.get_target_file_path_for_format( self.base_format ) disk_raw_file_stat = os.stat(self.diskname) os.chown( disk_format_file, disk_raw_file_stat.st_uid, disk_raw_file_stat.st_gid, ) Command.run(['cp', '-a', disk_format_file, disk_target]) else: Command.run(['cp', '-a', self.diskname, disk_target]) # build the container if base_image: shasum = self.runtime_config.get_checksum_handler( source_filename=base_image ) checksum = Checksum(base_image) base_image_sha = ''.join([base_image, shasum.suffix]) if not checksum.matches(shasum.digest(), base_image_sha): raise KiwiContainerBuilderError( f'base image file {base_image} checksum validation failed' ) container_image = ContainerImage.new( self.requested_container_type, container_root, self.container_config ) self.filename = container_image.create( self.filename, base_image or '', self.ensure_empty_tmpdirs, ( self.runtime_config.get_container_compression() # appx containers already contains a compressed root # wsl containers recommends gzip and we default to it if self.requested_container_type not in self.special_needs else False ), ) def store_to_result(self, result: Result) -> None: """ Store result file of the format conversion into the provided result instance. In case of a oci format we store the result uncompressed Since the created container is already compressed :param object result: Instance of Result """ result.add( key='disk_format_image', filename=self.filename, use_for_bundle=True, compress=False, shasum=True, ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7504408 kiwi-11.1.8/kiwi/storage/subformat/ova.py0000644000000000000000000001660015273675667015276 0ustar00# Copyright (c) 2018 Eaton. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import pathlib from textwrap import dedent # project from kiwi.firmware import FirmWare from kiwi.storage.subformat.vmdk import DiskFormatVmdk from kiwi.storage.subformat.base import DiskFormatBase from kiwi.command import Command from kiwi.path import Path from kiwi.system.result import Result from kiwi.storage.subformat.template.ova_compose import OvaComposeTemplate from kiwi.exceptions import ( KiwiFormatSetupError, KiwiCommandNotFound, KiwiTemplateError, ) class DiskFormatOva(DiskFormatBase): """ **Create ova disk format, based on vmdk** """ def post_init(self, custom_args: dict) -> None: """ vmdk disk format post initialization method Store qemu options as list from custom args dict :param dict custom_args: custom qemu arguments dictionary """ ovftype = 'vmware' # default OVA target infrastructure self.machine_setup = self.xml_state.get_build_type_machine_section() if self.machine_setup and self.machine_setup.get_ovftype(): ovftype = self.machine_setup.get_ovftype() if ovftype != 'vmware': raise KiwiFormatSetupError(f'Unsupported ovftype {ovftype}') self.image_format = 'ova' # ensure streamOptimized format is enabled custom_args.update({'subformat=streamOptimized': None}) self.firmware = FirmWare(self.xml_state) self.vmdk = DiskFormatVmdk( self.xml_state, self.root_dir, self.target_dir, custom_args ) def create_image_format(self) -> None: """ Create ova disk format using ova-compose https://github.com/vmware/open-vmdk """ # Check for required mkova tool ova_compose = Path.which(filename='ova-compose', access_mode=os.X_OK) if not ova_compose: tool_not_found_message = dedent( '''\n Required ova-compose not found in PATH on the build host Building OVA images requires the ova-compose tool which is usually provided by the open-vmdk package. ''' ) raise KiwiCommandNotFound(tool_not_found_message) # Create the vmdk disk image and vmx config self.vmdk.create_image_format() compose_meta = self.get_target_file_path_for_format('meta') ova = self.get_target_file_path_for_format('ova') # Create ova composer meta file self._create_ova_compose_meta_file() pathlib.Path(ova).unlink(missing_ok=True) os.chdir(self.target_dir) Command.run( [ ova_compose, '--input-file', compose_meta, '--output-file', ova, '--format', 'ova', ] ) def store_to_result(self, result: Result) -> None: """ Store the resulting ova file into the provided result instance. :param object result: Instance of Result """ result.add( key='disk_format_image', filename=self.get_target_file_path_for_format('ova'), use_for_bundle=True, compress=self.runtime_config.get_bundle_compression(default=False), shasum=True, ) def _create_ova_compose_meta_file(self) -> None: """ Create the ova-compose meta file used to create the final ova file. This method mirrors the logic from DiskFormatVmdk._create_vmware_settings_file() to ensure consistent hardware configuration between VMX and Meta files. """ displayname = self.xml_state.xml_data.get_displayname() efi_mode = self.firmware.efi_mode() template_record = { 'display_name': displayname or self.xml_state.xml_data.get_name(), 'vmdk_file': os.path.basename( self.get_target_file_path_for_format('vmdk') ), 'virtual_hardware_version': '9', 'guest_os': 'suse-64', 'disk_id': '0', 'memory_size': 4096, 'number_of_cpus': 2, 'firmware': 'efi' if efi_mode else 'bios', 'secure_boot': 'true' if efi_mode == 'uefi' else 'false', } # Basic setup - extract memory, guest OS, and CPU configuration machine_setup = self.xml_state.get_build_type_machine_section() memory_setup = None cpu_setup = None if machine_setup: memory_setup = machine_setup.get_memory() hardware_version = machine_setup.get_HWversion() guest_os = machine_setup.get_guestOS() cpu_setup = machine_setup.get_ncpus() if hardware_version: template_record['virtual_hardware_version'] = hardware_version if guest_os: template_record['guest_os'] = guest_os if memory_setup: template_record['memory_size'] = memory_setup if cpu_setup: template_record['number_of_cpus'] = cpu_setup # CD/DVD setup iso_setup = self.xml_state.get_build_type_vmdvd_section() iso_controller = 'ide' iso_id = '0' if iso_setup: iso_controller = iso_setup.get_controller() or iso_controller iso_id = iso_setup.get_id() or iso_id # Disk setup disk_controller = None disk_id = '0' disk_setup = self.xml_state.get_build_type_vmdisk_section() if disk_setup: disk_controller = disk_setup.get_controller() disk_id = disk_setup.get_id() or disk_id # Network setup network_entries = self.xml_state.get_build_type_vmnic_entries() network_setup = {} if network_entries: for network_entry in network_entries: network_setup[network_entry.get_interface() or '0'] = { 'driver': network_entry.get_driver(), 'connection_type': network_entry.get_mode(), 'mac': network_entry.get_mac() or 'generated', } # Build settings template and write settings file settings_template = OvaComposeTemplate().get_template( memory_setup, cpu_setup, network_setup, bool(iso_setup), disk_controller=disk_controller, iso_controller=iso_controller, disk_id=disk_id, iso_id=iso_id, ) try: settings_file = self.get_target_file_path_for_format('meta') with open(settings_file, 'w') as config: config.write(settings_template.substitute(template_record)) except Exception as issue: raise KiwiTemplateError(f'{type(issue).__name__}: {format(issue)}') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7504408 kiwi-11.1.8/kiwi/storage/subformat/qcow2.py0000644000000000000000000000554315273675667015550 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # project from kiwi.utils.temporary import Temporary from kiwi.storage.subformat.base import DiskFormatBase from kiwi.command import Command from kiwi.system.result import Result class DiskFormatQcow2(DiskFormatBase): """ **Create qcow2 disk format** """ def post_init(self, custom_args: dict) -> None: """ qcow2 disk format post initialization method Store qemu options as list from custom args dict :param dict custom_args: custom qemu arguments dictionary """ self.image_format: str = 'qcow2' self.options = self.get_qemu_option_list(custom_args) def create_image_format(self) -> None: """ Create qcow2 disk format """ intermediate = Temporary().new_file() Command.run( [ 'qemu-img', 'convert', '-f', 'raw', self.diskname, '-O', self.image_format, ] + self.options + [intermediate.name] ) Command.run( [ 'qemu-img', 'convert', '-c', '-f', self.image_format, intermediate.name, '-O', self.image_format, self.get_target_file_path_for_format(self.image_format), ] ) def store_to_result(self, result: Result) -> None: """ Store result file of the format conversion into the provided result instance. In case of a qcow2 format we store the result uncompressed Since the format conversion only takes the real bytes into account such that the sparseness of the raw disk will not result in the output format and can be taken one by one :param object result: Instance of Result """ result.add( key='disk_format_image', filename=self.get_target_file_path_for_format(self.image_format), use_for_bundle=True, compress=self.runtime_config.get_bundle_compression(default=False), shasum=True, ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7504408 kiwi-11.1.8/kiwi/storage/subformat/template/__init__.py0000644000000000000000000000000015273675667020046 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/template/ova_compose.py0000644000000000000000000002306115273675667020635 0ustar00# Copyright (c) 2026 SUSE LLC. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from string import Template from textwrap import dedent from typing import Dict, Optional, Set, Tuple from kiwi.exceptions import KiwiTemplateError class OvaComposeTemplate: """ OVA compose settings template """ def __init__(self) -> None: self.cr = '\n' self.header = ( dedent( ''' system: name: "${display_name}" type: vmx-${virtual_hardware_version} os_vmw: "${guest_os}" firmware: "${firmware}" secure_boot: ${secure_boot} ''' ).strip() + self.cr ) self.network = ( dedent( ''' networks: vm_network: name: "VM Network" description: "The VM Network" ''' ).strip() + self.cr ) def _get_controller( self, controller: Optional[str], device_id: str ) -> Tuple[str, str, Optional[str]]: # Maps the kiwi controller name to the ova-compose controller # name prefix, the ova-compose controller type and the subtype. # The SCSI subtype becomes the OVF ResourceSubType and must # be one of the names open-vmdk accepts. Paravirtual SCSI is # called VirtualSCSI in OVF and is the only SCSI subtype # vCenter accepts for many recent guest OS types controller_map: Dict[str, Tuple[str, str, Optional[str]]] = { 'ide': ('ide', 'ide_controller', None), 'sata': ('sata', 'sata_controller', None), 'nvme': ('nvme', 'nvme_controller', None), 'scsi': ('scsi', 'scsi_controller', 'VirtualSCSI'), 'paravirtual': ('scsi', 'scsi_controller', 'VirtualSCSI'), 'pvscsi': ('scsi', 'scsi_controller', 'VirtualSCSI'), 'lsilogic': ('scsi', 'scsi_controller', 'lsilogic'), 'buslogic': ('scsi', 'scsi_controller', 'buslogic'), } normalized_controller = (controller or 'nvme').lower() if normalized_controller not in controller_map: supported = ', '.join(controller_map.keys()) raise KiwiTemplateError( f'Controller "{controller}" is not supported for the ' f'OVA format, use one of: {supported}' ) controller_name, controller_type, controller_subtype = controller_map[ normalized_controller ] return ( f'{controller_name}{device_id}', controller_type, controller_subtype, ) def _add_controller( self, hardware_lines: list, controllers_added: set, controller_name: str, controller_type: str, controller_subtype: Optional[str] = None, ) -> None: if controller_name in controllers_added: return hardware_lines.append(f' {controller_name}:') hardware_lines.append(f' type: {controller_type}') if controller_subtype: hardware_lines.append(f' subtype: {controller_subtype}') controllers_added.add(controller_name) def _get_network_setup( self, network_setup: Optional[dict] = None ) -> Tuple[list, list]: hardware_lines = [] network_lines = ['networks:'] if network_setup: for nic_id, nic_setup in list(network_setup.items()): network_name = f'vm_network_{nic_id}' nic_name = f'ethernet{nic_id}' nic_driver = nic_setup.get('driver') or 'VmxNet3' hardware_lines.extend( [ f' {nic_name}:', ' type: ethernet', f' subtype: {nic_driver}', f' network: {network_name}', ] ) if nic_setup.get('mac') and nic_setup['mac'] != 'generated': hardware_lines.append( f' mac_address: "{nic_setup["mac"]}"' ) if nic_setup.get('connection_type'): hardware_lines.append( f' connection_type: "{nic_setup["connection_type"]}"' ) network_lines.extend( [ f' {network_name}:', f' name: "VM Network {nic_id}"', f' description: "The VM Network {nic_id} network"', ] ) else: hardware_lines.extend( [ ' ethernet0:', ' type: ethernet', ' subtype: VmxNet3', ' network: vm_network_0', ] ) network_lines.extend( [ ' vm_network_0:', ' name: "VM Network"', ' description: "The VM Network network"', ] ) return hardware_lines, network_lines def _get_hardware_template( self, memory_setup: Optional[int] = False, cpu_setup: Optional[int] = False, network_setup: Optional[dict] = None, iso_setup: bool = False, disk_controller: Optional[str] = None, iso_controller: str = 'ide', disk_id: str = '0', iso_id: str = '0', ) -> str: """ Generate hardware template with VMware feature parity. :rtype: str """ hardware_lines = ['hardware:'] if cpu_setup: hardware_lines.append(' cpus: ${number_of_cpus}') if memory_setup: hardware_lines.append(' memory: ${memory_size}') controllers_added: Set[str] = set() disk_parent, disk_controller_type, disk_controller_subtype = ( self._get_controller(disk_controller, str(disk_id)) ) self._add_controller( hardware_lines, controllers_added, disk_parent, disk_controller_type, disk_controller_subtype, ) if iso_setup: iso_parent, iso_controller_type, iso_controller_subtype = ( self._get_controller(iso_controller, str(iso_id)) ) self._add_controller( hardware_lines, controllers_added, iso_parent, iso_controller_type, iso_controller_subtype, ) hardware_lines.extend( [ f' cdrom{iso_id}:', ' type: cd_drive', f' parent: {iso_parent}', ] ) hardware_lines.extend( [ ' rootdisk:', ' type: hard_disk', f' parent: {disk_parent}', ' disk_image: "${vmdk_file}"', ' usb2:', ' type: usb_controller', ' usb3:', ' type: usb3_controller', ] ) nic_hardware, network_lines = self._get_network_setup(network_setup) hardware_lines.extend(nic_hardware) return ( '\n'.join(hardware_lines) + self.cr + '\n'.join(network_lines) + self.cr ) def get_template( self, memory_setup: Optional[int] = False, cpu_setup: Optional[int] = False, network_setup: Optional[Dict[str, Dict[str, Optional[str]]]] = None, iso_setup: bool = False, disk_controller: Optional[str] = 'ide', iso_controller: str = 'ide', disk_id: str = '0', iso_id: str = '0', ) -> Template: """ Set data for the ova-compose template :param bool memory_setup: with main memory setup true|false :param bool cpu_setup: with number of CPU's setup true|false :param dict network_setup: with network emulation setup :param bool iso_setup: with CD/DVD drive emulation true|false :param string disk_controller: add disk controller setup to template :param string iso_controller: add CD/DVD controller setup to template :param string disk_id: disk controller id :param string iso_id: cdrom controller id :rtype: Template """ template_data = self.header hardware = self._get_hardware_template( memory_setup=memory_setup, cpu_setup=cpu_setup, network_setup=network_setup, iso_setup=iso_setup, disk_controller=disk_controller, iso_controller=iso_controller, disk_id=disk_id, iso_id=iso_id, ) template_data += hardware return Template(template_data) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/template/vagrant_config.py0000644000000000000000000000664715273675667021325 0ustar00# Copyright (c) 2019 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import Optional from textwrap import dedent class VagrantConfigTemplate: """ **Generate a Vagrantfile configuration template** This class creates a simple template for the Vagrantfile that is included inside a vagrant box. The included Vagrantfile carries additional information for vagrant: by default that is nothing, but depending on the provider additional information need to be present. These can be passed via the parameter ``custom_settings`` to the method :meth:`get_template`. Example usage: The default without any additional settings will result in this Vagrantfile: .. code:: python >>> vagrant_config = VagrantConfigTemplate() >>> print( ... vagrant_config.get_template() ... ) Vagrant.configure("2") do |config| end If your provider/box requires additional settings, provide them as follows: .. code:: python >>> extra_settings = dedent(''' ... config.vm.hostname = "no-dead-beef" ... config.vm.provider :special do |special| ... special.secret_settings = "please_work" ... end ... ''').strip() >>> print( ... vagrant_config.get_template(extra_settings) ... ) Vagrant.configure("2") do |config| config.vm.hostname = "no-dead-beef" config.vm.provider :special do |special| special.secret_settings = "please_work" end end """ def __init__(self) -> None: self.indent = ' ' self.header = ( dedent( ''' Vagrant.configure("2") do |config| ''' ).strip() + os.linesep ) self.end = dedent( ''' end ''' ).strip() def get_template(self, custom_settings: Optional[str] = None) -> str: """ Return a new template with ``custom_settings`` included and indented appropriately. :param str custom_settings: String of additional settings that get pasted into the Vagrantfile template. The string is put at the correct indentation level for you, but the internal indentation has to be provided by the caller. :return: A string with ``custom_settings`` inserted at the appropriate position. The template has one the variable ``mac_address`` that must be substituted. :rtype: str """ template = self.header if custom_settings: template += self.indent template += self.indent.join(custom_settings.splitlines(True)) template += os.linesep template += self.end return template ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/template/virtualbox_ovf.py0000644000000000000000000001630115273675667021373 0ustar00# Copyright (c) 2019 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from string import Template class VirtualboxOvfTemplate: """ **Generate a OVF file template for a vagrant virtualbox box** This class provides a template for virtualbox' ovf configuration file that is embedded inside the vagrant box. The template itself was extracted from a vagrant box that was build via packer and from a script provided by Neal Gompa. """ def __init__(self) -> None: # note: the OS ID is set to Other Linux 64 self.OVF_TEMPLATE = """ List of the virtual disks used in the package Logical networks used in the package Logical network used by this appliance. A virtual machine The kind of installed guest operating system ${vm_description} Linux_64 Virtual hardware requirements for a virtual machine Virtual Hardware Family 0 ${vm_name} virtualbox-2.2 1 virtual CPU Number of virtual CPUs 1 virtual CPU(s) 1 3 1 MegaBytes 1024 MB of memory Memory Size 1024 MB of memory 2 4 1024 0 ideController0 IDE Controller ideController0 3 PIIX4 5 1 ideController1 IDE Controller ideController1 4 PIIX4 5 0 sataController0 SATA Controller sataController0 5 AHCI 20 3 false sound Sound Card sound 6 ensoniq1371 35 0 disk1 Disk Image disk1 /disk/vmdisk1 7 5 17 true Ethernet adapter on 'NAT' NAT Ethernet adapter on 'NAT' 8 E1000 10 """ def get_template(self) -> Template: """ Return the actual ovf template. The following values must be substituted: - ``vm_name``: the name of this VM - ``disk_image_capacity``: Size of the virtual disk image in GB - ``vm_description``: a description of this VM """ return Template(self.OVF_TEMPLATE) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/template/vmware_settings.py0000644000000000000000000001632715273675667021553 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from string import Template from textwrap import dedent from typing import Any, Dict, Optional class VmwareSettingsTemplate: """ VMware machine settings template """ def __init__(self) -> None: self.cr = '\n' self.header = ( dedent( ''' #!/usr/bin/env vmware # kiwi generated VMware settings file config.version = "8" tools.syncTime = "true" uuid.action = "create" virtualHW.version = "${virtual_hardware_version}" displayName = "${display_name}" guestOS = "${guest_os}" ''' ).strip() + self.cr ) self.ide_disk = ( dedent( ''' ide${disk_id}:0.present = "true" ide${disk_id}:0.fileName= "${vmdk_file}" ide${disk_id}:0.redo = "" ''' ).strip() + self.cr ) self.scsi_disk = ( dedent( ''' scsi${disk_id}.present = "true" scsi${disk_id}.sharedBus = "none" scsi${disk_id}.virtualDev = "${scsi_controller_name}" scsi${disk_id}:0.present = "true" scsi${disk_id}:0.fileName = "${vmdk_file}" scsi${disk_id}:0.deviceType = "scsi-hardDisk" ''' ).strip() + self.cr ) self.network = ( dedent( ''' ethernet{nic_id}.present = "true" ethernet{nic_id}.allow64bitVmxnet = "true" ''' ).strip() + self.cr ) self.network_mac_static = ( dedent( ''' ethernet{nic_id}.addressType = "static" ethernet{nic_id}.address = "{mac_address}" ''' ).strip() + self.cr ) self.network_mac_generated = ( dedent( ''' ethernet{nic_id}.addressType = "generated" ''' ).strip() + self.cr ) self.network_driver = ( dedent( ''' ethernet{nic_id}.virtualDev = "{network_driver}" ''' ).strip() + self.cr ) self.network_connection_type = ( dedent( ''' ethernet{nic_id}.connectionType = "{mode}" ''' ).strip() + self.cr ) self.memory = ( dedent( ''' memsize = "${memory_size}" ''' ).strip() + self.cr ) self.number_of_cpus = ( dedent( ''' numvcpus = "${number_of_cpus}" ''' ).strip() + self.cr ) self.ide_iso = ( dedent( ''' ide${iso_id}:0.present = "true" ide${iso_id}:0.deviceType = "cdrom-raw" ide${iso_id}:0.autodetect = "true" ide${iso_id}:0.startConnected = "true" ''' ).strip() + self.cr ) self.scsi_iso = ( dedent( ''' scsi${iso_id}:0.present = "true" scsi${iso_id}:0.deviceType = "cdrom-raw" scsi${iso_id}:0.autodetect = "true" scsi${iso_id}:0.startConnected = "true" ''' ).strip() + self.cr ) self.usb = ( dedent( ''' usb.present = "true" ''' ).strip() + self.cr ) self.defaults = ( dedent( ''' priority.grabbed = "normal" priority.ungrabbed = "normal" powerType.powerOff = "soft" powerType.powerOn = "soft" powerType.suspend = "soft" powerType.reset = "soft" ''' ).strip() + self.cr ) def get_template( self, memory_setup: Optional[int] = False, cpu_setup: Optional[int] = False, network_setup: Optional[Dict[str, Dict[str, Optional[str]]]] = None, iso_setup: Any = False, disk_controller: str = 'ide', iso_controller: str = 'ide', ) -> Template: """ VMware machine configuration template :param bool memory_setup: with main memory setup true|false :param bool cpu_setup: with number of CPU's setup true|false :param bool network_setup: with network emulation true|false :param bool iso_setup: with CD/DVD drive emulation true|false :param string disk_controller: add disk controller setup to template :param string iso_controller: add CD/DVD controller setup to template :param string network_mac: add static MAC address setup to template :param string network_driver: add network driver setup to template :param string network_connection_type: add connection type to template :rtype: Template """ template_data = self.header template_data += self.defaults if memory_setup: template_data += self.memory if cpu_setup: template_data += self.number_of_cpus if disk_controller == 'ide': template_data += self.ide_disk else: template_data += self.scsi_disk if network_setup: for nic_id, nic_setup in list(network_setup.items()): template_data += self.network.format(nic_id=nic_id) if nic_setup['mac'] == 'generated': template_data += self.network_mac_generated.format( nic_id=nic_id ) else: template_data += self.network_mac_static.format( nic_id=nic_id, mac_address=nic_setup['mac'] ) if nic_setup['driver']: template_data += self.network_driver.format( nic_id=nic_id, network_driver=nic_setup['driver'] ) if nic_setup['connection_type']: template_data += self.network_connection_type.format( nic_id=nic_id, mode=nic_setup['connection_type'] ) if iso_setup: if iso_controller == 'ide': template_data += self.ide_iso else: template_data += self.scsi_iso template_data += self.usb return Template(template_data) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/vagrant_base.py0000644000000000000000000002020215273675667017136 0ustar00# Copyright (c) 2019 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import json import os.path from kiwi.utils.temporary import Temporary from typing import Dict, Optional, List from kiwi import xml_parse from kiwi.system.result import Result from kiwi.storage.subformat.base import DiskFormatBase from kiwi.storage.subformat.template.vagrant_config import VagrantConfigTemplate from kiwi.command import Command from kiwi.exceptions import KiwiFormatSetupError class DiskFormatVagrantBase(DiskFormatBase): """ Base class for creating vagrant boxes. The documentation of the vagrant box format can be found here: https://www.vagrantup.com/docs/boxes/format.html In a nutshell, a vagrant box is a tar, tar.gz or zip archive of the following: 1. ``metadata.json``: A json file that contains the name of the provider and arbitrary additional data (that vagrant doesn't care about). 2. ``Vagrantfile``: A Vagrantfile which defines the boxes' MAC address. It can be also used to define other settings of the box, e.g. the method via which the ``/vagrant/`` directory is shared. This file is either automatically generated by KIWI or we use a file that has been provided by the user (depends on the setting in `vagrantconfig.embebbed_vagrantfile`) 3. The actual virtual disk image: this is provider specific and vagrant simply forwards it to your virtual machine provider. Required methods/variables that child classes must implement: * :meth:`vagrant_post_init` post initializing method that has to specify the vagrant provider name in :attr:`provider` and the box name in :attr:`image_format`. Note: new providers also needs to be specified in the schema and the box name needs to be registered to :func:`kiwi.defaults.Defaults.get_disk_format_types` * :meth:`create_box_img` Optional methods: * :meth:`get_additional_metadata` * :meth:`get_additional_vagrant_config_settings` """ def post_init( self, custom_args: Dict['str', xml_parse.vagrantconfig] ) -> None: """ vagrant disk format post initialization method store vagrantconfig information provided via custom_args :param dict custom_args: Contains instance of xml_parse::vagrantconfig .. code:: python {'vagrantconfig': object} """ if not custom_args or 'vagrantconfig' not in custom_args: raise KiwiFormatSetupError( 'object init requires custom_args hash with a vagrantconfig' ) if not custom_args['vagrantconfig']: raise KiwiFormatSetupError('no vagrantconfig provided') self.vagrantconfig = custom_args['vagrantconfig'] self.vagrant_post_init() def vagrant_post_init(self) -> None: """ Vagrant provider specific post initialization method Setup vagrant provider and box name. This information must be set by the specialized provider class implementation to make the this base class methods effective """ self.provider: Optional[str] = None def create_box_img(self, temp_image_dir: str) -> List[str]: """ Provider specific image creation step: this function creates the actual box image. It must be implemented by a child class. """ raise NotImplementedError def create_image_format(self) -> None: """ Create a vagrant box for any provider. This includes: * creation of box metadata.json * creation of box Vagrantfile (either from scratch or by using the user provided Vagrantfile) * creation of result format tarball from the files created above """ if not self.image_format or not self.provider: raise NotImplementedError( 'vagrant_post_init: Missing provider and/or box name setup' ) temp_image_dir = Temporary(prefix='kiwi_vagrant_box.').new_dir() box_img_files = self.create_box_img(temp_image_dir.name) metadata_json = os.path.join(temp_image_dir.name, 'metadata.json') with open(metadata_json, 'w') as meta: meta.write(self._create_box_metadata()) vagrantfile = os.path.join(temp_image_dir.name, 'Vagrantfile') with open(vagrantfile, 'w') as vagrant: # autogenerate a Vagrantfile: if not self.vagrantconfig.get_embedded_vagrantfile(): embedded_vagrantfile = self._create_box_vagrantconfig() # user provided a Vagrantfile else: with open( os.path.join( self.xml_state.xml_data.description_dir, self.vagrantconfig.get_embedded_vagrantfile(), ), 'r', ) as users_vagrantfile: embedded_vagrantfile = users_vagrantfile.read(-1) vagrant.write(embedded_vagrantfile) Command.run( [ 'tar', '-C', temp_image_dir.name, '-czf', self.get_target_file_path_for_format(self.image_format), os.path.basename(metadata_json), os.path.basename(vagrantfile), ] + [os.path.basename(box_img_file) for box_img_file in box_img_files] ) def store_to_result(self, result: Result) -> None: """ Store result file of the vagrant format conversion into the provided result instance. In this case compression is unwanted because the box is already created as a compressed tarball :param object result: Instance of Result """ if not self.image_format: raise NotImplementedError( 'vagrant_post_init: Missing box name setup' ) result.add( key='disk_format_image', filename=self.get_target_file_path_for_format(self.image_format), use_for_bundle=True, compress=False, shasum=True, ) def get_additional_metadata(self) -> Dict: """ Provide :meth:`create_image_format` with additional metadata that will be included in ``metadata.json``. The default implementation returns an empty dictionary. :return: A dictionary that is serializable to JSON :rtype: dict """ return {} def get_additional_vagrant_config_settings(self) -> str: """ Supply additional configuration settings for vagrant to be included in the resulting box. This function can be used by child classes to customize the behavior for different providers: the supplied configuration settings get forwarded to :func:`VagrantConfigTemplate.get_template` as the parameter ``custom_settings`` and included in the ``Vagrantfile``. The default implementation returns nothing. :return: additional vagrant settings :rtype: str """ return '' def _create_box_metadata(self) -> str: metadata = self.get_additional_metadata() or {} metadata['provider'] = self.provider return json.dumps( metadata, sort_keys=True, indent=2, separators=(',', ': ') ) def _create_box_vagrantconfig(self) -> str: template = VagrantConfigTemplate() return template.get_template( custom_settings=self.get_additional_vagrant_config_settings() ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/vagrant_libvirt.py0000644000000000000000000000552015273675667017705 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from textwrap import dedent from typing import List, Dict # project from kiwi.storage.subformat.vagrant_base import DiskFormatVagrantBase from kiwi.storage.subformat.qcow2 import DiskFormatQcow2 from kiwi.command import Command class DiskFormatVagrantLibVirt(DiskFormatVagrantBase): """ **Create a vagrant box for the libvirt provider** """ def vagrant_post_init(self) -> None: self.image_format = 'vagrant.libvirt.box' self.provider = 'libvirt' def create_box_img(self, temp_image_dir: str) -> List[str]: """ Creates the qcow2 disk image box for libvirt vagrant provider :param str temp_image_dir: Path to the temporary directory used to build the box image :return: A list of files relevant for the libvirt box to be included in the vagrant box :rtype: list """ qcow = DiskFormatQcow2(self.xml_state, self.root_dir, self.target_dir) qcow.create_image_format() box_img = os.sep.join([temp_image_dir, 'box.img']) Command.run( [ 'mv', self.get_target_file_path_for_format(qcow.image_format), box_img, ] ) return [box_img] def get_additional_metadata(self) -> Dict: """ Provide box metadata needed to create the box in vagrant :return: Returns a dictionary containing the virtual image format and the size of the image. :rtype: dict """ return { 'format': 'qcow2', 'virtual_size': int(self.vagrantconfig.get_virtualsize() or 42), } def get_additional_vagrant_config_settings(self) -> str: """ Returns settings for the libvirt provider telling vagrant to use kvm. :return: ruby code to be evaluated as string :rtype: str """ return dedent( ''' config.vm.synced_folder ".", "/vagrant", type: "rsync" config.vm.provider :libvirt do |libvirt| libvirt.driver = "kvm" end ''' ).strip() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/vagrant_virtualbox.py0000644000000000000000000001011015273675667020420 0ustar00# Copyright (c) 2019 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import random from textwrap import dedent from typing import List # project from kiwi.storage.subformat.template.virtualbox_ovf import VirtualboxOvfTemplate from kiwi.storage.subformat.vagrant_base import DiskFormatVagrantBase from kiwi.storage.subformat.vmdk import DiskFormatVmdk from kiwi.command import Command class DiskFormatVagrantVirtualBox(DiskFormatVagrantBase): """ **Create a vagrant box for the virtualbox provider** """ def vagrant_post_init(self) -> None: self.provider = 'virtualbox' self.image_format = 'vagrant.virtualbox.box' def get_additional_vagrant_config_settings(self) -> str: """ Configure the default shared folder to use rsync when guest additions are not present inside the box. :return: ruby code to be evaluated as string :rtype: str """ extra_settings = ( dedent( ''' config.vm.base_mac = "{mac_address}" ''' ) .strip() .format(mac_address=self._random_mac()) ) if not self.xml_state.get_vagrant_config_virtualbox_guest_additions(): extra_settings += ( os.linesep + dedent( ''' config.vm.synced_folder ".", "/vagrant", type: "rsync" ''' ).strip() ) return extra_settings def create_box_img(self, temp_image_dir: str) -> List[str]: """ Create the vmdk image for the Virtualbox vagrant provider. This function creates the vmdk disk image and the ovf file. The latter is created via the class :class:`VirtualboxOvfTemplate`. :param str temp_image_dir: Path to the temporary directory used to build the box image :return: A list of files relevant for the virtualbox box to be included in the vagrant box :rtype: list """ vmdk = DiskFormatVmdk(self.xml_state, self.root_dir, self.target_dir) vmdk.create_image_format() box_img = os.sep.join([temp_image_dir, 'box.vmdk']) Command.run( [ 'mv', self.get_target_file_path_for_format(vmdk.image_format), box_img, ] ) box_ovf = os.sep.join([temp_image_dir, 'box.ovf']) ovf_template = VirtualboxOvfTemplate() disk_image_capacity = self.vagrantconfig.get_virtualsize() or 42 xml_description_specification = ( self.xml_state.get_description_section().specification ) with open(box_ovf, "w") as ovf_file: ovf_file.write( ovf_template.get_template().substitute( { 'root_uuid': self.xml_state.get_root_filesystem_uuid(), 'vm_name': self.xml_state.xml_data.name, 'disk_image_capacity': disk_image_capacity, 'vm_description': xml_description_specification, } ) ) return [box_img, box_ovf] @staticmethod def _random_mac() -> str: return '%02x%02x%02x%02x%02x%02x'.upper() % ( 0x00, 0x16, 0x3E, random.randrange(0, 0x7E), random.randrange(0, 0xFF), random.randrange(0, 0xFF), ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/vdi.py0000644000000000000000000000325115273675667015271 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see from typing import Dict # project from kiwi.storage.subformat.base import DiskFormatBase from kiwi.command import Command class DiskFormatVdi(DiskFormatBase): """ **Create vdi disk format** """ def post_init(self, custom_args: Dict) -> None: """ vdi disk format post initialization method Store qemu options as list from custom args dict :param dict custom_args: custom qemu arguments dictionary """ self.image_format = 'vdi' self.options = self.get_qemu_option_list(custom_args) def create_image_format(self) -> None: """ Create vdi disk format """ Command.run( [ 'qemu-img', 'convert', '-f', 'raw', self.diskname, '-O', self.image_format, ] + self.options + [self.get_target_file_path_for_format(self.image_format)] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/vhd.py0000644000000000000000000000304015273675667015264 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Dict # project from kiwi.storage.subformat.base import DiskFormatBase from kiwi.command import Command class DiskFormatVhd(DiskFormatBase): """ **Create vhd disk format** """ def post_init(self, custom_args: Dict) -> None: """ vhd disk format post initialization method Store qemu options as list from custom args dict :param dict custom_args: custom qemu arguments dictionary """ self.image_format = 'vhd' self.options = self.get_qemu_option_list(custom_args) def create_image_format(self) -> None: """ Create vhd disk format """ Command.run( ['qemu-img', 'convert', '-f', 'raw', self.diskname, '-O', 'vpc'] + self.options + [self.get_target_file_path_for_format(self.image_format)] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/vhdfixed.py0000644000000000000000000001326415273675667016315 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Dict import struct from binascii import unhexlify import re # project from kiwi.system.result import Result from kiwi.storage.subformat.base import DiskFormatBase from kiwi.command import Command from kiwi.exceptions import KiwiVhdTagError class DiskFormatVhdFixed(DiskFormatBase): """ **Create vhd image format in fixed subformat** """ def post_init(self, custom_args: Dict) -> None: """ vhd disk format post initialization method Store qemu options as list from custom args dict Extract disk tag from custom args :param dict custom_args: custom vhdfixed and qemu argument dictionary .. code:: python {'--tag': 'billing_code', '--qemu-opt': 'value'} """ self.image_format = 'vhdfixed' self.tag = None if '--tag' in custom_args: self.tag = custom_args['--tag'] del custom_args['--tag'] self.options = self.get_qemu_option_list(custom_args) self.options.append('-o') self.options.append('subformat=fixed') def create_image_format(self) -> None: """ Create vhd fixed disk format """ Command.run( ['qemu-img', 'convert', '-f', 'raw', self.diskname, '-O', 'vpc'] + self.options + [self.get_target_file_path_for_format(self.image_format)] ) if self.tag: self._write_vhd_tag(self.tag) def store_to_result(self, result: Result) -> None: """ Store result file of the vhdfixed format conversion into the provided result instance. In this case compressing the result is preferred as vhdfixed is not a compressed or dynamic format. :param object result: Instance of Result """ compression = self.runtime_config.get_bundle_compression(default=True) if self.xml_state.get_luks_credentials() is not None: compression = False result.add( key='disk_format_image', filename=self.get_target_file_path_for_format(self.image_format), use_for_bundle=True, compress=compression, shasum=True, ) def _pack_net_guid_tag(self, tag: str) -> bytes: """ Pack tag format into 16 byte binary representation. String format of the tag is: XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX :param string tag: tagname """ tag_format = re.match( ''.join( [ '^', '([0-9a-f]{8})', '-', '([0-9a-f]{4})', '-', '([0-9a-f]{4})', '-', '([0-9a-f]{4})', '-', '([0-9a-f]{12})', '$', ] ), tag, ) if not tag_format: raise KiwiVhdTagError(f'disk tag {tag} does not match format') # pack first nibble into 4 byte unsigned long type binary_tag_part_1 = struct.pack( 'I', list(struct.unpack('>L', unhexlify(tag_format.group(1))))[0] ) # pack second nibble into 2 byte unsigned short type binary_tag_part_2 = struct.pack( 'H', list(struct.unpack('>H', unhexlify(tag_format.group(2))))[0] ) # pack third nibble into 2 byte unsigned short type binary_tag_part_3 = struct.pack( 'H', list(struct.unpack('>H', unhexlify(tag_format.group(3))))[0] ) # pack fourth nibble into hex binary_tag_part_4 = unhexlify(tag_format.group(4)) # pack fifth nibble into hex binary_tag_part_5 = unhexlify(tag_format.group(5)) return ( binary_tag_part_1 + binary_tag_part_2 + binary_tag_part_3 + binary_tag_part_4 + binary_tag_part_5 ) def _write_vhd_tag(self, tag: str) -> None: """ Azure service uses a tag injected into the disk image to identify the OS. The tag is 512B long, starting with a GUID, and is placed at a 64K offset from the start of the disk image. +------------------------------+ | jump | GUID(16B)000... | +------------------------------| | 64K offset | TAG (512B) | +------------+-----------------+ """ binary_tag = self._pack_net_guid_tag(tag) vhd_fixed_image = self.get_target_file_path_for_format('vhdfixed') # seek to 64k offset and zero out 512 byte with open(vhd_fixed_image, 'r+b') as vhd_fixed: with open('/dev/zero', 'rb') as null: vhd_fixed.seek(65536, 0) vhd_fixed.write(null.read(512)) vhd_fixed.seek(0, 2) # seek to 64k offset and write tag with open(vhd_fixed_image, 'r+b') as vhd_fixed: vhd_fixed.seek(65536, 0) vhd_fixed.write(binary_tag) vhd_fixed.seek(0, 2) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/vhdx.py0000644000000000000000000000322715273675667015463 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Dict # project from kiwi.storage.subformat.base import DiskFormatBase from kiwi.command import Command class DiskFormatVhdx(DiskFormatBase): """ **Create vhdx image format in dynamic subformat** """ def post_init(self, custom_args: Dict) -> None: """ vhdx disk format post initialization method Store qemu options as list from custom args dict :param dict custom_args: custom qemu arguments dictionary """ self.image_format = 'vhdx' self.options = self.get_qemu_option_list(custom_args) self.options.append('-o') self.options.append('subformat=dynamic') def create_image_format(self) -> None: """ Create vhdx dynamic disk format """ Command.run( ['qemu-img', 'convert', '-f', 'raw', self.diskname, '-O', 'vhdx'] + self.options + [self.get_target_file_path_for_format(self.image_format)] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/storage/subformat/vmdk.py0000644000000000000000000001454715273675667015462 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Dict import os # project from kiwi.system.result import Result from kiwi.storage.subformat.base import DiskFormatBase from kiwi.command import Command from kiwi.storage.subformat.template.vmware_settings import ( VmwareSettingsTemplate, ) from kiwi.exceptions import KiwiTemplateError class DiskFormatVmdk(DiskFormatBase): """ Create vmdk disk format """ def post_init(self, custom_args: Dict) -> None: """ vmdk disk format post initialization method Store qemu options as list from custom args dict :param dict custom_args: custom qemu arguments dictionary """ self.image_format = 'vmdk' self.options = self.get_qemu_option_list(custom_args) def create_image_format(self) -> None: """ Create vmdk disk format and machine settings file """ Command.run( ['qemu-img', 'convert', '-f', 'raw', self.diskname, '-O', 'vmdk'] + self.options + [self.get_target_file_path_for_format('vmdk')] ) self._create_vmware_settings_file() def store_to_result(self, result: Result) -> None: """ Store result files of the vmdk format conversion into the provided result instance. This includes the vmdk image file and the VMware settings file :param object result: Instance of Result """ compression = self.runtime_config.get_bundle_compression(default=False) if self.xml_state.get_luks_credentials() is not None: compression = False result.add( key='disk_format_image', filename=self.get_target_file_path_for_format('vmdk'), use_for_bundle=True, compress=compression, shasum=True, ) result.add( key='disk_format_machine_settings', filename=self.get_target_file_path_for_format('vmx'), use_for_bundle=True, compress=False, shasum=False, ) def _create_vmware_settings_file(self) -> None: """ In order to run a vmdk image in VMware products a settings file is needed """ displayname = self.xml_state.xml_data.get_displayname() template_record = { 'display_name': displayname or self.xml_state.xml_data.get_name(), 'vmdk_file': os.path.basename( self.get_target_file_path_for_format('vmdk') ), 'virtual_hardware_version': '9', 'guest_os': 'suse-64', 'disk_id': '0', } # Basic setup machine_setup = self.xml_state.get_build_type_machine_section() memory_setup = None cpu_setup = None if machine_setup: memory_setup = machine_setup.get_memory() hardware_version = machine_setup.get_HWversion() guest_os = machine_setup.get_guestOS() cpu_setup = machine_setup.get_ncpus() if hardware_version: template_record['virtual_hardware_version'] = hardware_version if guest_os: template_record['guest_os'] = guest_os if memory_setup: template_record['memory_size'] = memory_setup if cpu_setup: template_record['number_of_cpus'] = cpu_setup # CD/DVD setup iso_setup = self.xml_state.get_build_type_vmdvd_section() iso_controller = 'ide' if iso_setup: iso_controller = iso_setup.get_controller() or iso_controller template_record['iso_id'] = iso_setup.get_id() # Network setup network_entries = self.xml_state.get_build_type_vmnic_entries() network_setup = {} for network_entry in network_entries: network_setup[network_entry.get_interface() or '0'] = { 'driver': network_entry.get_driver(), 'connection_type': network_entry.get_mode(), 'mac': network_entry.get_mac() or 'generated', } # Disk setup disk_setup = self.xml_state.get_build_type_vmdisk_section() disk_controller = 'ide' if disk_setup: disk_controller = disk_setup.get_controller() or disk_controller if disk_controller in ('scsi', 'paravirtual'): # generic and paravirtual SCSI is pvscsi in VMX disk_controller = 'pvscsi' elif disk_controller in ('sata', 'nvme'): raise KiwiTemplateError( f'Controller "{disk_controller}" is not supported ' 'for the vmdk format, use ide or a SCSI controller' ) disk_id = disk_setup.get_id() if not disk_controller == 'ide': template_record['scsi_controller_name'] = disk_controller if disk_id: template_record['disk_id'] = disk_id # Addition custom entries custom_entries = self.xml_state.get_build_type_vmconfig_entries() # Build settings template and write settings file settings_template = VmwareSettingsTemplate().get_template( memory_setup, cpu_setup, network_setup, iso_setup, disk_controller, iso_controller, ) try: settings_file = self.get_target_file_path_for_format('vmx') with open(settings_file, 'w') as config: config.write(settings_template.substitute(template_record)) for custom_entry in custom_entries: config.write(custom_entry + os.linesep) except Exception as e: raise KiwiTemplateError(f'{type(e).__name__}: {format(e)}') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7506921 kiwi-11.1.8/kiwi/system/__init__.py0000644000000000000000000000000015273675667014111 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7512066 kiwi-11.1.8/kiwi/system/identifier.py0000644000000000000000000000507615273675667014516 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging import os import random import struct from typing import Optional # project from kiwi.storage.device_provider import DeviceProvider log = logging.getLogger('kiwi') class SystemIdentifier: """ **Create a random ID to identify the system** The information is used to create the mbrid file as an example :param str image_id: hex identifier string """ def __init__(self) -> None: self.image_id: Optional[str] = None sde = os.environ.get('SOURCE_DATE_EPOCH') if sde: log.info(f'Using SystemIdentifier seed SOURCE_DATE_EPOCH:{sde}') random.seed(int(sde)) def get_id(self) -> Optional[str]: """ Current hex identifier :return: hex id :rtype: str """ return self.image_id def calculate_id(self) -> None: """ Calculate random hex id Using 4 tuples of rand in range from 1..0xfe """ self.image_id = '0x%02x%02x%02x%02x' % ( self._rand(), self._rand(), self._rand(), self._rand(), ) def write(self, filename: str) -> None: """ Write current hex identifier to file :param str filename: file path name """ with open(filename, 'w') as identifier: identifier.write(f'{self.image_id}\n') def write_to_disk(self, device_provider: DeviceProvider) -> None: """ Write current hex identifier to MBR at offset 0x1b8 on disk :param object device_provider: Instance based on DeviceProvider """ if self.image_id: packed_id = struct.pack(' int: return random.randrange(1, 0xFE) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7512066 kiwi-11.1.8/kiwi/system/kernel.py0000644000000000000000000003120515273675667013645 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re import os from typing import NamedTuple, Optional, List, Tuple, Union # project from kiwi.command import Command from kiwi.defaults import KERNEL_FLAVOR_NONE from kiwi.exceptions import KiwiKernelLookupError kernel_type = NamedTuple( 'kernel_type', [('name', str), ('filename', str), ('version', str)] ) xen_hypervisor_type = NamedTuple( 'xen_hypervisor_type', [('filename', str), ('name', str)] ) class Kernel: """ **Implementes kernel lookup and extraction from given root tree** If more than one kernel is installed in the root tree, the kernel of the latest version is used, optionally of a given flavor only, see is_flavor(). The version of a kernel is the name of its modules directory, which is also the version the initrd gets created for, see get_kernel_versions() :param str root_dir: root directory path name :param list kernel_names: list of kernel names to search for functions.sh::suseStripKernel() provides a normalized file so that we do not have to search for many different names in this code """ def __init__(self, root_dir: str): self.root_dir = root_dir self.kernel_names = self._setup_kernel_names_for_lookup() def get_kernel( self, raise_on_not_found: bool = False, flavor: str = '' ) -> Optional[kernel_type]: """ Lookup kernel files and provide filename and version :param bool raise_on_not_found: sets the method to raise an exception if the kernel is not found :param str flavor: only look for kernels of this flavor, see is_flavor(). Kernels of any flavor are taken into account if not set :raises KiwiKernelLookupError: if raise_on_not_found flag is active and kernel is not found The kernel names are ordered by kernel version, latest first, see _setup_kernel_names_for_lookup(). The first existing kernel file is therefore the kernel of the latest version which is installed. Its version is taken from the kernel name, which is relative to the root tree: a path of the root tree itself does not affect it. With a flavor, the kernels of other flavors are skipped and the kernel of the latest version of that flavor is found :return: tuple with filename, kernelname and version :rtype: tuple|None """ kernel_patterns = [ r'^boot/[^/-]+-(.+)$', r'^(?:usr/)?lib/modules/([^/]+)/[^/]+$', ] for kernel_name in self.kernel_names: kernel_file = os.sep.join([self.root_dir, kernel_name]) if os.path.exists(kernel_file): for kernel_pattern in kernel_patterns: version_match = re.match(kernel_pattern, kernel_name) if version_match: version = version_match.group(1) if flavor and not Kernel.is_flavor(version, flavor): break return kernel_type( name=os.path.basename( os.path.realpath(kernel_file) ), filename=kernel_file, version=version, ) if raise_on_not_found: if flavor: raise KiwiKernelLookupError( 'No kernel of flavor {0} found in {1}, ' 'installed kernel versions: {2}'.format( flavor, self.root_dir, self.get_kernel_versions() ) ) raise KiwiKernelLookupError( 'No kernel found in {0}, searched for {1}'.format( self.root_dir, self.kernel_names ) ) return None @staticmethod def is_flavor(version: str, flavor: str) -> bool: """ Check if the given kernel version belongs to the given flavor The flavor is the end of the version, separated by - or + from the release which precedes it. The release is the last part of the version before the flavor which contains a digit. A flavor which only ends another flavor is therefore not the flavor of the version, e.g: * 6.4.0-150600.23.25-default is of flavor default * 6.1.0-21-rt-amd64 is of flavor rt-amd64, but not amd64 * 5.14.0-427.13.1.el9_4.x86_64+rt is of flavor rt The flavor none is the flavor of a kernel version which does not end with a flavor at all, see has_flavor(), e.g: * 7.2.15-100.fc43.x86_64 is of flavor none :param str version: kernel version :param str flavor: kernel flavor name :return: True or False :rtype: bool """ if flavor == KERNEL_FLAVOR_NONE: return not Kernel.has_flavor(version) return bool( re.fullmatch(rf'.*[0-9][^-+]*[-+]{re.escape(flavor)}', version) ) @staticmethod def has_flavor(version: str) -> bool: """ Check if the given kernel version ends with a flavor The flavor is a name after the last - or + of the version. A part which contains no letter is a release number and a part which contains a dot is the release itself, e.g: * 6.4.0-150600.23.25-default ends with the flavor default * 6.4.0-150600.23.25-64kb ends with the flavor 64kb * 7.2.15-100.fc43.x86_64 ends with its release * 6.10.1-arch1-1 ends with a release number :param str version: kernel version :return: True or False :rtype: bool """ parts = re.split(r'[-+]', version) last_part = parts[-1] if len(parts) > 1 else '' return bool(re.search(r'[a-zA-Z]', last_part)) and '.' not in last_part def get_kernel_versions(self) -> List[str]: """ Provide the versions of the kernels installed in the root tree, latest first The version of a kernel is the name of its modules directory below lib/modules or usr/lib/modules. The directories are not ordered by their name but by version, see version_key(), e.g 6.10.1 is later than 6.9.12. A version which is installed below both directories, e.g with lib being a link to usr/lib, is only listed once :return: list of kernel versions :rtype: list """ kernel_versions = set() kernel_module_dirs = [ os.sep.join([self.root_dir, 'lib/modules']), os.sep.join([self.root_dir, 'usr/lib/modules']), ] for kernel_module_dir in kernel_module_dirs: if os.path.isdir(kernel_module_dir): kernel_versions.update(os.listdir(kernel_module_dir)) return sorted( kernel_versions, key=lambda version: (Kernel.version_key(version), version), reverse=True, ) def get_version_in_name(self, name: str) -> Optional[str]: """ Provide the version of the installed kernel the given file name refers to, e.g 6.4.0-1-default for initrd-6.4.0-1-default The installed versions are looked for in the name longest first, a version does not match within a longer one, e.g 6.1 within initramfs-6.10.img :param str name: file name :return: kernel version or None :rtype: str|None """ for version in sorted( self.get_kernel_versions(), key=lambda version: (-len(version), version), ): if version in name: return version return None @staticmethod def version_key(version: str) -> List[Tuple[int, Union[int, str]]]: """ Provide a sort key which orders kernel versions by version rather than by name The version is split into its numeric and alphabetic parts, all other characters only separate them, like rpm does it. Numeric parts are compared as numbers, alphabetic parts as strings and a numeric part is later than an alphabetic one. A version which continues where another one ends is the later one, e.g: 6.4.0-150600.23.7-default < 6.4.0-150600.23.25-default 6.9.12-1-default < 6.10.1-1-default :param str version: kernel version :return: sort key :rtype: list """ return [ (1, int(part)) if part.isdigit() else (0, part) for part in re.findall(r'[0-9]+|[a-zA-Z]+', version) ] def get_xen_hypervisor(self) -> Optional[xen_hypervisor_type]: """ Lookup xen hypervisor and provide filename and hypervisor name :return: tuple with filename and hypervisor name :rtype: tuple|None """ xen_hypervisor = self.root_dir + '/boot/xen.gz' if os.path.exists(xen_hypervisor): return xen_hypervisor_type(filename=xen_hypervisor, name='xen.gz') return None def copy_kernel( self, target_dir: str, file_name: Optional[str] = None, flavor: str = '' ) -> None: """ Copy kernel to specified target If no file_name is given the target filename is set as kernel-.kernel :param str target_dir: target path name :param str filename: base filename in target :param str flavor: copy the kernel of this flavor, see get_kernel() """ kernel = self.get_kernel(flavor=flavor) if kernel: if not file_name: file_name = 'kernel-' + kernel.version + '.kernel' target_file = ''.join([target_dir, '/', file_name]) Command.run(['cp', kernel.filename, target_file]) def copy_xen_hypervisor( self, target_dir: str, file_name: Optional[str] = None ) -> None: """ Copy xen hypervisor to specified target If no file_name is given the target filename is set as hypervisor- :param str target_dir: target path name :param str filename: base filename in target """ xen = self.get_xen_hypervisor() if xen: if not file_name: file_name = 'hypervisor-' + xen.name target_file = ''.join([target_dir, '/', file_name]) Command.run(['cp', xen.filename, target_file]) def _setup_kernel_names_for_lookup(self) -> List[str]: """ The kernel image name is different per arch and distribution This method returns a list of possible kernel image names in order to search and find one of them The names are ordered by kernel version, latest first, and only then by the image name prefixes. All names of a version come before the names of an earlier version, the kernel of a later version is found first no matter its image name :return: list of kernel image names :rtype: list """ kernel_names = [] kernel_dirs = self.get_kernel_versions() if kernel_dirs: # append lookup for the real kernel image names # depending on the arch and os they are different # in their prefix kernel_prefixes = [ 'uImage', 'Image', 'zImage', 'vmlinuz', 'image', 'vmlinux', 'kernel', ] for kernel_dir in kernel_dirs: for kernel_prefix in kernel_prefixes: # add kernel names to be found in boot kernel_names.append(f'boot/{kernel_prefix}-{kernel_dir}') # add kernel names to be found in modules kernel_names.append( f'lib/modules/{kernel_dir}/{kernel_prefix}' ) kernel_names.append( f'usr/lib/modules/{kernel_dir}/{kernel_prefix}' ) return kernel_names ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7512066 kiwi-11.1.8/kiwi/system/mount.py0000644000000000000000000001536115273675667013534 0ustar00# Copyright (c) 2022 Marcus Schäfer. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from types import TracebackType from typing import List, Dict, Optional, Union, Type # project from kiwi.defaults import Defaults from kiwi.mount_manager import MountManager from kiwi.storage.disk import ptable_entry_type from kiwi.volume_manager.base import VolumeManagerBase from kiwi.filesystem.base import FileSystemBase log = logging.getLogger('kiwi') class ImageSystem: """ **Access the target image from the block layer** """ def __init__( self, device_map: Dict, root_dir: str, volume_manager: Optional[ Union[FileSystemBase, VolumeManagerBase] ] = None, partitions: Dict[str, ptable_entry_type] = {}, ) -> None: """ Construct a new ImageSystem object :param dict device_map: Block device map :param str root_dir: Path to unpacked image root tree :param VolumeManagerBase volume_manager: Optional VolumeManager instance """ self.arch = Defaults.get_platform_name() self.device_map = device_map self.root_dir = root_dir self.volume_manager = volume_manager self.partitions = partitions self.mount_list: List[MountManager] = [] self.root_mount_mountpoint = '' def __enter__(self) -> "ImageSystem": return self def mountpoint(self) -> str: """ Return image root mountpoint :return: mountpoint path or empty string :rtype: str """ return self.root_mount_mountpoint def mount(self) -> None: """ Mount image system from current block layers """ # mount root boot and efi devices as they are present root_device, boot_device, efi_device = self._setup_device_names() if self.volume_manager: self.volume_manager.mount_volumes() self.root_mount_mountpoint = ( self.volume_manager.get_mountpoint() or '' ) else: root_mount = MountManager(device=root_device) self.mount_list.append(root_mount) # The overlayroot readonly partition holds a read-only # filesystem (squashfs/erofs), mount it as such root_mount.mount( options=['ro'] if 'readonly' in self.device_map else [] ) self.root_mount_mountpoint = root_mount.mountpoint if 's390' in self.arch: boot_mount = MountManager( device=boot_device, mountpoint=os.path.join( self.root_mount_mountpoint, 'boot', 'zipl' ), ) else: boot_mount = MountManager( device=boot_device, mountpoint=os.path.join(self.root_mount_mountpoint, 'boot'), ) if efi_device: efi_mount = MountManager( device=efi_device, mountpoint=os.path.join( self.root_mount_mountpoint, 'boot', 'efi' ), ) if root_device != boot_device: self.mount_list.append(boot_mount) boot_mount.mount() if efi_device: self.mount_list.append(efi_mount) efi_mount.mount() if self.partitions: for map_name in sorted(self.partitions.keys()): if map_name in self.device_map: partition_mount = MountManager( device=self.device_map[map_name].get_device(), mountpoint=os.path.join( self.root_mount_mountpoint, self.partitions[map_name].mountpoint.lstrip(os.sep), ), ) self.mount_list.append(partition_mount) partition_mount.mount() # bind mount /image from unpacked root to get access to e.g scripts image_mount = MountManager( device=os.path.join(self.root_dir, 'image'), mountpoint=os.path.join(self.root_mount_mountpoint, 'image'), ) self.mount_list.append(image_mount) image_mount.bind_mount() # mount tmp as tmpfs tmp_mount = MountManager( device='tmpfs', mountpoint=os.path.join(self.root_mount_mountpoint, 'tmp'), ) self.mount_list.append(tmp_mount) tmp_mount.tmpfs_mount() # mount var/tmp as tmpfs var_tmp_mount = MountManager( device='tmpfs', mountpoint=os.path.join(self.root_mount_mountpoint, 'var', 'tmp'), ) self.mount_list.append(var_tmp_mount) var_tmp_mount.tmpfs_mount() # mount kernel interfaces as bind for location in ('proc', 'sys', 'dev'): shared_mount = MountManager( device=os.path.join('/', location), mountpoint=os.path.join(self.root_mount_mountpoint, location), ) self.mount_list.append(shared_mount) shared_mount.bind_mount() def umount(self) -> None: """ Umount all elements of mount_list in reverse order """ for mount in reversed(self.mount_list): if mount.is_mounted(): mount.umount() if self.volume_manager: self.volume_manager.umount_volumes() def _setup_device_names(self) -> tuple: root_device = self.device_map['root'].get_device() boot_device = root_device efi_device = '' if 'readonly' in self.device_map: root_device = self.device_map['readonly'].get_device() boot_device = root_device if 'boot' in self.device_map: boot_device = self.device_map['boot'].get_device() if 'efi' in self.device_map: efi_device = self.device_map['efi'].get_device() return (root_device, boot_device, efi_device) def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: self.umount() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7512066 kiwi-11.1.8/kiwi/system/prepare.py0000644000000000000000000007003615273675667014030 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from contextlib import ExitStack from types import TracebackType from typing import Dict, List, Any, Optional, Type from textwrap import dedent # project from kiwi.command import Command from kiwi.xml_parse import repository from kiwi.xml_state import XMLState from kiwi.system.root_init import RootInit from kiwi.system.root_import import RootImport from kiwi.system.root_bind import RootBind from kiwi.repository import Repository from kiwi.package_manager import PackageManager from kiwi.package_manager.base import PackageManagerBase from kiwi.command_process import CommandProcess from kiwi.system.uri import Uri from kiwi.archive.tar import ArchiveTar from kiwi.utils.sync import DataSync from kiwi.path import Path from kiwi.defaults import Defaults from kiwi.exceptions import ( KiwiBootStrapPhaseFailed, KiwiSystemUpdateFailed, KiwiSystemInstallPackagesFailed, KiwiSystemDeletePackagesFailed, KiwiInstallPhaseFailed, KiwiPackagesDeletePhaseFailed, ) log: Any = logging.getLogger('kiwi') class SystemPrepare: """ Implements preparation and installation of a new root system :param object xml_state: instance of :class:`XMLState` :param str root_dir: Path to new root directory :param bool allow_existing: Allow using an existing root_dir """ def __init__( self, xml_state: XMLState, root_dir: str, allow_existing: bool = False ): """ Setup and host bind new root system at given root_dir directory """ self.root_import = None log.info('Setup root directory: %s', root_dir) if not log.getLogLevel() == logging.DEBUG and not log.get_logfile(): self.issue_message = dedent( ''' {headline}: {reason} Further details to clarify the error might have been reported earlier in the package manager log information and did not get exposed to the caller. Thus if the above message is not clear on the error please call kiwi with the --debug or --logfile option. ''' ) else: self.issue_message = '{headline}: {reason}' root = RootInit(root_dir, allow_existing) root.create() image_uris = xml_state.get_derived_from_image_uri() delta_root = xml_state.build_type.get_delta_root() image_type = xml_state.build_type.get_image() if image_uris and image_type in ['docker', 'oci']: self.root_import = RootImport.new(root_dir, image_uris, image_type) if delta_root: self.root_import.overlay_data() else: self.root_import.sync_data() root_bind = RootBind(root) root_bind.setup_intermediate_config() root_bind.mount_kernel_file_systems(delta_root) root_bind.mount_shared_directory() self.delta_root = delta_root self.root_dir = root_dir self.xml_state = xml_state self.profiles = xml_state.profiles self.root_bind = root_bind #: A list of Uri references self.uri_list: List[Uri] = [] def __enter__(self) -> "SystemPrepare": return self def setup_repositories( self, clear_cache: bool = False, signing_keys: Optional[List[str]] = None, target_arch: Optional[str] = None, ) -> PackageManagerBase: """ Set up repositories for software installation and return a package manager for performing software installation tasks :param bool clear_cache: Flag the clear cache before configure anything :param list signing_keys: Keys imported to the package manager :param str target_arch: Target architecture name :return: instance of :class:`PackageManager` subclass :rtype: PackageManager """ repository_options = [] repository_sections = ( self.xml_state.get_repository_sections_used_for_build() ) package_manager = self.xml_state.get_package_manager() release_version = self.xml_state.get_release_version() rpm_locale_list = self.xml_state.get_rpm_locale() if self.xml_state.get_rpm_check_signatures(): repository_options.append('check_signatures') if self.xml_state.get_rpm_excludedocs(): repository_options.append('exclude_docs') if rpm_locale_list: repository_options.append( '_install_langs%{0}'.format(':'.join(rpm_locale_list)) ) if target_arch: repository_options.append(f'_target_arch%{target_arch}') with Repository.new( self.root_bind, package_manager, repository_options ) as repo: repo.setup_package_database_configuration() if signing_keys: repo.import_trusted_keys(signing_keys) for xml_repo in repository_sections: repo_type = xml_repo.get_type() repo_source = xml_repo.get_source().get_path() repo_architectures = xml_repo.get_architectures() repo_user = xml_repo.get_username() repo_secret = xml_repo.get_password() repo_alias = xml_repo.get_alias() repo_priority = xml_repo.get_priority() repo_dist = xml_repo.get_distribution() repo_components = xml_repo.get_components() repo_repository_gpgcheck = xml_repo.get_repository_gpgcheck() repo_package_gpgcheck = xml_repo.get_package_gpgcheck() repo_customization_script = self._get_repo_customization_script( xml_repo ) repo_sourcetype = xml_repo.get_sourcetype() log.info( 'Setting up repository %s', Uri.print_sensitive(repo_source) ) log.info('--> Type: {0}'.format(repo_type)) if repo_sourcetype: log.info('--> SourceType: {0}'.format(repo_sourcetype)) if repo_priority: log.info('--> Priority: {0}'.format(repo_priority)) uri = Uri(repo_source, repo_type) repo_source_translated = uri.translate() log.info( '--> Translated: {0}'.format( Uri.print_sensitive(repo_source_translated) ) ) if not repo_alias: repo_alias = uri.alias() log.info('--> Alias: {0}'.format(repo_alias)) if not uri.is_remote() and not os.path.exists( repo_source_translated ): log.warning( 'repository %s does not exist and will be skipped', repo_source, ) continue if not uri.is_remote(): self.root_bind.mount_shared_directory( repo_source_translated ) repo.add_repo( repo_alias, repo_source_translated, repo_type, repo_priority, repo_dist, repo_components, repo_user, repo_secret, uri.credentials_file_name(), repo_repository_gpgcheck, repo_package_gpgcheck, repo_sourcetype, repo_customization_script, repo_architectures, ) if clear_cache: repo.delete_repo_cache(repo_alias) self.uri_list.append(uri) repo.cleanup_unused_repos() return PackageManager.new( repository=repo, package_manager_name=package_manager, release_version=release_version, ) def install_bootstrap( self, manager: PackageManagerBase, plus_packages: Optional[List] = None ) -> None: """ Install system software using the package manager from the host, also known as bootstrapping :param object manager: instance of a :class:`PackageManager` subclass :param list plus_packages: list of additional packages :raises KiwiBootStrapPhaseFailed: if the bootstrapping process fails either installing packages or including bootstrap archives """ if ( not self.xml_state.get_bootstrap_packages_sections() and not plus_packages ): log.warning('No sections marked as "bootstrap" found') log.info('Processing of bootstrap stage skipped') return log.info('Installing bootstrap packages') bootstrap_packages = self.xml_state.get_bootstrap_packages( plus_packages ) collection_type = self.xml_state.get_bootstrap_collection_type() log.info('--> collection type: %s', collection_type) bootstrap_collections = self.xml_state.get_bootstrap_collections() bootstrap_products = self.xml_state.get_bootstrap_products() bootstrap_archives = self.xml_state.get_bootstrap_archives() bootstrap_archives_target_dirs = ( self.xml_state.get_bootstrap_archives_target_dirs() ) bootstrap_packages_ignored = ( self.xml_state.get_bootstrap_ignore_packages() ) package_manager = self.xml_state.get_package_manager() # process package installations if collection_type == 'onlyRequired': manager.process_only_required() else: manager.process_plus_recommended() all_install_items = self._setup_requests( manager, bootstrap_packages, bootstrap_collections, bootstrap_products, bootstrap_packages_ignored, ) manager.setup_repository_modules( self.xml_state.get_collection_modules() ) process = CommandProcess( command=manager.process_install_requests_bootstrap( self.root_bind, self.xml_state.get_bootstrap_package_name() ), log_topic='bootstrap', ) try: process.poll_show_progress( items_to_complete=all_install_items, match_method=process.create_match_method( manager.match_package_installed ), with_stderr=True if package_manager == 'dnf5' else False, ) except Exception as issue: if manager.has_failed(process.returncode()): raise KiwiBootStrapPhaseFailed( self.issue_message.format( headline='Bootstrap package installation failed', reason=f'{issue}: {manager.get_error_details()}', ) ) manager.post_process_install_requests_bootstrap( self.root_bind, self.delta_root ) # process archive installations if bootstrap_archives: try: self._install_archives( bootstrap_archives, bootstrap_archives_target_dirs ) except Exception as issue: raise KiwiBootStrapPhaseFailed( self.issue_message.format( headline='Bootstrap archive installation failed', reason=issue, ) ) def install_system(self, manager: PackageManagerBase) -> None: """ Install system software using the package manager inside of the new root directory. This is done via a chroot operation and requires the desired package manager to became installed via the bootstrap phase :param object manager: instance of a :class:`PackageManager` subclass :raises KiwiInstallPhaseFailed: if the install process fails either installing packages or including any archive """ log.info( 'Installing system (chroot) for build type: %s', self.xml_state.get_build_type_name(), ) collection_type = self.xml_state.get_system_collection_type() log.info('--> collection type: %s', collection_type) system_packages = self.xml_state.get_system_packages() system_collections = self.xml_state.get_system_collections() system_products = self.xml_state.get_system_products() system_archives = self.xml_state.get_system_archives() system_archives_target_dirs = ( self.xml_state.get_system_archives_target_dirs() ) system_packages_ignored = self.xml_state.get_system_ignore_packages() package_manager = self.xml_state.get_package_manager() # process package installations if collection_type == 'onlyRequired': manager.process_only_required() else: manager.process_plus_recommended() all_install_items = self._setup_requests( manager, system_packages, system_collections, system_products, system_packages_ignored, ) if all_install_items: process = CommandProcess( command=manager.process_install_requests(), log_topic='system' ) try: process.poll_show_progress( items_to_complete=all_install_items, match_method=process.create_match_method( manager.match_package_installed ), with_stderr=True if package_manager == 'dnf5' else False, ) except Exception as issue: if manager.has_failed(process.returncode()): raise KiwiInstallPhaseFailed( self.issue_message.format( headline='System package installation failed', reason=issue, ) ) # process archive installations if system_archives: try: self._install_archives( system_archives, system_archives_target_dirs ) except Exception as issue: raise KiwiInstallPhaseFailed( self.issue_message.format( headline='System archive installation failed', reason=issue, ) ) def pinch_system( self, manager: Optional[PackageManagerBase] = None, force: bool = False ) -> None: """ Delete packages marked for deletion in the XML description. If force param is set to False uninstalls packages marked with `type="uninstall"` if any; if force is set to True deletes packages marked with `type="delete"` if any. :param object manager: instance of :class:`PackageManager` subclass :param bool force: Forced deletion True|False :raises KiwiPackagesDeletePhaseFailed: if the deletion packages process fails """ if self.delta_root: # In delta mode create a reference tree to allow # to diff on deleted data Command.run( [ 'rsync', '-a', f'{self.root_dir}_cow/', f'{self.root_dir}_cow_before_pinch', ] ) to_become_deleted_packages = ( self.xml_state.get_to_become_deleted_packages(force) ) if to_become_deleted_packages: log.info( '{0} system packages (chroot)'.format( 'Force deleting' if force else 'Uninstalling' ) ) try: with ExitStack() as stack: if manager is None: package_manager = self.xml_state.get_package_manager() release_version = self.xml_state.get_release_version() repo = Repository.new(self.root_bind, package_manager) stack.push(repo) manager = PackageManager.new( repository=repo, package_manager_name=package_manager, release_version=release_version, ) stack.push(manager) self.delete_packages( manager, to_become_deleted_packages, force ) except Exception as issue: raise KiwiPackagesDeletePhaseFailed( self.issue_message.format( headline='System package deletion failed', reason=issue ) ) def install_packages( self, manager: PackageManagerBase, packages: List ) -> None: """ Install one or more packages using the package manager inside of the new root directory :param object manager: instance of a :class:`PackageManager` subclass :param list packages: package list :raises KiwiSystemInstallPackagesFailed: if installation process fails """ log.info('Installing system packages (chroot)') package_manager = self.xml_state.get_package_manager() all_install_items = self._setup_requests(manager, packages) if all_install_items: process = CommandProcess( command=manager.process_install_requests(), log_topic='system' ) try: process.poll_show_progress( items_to_complete=all_install_items, match_method=process.create_match_method( manager.match_package_installed ), with_stderr=True if package_manager == 'dnf5' else False, ) except Exception as issue: raise KiwiSystemInstallPackagesFailed( self.issue_message.format( headline='Package installation failed', reason=issue ) ) def delete_packages( self, manager: PackageManagerBase, packages: List, force: bool = False ) -> None: """ Delete one or more packages using the package manager inside of the new root directory. If the removal is set with `force` flag only listed packages are deleted and any dependency break or leftover is ignored. :param object manager: instance of a :class:`PackageManager` subclass :param list packages: package list :param bool force: force deletion true|false :raises KiwiSystemDeletePackagesFailed: if installation process fails """ package_manager = self.xml_state.get_package_manager() all_delete_items = self._setup_requests(manager, packages) if all_delete_items: log.info( '{0} system packages (chroot)'.format( 'Force deleting' if force else 'Uninstall' ) ) process = CommandProcess( command=manager.process_delete_requests(force), log_topic='system', ) try: process.poll_show_progress( items_to_complete=all_delete_items, match_method=process.create_match_method( manager.match_package_deleted ), with_stderr=True if package_manager == 'dnf5' else False, ) manager.post_process_delete_requests(self.root_bind) except Exception as issue: raise KiwiSystemDeletePackagesFailed( self.issue_message.format( headline='Package deletion failed', reason=issue ) ) def update_system(self, manager: PackageManagerBase) -> None: """ Install package updates from the used repositories. the process uses the package manager from inside of the new root directory :param object manager: instance of a :class:`PackageManager` subclass :raises KiwiSystemUpdateFailed: if packages update fails """ log.info('Update system (chroot)') process = CommandProcess(command=manager.update(), log_topic='update') try: process.poll() except Exception as issue: raise KiwiSystemUpdateFailed( self.issue_message.format( headline='System update failed', reason=issue ) ) def clean_package_manager_leftovers(self) -> None: """ This methods cleans some package manager artifacts created at run time such as macros """ package_manager = self.xml_state.get_package_manager() release_version = self.xml_state.get_release_version() with Repository.new(self.root_bind, package_manager) as repo: with PackageManager.new( repository=repo, package_manager_name=package_manager, release_version=release_version, ) as manager: manager.clean_leftovers() def setup_ca_certificates(self) -> None: """ Setup custom CA certificates in the chroot environment. This is done by copying the certificate list from get_certificates() to the distribution specific certificate store followed by calling the distribution specific update tool. :raises KiwiBootStrapPhaseFailed: The CA certificates are added immediately after the bootstrap package installation, yet before the system packages are installed, therefore a bootstrap failure is raised if we catch any exception here. """ ca_certs = self.xml_state.get_certificates() if ca_certs: # Determine the correct distro specific update tool and cert store log.info('Updating CA certificate store') target_distribution = ( self.xml_state.get_certificates_target_distribution() ) ca_update_info = Defaults.get_ca_update_map(target_distribution) if ca_update_info: ca_chroot_path = os.path.normpath( os.sep.join( [self.root_dir, ca_update_info['destination_path']] ) ) # sync certificates, we accept no errors on this operation try: Path.create(ca_chroot_path) has_new_certs = False for cert_file in ca_certs: if os.path.exists(cert_file) and not os.path.isdir( cert_file ): log.info( f'--> Syncing: {cert_file} to {ca_chroot_path}' ) DataSync(cert_file, ca_chroot_path).sync_data() has_new_certs = True else: log.warning( f'--> Skipping: {cert_file}: ' 'does not exist or is directory' ) if has_new_certs: ca_tool = ca_update_info['tool'] log.info( f'--> Updating CA certificate store with: {ca_tool}' ) Command.run(['chroot', self.root_dir, ca_tool]) except Exception as issue: raise KiwiBootStrapPhaseFailed( self.issue_message.format( headline='Failed to setup custom CA certificates', reason=issue, ) ) else: log.warning( 'Could not determine CA update tool, skipping setup' ) def _install_archives( self, archive_list: List[str], archive_target_dir_dict: Dict ) -> None: log.info("Installing archives") for archive in archive_list: log.info("--> archive: %s", archive) description_dir = self.xml_state.xml_data.description_dir derived_description_dir = ( self.xml_state.xml_data.derived_description_dir ) archive_is_absolute = archive.startswith('/') if archive_is_absolute: archive_file = archive else: archive_file = '/'.join([description_dir, archive]) archive_exists = os.path.exists(archive_file) if ( not archive_is_absolute and not archive_exists and derived_description_dir ): archive_file = '/'.join([derived_description_dir, archive]) target_dir = self.root_bind.root_dir if archive_target_dir_dict.get(archive): target_dir = os.path.normpath( os.sep.join([target_dir, archive_target_dir_dict[archive]]) ) log.info('--> target dir: %s', target_dir) tar = ArchiveTar(archive_file) tar.extract(target_dir) def _setup_requests( self, manager: PackageManagerBase, packages: List[str], collections: Optional[List[str]] = None, products: Optional[List[str]] = None, ignored: Optional[List[str]] = None, ) -> List[str]: if packages: for package in sorted(packages): log.info('--> package: {0}'.format(package)) manager.request_package(package) if collections: for collection in sorted(collections): log.info('--> collection: {0}'.format(collection)) manager.request_collection(collection) if products: for product in sorted(products): log.info('--> product: {0}'.format(product)) manager.request_product(product) if ignored: for package in sorted(ignored): log.info('--> package excluded: {0}'.format(package)) manager.request_package_exclusion(package) return ( manager.package_requests + manager.collection_requests + manager.product_requests + manager.exclude_requests ) def _get_repo_customization_script(self, xml_repo: repository) -> str: script_path = xml_repo.get_customize() if script_path and not os.path.isabs(script_path): script_path = os.path.join( self.xml_state.xml_data.description_dir, script_path ) return script_path def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: if hasattr(self, 'root_bind'): self.root_bind.cleanup() if self.root_import: self.root_import.overlay_finalize(self.xml_state) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7512066 kiwi-11.1.8/kiwi/system/profile.py0000644000000000000000000004246015273675667014032 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging import collections from typing import Dict, List, Optional, Union # project from kiwi.runtime_config import RuntimeConfig from kiwi.utils.temporary import Temporary from kiwi.xml_state import XMLState from kiwi.system.shell import Shell from kiwi.defaults import Defaults log = logging.getLogger('kiwi') class Profile: """ **Create bash readable .profile environment from the XML description** :param object xml_state: instance of :class`XMLState` """ def __init__(self, xml_state: XMLState): self.xml_state = xml_state self.dot_profile: Dict = {} self._image_names_to_profile() self._profile_names_to_profile() self._packages_marked_for_deletion_to_profile() self._type_to_profile() self._type_complex_to_profile() self._preferences_to_profile() self._systemdisk_to_profile() self._strip_to_profile() self._oemconfig_to_profile() self._drivers_to_profile() self._root_partition_uuid_to_profile() self._runtime_settings_to_profile() def get_settings(self) -> Dict: """ Return all profile elements that has a value """ profile = {} for key, value in list(self.dot_profile.items()): profile[key] = Shell.format_to_variable_value(value) return collections.OrderedDict(sorted(profile.items())) def add(self, key: str, value: Optional[Union[str, int, bool]]) -> None: """ Add key/value pair to profile dictionary :param str key: profile key :param str value: profile value """ self.dot_profile[key] = value def delete(self, key: str) -> None: if key in self.dot_profile: del self.dot_profile[key] def create(self, filename: str) -> None: """ Create bash quoted profile :param str filename: file path name """ sorted_profile = self.get_settings() temp_profile = Temporary().new_file() with open(temp_profile.name, 'w') as profile: for key, value in list(sorted_profile.items()): profile.write('{0}={1}{2}'.format(key, value, os.linesep)) profile_environment = Shell.quote_key_value_file(temp_profile.name) with open(filename, 'w') as profile: for line in profile_environment: profile.write(line + os.linesep) log.debug('--> {0}'.format(line)) def _oemconfig_to_profile(self) -> None: # kiwi_oemvmcp_parmfile # kiwi_oemmultipath_scan # kiwi_oemswapMB # kiwi_oemrootMB # kiwi_oemresizeonce # kiwi_oempartition_install # kiwi_oemdevicefilter # kiwi_oemtitle # kiwi_oemkboot # kiwi_oemnicfilter # kiwi_oemreboot # kiwi_oemrebootinteractive # kiwi_oemshutdown # kiwi_oemshutdowninteractive # kiwi_oemsilentboot # kiwi_oemsilentinstall # kiwi_oemsilentverify # kiwi_oemskipverify # kiwi_oembootwait # kiwi_oemunattended # kiwi_oemunattended_id # kiwi_oemrecovery # kiwi_oemrecoveryID # kiwi_oemrecoveryPartSize # kiwi_oemrecoveryInPlace oemconfig = self.xml_state.get_build_type_oemconfig_section() if oemconfig: self.dot_profile['kiwi_oemvmcp_parmfile'] = self._text( oemconfig.get_oem_vmcp_parmfile() ) self.dot_profile['kiwi_oemmultipath_scan'] = self._text( oemconfig.get_oem_multipath_scan() ) self.dot_profile['kiwi_oemswapMB'] = self._text( oemconfig.get_oem_swapsize() ) self.dot_profile['kiwi_oemrootMB'] = self._text( oemconfig.get_oem_systemsize() ) self.dot_profile['kiwi_oemresizeonce'] = self._text( oemconfig.get_oem_resize_once() ) self.dot_profile['kiwi_oempartition_install'] = self._text( oemconfig.get_oem_partition_install() ) self.dot_profile['kiwi_oemramdisksize'] = self._text( oemconfig.get_oem_ramdisk_size() ) self.dot_profile['kiwi_oemdevicefilter'] = self._text( oemconfig.get_oem_device_filter() ) self.dot_profile['kiwi_oemtitle'] = self._text( oemconfig.get_oem_boot_title() ) self.dot_profile['kiwi_oemkboot'] = self._text( oemconfig.get_oem_kiwi_initrd() ) self.dot_profile['kiwi_oemnicfilter'] = self._text( oemconfig.get_oem_nic_filter() ) self.dot_profile['kiwi_oemreboot'] = self._text( oemconfig.get_oem_reboot() ) self.dot_profile['kiwi_oemrebootinteractive'] = self._text( oemconfig.get_oem_reboot_interactive() ) self.dot_profile['kiwi_oemshutdown'] = self._text( oemconfig.get_oem_shutdown() ) self.dot_profile['kiwi_oemshutdowninteractive'] = self._text( oemconfig.get_oem_shutdown_interactive() ) self.dot_profile['kiwi_oemsilentboot'] = self._text( oemconfig.get_oem_silent_boot() ) self.dot_profile['kiwi_oemsilentinstall'] = self._text( oemconfig.get_oem_silent_install() ) self.dot_profile['kiwi_oemsilentverify'] = self._text( oemconfig.get_oem_silent_verify() ) self.dot_profile['kiwi_oemskipverify'] = self._text( oemconfig.get_oem_skip_verify() ) self.dot_profile['kiwi_oembootwait'] = self._text( oemconfig.get_oem_bootwait() ) self.dot_profile['kiwi_oemunattended'] = self._text( oemconfig.get_oem_unattended() ) self.dot_profile['kiwi_oemunattended_id'] = self._text( oemconfig.get_oem_unattended_id() ) self.dot_profile['kiwi_oemrecovery'] = self._text( oemconfig.get_oem_recovery() ) self.dot_profile['kiwi_oemrecoveryID'] = self._text( oemconfig.get_oem_recoveryID() ) self.dot_profile['kiwi_oemrecoveryPartSize'] = self._text( oemconfig.get_oem_recovery_part_size() ) self.dot_profile['kiwi_oemrecoveryInPlace'] = self._text( oemconfig.get_oem_inplace_recovery() ) def _drivers_to_profile(self) -> None: # kiwi_drivers self.dot_profile['kiwi_drivers'] = ','.join( self.xml_state.get_drivers_list() ) def _type_complex_to_profile(self) -> None: # kiwi_xendomain # kiwi_install_volid if self.xml_state.is_xen_server(): self.dot_profile['kiwi_xendomain'] = 'dom0' if self.xml_state.get_build_type_name() == 'oem': install_volid = ( self.xml_state.build_type.get_volid() or Defaults.get_install_volume_id() ) self.dot_profile['kiwi_install_volid'] = install_volid if self.xml_state.get_build_type_name() == 'iso': live_iso_volid = ( self.xml_state.build_type.get_volid() or Defaults.get_volume_id() ) self.dot_profile['kiwi_live_volid'] = live_iso_volid def _strip_to_profile(self) -> None: # kiwi_strip_delete # kiwi_strip_tools # kiwi_strip_libs self.dot_profile['kiwi_strip_delete'] = ' '.join( self.xml_state.get_strip_files_to_delete() ) self.dot_profile['kiwi_strip_tools'] = ' '.join( self.xml_state.get_strip_tools_to_keep() ) self.dot_profile['kiwi_strip_libs'] = ' '.join( self.xml_state.get_strip_libraries_to_keep() ) def _systemdisk_to_profile(self) -> None: # kiwi_lvmgroup # kiwi_lvm # kiwi_Volume_X systemdisk = self.xml_state.get_build_type_system_disk_section() if systemdisk: volume_manager_name = self.xml_state.get_volume_management() if volume_manager_name == 'lvm': self.dot_profile['kiwi_lvm'] = 'true' self.dot_profile['kiwi_lvmgroup'] = systemdisk.get_name() if not self.dot_profile['kiwi_lvmgroup']: self.dot_profile['kiwi_lvmgroup'] = ( Defaults.get_default_volume_group_name() ) volume_count = 1 for volume in self.xml_state.get_volumes(): if volume.is_root_volume: volume_id_name = 'kiwi_Volume_Root' else: volume_id_name = 'kiwi_Volume_{id}'.format(id=volume_count) volume_count += 1 self.dot_profile[volume_id_name] = '|'.join( [ volume.name, 'size:all' if volume.fullsize else volume.size, volume.mountpoint or '', ] ) def _preferences_to_profile(self) -> None: # kiwi_iversion # kiwi_showlicense # kiwi_keytable # kiwi_timezone # kiwi_language # kiwi_splash_theme # kiwi_loader_theme for preferences in reversed(self.xml_state.get_preferences_sections()): if ( 'kiwi_iversion' not in self.dot_profile and preferences.get_version() ): self.dot_profile['kiwi_iversion'] = self._text( preferences.get_version() ) if 'kiwi_showlicense' not in self.dot_profile: self.dot_profile['kiwi_showlicense'] = self._text( preferences.get_showlicense() ) if ( 'kiwi_keytable' not in self.dot_profile and preferences.get_keytable() ): self.dot_profile['kiwi_keytable'] = self._text( preferences.get_keytable() ) if ( 'kiwi_timezone' not in self.dot_profile and preferences.get_timezone() ): self.dot_profile['kiwi_timezone'] = self._text( preferences.get_timezone() ) if ( 'kiwi_language' not in self.dot_profile and preferences.get_locale() ): self.dot_profile['kiwi_language'] = self._text( preferences.get_locale() ) if ( 'kiwi_splash_theme' not in self.dot_profile and preferences.get_bootsplash_theme() ): self.dot_profile['kiwi_splash_theme'] = self._text( preferences.get_bootsplash_theme() ) if ( 'kiwi_loader_theme' not in self.dot_profile and preferences.get_bootloader_theme() ): self.dot_profile['kiwi_loader_theme'] = self._text( preferences.get_bootloader_theme() ) def _type_to_profile(self) -> None: # kiwi_type # kiwi_compressed # kiwi_boot_timeout # kiwi_wwid_wait_timeout # kiwi_hybrid # kiwi_hybridpersistent # kiwi_hybridpersistent_filesystem # kiwi_initrd_system # kiwi_ramonly # kiwi_target_blocksize # kiwi_target_removable # kiwi_cmdline # kiwi_firmware # kiwi_bootloader # kiwi_bootloader_console # kiwi_devicepersistency # kiwi_installboot # kiwi_bootkernel # kiwi_fsmountoptions # kiwi_bootprofile # kiwi_vga # kiwi_btrfs_root_is_snapper_snapshot # kiwi_startsector type_section = self.xml_state.build_type self.dot_profile['kiwi_type'] = type_section.get_image() self.dot_profile['kiwi_compressed'] = type_section.get_compressed() self.dot_profile['kiwi_boot_timeout'] = ( self.xml_state.get_build_type_bootloader_timeout() ) self.dot_profile['kiwi_wwid_wait_timeout'] = ( type_section.get_wwid_wait_timeout() ) self.dot_profile['kiwi_hybridpersistent'] = ( type_section.get_hybridpersistent() ) self.dot_profile['kiwi_hybridpersistent_filesystem'] = ( type_section.get_hybridpersistent_filesystem() ) self.dot_profile['kiwi_initrd_system'] = ( self.xml_state.get_initrd_system() ) self.dot_profile['kiwi_ramonly'] = type_section.get_ramonly() self.dot_profile['kiwi_target_blocksize'] = ( type_section.get_target_blocksize() or '512' ) self.dot_profile['kiwi_target_removable'] = ( type_section.get_target_removable() ) self.dot_profile['kiwi_cmdline'] = type_section.get_kernelcmdline() self.dot_profile['kiwi_firmware'] = type_section.get_firmware() self.dot_profile['kiwi_bootloader'] = ( self.xml_state.get_build_type_bootloader_name() ) self.dot_profile['kiwi_bootloader_console'] = "{}:{}".format( self.xml_state.get_build_type_bootloader_console()[0] or 'default', self.xml_state.get_build_type_bootloader_console()[1] or 'default', ) self.dot_profile['kiwi_btrfs_root_is_snapshot'] = ( type_section.get_btrfs_root_is_snapper_snapshot() ) self.dot_profile['kiwi_btrfs_root_is_snapper_snapshot'] = ( type_section.get_btrfs_root_is_snapper_snapshot() ) self.dot_profile['kiwi_gpt_hybrid_mbr'] = ( type_section.get_gpt_hybrid_mbr() ) self.dot_profile['kiwi_devicepersistency'] = ( type_section.get_devicepersistency() ) self.dot_profile['kiwi_installboot'] = type_section.get_installboot() self.dot_profile['kiwi_bootkernel'] = type_section.get_bootkernel() self.dot_profile['kiwi_fsmountoptions'] = ( type_section.get_fsmountoptions() ) self.dot_profile['kiwi_bootprofile'] = type_section.get_bootprofile() self.dot_profile['kiwi_vga'] = ( self.xml_state.get_build_type_bootloader_video_mode() ) self.dot_profile['kiwi_startsector'] = ( self.xml_state.get_disk_start_sector() ) self.dot_profile['kiwi_luks_empty_passphrase'] = ( self.xml_state.get_luks_credentials() == '' ) def _runtime_settings_to_profile(self) -> None: # kiwi_shasum_suffix temp_file = Temporary().new_file() runtime_config = RuntimeConfig() self.dot_profile['kiwi_shasum_suffix'] = ( runtime_config.get_checksum_handler(temp_file.name).suffix ) def _profile_names_to_profile(self) -> None: # kiwi_profiles self.dot_profile['kiwi_profiles'] = ','.join(self.xml_state.profiles) def _packages_marked_for_deletion_to_profile(self) -> None: # kiwi_delete self.dot_profile['kiwi_delete'] = ' '.join( self.xml_state.get_to_become_deleted_packages() ) def _image_names_to_profile(self) -> None: # kiwi_displayname # kiwi_cpio_name # kiwi_iname self.dot_profile['kiwi_iname'] = self.xml_state.xml_data.get_name() self.dot_profile['kiwi_displayname'] = ( self.xml_state.xml_data.get_displayname() ) if not self.dot_profile['kiwi_displayname']: self.dot_profile['kiwi_displayname'] = self.dot_profile[ 'kiwi_iname' ] if self.xml_state.get_build_type_name() == 'cpio': self.dot_profile['kiwi_cpio_name'] = self.dot_profile['kiwi_iname'] def _root_partition_uuid_to_profile(self) -> None: # kiwi_rootpartuuid self.dot_profile['kiwi_rootpartuuid'] = ( self.xml_state.get_root_partition_uuid() ) def _text( self, section_content: List[Union[str, int, bool]] ) -> Optional[Union[str, int, bool]]: """ Helper method to return the text for XML elements of the following structure:
text
. The data structure builder will return the text as a list """ if section_content: content = section_content[0] if content is True: return 'true' else: return content return None ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7512066 kiwi-11.1.8/kiwi/system/result.py0000644000000000000000000002124115273675667013702 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging import simplejson import pickle import os from typing import Dict, NamedTuple, Any, Optional # project from kiwi.xml_state import XMLState from kiwi.exceptions import KiwiResultError log = logging.getLogger('kiwi') # must be global to allow pickle to find it result_file_type = NamedTuple( 'result_file_type', [ ('filename', str), ('use_for_bundle', bool), ('compress', bool), ('shasum', bool), ], ) result_name_tags = NamedTuple( 'result_name_tags', [ ('N', str), # image name ('P', str), # concatenated profile name (_) ('A', str), # architecture name ('I', str), # custom ID setting ('T', str), # image type name ('M', str), # Major version number ('m', str), # Minor version number ('p', str), # Patch version number ('v', str), # Version string ], ) class Result: """ **Collect image building results** :param dict result_files: dict of result files :param object class_version: :class:`Result` class version :param object xml_state: instance of :class:`XMLState` """ def __init__(self, xml_state: XMLState): self.result_files: Dict[str, Any] = {} # Instances of this class are stored as result reference. # In order to handle class format changes any instance # provides a version information self.class_version: int = 1 self.xml_state = xml_state def add_bundle_format(self, pattern: str) -> None: version_string = self.xml_state.get_image_version() if '.' in version_string: major, minor, patch = version_string.split(sep='.', maxsplit=2) else: major, minor, patch = (version_string, '', '') self.name_tags = result_name_tags( N=self.xml_state.xml_data.get_name(), P=( '_'.join(self.xml_state.profiles) if self.xml_state.profiles else '' ), A=self.xml_state.host_architecture, I='', T=self.xml_state.get_build_type_name(), M=major, m=minor, p=patch, v=version_string, ) self.result_files['bundle_format'] = { 'pattern': pattern, 'tags': self.name_tags, } def get_name_for_pattern(self, command_args: Dict[str, str] = {}) -> str: bundle_format = self.result_files.get('bundle_format') bundle_file_format_name = '' if bundle_format: tags = bundle_format['tags'] bundle_file_format_name = bundle_format['pattern'] # Insert image name bundle_file_format_name = bundle_file_format_name.replace( '%N', tags.N ) # Insert Concatenated profile name (_) bundle_file_format_name = bundle_file_format_name.replace( '%P', tags.P ) # Insert Architecture name bundle_file_format_name = bundle_file_format_name.replace( '%A', tags.A ) # Insert Image build type name bundle_file_format_name = bundle_file_format_name.replace( '%T', tags.T ) # Insert Image Major version number bundle_file_format_name = bundle_file_format_name.replace( '%M', format(tags.M) ) # Insert Image Minor version number bundle_file_format_name = bundle_file_format_name.replace( '%m', format(tags.m) ) # Insert Image Patch version number bundle_file_format_name = bundle_file_format_name.replace( '%p', format(tags.p) ) # Insert Version string bundle_file_format_name = bundle_file_format_name.replace( '%v', format(tags.v) ) # Insert Bundle ID if command_args.get('--id'): bundle_file_format_name = bundle_file_format_name.replace( '%I', command_args['--id'] ) return bundle_file_format_name def add( self, key: str, filename: str, use_for_bundle: bool = True, compress: bool = False, shasum: bool = True, ) -> None: """ Add result tuple to result_files list :param str key: name :param str filename: file path name :param bool use_for_bundle: use when bundling results true|false :param bool compress: compress when bundling true|false :param bool shasum: create shasum when bundling true|false """ if key and filename: self.result_files[key] = result_file_type( filename=filename, use_for_bundle=use_for_bundle, compress=compress, shasum=shasum, ) def get_results(self) -> Dict[str, result_file_type]: """ Current list of result tuples """ return self.result_files def print_results(self) -> None: """ Print results human readable """ if self.result_files: log.info('Result files:') for key, value in sorted(list(self.result_files.items())): if key == 'bundle_format': log.info('--> {0}: {1}'.format(key, value.get('pattern'))) else: log.info('--> {0}: {1}'.format(key, value.filename)) def dump(self, filename: str, portable: bool = True) -> None: """ Picke dump this instance to a file :param str filename: file path name :param bool portable: If set to true also create a .json formatted variant of the dump file which contains the elements of this instance that could be expressed in a portable json document. Default is set to: True :raises KiwiResultError: if pickle fails to dump :class:`Result` instance """ try: with open(filename, 'wb') as result: pickle.dump(self, result) if portable: with open(filename + '.json', 'w') as result_portable: result_portable.write( simplejson.dumps( self.result_files, sort_keys=True, indent=4 ) + os.linesep ) except Exception as e: raise KiwiResultError(f'Failed to pickle dump results: {format(e)}') @staticmethod def load(filename: str) -> 'Result': """ Load pickle dumped filename into a Result instance :param str filename: file path name :raises KiwiResultError: if filename does not exist or pickle fails to load filename """ if not os.path.exists(filename): raise KiwiResultError(f'No result information {filename} found') try: with open(filename, 'rb') as result: return pickle.load(result) except Exception as e: raise KiwiResultError( f'Failed to pickle load results: {type(e).__name__}' ) @staticmethod def verify_image_size(size_limit: Optional[int], filename: str) -> None: """ Verifies the given image file does not exceed the size limit. Throws an exception if the limit is exceeded. If the size limit is set to None no verification is done. :param int size_limit: The size limit for filename in bytes. :param str filename: File to verify. :raises KiwiResultError: if filename exceeds the size limit """ if size_limit is not None: if os.path.getsize(filename) > size_limit: raise KiwiResultError( 'Build constraint failed: {0} is bigger than {1}'.format( filename, size_limit ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7512066 kiwi-11.1.8/kiwi/system/root_bind.py0000644000000000000000000003364115273675667014352 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging import shutil import textwrap from typing import List, Optional # project from kiwi.runtime_config import RuntimeConfig from kiwi.command import Command from kiwi.defaults import Defaults from kiwi.path import Path from kiwi.mount_manager import MountManager from kiwi.utils.checksum import Checksum from kiwi.system.root_init import RootInit from kiwi.exceptions import ( KiwiMountKernelFileSystemsError, KiwiMountSharedDirectoryError, KiwiSetupIntermediateConfigError, ) log = logging.getLogger('kiwi') class RootBind: """ **Implements binding/copying of host system paths into the new root directory** :param str root_dir: root directory path name :param list cleanup_files: list of files to cleanup, delete :param list mount_stack: list of mounted directories for cleanup :param list dir_stack: list of directories for cleanup :param list config_files: list of initial config files :param list bind_locations: list of kernel filesystems to bind mount :param str shared_location: shared directory between image root and build system root """ def __init__(self, root_init: RootInit): self.runtime_config = RuntimeConfig() self.root_dir = root_init.root_dir self.cleanup_files: List[str] = [] self.mount_stack: List[MountManager] = [] self.dir_stack: List[str] = [] # need resolv.conf/hosts for chroot name resolution # need /etc/sysconfig/proxy for chroot proxy usage self.config_files = [ '/etc/resolv.conf', '/etc/hosts', '/etc/sysconfig/proxy', ] # need kernel filesystems bind mounted self.bind_locations = [ '/proc', '/dev', '/var/run/dbus', '/sys', '/sys/fs/cgroup', ] # share the following directory with the host self.shared_location = '/' + Defaults.get_shared_cache_location() def mount_kernel_file_systems(self, delta_root: bool = False) -> None: """ Bind mount kernel filesystems :raises KiwiMountKernelFileSystemsError: if some kernel filesystem fails to mount """ try: if not delta_root: # Yes this bind mount to yourself looks weird and should not # be needed at all. The reason why it exists is to overcome # an issue that appears if you run containers in kiwi scripts # via e.g podman or docker. There is some information about the # topic here: https://github.com/moby/moby/issues/34817 shared_mount = MountManager( device=self.root_dir, mountpoint=self.root_dir ) shared_mount.bind_mount() self.mount_stack.append(shared_mount) for location in self.bind_locations: location_mount_target = os.path.normpath( os.sep.join([self.root_dir, location]) ) if os.path.exists(location) and os.path.exists( location_mount_target ): shared_mount = MountManager( device=location, mountpoint=location_mount_target ) shared_mount.bind_mount() self.mount_stack.append(shared_mount) except Exception as e: self.cleanup() raise KiwiMountKernelFileSystemsError( f'{type(e).__name__}: {format(e)}' ) def umount_kernel_file_systems(self) -> None: """ Umount kernel filesystems :raises KiwiMountKernelFileSystemsError: if some kernel filesystem fails to mount """ umounts = [ mnt for mnt in self.mount_stack if mnt.device in self.bind_locations ] self._cleanup_mounts(umounts) def mount_shared_directory(self, host_dir: Optional[str] = None) -> None: """ Bind mount shared location The shared location is a directory which shares data from the image buildsystem host with the image root system. It is used for the repository setup and the package manager cache to allow chroot operations without being forced to duplicate this data :param str host_dir: directory to share between image root and build system root :raises KiwiMountSharedDirectoryError: if mount fails """ if host_dir is None: host_dir = self.shared_location try: Path.create(self.root_dir + host_dir) Path.create('/' + host_dir) shared_mount = MountManager( device=host_dir, mountpoint=self.root_dir + host_dir ) shared_mount.bind_mount() self.mount_stack.append(shared_mount) self.dir_stack.append(host_dir) except Exception as e: self.cleanup() raise KiwiMountSharedDirectoryError( f'{type(e).__name__}: {format(e)}' ) def setup_intermediate_config(self) -> None: """ Create intermediate config files Some config files e.g etc/hosts needs to be temporarly copied from the buildsystem host to the image root system in order to allow e.g DNS resolution in the way as it is configured on the buildsystem host. These config files only exists during the image build process and are not part of the final image :raises KiwiSetupIntermediateConfigError: if the management of intermediate configuration files fails """ try: for config in self.config_files: if os.path.exists(config): Command.run( ['cp', config, self.root_dir + config + '.kiwi'] ) self._link_intermediate_config(config) except Exception as e: self.cleanup() raise KiwiSetupIntermediateConfigError( f'{type(e).__name__}: {format(e)}' ) def add_intermediate_config(self, config: str, data: str) -> None: """ Create intermediate config file from the given data In contrast to setup_intermediate_config the config file content is not copied from the buildsystem host but provided by the caller, e.g. a config file generated from the host environment. The file has the same lifecycle as the intermediate config files copied from the host :param str config: config file path, relative to the image root :param str data: config file content :raises KiwiSetupIntermediateConfigError: if the management of the intermediate configuration file fails """ try: config_file = self.root_dir + config + '.kiwi' Path.create(os.path.dirname(config_file)) with open(config_file, 'w') as intermediate: intermediate.write(data) self._link_intermediate_config(config) if config not in self.config_files: self.config_files.append(config) except Exception as e: raise KiwiSetupIntermediateConfigError( f'{type(e).__name__}: {format(e)}' ) def _link_intermediate_config(self, config: str) -> None: config_file = self.root_dir + config + '.kiwi' self.cleanup_files.append(config + '.kiwi') link_target = os.path.basename(config) + '.kiwi' Command.run(['ln', '-s', '-f', link_target, self.root_dir + config]) shasum = self.runtime_config.get_checksum_handler( source_filename=config_file ) with open(f'{self.root_dir}{config}.sha', 'w') as sha_file: sha_file.write(shasum.digest()) def cleanup(self) -> None: """ Cleanup mounted locations, directories and intermediate config files """ self._cleanup_mount_stack() self._cleanup_dir_stack() self._cleanup_intermediate_config() def _cleanup_intermediate_config(self) -> None: # delete kiwi copied config files config_files_to_delete = [] for config in self.cleanup_files: config_file = self.root_dir + config sha_file = config_file.replace('.kiwi', '.sha') config_files_to_delete.append(config_file) config_files_to_delete.append(sha_file) shasum = self.runtime_config.get_checksum_handler( source_filename=config_file ) checksum = Checksum(config_file) if not checksum.matches(shasum.digest(), sha_file): message = textwrap.dedent( '''\n Modifications to intermediate config file detected The file: {0} is a copy from the host system and symlinked to its origin in the image root during build time. Modifications to this file by e.g script code will not have any effect because the file gets restored by one of the following actions: 1. A package during installation provides it 2. A custom version of the file is setup as overlay file 3. The file is not provided by install or overlay and will be deleted at the end of the build process If you need a custom version of that file please provide it as an overlay file in your image description ''' ) log.warning(message.format(config_file)) del self.cleanup_files[:] # delete stale symlinks if there are any. normally the package # installation process should have replaced the symlinks with # real files from the packages. On deletion check for the # presence of a config file template and restore it try: for config in self.config_files: config_file = self.root_dir + config if os.path.islink(config_file): Command.run(['rm', '-f', config_file]) self._restore_config_template(config_file) Command.run(['rm', '-f'] + config_files_to_delete) except Exception as issue: log.warning( 'Failed to cleanup intermediate config files: {0}'.format(issue) ) self._restore_intermediate_config_rpmnew_variants() def _restore_config_template(self, config_file: str) -> None: """ Systems that use configuration templates and a tool to manage them might have skipped their call due to the presence of intermediate host config files in the new root tree. In this case if no custom file was provided the template file is used to restore the system standard configuration file """ template_map = { self.root_dir + '/etc/sysconfig/proxy': 'sysconfig.proxy' } template_dirs = [ self.root_dir + '/var/adm/fillup-templates', self.root_dir + '/usr/share/fillup-templates', ] if template_map.get(config_file): for template_dir in template_dirs: template_file = os.sep.join( [template_dir, template_map[config_file]] ) if os.path.exists(template_file): Command.run(['cp', template_file, config_file]) def _restore_intermediate_config_rpmnew_variants(self) -> None: """ check for rpmnew variants of the config files. if the package installed an rpmnew variant of the config file it needs to be moved to the original file name """ for config in self.config_files: config_rpm_new = self.root_dir + config + '.rpmnew' if os.path.exists(config_rpm_new) and not os.path.exists( self.root_dir + config ): shutil.move(config_rpm_new, self.root_dir + config) def _cleanup_mounts(self, umounts: List[MountManager]) -> None: for umount in reversed(umounts): if umount.is_mounted(): try: umount.umount_lazy() self.mount_stack.remove(umount) except Exception as e: log.warning( 'Image root directory %s not cleanly umounted: %s', self.root_dir, format(e), ) else: log.warning('Path %s not a mountpoint', umount.mountpoint) def _cleanup_mount_stack(self) -> None: self._cleanup_mounts(self.mount_stack) del self.mount_stack[:] def _cleanup_dir_stack(self) -> None: for location in reversed(self.dir_stack): try: Path.remove_hierarchy(root=self.root_dir, path=location) except Exception as e: log.warning( 'Failed to remove directory hierarchy {0}: {1}'.format( self.root_dir + location, e ) ) del self.dir_stack[:] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7512066 kiwi-11.1.8/kiwi/system/root_import/__init__.py0000644000000000000000000000516115273675667016503 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging import importlib from typing import TYPE_CHECKING, Any, List from abc import ABCMeta, abstractmethod # project from kiwi.system.uri import Uri from kiwi.exceptions import KiwiRootImportError if TYPE_CHECKING: # pragma: nocover from kiwi.system.root_import.base import RootImportBase log = logging.getLogger('kiwi') class RootImport(metaclass=ABCMeta): """ Root import factory Attibutes * :attr:`root_dir` root directory path name * :attr:`image_uri` an instance of :class:`Uri` to an image containing a the root system * :attr:`image_type` type of the image to import """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( root_dir: str, image_uri: List[Uri], image_type: str ) -> 'RootImportBase': name_map = {'docker': 'OCI', 'oci': 'OCI'} log.info('Importing root from a {0} image type'.format(image_type)) custom_args, module_namespace = RootImport._custom_args_for_root_import( image_type ) try: rootimport = importlib.import_module( 'kiwi.system.root_import.{0}'.format(module_namespace) ) module_name = 'RootImport{0}'.format(name_map[module_namespace]) return rootimport.__dict__[module_name]( root_dir, image_uri, custom_args ) except Exception as issue: raise KiwiRootImportError( 'Support to import {0} images not implemented: {1}'.format( image_type, issue ) ) @staticmethod def _custom_args_for_root_import(image_type: str) -> List[Any]: if image_type == 'docker': custom_args = {'archive_transport': 'docker-archive'} else: custom_args = {'archive_transport': 'oci-archive'} return [custom_args, 'oci'] ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.751661 kiwi-11.1.8/kiwi/system/root_import/base.py0000644000000000000000000001551515273675667015662 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging import pathlib from typing import Dict, List, Optional # project from kiwi.runtime_config import RuntimeConfig from kiwi.xml_state import XMLState from kiwi.defaults import Defaults from kiwi.system.setup import SystemSetup from kiwi.path import Path from kiwi.system.uri import Uri from kiwi.command import Command from kiwi.mount_manager import MountManager from kiwi.exceptions import KiwiRootImportError, KiwiUriTypeUnknown log = logging.getLogger('kiwi') class RootImportBase: """ Imports the root system from an already packed image. * :attr:`root_dir` root directory path name * :attr:`image_uris` Uri object(s) to store source location(s) * :attr:`custom_args` Dictonary to set specialized class specific configuration values """ def __init__( self, root_dir: str, image_uris: List[Uri], custom_args: Dict[str, str] = {}, ): self.runtime_config = RuntimeConfig() self.raw_urls: List[str] = [] self.image_files: List[str] = [] self.overlay: Optional[MountManager] = None self.root_dir = root_dir for image_uri in image_uris: try: if image_uri.is_remote(): raise KiwiRootImportError( 'Only local imports are supported' ) image_file = image_uri.translate() self.image_files.append(image_file) if not os.path.exists(image_file): raise KiwiRootImportError( f'Could not stat base image file: {image_file}' ) except KiwiUriTypeUnknown: # Let specialized class handle unknown uri schemes raw_url = image_uri.uri log.warning(f'Unkown URI type for the base image: {raw_url}') self.raw_urls.append(raw_url) self.post_init(custom_args) def post_init(self, custom_args: Dict[str, str]) -> None: """ Initialization of the specialized import class Implementation in specialized root import class """ pass def overlay_finalize(self, xml_state: XMLState) -> None: """ Umount the overlay root, delete lower and work directories and move the upper (delta) to represent the final root_dir. All files that got deleted will be reported in a metadata file named Defaults.get_removed_files_name(). This information can be used by other tools to know about actively deleted files and bring them back at a later point in time. :param XMLState xml_state: Instance of XML state """ if self.overlay: pinch_reference = f'{self.root_dir}_cow_before_pinch' removed = f'{self.root_dir}/{Defaults.get_removed_files_name()}' systemfiles = f'{self.root_dir}/{Defaults.get_system_files_name()}' system = SystemSetup(xml_state, self.root_dir) # Run config-overlay.sh system.call_config_overlay_script() # Run config-host-overlay.sh system.call_config_host_overlay_script( working_directory=self.root_dir ) # Include system files if requested if xml_state.build_type.get_require_system_files(): with open(systemfiles, 'a') as systemfiles_fd: # copy on write makes this file to become part of the delta systemfiles_fd.write(os.linesep) # Umount and rename upper to be the new root self.overlay.umount() Path.wipe(self.root_dir) log.debug("renaming %s -> %s", self.overlay.upper, self.root_dir) pathlib.Path(self.overlay.upper).replace(self.root_dir) # Create removed files metadata if not os.path.isdir(pinch_reference): Path.create(pinch_reference) exclude_options = [] removed_files = [] for item in Defaults.get_exclude_list_for_removed_files_detection(): exclude_options.append('--exclude') exclude_options.append(item) get_removed = ( ['rsync', '-av', '--dry-run', '--out-format=%n'] + exclude_options + [f'{pinch_reference}/', f'{self.root_dir}/'] ) for item in Command.run(get_removed).output.split(os.linesep): entry = f'{pinch_reference}/{item}' if item and os.path.exists(entry) and not os.path.isdir(entry): removed_files.append(item) Path.wipe(pinch_reference) if removed_files: with open(removed, 'w') as removed_fd: for filename in removed_files: removed_fd.write(filename) removed_fd.write(os.linesep) # delete character device nodes from delta tree. # (c) device nodes are used to track deleted files # and directories from the lower path of the overlayfs # tree. Since we extract the upper path of the overlay # any changes to the lower tree cannot be tracked. Command.run(['find', self.root_dir, '-type', 'c', '-delete']) Path.wipe(self.overlay.lower) Path.wipe(self.overlay.work) def overlay_data(self) -> None: """ Synchronize data from the given base image to the target root directory as an overlayfs mounted target. Implementation in specialized root import class """ raise NotImplementedError def sync_data(self) -> None: """ Synchronizes the root system of `image_file` into the root_dir Implementation in specialized root import class """ raise NotImplementedError def _make_checksum(self, image: str) -> None: shasum = self.runtime_config.get_checksum_handler( source_filename=image, target_filename='{}{}'.format( image, self.runtime_config.get_checksum_handler(image).suffix ), ) shasum.digest() ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.751661 kiwi-11.1.8/kiwi/system/root_import/oci.py0000644000000000000000000000770615273675667015525 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging import pathlib from typing import Dict, List # project from kiwi.system.root_import.base import RootImportBase from kiwi.mount_manager import MountManager from kiwi.path import Path from kiwi.defaults import Defaults from kiwi.utils.compress import Compress from kiwi.oci_tools import OCI log = logging.getLogger('kiwi') class RootImportOCI(RootImportBase): """ Implements the base class for importing a root system from a oci image tarball file. """ def post_init(self, custom_args: Dict[str, str]) -> None: self.archive_transport = custom_args['archive_transport'] self.compressed_image_files: List[Compress] = [] def sync_data(self) -> None: """ Synchronize data from the given base image to the target root directory. """ for image_url in self._get_image_urls(): with OCI.new() as oci: oci.import_container_image(image_url) oci.unpack() oci.import_rootfs(self.root_dir) # A copy of the uncompressed image(all derived imports) and # its checksum are kept inside the root_dir in order to ensure # the later steps i.e. system create are atomic and don't need # any third party archive. image_copy = Defaults.get_imported_root_image(self.root_dir) Path.create(os.path.dirname(image_copy)) oci.export_container_image( image_copy, 'oci-archive', Defaults.get_container_base_image_tag() ) self._make_checksum(image_copy) def overlay_data(self) -> None: """ Synchronize data from the given base image to the target root directory as an overlayfs mounted target. """ root_dir_ro = f'{self.root_dir}_ro' for image_url in self._get_image_urls(): with OCI.new() as oci: oci.import_container_image(image_url) oci.unpack() oci.import_rootfs(self.root_dir) log.debug("renaming %s -> %s", self.root_dir, root_dir_ro) pathlib.Path(self.root_dir).replace(root_dir_ro) Path.create(self.root_dir) self.overlay = MountManager(device='', mountpoint=self.root_dir) self.overlay.overlay_mount(root_dir_ro) def _get_image_urls(self) -> List[str]: if not self.raw_urls: image_urls: List[str] = [] for image_file in self.image_files: compressor = Compress(image_file) # Increase livetime of the the compressor instances # to the livetime of RootImportOCI. They create # temporary files which are referenced later and # need to live longer than this loop block self.compressed_image_files.append(compressor) if compressor.get_format(): compressor.uncompress(True) uncompressed_image = compressor.uncompressed_filename else: uncompressed_image = image_file image_urls.append( f"{self.archive_transport}:{uncompressed_image}" ) return image_urls else: log.warning('Bypassing base image URI to OCI tools') return self.raw_urls ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.751661 kiwi-11.1.8/kiwi/system/root_init.py0000644000000000000000000001040715273675667014374 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from pwd import getpwnam from shutil import copy import os # project from kiwi.utils.temporary import Temporary from kiwi.utils.sync import DataSync from kiwi.path import Path from kiwi.defaults import Defaults from kiwi.exceptions import KiwiRootDirExists, KiwiRootInitCreationError class RootInit: """ **Implements creation of new root directory for a linux system** Host system independent static default files and device nodes are created to initialize a new base system :param str root_dir: root directory path name """ def __init__(self, root_dir: str, allow_existing: bool = False): if not allow_existing and os.path.exists(root_dir): raise KiwiRootDirExists(f'Root directory {root_dir} already exists') self.root_dir = root_dir def delete(self) -> None: """ Force delete root directory and its contents """ Path.wipe(self.root_dir) def create(self) -> None: """ Create new system root directory The method creates a temporary directory and initializes it for the purpose of building a system image from it. This includes the following setup: * create core system paths * create static core device nodes On success the contents of the temporary location are synced to the specified root_dir and the temporary location will be deleted. That way we never work on an incomplete initial setup :raises KiwiRootInitCreationError: if the init creation fails at some point """ root = Temporary(prefix='kiwi_root.').new_dir() Path.create(self.root_dir) os.chmod(self.root_dir, 0o755) try: self._create_base_directories(root.name) self._create_base_links(root.name) data = DataSync(root.name + '/', self.root_dir) data.sync_data(options=['-a', '--ignore-existing']) if Defaults.is_buildservice_worker(): copy( os.sep + Defaults.get_buildservice_env_name(), self.root_dir ) except Exception as e: self.delete() raise KiwiRootInitCreationError(f'{type(e).__name__}: {format(e)}') def _create_base_directories(self, root: str) -> None: """ Create minimum collection of directories in the new root system required for kiwi to operate :param str root: path to the new root """ base_system_paths = ( Defaults.get_shared_cache_location(), 'dev/pts', 'proc', 'etc/sysconfig', 'run', 'sys', 'var', ) root_uid = getpwnam('root').pw_uid root_gid = getpwnam('root').pw_gid for path in base_system_paths: root_path = os.sep.join([root, path]) if not os.path.exists(root_path): os.makedirs(root_path) os.chown(root_path, root_uid, root_gid) def _create_base_links(self, root: str) -> None: """ Create minimum collection of file handle and runtime links which needs to be present prior to any package installation :param str root: path to the new root """ base_system_links = ( ('/proc/self/fd', '%s/dev/fd'), ('fd/2', '%s/dev/stderr'), ('fd/0', '%s/dev/stdin'), ('fd/1', '%s/dev/stdout'), ) for src, target in base_system_links: os.symlink( src, target % root, ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.751661 kiwi-11.1.8/kiwi/system/setup.py0000644000000000000000000020030315273675667013522 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import glob import os import logging import copy import pathlib from contextlib import ExitStack from collections import OrderedDict from collections import namedtuple from textwrap import dedent from typing import Any, List, Optional, Dict # project import kiwi.defaults as defaults from kiwi.xml_parse import repository from kiwi.utils.fstab import Fstab from kiwi.xml_state import XMLState, FileT from kiwi.runtime_config import RuntimeConfig from kiwi.mount_manager import MountManager from kiwi.system.uri import Uri from kiwi.repository import Repository from kiwi.system.root_bind import RootBind from kiwi.system.root_init import RootInit from kiwi.command import Command from kiwi.command_process import CommandProcess from kiwi.utils.sync import DataSync from kiwi.defaults import Defaults from kiwi.system.users import Users from kiwi.system.shell import Shell from kiwi.path import Path from kiwi.archive.tar import ArchiveTar from kiwi.utils.compress import Compress from kiwi.utils.command_capabilities import CommandCapabilities from kiwi.utils.rpm_database import RpmDataBase from kiwi.builder.template.container_import import BuilderTemplateSystemdUnit from kiwi.system.profile import Profile from kiwi.exceptions import ( KiwiCommandError, KiwiImportDescriptionError, KiwiScriptFailed, KiwiFileNotFound, ) log: Any = logging.getLogger('kiwi') class SystemSetup: """ **Implementation of system setup steps supported by kiwi** Kiwi is not responsible for the system configuration, however some setup steps needs to be performed in order to provide a minimal work environment inside of the image according to the desired image type. :param object xml_state: instance of :class:`XMLState` :param str root_dir: root directory path name """ def __init__(self, xml_state: XMLState, root_dir: str): self.runtime_config = RuntimeConfig() self.arch = Defaults.get_platform_name() self.xml_state = xml_state self.description_dir = xml_state.xml_data.description_dir self.derived_description_dir = ( xml_state.xml_data.derived_description_dir ) self.root_dir = root_dir self._preferences_lookup() self._oemconfig_lookup() def setup_registry_import(self) -> None: """ Fetch container(s) and activate systemd unit to load containers from local oci-archive file during boot """ container_files_to_load = [] container_execs_to_load = [] after_services = set() for container in self.xml_state.get_containers(): log.info(f'Fetching container: {container.name}') pathlib.Path(f'{self.root_dir}/{defaults.LOCAL_CONTAINERS}').mkdir( parents=True, exist_ok=True ) container.fetch_command(self.root_dir) if container.load_command: container_files_to_load.append(container.container_file) container_execs_to_load.append(container.load_command) if container.backend == 'docker': after_services.add('docker.service') elif container.backend == 'container-snap': after_services.add('container-snap.service') if container_files_to_load: log.info('--> Setup kiwi_containers.service import unit') service = BuilderTemplateSystemdUnit() unit_template = service.get_container_import_template( container_files_to_load, container_execs_to_load, list(after_services), ) unit = unit_template.substitute() unit_file = '{0}/etc/systemd/system/{1}.service'.format( self.root_dir, 'kiwi_containers' ) with open(unit_file, 'w') as systemd: systemd.write(unit) Command.run( [ 'chroot', self.root_dir, 'systemctl', 'enable', 'kiwi_containers', ] ) def import_description(self) -> None: """ Import XML descriptions, custom scripts, archives and script helper methods """ log.info('Importing Image description to system tree') description = os.path.join( self.root_dir, defaults.IMAGE_METADATA_DIR, 'config.xml' ) log.info( '--> Importing state XML description to {0}'.format(description) ) Path.create(os.path.join(self.root_dir, defaults.IMAGE_METADATA_DIR)) with open(description, 'w', encoding='utf-8') as config: config.write('') self.xml_state.xml_data.export(outfile=config, level=0) self._import_custom_scripts() self._import_custom_archives() self._import_custom_files() self._import_cdroot_archive() def script_exists(self, name: str) -> bool: """ Check if provided script base name exists in the image description :param str name: script base name """ return os.path.exists(os.path.join(self.description_dir, name)) def cleanup(self) -> None: """ Delete all traces of a kiwi description which are not required in the later image """ Command.run( [ 'chroot', self.root_dir, 'rm', '-f', '.kconfig', '.profile', 'config.bootoptions', ] ) meta_dir = f'{self.root_dir}/{defaults.IMAGE_METADATA_DIR}' if os.path.isdir(meta_dir): image_meta = MountManager(device='none', mountpoint=meta_dir) image_meta.umount() Path.wipe(meta_dir) def import_repositories_marked_as_imageinclude(self) -> None: """ Those sections which are marked with the imageinclude attribute should be permanently added to the image repository configuration """ repository_sections = ( self.xml_state.get_repository_sections_used_in_image() ) root = RootInit(root_dir=self.root_dir, allow_existing=True) with Repository.new( RootBind(root), self.xml_state.get_package_manager() ) as repo: repo.use_default_location() for xml_repo in repository_sections: repo_type = xml_repo.get_type() repo_source = xml_repo.get_source().get_path() repo_architectures = xml_repo.get_architectures() repo_user = xml_repo.get_username() repo_secret = xml_repo.get_password() repo_alias = xml_repo.get_alias() repo_priority = xml_repo.get_priority() repo_dist = xml_repo.get_distribution() repo_components = xml_repo.get_components() repo_repository_gpgcheck = xml_repo.get_repository_gpgcheck() repo_package_gpgcheck = xml_repo.get_package_gpgcheck() repo_customization_script = self._get_repo_customization_script( xml_repo ) repo_sourcetype = xml_repo.get_sourcetype() uri = Uri(repo_source, repo_type) repo_source_translated = uri.translate( check_build_environment=False ) if not repo_alias: repo_alias = uri.alias() log.info( 'Setting up image repository {0}'.format( Uri.print_sensitive(repo_source) ) ) log.info('--> Type: {0}'.format(repo_type)) log.info( '--> Translated: {0}'.format( Uri.print_sensitive(repo_source_translated) ) ) log.info('--> Alias: {0}'.format(repo_alias)) repo_signing_keys = self.xml_state.get_repository_signing_keys( xml_repo ) if repo_signing_keys: repo.import_repository_signing_keys( repo_alias, repo_signing_keys ) repo.add_repo( repo_alias, repo_source_translated, repo_type, repo_priority, repo_dist, repo_components, repo_user, repo_secret, uri.credentials_file_name(), repo_repository_gpgcheck, repo_package_gpgcheck, repo_sourcetype, repo_customization_script, repo_architectures, ) def import_cdroot_files(self, target_dir: str) -> None: """ Copy cdroot files from the image description to the specified target directory. Supported is a tar archive named config-cdroot.tar[.compression-postfix] :param str target_dir: directory to unpack archive to """ glob_match = self.description_dir + '/config-cdroot.tar*' for cdroot_archive in sorted(glob.iglob(glob_match)): log.info( 'Extracting ISO user config archive: {0} to: {1}'.format( cdroot_archive, target_dir ) ) archive = ArchiveTar(cdroot_archive) archive.extract(target_dir) break def import_files(self) -> None: system_files = self.xml_state.get_system_files() bootstrap_files = self.xml_state.get_bootstrap_files() if system_files: self._sync_files(system_files) if bootstrap_files: self._sync_files(bootstrap_files) def import_overlay_files( self, follow_links: bool = False, preserve_owner_group: bool = False ) -> None: """ Copy overlay files from the image description to the image root tree. Supported are a root/ directory or a root.tar.gz tarball. The root/ directory takes precedence over the tarball. In addition the method also supports profile specific overlay files which are searched in a directory of the same name as the profile name. The overall order for including overlay files is as follows: 1. root/ dir or root.tar.gz 2. PROFILE_NAME/ dir(s) in the order of the selected profiles :param bool follow_links: follow symlinks true|false :param bool preserve_owner_group: preserve permissions true|false """ overlay_directory = self.description_dir + '/root/' overlay_archive = self.description_dir + '/root.tar.gz' if os.path.exists(overlay_directory): self._sync_overlay_files( f'{os.path.normpath(overlay_directory)}/', follow_links, preserve_owner_group, ) elif os.path.exists(overlay_archive): log.info('Extracting user defined files from archive to image tree') archive = ArchiveTar(overlay_archive) archive.extract(self.root_dir) for profile in self.xml_state.profiles: overlay_directory = ( os.path.join(self.description_dir, profile) + os.sep ) if os.path.exists(overlay_directory): self._sync_overlay_files( overlay_directory, follow_links, preserve_owner_group, profile, ) def setup_machine_id(self) -> None: """ Setup systemd machine id There are various states of /etc/machine-id: a) Does not exist: Triggers ConditionFirstBoot, but does not work if the filesystem is initially read-only (booted without "rw"). b) Exists, is empty: Does not trigger ConditionFirstBoot, but works with read-only mounts. c) Exists, contains the string "uninitialized": Same as b), but triggers ConditionFirstBoot. Supported by systemd v247+ only. d) Exists, contains a valid ID. See the machine-id(5) man page for details. In images, d) is not desirable, so truncate the file. This is the previous behaviour and what existing images expect. If the image has one of the other states, keep it as-is. """ machine_id = os.path.join(self.root_dir, 'etc', 'machine-id') if os.path.exists(machine_id): with open(machine_id, 'r+') as f: if 'uninitialized' not in f.read(): f.truncate(0) def setup_permissions(self) -> None: """ Check and Fix permissions using chkstat Call chkstat in system mode which reads /etc/sysconfig/security to determine the configured security level and applies the appropriate permission definitions from the /etc/permissions* files. It's possible to provide those files as overlay files in the image description to apply a certain permission setup when needed. Otherwise the default setup as provided on the package level applies. It's required that the image root system has chkstat installed. If not present KIWI skips this step and continuous with a warning. """ chkstat = Path.which( 'chkstat', root_dir=self.root_dir, access_mode=os.X_OK ) if chkstat: log.info('Check/Fix File Permissions') Command.run( ['chroot', self.root_dir, 'chkstat', '--system', '--set'] ) else: log.debug( 'chkstat not found in image. File Permissions Check skipped' ) def setup_keyboard_map(self) -> None: """ Setup console keyboard """ if 'keytable' in self.preferences: log.info( 'Setting up keytable: {0}'.format(self.preferences['keytable']) ) if CommandCapabilities.has_option_in_help( 'systemd-firstboot', '--keymap', root=self.root_dir, raise_on_error=False, ): Path.wipe(self.root_dir + '/etc/vconsole.conf') res = Command.run( [ 'chroot', self.root_dir, 'systemd-firstboot', '--keymap=' + self.preferences['keytable'], ], raise_on_error=False, ) if res.returncode != 0: message = dedent( f'''\n keyboard setup skipped because `systemd-firstboot --keymap` failed (code {res.returncode}): {res.error} This can happen for example if the specified keytable ({self.preferences['keytable']}) is not available, or if your system does not support the systemd way of managing keymaps. Note that in both cases, systemd-firstboot's error message complains that the keymap is not installed. If the keytable is missing, you might be able to install it for example via an additional package. If your system doesn't support systemd's keymap management, then you can use a distribution-specific method to set the keymap in a config.sh script. You can try `localectl list-keymaps` to see if a particular distro supports systemd keymap management. ''' ) raise KiwiCommandError(message) elif os.path.exists(self.root_dir + '/etc/sysconfig/keyboard'): Shell.run_common_function( 'baseUpdateSysConfig', [ self.root_dir + '/etc/sysconfig/keyboard', 'KEYTABLE', '"' + self.preferences['keytable'] + '"', ], ) else: log.warning( 'keyboard setup skipped no capable ' 'systemd-firstboot or etc/sysconfig/keyboard found' ) def setup_locale(self) -> None: """ Setup UTF8 system wide locale """ if 'locale' in self.preferences: if 'POSIX' in self.preferences['locale'].split(','): locale = 'POSIX' else: locale = '{0}.UTF-8'.format( self.preferences['locale'].split(',')[0] ) log.info( 'Setting up locale: {0}'.format(self.preferences['locale']) ) if CommandCapabilities.has_option_in_help( 'systemd-firstboot', '--locale', root=self.root_dir, raise_on_error=False, ): Path.wipe(self.root_dir + '/etc/locale.conf') Command.run( [ 'chroot', self.root_dir, 'systemd-firstboot', '--locale=' + locale, ] ) def setup_timezone(self) -> None: """ Setup timezone symlink """ if 'timezone' in self.preferences: log.info( 'Setting up timezone: {0}'.format(self.preferences['timezone']) ) if CommandCapabilities.has_option_in_help( 'systemd-firstboot', '--timezone', root=self.root_dir, raise_on_error=False, ): Path.wipe(self.root_dir + '/etc/localtime') Command.run( [ 'chroot', self.root_dir, 'systemd-firstboot', '--timezone=' + self.preferences['timezone'], ] ) else: zoneinfo = '/usr/share/zoneinfo/' + self.preferences['timezone'] Command.run( [ 'chroot', self.root_dir, 'ln', '-s', '-f', zoneinfo, '/etc/localtime', ] ) def setup_groups(self) -> None: """ Add groups for configured users """ system_users = Users(self.root_dir) for user in self.xml_state.get_users(): group_dict = self._get_group_names_and_ids_for_user(user.get_name()) for group, group_id in group_dict.items(): if not system_users.group_exists(group): log.info('Adding group {0}'.format(group)) options = self._process_user_options(group_id=group_id) system_users.group_add(group, options) def setup_users(self) -> None: """ Add/Modify configured users """ system_users = Users(self.root_dir) for user in self.xml_state.get_users(): log.info('Setting up user {0}'.format(user.get_name())) password = user.get_password() password_format = user.get_pwdformat() home_path = user.get_home() user_name = user.get_name() user_id = user.get_id() user_realname = user.get_realname() user_shell = user.get_shell() user_groups = list( self._get_group_names_and_ids_for_user(user.get_name()).keys() ) user_exists = system_users.user_exists(user_name) options = self._process_user_options( password_format=password_format, password=password, user_shell=user_shell, user_groups=user_groups, user_id=user_id, user_realname=user_realname, user_exists=user_exists, home_path=home_path, ) group_msg = ( '--> Primary group for user {0}: {1}'.format( user_name, user_groups[0] ) if len(user_groups) else '' ) if user_exists: log.info('--> Modifying user: {0}'.format(user_name)) if group_msg: log.info(group_msg) system_users.user_modify(user_name, options) else: log.info('--> Adding user: {0}'.format(user_name)) if group_msg: log.info(group_msg) system_users.user_add(user_name, options) if home_path: log.info( '--> Setting permissions for {0}'.format(home_path) ) # Emtpy group string assumes the login or default group system_users.setup_home_for_user( user_name, user_groups[0] if len(user_groups) else '', home_path, ) def setup_plymouth_splash(self) -> None: """ Setup the KIWI configured splash theme as default The method uses the plymouth-set-default-theme tool to setup the theme for the plymouth splash system. Only in case the tool could be found in the image root, it is assumed plymouth splash is in use and the tool is called in a chroot operation """ theme_setup = 'plymouth-set-default-theme' if Path.which(filename=theme_setup, root_dir=self.root_dir): for preferences in self.xml_state.get_preferences_sections(): splash_section_content = preferences.get_bootsplash_theme() if splash_section_content: splash_theme = splash_section_content[0] Command.run( ['chroot', self.root_dir, theme_setup, splash_theme] ) def import_image_identifier(self) -> None: """ Create etc/ImageID identifier file """ image_id = self.xml_state.xml_data.get_id() if image_id and os.path.exists(self.root_dir + '/etc'): image_id_file = self.root_dir + '/etc/ImageID' log.info( 'Creating image identifier: {0} in {1}'.format( image_id, image_id_file ) ) with open(image_id_file, 'w') as identifier: identifier.write('{0}{1}'.format(image_id, os.linesep)) def set_selinux_file_contexts(self, security_context_file: str) -> None: """ Initialize the security context fields (extended attributes) on the files matching the security_context_file :param str security_context_file: path file name """ log.info('Processing SELinux file security contexts') if not os.access(self.root_dir, os.W_OK): log.info('System is read-only, security context unchanged') return exclude = [] for devname in Defaults.get_exclude_list_for_non_physical_devices(): exclude.append('-e') exclude.append(f'/{devname}') # setfiles doesn't come with a stable command API and older versions # needs a different invocation syntax. On older versions the usage # information explicitly lists "setfiles -c policyfile" which is not # present in newer versions. As setfiles doesn't come with a simple # --version option, checking for this extra element in the usage # was the only pointer I could come up with to differentiate the # call options. if CommandCapabilities.has_option_in_help( 'setfiles', 'setfiles -c policyfile', ['--help'], root=self.root_dir, raise_on_error=False, silent=True, ): Command.run( [ 'chroot', self.root_dir, 'setfiles', '-c', self._find_selinux_policy_file( self.xml_state.build_type.get_selinux_policy() or 'targeted' ), security_context_file, ] ) Command.run( ['chroot', self.root_dir, 'setfiles', '-F', '-p'] + exclude + [security_context_file, '/'] ) else: Command.run( [ 'chroot', self.root_dir, 'setfiles', '-T0', '-F', '-p', '-c', self._find_selinux_policy_file( self.xml_state.build_type.get_selinux_policy() or 'targeted' ), ] + exclude + [security_context_file, '/'] ) def setup_selinux_file_contexts(self) -> None: """ Set SELinux file security contexts if the default context file is found """ security_context = '/etc/selinux/targeted/contexts/files/file_contexts' if os.path.exists(self.root_dir + security_context): if Path.which( filename='setfiles', access_mode=os.X_OK, root_dir=self.root_dir ): self.set_selinux_file_contexts(security_context) else: log.warning( 'security_context found but setfiles tool not installed' ) def export_modprobe_setup(self, target_root_dir: str) -> None: """ Export etc/modprobe.d to given root_dir :param str target_root_dir: path name """ modprobe_config = self.root_dir + '/etc/modprobe.d' if os.path.exists(modprobe_config): log.info('Export modprobe configuration') Path.create(target_root_dir + '/etc') data = DataSync(modprobe_config, target_root_dir + '/etc/') data.sync_data(options=['-a']) def export_flake_pilot_system_file_list( self, target_dir: str, file_name: str ) -> str: """ Export image package file list to the target_dir and filename :param str target_dir: path name :param str file_name: file name """ packager = Defaults.get_default_packager_tool( self.xml_state.get_package_manager() ) result_file = os.path.normpath(f'{target_dir}/{file_name}') if packager == 'rpm': self._export_rpm_flake_pilot_system_file_list(result_file) return result_file return '' def export_package_list(self, target_dir: str) -> str: """ Export image package list as metadata reference used by the open buildservice :param str target_dir: path name """ image_version = self.xml_state.get_image_version() or 'unspecified' filename = ''.join( [ target_dir, '/', self.xml_state.xml_data.get_name(), '.' + self.arch, '-' + image_version, '.packages', ] ) packager = Defaults.get_default_packager_tool( self.xml_state.get_package_manager() ) if packager == 'rpm': self._export_rpm_package_list(filename) return filename elif packager == 'dpkg': self._export_deb_package_list(filename) return filename elif packager == 'pacman': self._export_pacman_package_list(filename) return filename return '' def export_package_changes(self, target_dir: str) -> str: """ Export image package changelog for comparision of actual changes of the installed packages :param str target_dir: path name """ image_version = self.xml_state.get_image_version() or 'unspecified' if self.runtime_config.get_package_changes(): filename = ''.join( [ target_dir, '/', self.xml_state.xml_data.get_name(), '.' + self.arch, '-' + image_version, '.changes', ] ) packager = Defaults.get_default_packager_tool( self.xml_state.get_package_manager() ) if packager == 'rpm': self._export_rpm_package_changes(filename) return filename elif packager == 'dpkg': self._export_deb_package_changes(filename) return filename return '' def export_package_verification(self, target_dir: str) -> str: """ Export package verification result as metadata reference used by the open buildservice :param str target_dir: path name """ image_version = self.xml_state.get_image_version() or 'unspecified' filename = ''.join( [ target_dir, '/', self.xml_state.xml_data.get_name(), '.' + self.arch, '-' + image_version, '.verified', ] ) packager = Defaults.get_default_packager_tool( self.xml_state.get_package_manager() ) if packager == 'rpm': self._export_rpm_package_verification(filename) return filename elif packager == 'dpkg': self._export_deb_package_verification(filename) return filename return '' def call_disk_script(self) -> None: """ Call disk.sh script chrooted """ self._call_script( defaults.POST_DISK_SYNC_SCRIPT, root_is_mountpoint=True ) def call_pre_disk_script(self) -> None: """ Call pre_disk_sync.sh script chrooted """ self._call_script(defaults.PRE_DISK_SYNC_SCRIPT) def call_post_bootstrap_script(self) -> None: """ Call post_bootstrap.sh script chrooted """ self._call_script(defaults.POST_BOOTSTRAP_SCRIPT) def call_config_script(self) -> None: """ Call config.sh script chrooted """ self._call_script(defaults.POST_PREPARE_SCRIPT) def call_config_overlay_script(self) -> None: """ Call config-overlay.sh script chrooted """ self._call_script(defaults.POST_PREPARE_OVERLAY_SCRIPT) def call_config_host_overlay_script( self, working_directory: Optional[str] = None ) -> None: """ Call config-host-overlay.sh script _NON_ chrooted """ self._call_script_no_chroot( name=defaults.POST_HOST_PREPARE_OVERLAY_SCRIPT, option_list=[], working_directory=working_directory, ) def call_image_script(self) -> None: """ Call images.sh script chrooted """ self._call_script(defaults.PRE_CREATE_SCRIPT) def call_edit_boot_config_script( self, filesystem: str, boot_part_id: int, working_directory: Optional[str] = None, ) -> None: """ Call configured editbootconfig script _NON_ chrooted Pass the boot filesystem name and the partition number of the boot partition as parameters to the call :param str filesystem: boot filesystem name :param int boot_part_id: boot partition number :param str working_directory: directory name """ self._call_script_no_chroot( name=defaults.EDIT_BOOT_CONFIG_SCRIPT, option_list=[filesystem, format(boot_part_id)], working_directory=working_directory, ) def call_edit_boot_install_script( self, diskname: str, boot_device_node: str, working_directory: Optional[str] = None, ) -> None: """ Call configured editbootinstall script _NON_ chrooted Pass the disk file name and the device node of the boot partition as parameters to the call :param str diskname: file path name :param str boot_device_node: boot device node name :param str working_directory: directory name """ self._call_script_no_chroot( name=defaults.EDIT_BOOT_INSTALL_SCRIPT, option_list=[diskname, boot_device_node], working_directory=working_directory, ) def create_system_files(self) -> None: """ Create file list of packages to be used by flake-pilot """ if self.xml_state.build_type.get_provide_system_files(): self.export_flake_pilot_system_file_list( self.root_dir, Defaults.get_system_files_name() ) def create_fstab(self, fstab: Fstab) -> None: """ Create etc/fstab from given Fstab object Custom fstab modifications are possible and handled in the following order: 1. Look for an optional fstab.append file which allows to append custom fstab entries to the final fstab. Once embedded the fstab.append file will be deleted 2. Look for an optional fstab.patch file which allows to patch the current contents of the fstab file with a given patch file. Once patched the fstab.patch file will be deleted 3. Look for an optional fstab.script file which is called chrooted for the purpose of updating the fstab file as appropriate. Note: There is no validation in place that checks if the script actually handles fstab or any other file in the image rootfs. Once called the fstab.script file will be deleted :param object fstab: instance of Fstab """ fstab_file = self.root_dir + '/etc/fstab' fstab_append_file = self.root_dir + '/etc/fstab.append' fstab_patch_file = self.root_dir + '/etc/fstab.patch' fstab_script_file = self.root_dir + '/etc/fstab.script' fstab.export(fstab_file) if os.path.exists(fstab_append_file): with open(fstab_file, 'a') as fstab_io: with open(fstab_append_file, 'r') as append: fstab_io.write(append.read()) Path.wipe(fstab_append_file) if os.path.exists(fstab_patch_file): Command.run(['patch', fstab_file, fstab_patch_file]) Path.wipe(fstab_patch_file) if os.path.exists(fstab_script_file): self._call_script(name='etc/fstab.script', path_prefix='') Path.wipe(fstab_script_file) def create_init_link_from_linuxrc(self) -> None: """ kiwi boot images provides the linuxrc script, however the kernel also expects an init executable to be present. This method creates a hard link to the linuxrc file """ Command.run(['ln', self.root_dir + '/linuxrc', self.root_dir + '/init']) def create_recovery_archive(self) -> None: """ Create a compressed recovery archive from the root tree for use with kiwi's recvoery system. The method creates additional data into the image root filesystem which is deleted prior to the creation of a new recovery data set """ # cleanup bash_comand = ['rm', '-f', self.root_dir + '/recovery.*'] Command.run(['bash', '-c', ' '.join(bash_comand)]) if not self.oemconfig['recovery']: return # recovery.tar log.info('Creating recovery tar archive') metadata = { 'archive_name': self.root_dir + '/recovery.tar', 'archive_filecount': self.root_dir + '/recovery.tar.files', 'archive_size': self.root_dir + '/recovery.tar.size', 'partition_size': self.root_dir + '/recovery.partition.size', 'partition_filesystem': self.root_dir + '/recovery.tar.filesystem', } pathlib.Path(metadata['archive_name']).touch() archive = ArchiveTar( filename=metadata['archive_name'], create_from_file_list=False ) archive.create( source_dir=self.root_dir, exclude=['dev', 'proc', 'sys'], options=[ '--numeric-owner', '--hard-dereference', '--preserve-permissions', ], ) # recovery.tar.filesystem recovery_filesystem = self.xml_state.build_type.get_filesystem() with open(metadata['partition_filesystem'], 'w') as partfs: partfs.write('{0}'.format(recovery_filesystem)) log.info( '--> Recovery partition filesystem: {0}'.format(recovery_filesystem) ) # recovery.tar.files bash_comand = ['tar', '-tf', metadata['archive_name'], '|', 'wc', '-l'] tar_files_call = Command.run(['bash', '-c', ' '.join(bash_comand)]) tar_files_count = int(tar_files_call.output.rstrip('\n')) with open(metadata['archive_filecount'], 'w') as files: files.write('{0}{1}'.format(tar_files_count, os.linesep)) log.info('--> Recovery file count: {0} files'.format(tar_files_count)) # recovery.tar.size recovery_archive_size_bytes = os.path.getsize(metadata['archive_name']) with open(metadata['archive_size'], 'w') as size: size.write('{0}'.format(recovery_archive_size_bytes)) log.info( '--> Recovery uncompressed size: {0} mbytes'.format( int(recovery_archive_size_bytes / 1048576) ) ) # recovery.tar.gz log.info('--> Compressing recovery archive') compress = Compress(self.root_dir + '/recovery.tar') compress.gzip() # recovery.partition.size recovery_archive_gz_size_mbytes = int( os.path.getsize(metadata['archive_name'] + '.gz') / 1048576 ) recovery_partition_mbytes = ( recovery_archive_gz_size_mbytes + Defaults.get_recovery_spare_mbytes() ) with open(metadata['partition_size'], 'w') as gzsize: gzsize.write('{0}'.format(recovery_partition_mbytes)) log.info( '--> Recovery partition size: {0} mbytes'.format( recovery_partition_mbytes ) ) # delete recovery archive if inplace recovery is requested # In this mode the recovery archive is created at install time # and not at image creation time. However the recovery metadata # is preserved in order to be able to check if enough space # is available on the disk to create the recovery archive. if self.oemconfig['recovery_inplace']: log.info('--> Inplace recovery requested, deleting archive') Path.wipe(metadata['archive_name'] + '.gz') def _process_user_options( self, password_format: str = '', password: str = '', user_shell: str = '', user_groups: List[str] = [], user_id: str = '', group_id: str = '', user_realname: str = '', user_exists: bool = True, home_path: str = '', ) -> List[str]: options = [] if password_format == 'plain': password = self._create_passwd_hash(password) if password: options.append('-p') options.append(password) if user_shell: options.append('-s') options.append(user_shell) if len(user_groups): options.append('-g') options.append(user_groups[0]) if len(user_groups) > 1: options.append('-G') options.append(','.join(user_groups[1:])) if user_id: options.append('-u') options.append('{0}'.format(user_id)) if group_id: options.append('-g') options.append('{0}'.format(group_id)) if user_realname: options.append('-c') options.append(user_realname) if not user_exists: options.append('-m') if home_path: options.append('-d') options.append(home_path) return options def _import_cdroot_archive(self) -> None: glob_match = self.description_dir + '/config-cdroot.tar*' for cdroot_archive in sorted(glob.iglob(glob_match)): archive_file = os.path.join( self.root_dir, defaults.IMAGE_METADATA_DIR ) log.info( '--> Importing {0} archive to {1}'.format( cdroot_archive, archive_file ) ) Command.run(['cp', cdroot_archive, archive_file + os.sep]) break def _import_custom_files(self) -> None: """ Import custom file files """ file_list: List[str] = [] system_files = self.xml_state.get_system_files() bootstrap_files = self.xml_state.get_bootstrap_files() if system_files: file_list += system_files.keys() if bootstrap_files: file_list += bootstrap_files.keys() file_target_dir = ( os.path.join(self.root_dir, defaults.IMAGE_METADATA_DIR) + os.sep ) for file in file_list: file_is_absolute = file.startswith(os.sep) if file_is_absolute: file_file = file else: file_file = os.path.join(self.description_dir, file) file_exists = os.path.exists(file_file) if not file_exists: if self.derived_description_dir and not file_is_absolute: file_file = self.derived_description_dir + '/' + file file_exists = os.path.exists(file_file) if file_exists: log.info( '--> Importing {0} file to {1}'.format( file_file, file_target_dir ) ) Command.run(['cp', file_file, file_target_dir]) else: raise KiwiImportDescriptionError( f'Specified file {file_file} does not exist' ) def _import_custom_archives(self) -> None: """ Import custom tar archive files """ archive_list = [] system_archives = self.xml_state.get_system_archives() bootstrap_archives = self.xml_state.get_bootstrap_archives() if system_archives: archive_list += system_archives if bootstrap_archives: archive_list += bootstrap_archives archive_target_dir = ( os.path.join(self.root_dir, defaults.IMAGE_METADATA_DIR) + os.sep ) for archive in archive_list: archive_is_absolute = archive.startswith(os.sep) if archive_is_absolute: archive_file = archive else: archive_file = os.path.join(self.description_dir, archive) archive_exists = os.path.exists(archive_file) if not archive_exists: if self.derived_description_dir and not archive_is_absolute: archive_file = self.derived_description_dir + '/' + archive archive_exists = os.path.exists(archive_file) if archive_exists: log.info( '--> Importing {0} archive to {1}'.format( archive_file, archive_target_dir ) ) Command.run(['cp', archive_file, archive_target_dir]) else: raise KiwiImportDescriptionError( 'Specified archive {0} does not exist'.format(archive_file) ) def _import_custom_scripts(self) -> None: """ Import custom scripts """ # custom_scripts defines a dictionary with all script hooks # for each script name a the filepath and additional flags # are defined. the filepath could be either a relative or # absolute information. If filepath is set to None this indicates # the script hook is not used. The raise_if_not_exists flag # causes kiwi to raise an exception if a specified script # filepath does not exist script_type = namedtuple( 'script_type', ['filepath', 'raise_if_not_exists'] ) custom_scripts = { defaults.POST_BOOTSTRAP_SCRIPT: script_type( filepath=defaults.POST_BOOTSTRAP_SCRIPT, raise_if_not_exists=False, ), defaults.POST_PREPARE_SCRIPT: script_type( filepath=defaults.POST_PREPARE_SCRIPT, raise_if_not_exists=False ), defaults.POST_PREPARE_OVERLAY_SCRIPT: script_type( filepath=defaults.POST_PREPARE_OVERLAY_SCRIPT, raise_if_not_exists=False, ), defaults.POST_HOST_PREPARE_OVERLAY_SCRIPT: script_type( filepath=defaults.POST_HOST_PREPARE_OVERLAY_SCRIPT, raise_if_not_exists=False, ), defaults.PRE_CREATE_SCRIPT: script_type( filepath=defaults.PRE_CREATE_SCRIPT, raise_if_not_exists=False ), defaults.PRE_DISK_SYNC_SCRIPT: script_type( filepath=defaults.PRE_DISK_SYNC_SCRIPT, raise_if_not_exists=False, ), defaults.POST_DISK_SYNC_SCRIPT: script_type( filepath=defaults.POST_DISK_SYNC_SCRIPT, raise_if_not_exists=False, ), defaults.EDIT_BOOT_CONFIG_SCRIPT: script_type( filepath=self.xml_state.build_type.get_editbootconfig(), raise_if_not_exists=True, ), defaults.EDIT_BOOT_INSTALL_SCRIPT: script_type( filepath=self.xml_state.build_type.get_editbootinstall(), raise_if_not_exists=True, ), } sorted_custom_scripts = OrderedDict(sorted(custom_scripts.items())) script_target_dir = os.path.join( self.root_dir, defaults.IMAGE_METADATA_DIR ) need_script_helper_functions = False for name, script in list(sorted_custom_scripts.items()): if script.filepath: if script.filepath.startswith('/'): script_file = script.filepath else: script_file = os.path.join( self.description_dir, script.filepath ) if os.path.exists(script_file): script_target_file = os.path.join(script_target_dir, name) log.info( '--> Importing {0} script to {1}'.format( script.filepath, script_target_file ) ) Command.run(['cp', script_file, script_target_file]) need_script_helper_functions = True elif script.raise_if_not_exists: raise KiwiImportDescriptionError( 'Specified script {0} does not exist'.format( script_file ) ) if need_script_helper_functions: log.info('--> Importing script helper functions') Command.run( [ 'cp', Defaults.get_common_functions_file(), self.root_dir + '/.kconfig', ] ) def _call_script( self, name: str, option_list: List[str] = [], path_prefix: str = defaults.IMAGE_METADATA_DIR, root_is_mountpoint: bool = False, ) -> None: with ExitStack() as stack: script_path = os.path.join(self.root_dir, path_prefix, name) if os.path.exists(script_path): if root_is_mountpoint: chroot_mount = MountManager( device=self.root_dir, mountpoint=self.root_dir ) if not chroot_mount.is_mounted(): log.debug( f'Self bind mount {self.root_dir} for (/) in chroot' ) chroot_mount.bind_mount() stack.push(chroot_mount) options = option_list or [] if log.getLogFlags().get('run-scripts-in-screen'): # Run scripts in a screen session if requested command = ['screen', '-t', '-X', 'chroot', self.root_dir] else: # In standard mode run scripts without a terminal # associated to them command = ['chroot', self.root_dir] if not Path.access(script_path, os.X_OK): command.append('bash') command.append(os.path.join(os.sep, path_prefix, name)) command.extend(options) profile = Profile(self.xml_state) caller_environment = copy.deepcopy(os.environ) caller_environment.update(profile.get_settings()) config_script = Command.call(command, caller_environment) process = CommandProcess( command=config_script, log_topic='Calling ' + name + ' script', ) result = process.poll_and_watch() if result.returncode != 0: raise KiwiScriptFailed( f'{name} failed with: {result.stderr}' ) # if configured, assign SELinux labels self.setup_selinux_file_contexts() def _call_script_no_chroot( self, name: str, option_list: List[str], working_directory: Optional[str], ) -> None: if not working_directory: working_directory = self.root_dir script_path = os.path.abspath( os.sep.join([self.root_dir, 'image', name]) ) profile = Profile(self.xml_state) caller_environment = copy.deepcopy(os.environ) caller_environment.update(profile.get_settings()) if os.path.exists(script_path): bash_command = [ 'cd', working_directory, '&&', 'bash', '--norc', script_path, ' '.join(option_list), ] if log.getLogFlags().get('run-scripts-in-screen'): # Run scripts in a screen session if requested config_script = Command.call( [ 'screen', '-t', '-X', 'bash', '-c', ' '.join(bash_command), ], caller_environment, ) else: # In standard mode run script through bash config_script = Command.call( ['bash', '-c', ' '.join(bash_command)], caller_environment ) process = CommandProcess( command=config_script, log_topic='Calling ' + name + ' script' ) result = process.poll_and_watch() if result.returncode != 0: raise KiwiScriptFailed( '{0} failed: {1}'.format(name, result.stderr) ) def _create_passwd_hash(self, password: str) -> str: openssl = Command.run( ['openssl', 'passwd', '-1', '-salt', 'xyz', password] ) return openssl.output[:-1] def _preferences_lookup(self) -> None: self.preferences = {} for preferences in self.xml_state.get_preferences_sections(): timezone_section = preferences.get_timezone() locale_section = preferences.get_locale() keytable_section = preferences.get_keytable() if timezone_section: self.preferences['timezone'] = timezone_section[0] if locale_section: self.preferences['locale'] = locale_section[0] if keytable_section: self.preferences['keytable'] = keytable_section[0] def _oemconfig_lookup(self) -> None: self.oemconfig: Dict[str, Optional[bool]] = { 'recovery_inplace': False, 'recovery': False, } oemconfig = self.xml_state.get_build_type_oemconfig_section() if oemconfig: self.oemconfig['recovery'] = self._text( oemconfig.get_oem_recovery() ) self.oemconfig['recovery_inplace'] = self._text( oemconfig.get_oem_inplace_recovery() ) def _text(self, section_content: List[bool]) -> Optional[bool]: """ Helper method to return the text for XML elements of the following structure:
text
. """ if section_content: return section_content[0] return None def _export_rpm_flake_pilot_system_file_list(self, filename: str) -> None: log.info('Export rpm system files script for flake-pilot') dbpath_option = ['--dbpath', self._get_rpm_database_location()] skip_list = self.xml_state.get_system_files_ignore_packages() query_call = Command.run( ['rpm', '--root', self.root_dir, '-qa', '--qf', '%{NAME}\n'] + dbpath_option ) with open(filename, 'w', encoding='utf-8') as systemfiles: systemfiles.write('set -e\n') for package in query_call.output.splitlines(): if package not in skip_list: systemfiles.write(f'rpm --noghost -ql {package}\n') def _export_rpm_package_list(self, filename: str) -> None: log.info('Export rpm packages metadata') dbpath_option = ['--dbpath', self._get_rpm_database_location()] query_call = Command.run( [ 'rpm', '--root', self.root_dir, '-qa', '--qf', '|'.join( [ '%{NAME}', '%{EPOCH}', '%{VERSION}', '%{RELEASE}', '%{ARCH}', '%{DISTURL}', '%{LICENSE}', ] ) + '\\n', ] + dbpath_option ) with open(filename, 'w', encoding='utf-8') as packages: packages.write( os.linesep.join(sorted(query_call.output.splitlines())) ) packages.write(os.linesep) def _export_deb_package_list(self, filename: str) -> None: log.info('Export deb packages metadata') query_call = Command.run( [ 'dpkg-query', '--admindir', os.sep.join([self.root_dir, 'var/lib/dpkg']), '-W', '-f', '|'.join( [ '${Package}', 'None', '${Version}', 'None', '${Architecture}', 'None', 'None', ] ) + '\\n', ] ) with open(filename, 'w', encoding='utf-8') as packages: packages.write( os.linesep.join(sorted(query_call.output.splitlines())) ) packages.write(os.linesep) def _export_pacman_package_list(self, filename: str) -> None: log.info('Export pacman packages metadata') query_call = Command.run( [ 'pacman', '--query', '--dbpath', os.sep.join([self.root_dir, 'var/lib/pacman']), ] ) with open(filename, 'w') as packages: for line in query_call.output.splitlines(): package, _, version_release = line.partition(' ') version, _, release = version_release.partition('-') packages.writelines( [ '{0}|None|{1}|{2}|None|None|None{3}'.format( package, version, release, os.linesep ) ] ) def _export_rpm_package_changes(self, filename: str) -> None: log.info('Export rpm packages changelog metadata') dbpath_option = ['--dbpath', self._get_rpm_database_location()] query_call = Command.run( [ 'rpm', '--root', self.root_dir, '-qa', '--qf', '%{NAME}|\\n', '--changelog', ] + dbpath_option ) with open(filename, 'w', encoding='utf-8') as changelog: changelog.write(query_call.output) def _export_deb_package_changes(self, filename: str) -> None: log.info('Export deb packages changelog metadata') package_doc_dir = os.sep.join([self.root_dir, '/usr/share/doc']) with open(filename, 'w', encoding='utf-8') as changelog: for package in sorted(os.listdir(package_doc_dir)): changelog_file = os.sep.join( [package_doc_dir, package, 'changelog.Debian.gz'] ) if os.path.exists(changelog_file): changelog.write( '{0}{1}{2}'.format(package, '|', os.linesep) ) changelog.write( '{0}{1}'.format( Command.run(['zcat', changelog_file]).output, os.linesep, ) ) def _export_rpm_package_verification(self, filename: str) -> None: log.info('Export rpm verification metadata') dbpath_option = ['--dbpath', self._get_rpm_database_location()] query_call = Command.run( command=['rpm', '--root', self.root_dir, '-Va'] + dbpath_option, raise_on_error=False, ) with open(filename, 'w', encoding='utf-8') as verified: verified.write(query_call.output) def _export_deb_package_verification(self, filename: str) -> None: log.info('Export deb verification metadata') query_call = Command.run( command=[ 'dpkg', '--root', self.root_dir, '-V', '--verify-format', 'rpm', ], raise_on_error=False, ) with open(filename, 'w', encoding='utf-8') as verified: verified.write(query_call.output) def _get_rpm_database_location(self) -> str: shared_mount = MountManager( device='/dev', mountpoint=self.root_dir + '/dev' ) if not shared_mount.is_mounted(): shared_mount.bind_mount() rpmdb = RpmDataBase(self.root_dir) if rpmdb.has_rpm(): dbpath = rpmdb.rpmdb_image.expand_query('%_dbpath') else: dbpath = rpmdb.rpmdb_host.expand_query('%_dbpath') if shared_mount.is_mounted(): shared_mount.umount_lazy() return dbpath def _sync_files(self, file_list: Dict[str, FileT]) -> None: log.info("Installing files") ordered_files = OrderedDict(sorted(file_list.items())) for filename, file_t in list(ordered_files.items()): target = file_t.target target_owner = file_t.owner target_permissions = file_t.permissions file_file = '/'.join([self.root_dir, 'image', filename]) target_name = self.root_dir if target: target_name = os.path.normpath( os.sep.join([target_name, target]) ) log.info(f'--> file: {file_file} -> {target_name}') if target_owner: Command.run( [ 'chroot', self.root_dir, 'chown', target_owner, file_file.replace(self.root_dir, ''), ] ) if target_permissions: Command.run( [ 'chroot', self.root_dir, 'chmod', target_permissions, file_file.replace(self.root_dir, ''), ] ) if os.path.dirname(target_name): Path.create(os.path.dirname(target_name)) data = DataSync(file_file, target_name) data.sync_data(options=Defaults.get_sync_options()) def _sync_overlay_files( self, overlay_directory: str, follow_links: bool = False, preserve_owner_group: bool = False, profile: Optional[str] = None, ) -> None: log.info( 'Copying user defined {0} to image tree'.format( 'files for profile: {0}'.format(profile) if profile else 'files' ) ) sync_options = [ '-r', '-p', '-t', '-D', '-H', '-X', '-A', '--one-file-system', ] if follow_links: sync_options.append('--copy-links') else: sync_options.append('--links') if preserve_owner_group: sync_options.append('-o') sync_options.append('-g') data = DataSync(overlay_directory, self.root_dir) data.sync_data(options=sync_options) def _get_repo_customization_script(self, xml_repo: repository) -> str: script_path = xml_repo.get_customize() if script_path and not os.path.isabs(script_path): script_path = os.path.join(self.description_dir, script_path) return script_path def _get_group_names_and_ids_for_user(self, user: str) -> OrderedDict: group: OrderedDict = OrderedDict() for group_match in self.xml_state.get_user_groups(user): group_and_id = group_match.split(':') group.update( [ ( group_and_id[0], group_and_id[1] if len(group_and_id) > 1 else '', ) ] ) return group def _find_selinux_policy_file(self, policy_name: str) -> str: policy_dir = f'/etc/selinux/{policy_name}/policy' policy_dir_in_root = self.root_dir + policy_dir scandir_error = '' try: with os.scandir(policy_dir_in_root) as policy_path: for entry in policy_path: if entry.is_file() and entry.name.startswith('policy.'): return os.path.join(policy_dir, entry.name) except Exception as issue: scandir_error = format(issue) raise KiwiFileNotFound( 'Unable to find SELinux policy in {0!r} {1}'.format( policy_dir_in_root, scandir_error ) ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.751661 kiwi-11.1.8/kiwi/system/shell.py0000644000000000000000000001001615273675667013471 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import Optional, Any, List from collections.abc import Iterable # project from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.defaults import Defaults from kiwi.exceptions import KiwiShellVariableValueError class Shell: """ **Special character handling for shell evaluated code** """ @staticmethod def quote(message: str) -> str: """ Quote characters which have a special meaning for bash but should be used as normal characters. actually I had planned to use pipes.quote but it does not quote as I had expected it. e.g 'name_wit_a_$' does not quote the $ so we do it on our own for the scope of kiwi :param str message: message text :return: quoted text :rtype: str """ # \\ quoting must be first in the list quote_characters = ['\\', '$', '"', '`', '!'] for quote in quote_characters: message = message.replace(quote, '\\' + quote) return message @staticmethod def quote_key_value_file(filename: str) -> List[str]: """ Quote given input file which has to be of the form key=value to be able to become sourced by the shell :param str filename: file path name :return: list of quoted text :rtype: List[str] """ temp_copy = Temporary().new_file() Command.run(['cp', filename, temp_copy.name]) Shell.run_common_function('baseQuoteFile', [temp_copy.name]) with open(temp_copy.name) as quoted: return quoted.read().splitlines() @staticmethod def run_common_function(name: str, parameters: List[str]) -> None: """ Run a function implemented in config/functions.sh :param str name: function name :param list parameters: function arguments """ Command.run( [ 'bash', '-c', 'source ' + ''.join( [ Defaults.get_common_functions_file(), '; ', name, ' ', ' '.join(parameters), ] ), ] ) @staticmethod def format_to_variable_value(value: Optional[Any]) -> str: """ Format given variable value to return a string value representation that can be sourced by shell scripts. If the provided value is not representable as a string (list, dict, tuple etc) an exception is raised :param any value: a python variable :raises KiwiShellVariableValueError: if value is an iterable :return: string value representation :rtype: str """ if value is None: return '' if isinstance(value, bool): return format(value).lower() if isinstance(value, str): return value if isinstance(value, bytes): return format(value.decode()) if isinstance(value, Iterable): # we will have a hard time to turn an iterable (list, dict ...) # into a useful string raise KiwiShellVariableValueError( 'Value cannot be {0}'.format(type(value)) ) return format(value) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.751661 kiwi-11.1.8/kiwi/system/size.py0000644000000000000000000000664115273675667013345 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import List, Optional # project from kiwi.command import Command from kiwi.defaults import Defaults class SystemSize: """ **Provide source tree size information** :param str source_dir: source directory path name """ def __init__(self, source_dir: str): self.source_dir = source_dir def customize(self, size: float, requested_filesystem: str) -> int: """ Increase the sum of all file sizes by an empiric factor Each filesystem has some overhead it needs to manage itself. Thus the plain data size is always smaller as the size of the container which embeds it. This method increases the given size by a filesystem specific empiric factor to ensure the given data size can be stored in a filesystem of the customized size :param float size: mbsize to update :param str requested_filesystem: filesystem name :return: mbytes :rtype: int """ if requested_filesystem: if requested_filesystem.startswith('ext'): size *= 1.5 file_count = self.accumulate_files() inode_mbytes = ( file_count * Defaults.get_default_inode_size() / 1048576 ) size += 2 * inode_mbytes elif requested_filesystem == 'btrfs': size *= 1.5 elif requested_filesystem == 'xfs': size *= 1.5 return int(size) def accumulate_mbyte_file_sizes( self, exclude: Optional[List[str]] = None ) -> int: """ Calculate data size of all data in the source tree :param list exclude: list of paths to exclude :return: mbytes :rtype: int """ exclude_options: List[str] = [] for nodev in Defaults.get_exclude_list_for_non_physical_devices(): exclude_options.append('--exclude') exclude_options.append(os.sep.join([self.source_dir, nodev])) if exclude: for item in exclude: exclude_options.append('--exclude') exclude_options.append(item) du_call = Command.run( ['du', '-s', '--apparent-size', '--block-size', '1'] + exclude_options + [self.source_dir] ) return int(int(du_call.output.split('\t')[0]) / 1048576) def accumulate_files(self) -> int: """ Calculate sum of all files in the source tree :return: number of files :rtype: int """ bash_comand = ['find', self.source_dir, '|', 'wc', '-l'] wc_call = Command.run(['bash', '-c', ' '.join(bash_comand)]) return int(wc_call.output.rstrip('\n')) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.751661 kiwi-11.1.8/kiwi/system/uri.py0000644000000000000000000003066415273675667013174 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import re import logging from lxml import etree from urllib.parse import urlparse, ParseResult, quote from urllib.request import urlopen from urllib.request import Request import requests from uuid import uuid4 from typing import Optional # project from kiwi.defaults import Defaults from kiwi.runtime_config import RuntimeConfig from kiwi.exceptions import ( KiwiUriStyleUnknown, KiwiUriTypeUnknown, KiwiUriOpenError, ) log = logging.getLogger('kiwi') class Uri: """ **Normalize and manage URI types** """ def __init__( self, uri: str, repo_type: str = 'rpm-md', source_type: str = '' ): """ Manage kiwi source URIs and allow transformation into standard URLs :param str uri: URI, remote, local or metalink repository location The resource type as part of the URI can be set to one of: * http: * https: * ftp: * obs: * dir: * file: * obsrepositories: * this: The special this:// type resolve to the image description directory. The code to resolve this is not part of the Uri class because it has no state information about the image description directory. Therefore the resolving of the this:// path happens on construction of an XMLState object as part of the resolve_this_path() method. The method resolves the path into a native dir:// URI which can be properly handled here. :param str repo_type: repository type name, defaults to 'rpm-md' and is only effectively used when building inside of the open build service which maps local repositories to a specific environment :param str source_type: specify source type if the provided URI is a service. Currently only the metalink source type is handled """ self.runtime_config = RuntimeConfig() if source_type == 'metalink': uri = self._resolve_metalink_uri(uri) self.repo_type = repo_type self.uri = ( uri if not uri.startswith(os.sep) else ''.join([Defaults.get_default_uri_type(), uri]) ) self.remote_uri_types = { 'http': True, 'https': True, 'ftp': True, 'obs': True, } self.local_uri_type = { 'dir': True, 'file': True, 'obsrepositories': True, } def translate(self, check_build_environment: bool = True) -> str: """ Translate repository location according to their URI type Depending on the URI type the provided location needs to be adapted e.g updated by the service URL in case of an open buildservice project name :raises KiwiUriStyleUnknown: if the uri scheme can't be detected, is unknown or it is inconsistent with the build environment :param bool check_build_environment: specify if the uri translation should depend on the environment the build is called in. As of today this only effects the translation result if the image build happens inside of the Open Build Service :return: translated repository location :rtype: str """ uri = urlparse(self.uri) if not uri.scheme: raise KiwiUriStyleUnknown( 'URI scheme not detected {uri}'.format(uri=self.uri) ) elif uri.scheme == 'obs': if check_build_environment and Defaults.is_buildservice_worker(): return self._buildservice_path( name=''.join([uri.netloc, uri.path]).replace(':/', ':'), fragment=uri.fragment, urischeme=uri.scheme, ) else: return self._obs_project_download_link( ''.join([uri.netloc, uri.path]).replace(':/', ':') ) elif uri.scheme == 'obsrepositories': if not Defaults.is_buildservice_worker(): raise KiwiUriStyleUnknown( 'Only the buildservice can use the {0} schema'.format( uri.scheme ) ) return self._buildservice_path( name=''.join([uri.netloc, uri.path]).replace(':/', ':'), fragment=uri.fragment, urischeme=uri.scheme, ) elif uri.scheme == 'dir': return self._local_path(uri.path) elif uri.scheme == 'file': return self._local_path(uri.path) elif uri.scheme.startswith('http') or uri.scheme == 'ftp': netloc = uri.netloc uri_with_credentials_pattern = '^(.*):(.*)@(.*)$' sensitive_match = re.match(uri_with_credentials_pattern, netloc) if sensitive_match: netloc = "{0}:{1}@{2}".format( quote(sensitive_match.group(1)), quote(sensitive_match.group(2)), sensitive_match.group(3), ) if self._get_credentials_uri() or not uri.query: return ''.join([uri.scheme, '://', netloc, uri.path]) else: return ''.join( [uri.scheme, '://', netloc, uri.path, '?', uri.query] ) else: raise KiwiUriStyleUnknown(f'URI schema {self.uri} not supported') @staticmethod def print_sensitive(location: str) -> str: uri_with_credentials_pattern = '^.*://(.*:.*)@.*' sensitive_match = re.match(uri_with_credentials_pattern, location) if sensitive_match: return location.replace(sensitive_match.group(1), '******') else: return location def credentials_file_name(self) -> str: """ Filename to store repository credentials :return: credentials file name :rtype: str """ uri = self._get_credentials_uri() # initialize query with default credentials file name. # The information will be overwritten if the uri contains # a parameter query with a credentials parameter query = {'credentials': 'kiwiRepoCredentials'} if uri: query = dict(params.split('=') for params in uri.query.split('&')) return query['credentials'] def alias(self) -> str: """ Create hex representation of uuid4 If the repository definition from the XML description does not provide an alias, kiwi creates one for you. However it's better to assign a human readable alias in the XML configuration :return: alias name as hex representation of uuid4 :rtype: str """ return uuid4().hex def is_remote(self) -> bool: """ Check if URI is a remote or local location :return: True|False :rtype: bool """ uri = urlparse(self.uri) if not uri.scheme: raise KiwiUriStyleUnknown(f'URI scheme not detected {self.uri}') if uri.scheme == 'obs' and Defaults.is_buildservice_worker(): return False elif uri.scheme in self.remote_uri_types: return True elif uri.scheme in self.local_uri_type: return False else: raise KiwiUriTypeUnknown(f'URI type {uri.scheme} unknown') def is_public(self) -> bool: """ Check if URI is considered to be publicly reachable :return: True|False :rtype: bool """ uri = urlparse(self.uri) if not uri.scheme: # unknown uri schema is considered not public return False elif uri.scheme == 'obs': # obs is public but only if the configured download_server is public return self.runtime_config.is_obs_public() elif uri.scheme in self.remote_uri_types: # listed in remote uri types, thus public return True else: # unknown uri type considered not public return False def get_fragment(self) -> str: """ Returns the fragment part of the URI. :return: fragment part of the URI if any, empty string otherwise :rtype: str """ uri = urlparse(self.uri) return uri.fragment def _get_credentials_uri(self) -> Optional[ParseResult]: uri = urlparse(self.uri) credentials_uri = None if uri.query and uri.query.startswith('credentials='): credentials_uri = uri return credentials_uri def _local_path(self, path: str) -> str: return os.path.abspath(os.path.normpath(path)) def _obs_project_download_link(self, name: str) -> str: name_parts = name.split(os.sep) repository = name_parts.pop() project = os.sep.join(name_parts) download_link = None try: download_link = os.sep.join( [ self.runtime_config.get_obs_download_server_url(), project.replace(':', ':/'), repository, ] ) if not Defaults.is_buildservice_worker(): request = requests.get(download_link) request.raise_for_status() return request.url else: log.warning( 'Using {0} without location verification due to build ' 'in isolated environment'.format(download_link) ) return download_link except Exception as issue: raise KiwiUriOpenError(f'{download_link}: {issue}') def _buildservice_path( self, name: str, urischeme: str, fragment: str = '' ) -> str: """ Special to openSUSE buildservice. If the buildservice builds the image it arranges the repos for each build in a special environment, the so called build worker. """ bs_source_dir = '/usr/src/packages/SOURCES' if self.repo_type == 'container': if urischeme == 'obsrepositories': local_path = os.sep.join( [bs_source_dir, 'containers/_obsrepositories', name] ) else: local_path = os.sep.join([bs_source_dir, 'containers', name]) if fragment: local_path = ''.join([local_path, '#', fragment]) else: local_path = os.sep.join([bs_source_dir, 'repos', name]) return self._local_path(local_path) def _resolve_metalink_uri(self, uri: str) -> str: selected_repo_source = uri namespace_map = dict(metalink="http://www.metalinker.org/") expression = '//metalink:file[@name="repomd.xml"]/metalink:resources/*' try: metalink_location = urlopen(Request(uri)) xml = etree.parse(metalink_location) url_list = xml.getroot().xpath(expression, namespaces=namespace_map) source_dict = {} for url in url_list: if url.get('protocol') == 'https': source_dict[url.text] = int(url.get('preference')) start_preference = 0 for url in sorted(source_dict.keys()): preference = source_dict[url] if preference > start_preference: selected_repo_source = url start_preference = preference except Exception as issue: raise KiwiUriOpenError( f'Failed to resolve metalink URI {uri}: {issue}' ) selected_repo_source = selected_repo_source.replace( 'repodata/repomd.xml', '' ) return selected_repo_source ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.751661 kiwi-11.1.8/kiwi/system/users.py0000644000000000000000000001126315273675667013530 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import List, Optional # project from kiwi.command import Command from kiwi.path import Path class Users: """ **Operations on users and groups in a root directory** :param str root_dir: root directory path name """ def __init__(self, root_dir: str): self.root_dir = root_dir def user_exists(self, user_name: str) -> bool: """ Check if user exists :param str user_name: user name :return: True|False :rtype: bool """ return self._search_for(user_name, '/etc/passwd') def group_exists(self, group_name: str) -> bool: """ Check if group exists :param str group_name: group name :return: True|False :rtype: bool """ return self._search_for(group_name, '/etc/group') def group_add(self, group_name: str, options: List[str]) -> None: """ Add group with options :param str group_name: group name :param list options: groupadd options """ Command.run( ['chroot', self.root_dir, 'groupadd'] + options + [group_name] ) def user_add(self, user_name: str, options: List[str]) -> None: """ Add user with options :param str user_name: user name :param list options: useradd options """ # useradd -m creates the home directory itself, but not missing # parents. self._create_home_parent(options) Command.run( ['chroot', self.root_dir, 'useradd'] + options + [user_name] ) def user_modify(self, user_name: str, options: List[str]) -> None: """ Modify user with options :param str user_name: user name :param list options: usermod options """ Command.run( ['chroot', self.root_dir, 'usermod'] + options + [user_name] ) def setup_home_for_user( self, user_name: str, group_name: str, home_path: str ) -> None: """ Setup user home directory :param str user_name: user name :param str group_name: group name :param str home_path: path name """ user_and_group = user_name + ':' + group_name Command.run( ['chroot', self.root_dir, 'chown', '-R', user_and_group, home_path] ) def _search_for(self, name: str, in_file: str) -> bool: search = '^' + name + ':' try: Command.run( ['chroot', self.root_dir, 'grep', '-q', search, in_file] ) except Exception: return False return True def _create_home_parent(self, options: List[str]) -> None: """ Create missing parent directories for a useradd home path useradd creates the home directory given with -d/--home-dir when -m is set, but fails if a parent of that path does not exist. """ home_path = self._home_path_from_options(options) if home_path and home_path.startswith(os.sep): # dirname() keeps a leading separator; drop it so join does not # discard root_dir (os.path.join ignores earlier parts on abs paths). # An empty relative parent means the home is directly under '/'. relative_parent = os.path.dirname(home_path.rstrip(os.sep)).lstrip( os.sep ) if relative_parent: parent = os.path.join(self.root_dir, relative_parent) if not os.path.isdir(parent): Path.create(parent) @staticmethod def _home_path_from_options(options: List[str]) -> Optional[str]: home_flags = ('-d', '--home', '--home-dir') for index, option in enumerate(options): flag, separator, value = option.partition('=') if flag in home_flags: if separator: return value if index + 1 < len(options): return options[index + 1] return None ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.751661 kiwi-11.1.8/kiwi/tasks/__init__.py0000644000000000000000000000000015273675667013712 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/base.py0000644000000000000000000002470415273675667013106 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging import glob from typing import List, Dict, Optional, Union, Any from operator import attrgetter # project from kiwi.cli import Cli from kiwi.xml_state import XMLState from kiwi.xml_description import XMLDescription from kiwi.runtime_checker import RuntimeChecker from kiwi.exceptions import KiwiConfigFileNotFound log: Any = logging.getLogger('kiwi') class CliTask: """ Base class for all task classes, loads the task and provides the interface to the command options and the XML description Attributes * :attr:`should_perform_task_setup` Indicates if the task should perform the setup steps which covers the following task configurations: * setup debug level * setup logfile * setup color output """ def __init__(self, should_perform_task_setup: bool = True) -> None: self.cli = Cli() # initialize runtime checker self.runtime_checker: Optional[RuntimeChecker] = None # load/import task module self.task = self.cli.load_command() # get command specific args self.command_args = self.cli.get_command_args() # get global args self.global_args = self.cli.get_global_args() # initialize generic runtime check dicts self.checks_before_command_args: Dict[str, List[str]] = { 'check_image_version_provided': [], 'check_initrd_selection_required': [], 'check_boot_description_exists': [], 'check_consistent_kernel_in_boot_and_system_image': [], 'check_container_tool_chain_installed': [], 'check_volume_setup_defines_reserved_labels': [], 'check_volume_setup_defines_multiple_fullsize_volumes': [], 'check_volume_setup_has_no_root_definition': [], 'check_volume_label_used_with_lvm': [], 'check_swap_name_used_with_lvm': [], 'check_xen_uniquely_setup_as_server_or_guest': [], 'check_mediacheck_installed': [], 'check_checkmedia_used_with_msdos_table': [], 'check_dracut_module_for_live_iso_in_package_list': [], 'check_dracut_module_for_disk_overlay_in_package_list': [], 'check_dracut_module_for_disk_oem_in_package_list': [], 'check_dracut_module_for_oem_install_in_package_list': [], 'check_appx_naming_conventions_valid': [], 'check_image_type_unique': [], 'check_include_references_unresolvable': [], 'check_luksformat_options_valid': [], 'check_partuuid_persistency_type_used_with_mbr': [], 'check_efi_fat_image_has_correct_size': [], 'check_bootloader_env_compatible_with_loader': [], 'check_kernel_flavor_supported': [], } self.checks_after_command_args: Dict[str, List[str]] = { 'check_repositories_configured': [], 'check_image_include_repos_publicly_resolvable': [], } if should_perform_task_setup: # set log file if self.global_args['--logfile']: log.set_logfile(self.global_args['--logfile']) # set log socket if self.global_args['--logsocket']: log.set_log_socket(self.global_args['--logsocket']) # set log level if self.global_args['--loglevel']: try: log.setLogLevel(int(self.global_args['--loglevel'])) except ValueError: # Not a numeric log level, stick with the default # which is INFO log.setLogLevel(logging.INFO) elif self.global_args['--debug']: log.setLogLevel(logging.DEBUG) else: log.setLogLevel(logging.INFO) if self.global_args['--logfile'] == 'stdout': # deactivate standard console logger by setting # the highest possible log entry level log.setLogLevel(logging.CRITICAL, except_for=['file', 'socket']) elif self.global_args['--logfile']: # set debug level for the file and socket logger log.setLogLevel(logging.DEBUG, only_for=['file', 'socket']) # set log flags if self.global_args['--debug-run-scripts-in-screen']: log.setLogFlag('run-scripts-in-screen') if self.global_args['--color-output']: log.set_color_format() if self.global_args['--setenv']: for setenv in self.global_args['--setenv']: variable, value = self.attr_token(setenv) log.info(f'--> Set Env[{variable}]="{value}"') os.environ[format(variable)] = format(value) # initialize runtime configuration # import RuntimeConfig late to make sure the logging setup applies from kiwi.runtime_config import RuntimeConfig self.runtime_config = RuntimeConfig() def load_xml_description( self, description_directory: str, kiwi_file: str = '' ) -> None: """ Load, upgrade, validate XML description :param str description_directory: Path to the image description :param str kiwi_file: Basename of kiwi file which contains the main image configuration elements. If not specified kiwi searches for a file named config.xml or a file matching .kiwi """ if kiwi_file: config_file = os.sep.join([description_directory, kiwi_file]) else: config_file = os.sep.join([description_directory, '/config.xml']) if not os.path.exists(config_file): # alternative config file lookup location config_file = description_directory + '/image/config.xml' if not os.path.exists(config_file): # glob config file search, first match wins glob_match = description_directory + '/*.kiwi' for kiwi_file in sorted(glob.iglob(glob_match)): config_file = kiwi_file break if not os.path.exists(config_file): raise KiwiConfigFileNotFound( f'no XML description found in {description_directory}' ) self.description = XMLDescription(config_file) self.xml_data = self.description.load() self.config_file = config_file.replace('//', '/') self.xml_state = XMLState( self.xml_data, self.global_args['--profile'], self.global_args['--type'], ) log.info('--> loaded %s', self.config_file) if self.xml_state.build_type: log.info( '--> Selected build type: %s', self.xml_state.get_build_type_name(), ) if self.xml_state.profiles: log.info( '--> Selected profiles: %s', ','.join(self.xml_state.profiles) ) self.runtime_checker = RuntimeChecker(self.xml_state) def eleventuple_token( self, option: str ) -> List[Union[bool, str, List[str], None]]: """ Helper method for commandline options of the form --option a,b,c,d,e,f,g,h,i,j,k Make sure to provide a common result for option values which separates the information in a comma separated list of values :param str option: comma separated option string :return: common option value representation :rtype: list """ return self._ntuple_token(option, 11) def attr_token( self, option: str ) -> List[Union[bool, str, List[str], None]]: """ Helper method for commandline options of the form --option attribute=value :param str option: attribute=value string :return: common option value representation :rtype: list """ return self._ntuple_token(option, 2, '=') def run_checks(self, checks: Dict[str, List[str]]) -> None: """ This method runs the given runtime checks excluding the ones disabled in the runtime configuration file. :param dict checks: A dictionary with the runtime method names as keys and their arguments list as the values. """ exclude_list = self.runtime_config.get_disabled_runtime_checks() if self.runtime_checker is not None: for method, args in { key: value for key, value in checks.items() if key not in exclude_list }.items(): attrgetter(method)(self.runtime_checker)(*args) def _pop_token(self, tokens: List[str]) -> Union[bool, str, List[str]]: token = tokens.pop(0) if len(token) > 0 and token == 'true': return True elif len(token) > 0 and token == 'false': return False elif len(token) > 0 and token.startswith('{'): return token.replace('{', '').replace('}', '').split(';') else: return token def _ntuple_token( self, option: str, tuple_count: int, separator: str = ',' ) -> List[Union[bool, str, List[str], None]]: """ Helper method for commandline options of the form --option a,b,c,d,e,f Make sure to provide a common result for option values which separates the information in a comma separated list of values :param str option: comma separated option string :param int tuple_count: divide into tuple_count tuples :return: common option value representation :rtype: list """ tokens = option.split(separator, tuple_count - 1) if option else [] return [ self._pop_token(tokens) if len(tokens) else None for _ in range(0, tuple_count) ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/image_info.py0000644000000000000000000002317115273675667014266 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import Any, List, Optional from itertools import zip_longest from urllib.parse import urlparse # project from kiwi.tasks.base import CliTask from kiwi.help import Help from kiwi.utils.output import DataOutput from kiwi.solver.sat import Sat from kiwi.solver.repository import SolverRepository from kiwi.solver.repository.base import SolverRepositoryBase from kiwi.system.uri import Uri from kiwi.system.profile import Profile from kiwi.defaults import Defaults import kiwi.defaults as defaults class ImageInfoTask(CliTask): """ Implements retrieval of in depth information for an image description Attributes * :attr:`manual` Instance of Help """ def process(self) -> None: """ Walks through the given info options and provide the requested data """ self.manual = Help() if self.command_args.get('help') is True: return self.manual.show('kiwi::image::info') self.load_xml_description( self.command_args['--description'], self.global_args['--kiwi-file'] ) if self.command_args['--ignore-repos']: self.xml_state.delete_repository_sections() if self.command_args['--add-repo']: for add_repo, add_credentials in zip_longest( self.command_args['--add-repo'], self.command_args['--add-repo-credentials'], ): self.xml_state.add_repository( *self._get_repo_parameters(add_repo, add_credentials) ) assert self.runtime_checker is not None self.runtime_checker.check_repositories_configured() result = {'image': self.xml_state.xml_data.get_name()} if self.command_args['--print-kiwi-env']: profile = Profile(self.xml_state) defaults = Defaults() defaults.to_profile(profile) result['kiwi_env'] = profile.get_settings() if self.command_args['--list-profiles']: result['profile_names'] = [] for profiles_section in self.xml_state.xml_data.get_profiles(): for profile in profiles_section.get_profile(): result['profile_names'].append(profile.get_name()) if self.command_args['--resolve-package-list']: solver = self._setup_solver() boostrap_package_list = self.xml_state.get_bootstrap_packages() package_list = ( boostrap_package_list + self.xml_state.get_system_packages() ) bootstrap_collection_type = ( self.xml_state.get_bootstrap_collection_type() ) system_collection_type = self.xml_state.get_system_collection_type() bootstrap_packages = solver.solve( boostrap_package_list, False, True if bootstrap_collection_type == 'onlyRequired' else False, ) solved_packages = solver.solve( self.xml_state.get_system_packages(), False, True if system_collection_type == 'onlyRequired' else False, ) solved_packages.update(bootstrap_packages) package_info = {} for package, metadata in sorted(list(solved_packages.items())): if package in package_list: status = 'listed_in_kiwi_description' else: status = 'added_by_dependency_solver' package_info[package] = { 'source': metadata.uri, 'installsize_bytes': int(metadata.installsize_bytes), 'arch': metadata.arch, 'version': metadata.version, 'status': status, } result['resolved-packages'] = package_info if self.global_args['--color-output']: DataOutput(result, style='color').display() else: DataOutput(result).display() if self.command_args['--print-xml']: DataOutput.display_file( self.description.markup.get_xml_description(), 'Description(XML):', ) elif self.command_args['--print-yaml']: DataOutput.display_file( self.description.markup.get_yaml_description(), 'Description(YAML):', ) elif self.command_args['--print-toml']: DataOutput.display_file( self.description.markup.get_toml_description(), 'Description(TOML):', ) def _setup_solver(self) -> Sat: solver = Sat() for xml_repo in self.xml_state.get_repository_sections_used_for_build(): repo_source = xml_repo.get_source().get_path() repo_sourcetype = xml_repo.get_sourcetype() or '' repo_user = xml_repo.get_username() repo_secret = xml_repo.get_password() repo_type = xml_repo.get_type() repo_dist = xml_repo.get_distribution() repo_components = xml_repo.get_components() if not repo_type: repo_type = SolverRepositoryBase( Uri(uri=repo_source, source_type=repo_sourcetype), repo_user, repo_secret, ).get_repo_type() if repo_type == 'apt-deb': # Debian based repos can be setup for a specific # distribution including a list of individual components. # For each component of the selected distribution extra # repository metadata exists. In such a case we iterate # over the configured dist components and add them as # repository each. dist_type = solver.set_dist_type('deb') # without a Debian name for the architecture the # solver uses the machine name, see Sat.set_dist_type deb_arch = ( dist_type['arch'] if dist_type else defaults.PLATFORM_MACHINE ) if repo_components and repo_dist: for component in repo_components.split(): repo_source_for_component = os.sep.join( [ repo_source.rstrip(os.sep), 'dists', repo_dist, component, f'binary-{deb_arch}', ] ) solver.add_repository( SolverRepository.new( Uri( repo_source_for_component, repo_type, repo_sourcetype, ), repo_user, repo_secret, ) ) continue solver.add_repository( SolverRepository.new( Uri(repo_source, repo_type, repo_sourcetype), repo_user, repo_secret, ) ) return solver def _get_repo_parameters( self, tokens: str, credentials: Optional[str] ) -> List[Any]: parameters: List[Any] = self.eleventuple_token(tokens) signing_keys_index = 6 repo_source_index = 0 repo_type_index = 1 repo_alias_index = 2 if not parameters[repo_type_index]: # make sure to pass a None value if an empty string # is provided as repo type. This will cause no type # attribute to be set instead of an empty type which # is not allowed by the schema parameters[repo_type_index] = None if not parameters[repo_alias_index]: # make sure to pass a None value if an empty string # is provided as repo alias. This will cause no alias # attribute to be set instead of an empty type which # is not allowed by the schema parameters[repo_alias_index] = None if not parameters[signing_keys_index]: # make sure to pass empty list for signing_keys param parameters[signing_keys_index] = [] if credentials: if os.path.isfile(credentials): with open(credentials) as credentials_fd: credentials = credentials_fd.readline().strip(os.linesep) repo_source = parameters[repo_source_index] repo_scheme = urlparse(repo_source).scheme if repo_scheme: repo_source = repo_source.replace(f'{repo_scheme}://', '') repo_source = f'{repo_scheme}://{credentials}@{repo_source}' parameters[repo_source_index] = repo_source return parameters ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/image_resize.py0000644000000000000000000000674515273675667014644 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging # project from kiwi.firmware import FirmWare from kiwi.storage.loop_device import LoopDevice from kiwi.partitioner import Partitioner from kiwi.tasks.base import CliTask from kiwi.help import Help from kiwi.storage.subformat import DiskFormat from kiwi.utils.size import StringToSize from kiwi.exceptions import KiwiImageResizeError log = logging.getLogger('kiwi') class ImageResizeTask(CliTask): """ Implements resizing of disk images and their disk format Attributes * :attr:`manual` Instance of Help """ def process(self) -> None: """ reformats raw disk image and its format to a new disk geometry using the qemu tool chain """ self.manual = Help() if self.command_args.get('help') is True: return self.manual.show('kiwi::image::resize') abs_target_dir_path = os.path.abspath(self.command_args['--target-dir']) if self.command_args['--root']: image_root = os.path.abspath( os.path.normpath(self.command_args['--root']) ) else: image_root = os.sep.join( [abs_target_dir_path, 'build', 'image-root'] ) self.load_xml_description(image_root, self.global_args['--kiwi-file']) disk_format = self.xml_state.build_type.get_format() with DiskFormat.new( disk_format or 'raw', self.xml_state, image_root, abs_target_dir_path, ) as image_format: if not image_format.has_raw_disk(): raise KiwiImageResizeError( 'no raw disk image {0} found in build results'.format( image_format.diskname ) ) new_disk_size = StringToSize.to_bytes(self.command_args['--size']) # resize raw disk log.info(f'Resizing raw disk to {new_disk_size} bytes') resize_result = image_format.resize_raw_disk(new_disk_size) # resize raw disk partition table firmware = FirmWare(self.xml_state) with LoopDevice(image_format.diskname) as loop_provider: loop_provider.create(overwrite=False) partitioner = Partitioner.new( firmware.get_partition_table_type(), loop_provider ) partitioner.resize_table() # resize disk format from resized raw disk if disk_format and resize_result is True: log.info( f'Creating {disk_format} disk format from resized raw disk' ) image_format.create_image_format() elif resize_result is False: log.info(f'Raw disk is already at {new_disk_size} bytes') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/result_bundle.py0000644000000000000000000003413715273675667015044 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from collections import OrderedDict from textwrap import dedent from typing import Any, Dict, List, Union import logging import glob import os # project from kiwi.tasks.base import CliTask from kiwi.help import Help from kiwi.system.result import Result, result_file_type from kiwi.path import Path from kiwi.utils.compress import Compress from kiwi.privileges import Privileges from kiwi.command import Command from kiwi.exceptions import KiwiBundleError log = logging.getLogger('kiwi') class ResultBundleTask(CliTask): """ Implements result bundler Attributes * :attr:`manual` Instance of Help """ def process(self) -> None: """ Create result bundle from the image build results in the specified target directory. Each result image will contain the specified bundle identifier as part of its filename. Uncompressed image files will also become xz compressed and a sha sum will be created from every result image """ self.manual = Help() if self._help(): return if self.command_args['--package-as-rpm']: Privileges.check_for_root_permissions() # load serialized result object from target directory result_directory = os.path.abspath(self.command_args['--target-dir']) bundle_directory = os.path.abspath(self.command_args['--bundle-dir']) if result_directory == bundle_directory: raise KiwiBundleError( 'Bundle directory must be different from target directory' ) log.info('Bundle build results from %s', result_directory) result: Result = Result.load(result_directory + '/kiwi.result') if self.command_args['--bundle-format']: result.add_bundle_format(self.command_args['--bundle-format']) image_version = result.xml_state.get_image_version() image_name = result.xml_state.xml_data.get_name() image_description = result.xml_state.get_description_section() ordered_results: Dict[str, Any] = OrderedDict( sorted(result.get_results().items()) ) # hard link bundle files, compress and build checksum if self.command_args['--package-as-rpm']: Path.wipe(bundle_directory) if not os.path.exists(bundle_directory): Path.create(bundle_directory) bundle_file_format_name = '' if 'bundle_format' in ordered_results: bundle_format = ordered_results['bundle_format'] tags = bundle_format['tags'] bundle_file_format_name = bundle_format['pattern'] # Insert image name bundle_file_format_name = bundle_file_format_name.replace( '%N', tags.N ) # Insert Concatenated profile name (_) bundle_file_format_name = bundle_file_format_name.replace( '%P', tags.P ) # Insert Architecture name bundle_file_format_name = bundle_file_format_name.replace( '%A', tags.A ) # Insert Image build type name bundle_file_format_name = bundle_file_format_name.replace( '%T', tags.T ) # Insert Image Major version number bundle_file_format_name = bundle_file_format_name.replace( '%M', format(tags.M) ) # Insert Image Minor version number bundle_file_format_name = bundle_file_format_name.replace( '%m', format(tags.m) ) # Insert Image Patch version number bundle_file_format_name = bundle_file_format_name.replace( '%p', format(tags.p) ) # Insert Version string bundle_file_format_name = bundle_file_format_name.replace( '%v', format(tags.v) ) # Insert Bundle ID bundle_file_format_name = bundle_file_format_name.replace( '%I', self.command_args['--id'] ) del ordered_results['bundle_format'] # copy result files origin_files = [] copied_files = [] for result_file in list(ordered_results.values()): if result_file.use_for_bundle: bundle_file_basename = self._get_bundle_file_basename( result, result_file, bundle_file_format_name ) log.info('Creating %s', bundle_file_basename) bundle_file = ''.join( [bundle_directory, '/', bundle_file_basename] ) Command.run(['cp', result_file.filename, bundle_file]) copied_files.append(bundle_file) result_file_basename = os.path.basename(result_file.filename) if result_file_basename != bundle_file_basename: symlink_orignal_name = ( f'{bundle_directory}/{result_file_basename}' ) if os.path.islink(symlink_orignal_name): os.unlink(symlink_orignal_name) os.symlink(bundle_file, symlink_orignal_name) origin_files.append(symlink_orignal_name) # check and fix file references due to possible bundle_format renames for origin_file in origin_files: origin_file_basename = os.path.basename(origin_file) bundle_file_basename = os.path.basename(os.readlink(origin_file)) log.info(f'Checking file references for {origin_file_basename}') for result_file in copied_files: if 'text' in Command.run(['file', result_file]).output: log.info(f'--> {result_file}') Command.run( [ 'sed', '-ie', f's/{origin_file_basename}/{bundle_file_basename}/g', result_file, ] ) os.unlink(f'{result_file}e') os.unlink(origin_file) # finalize result data, checksums, compressions for result_file in list(ordered_results.values()): if result_file.use_for_bundle: bundle_file_basename = self._get_bundle_file_basename( result, result_file, bundle_file_format_name ) log.info(f'Finalizing {bundle_file_basename}') bundle_file = ''.join( [bundle_directory, '/', bundle_file_basename] ) if ( result_file.compress and not self.command_args['--no-compress'] ): log.info('--> Compressing') compress = Compress(bundle_file) bundle_file = compress.xz( self.runtime_config.get_xz_options() ) if self.command_args['--zsync-source'] and result_file.shasum: # Files with a checksum are considered to be image files # and are therefore eligible to be provided via the # requested Partial/differential file download based on # zsync zsyncmake = Path.which('zsyncmake', access_mode=os.X_OK) if zsyncmake: log.info('--> Creating zsync control file') Command.run( [ zsyncmake, '-e', '-u', os.sep.join( [ self.command_args['--zsync-source'], os.path.basename(bundle_file), ] ), '-o', bundle_file + '.zsync', bundle_file, ] ) else: log.warning( '--> zsyncmake missing, zsync setup skipped' ) if result_file.shasum: checksum = self.runtime_config.get_checksum_handler( source_filename=bundle_file, bundle_lookup=True ) log.info(f'--> Creating {checksum.suffix} sum') with open(f'{bundle_file}{checksum.suffix}', 'w') as shasum: shasum.write( '{0} {1}{2}'.format( checksum.digest(), os.path.basename(bundle_file), os.linesep, ) ) if self.command_args['--package-as-rpm']: ResultBundleTask._build_rpm_package( bundle_directory, bundle_file_format_name or image_name, image_version, image_description.specification, list(glob.iglob(f'{bundle_directory}/*')), ) def _get_bundle_file_basename( self, result: Result, result_file: result_file_type, bundle_file_format_name: str, ) -> str: image_version = result.xml_state.get_image_version() image_name = result.xml_state.xml_data.get_name() special_exts = ['.oci.tar.', '.docker.tar.', '.vagrant.'] special_exts_uncompressed = ['.oci.tar', '.docker.tar'] if any( special_ext in result_file.filename for special_ext in special_exts ): extension = f'{".".join(result_file.filename.split(".")[-3:])}' elif any( special_ext in result_file.filename for special_ext in special_exts_uncompressed ): extension = f'{".".join(result_file.filename.split(".")[-2:])}' elif '.tar.' in result_file.filename: extension = f'tar.{result_file.filename.split(".").pop()}' else: extension = result_file.filename.split('.').pop() if bundle_file_format_name: bundle_file_basename = '.'.join( [bundle_file_format_name, extension] ) else: bundle_file_basename = os.path.basename(result_file.filename) # The bundle id is only taken into account for image results # which contains the image version appended in its file name part_name = list(bundle_file_basename.partition(image_name)) bundle_file_basename = ''.join( [ part_name[0], part_name[1], part_name[2].replace( image_version, image_version + '-' + self.command_args['--id'], ), ] ) return bundle_file_basename @staticmethod def _build_rpm_package( bundle_directory: str, image_name: str, image_version: str, description_text: str, filenames: List[str], ) -> None: source_links = [] for source_file in filenames: source_links.append( ' '.join( [ 'ln', '%{_sourcedir}/' + os.path.basename(source_file), '%{buildroot}' + f'/var/tmp/{image_name}', ] ) ) spec_file_name = os.path.join(bundle_directory, f'{image_name}.spec') spec_data = dedent( ''' %global _sourcedir %(pwd) %global _rpmdir . Url: https://osinside.github.io/kiwi Name: {name} Summary: {name} Version: {version} Release: 0 Group: %{{sysgroup}} License: GPL-3.0-or-later BuildRoot: %{{_tmppath}}/%{{name}}-%{{version}}-build BuildArch: noarch %description {description} %prep %build %install install -d -m 755 %{{buildroot}}/var/tmp/{name} {source_links} %clean rm -rf %{{buildroot}} %files %defattr(-, root, root) /var/tmp/{name} %changelog ''' ).format( name=image_name, version=image_version, description=description_text, source_links=os.linesep.join(source_links), ) with open(spec_file_name, 'w') as spec: spec.write(spec_data) os.chdir(bundle_directory) log.info('Creating rpm package...') Command.run( [ 'rpmbuild', '--nodeps', '--nocheck', '--rmspec', '-bb', spec_file_name, ] ) for source_file in filenames: os.unlink(source_file) Command.run(['bash', '-c', 'mv noarch/*.rpm . && rmdir noarch']) def _help(self) -> Union[bool, Help]: if self.command_args['help']: self.manual.show('kiwi::result::bundle') else: return False return self.manual ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/result_list.py0000644000000000000000000000321315273675667014535 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import Union import logging # project from kiwi.tasks.base import CliTask from kiwi.help import Help from kiwi.system.result import Result log = logging.getLogger('kiwi') class ResultListTask(CliTask): """ Implements result listing Attributes * :attr:`manual` Instance of Help """ def process(self) -> None: """ List result information from a previous system command """ self.manual = Help() if self._help(): return result_directory = os.path.abspath(self.command_args['--target-dir']) log.info('Listing results from %s', result_directory) result: Result = Result.load(result_directory + '/kiwi.result') result.print_results() def _help(self) -> Union[bool, Help]: if self.command_args['help']: self.manual.show('kiwi::result::list') else: return False return self.manual ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/system_boxbuild.py0000644000000000000000000001445415273675667015411 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from typing import List # project from kiwi.tasks.base import CliTask from kiwi.help import Help from kiwi.boxbuild.box_build import BoxBuild from kiwi.boxbuild.box_container_build import BoxContainerBuild from kiwi.boxbuild.boxes_config import BoxesConfig from kiwi.exceptions import KiwiBoxBuildError log = logging.getLogger('kiwi') class SystemBoxbuildTask(CliTask): """ Implements building of system images in a self contained virtual machine or container, called a box Attributes * :attr:`manual` Instance of Help """ def process(self) -> None: """ Build a system image from the specified description in a box. The box runs the kiwi build command with the provided build command arguments """ self.manual = Help() if self._help(): return if self.command_args.get('--list-boxes'): print(BoxesConfig().dump_config()) elif self.command_args.get('--box'): keep_open = bool(self.command_args.get('--box-debug')) kiwi_version = self.command_args.get('--kiwi-version') shared_path = self.command_args.get('--shared-path') if self.command_args.get('--container'): box_container_build = BoxContainerBuild( boxname=self.command_args['--box'], arch=self._get_box_arch(), ) box_container_build.run( self._get_kiwi_build_command(), keep_open, kiwi_version, shared_path, ) else: request_update_check = not self.command_args.get( '--no-update-check' ) request_snapshot_mode = not self.command_args.get( '--no-snapshot' ) box_build = BoxBuild( boxname=self.command_args['--box'], ram=self.command_args.get('--box-memory'), console=self.command_args.get('--box-console'), smp=self.command_args.get('--box-smp-cpus'), arch=self._get_box_arch(), machine=self.command_args.get('--machine'), cpu=self.command_args.get('--cpu') or 'host', sharing_backend=self._get_sharing_backend(), ssh_key=self.command_args.get('--ssh-key') or 'id_rsa', ssh_port=self.command_args.get('--ssh-port') or '', accel=not bool(self.command_args.get('--no-accel')), ) box_build.run( self._get_kiwi_build_command(), request_update_check, request_snapshot_mode, keep_open, kiwi_version, shared_path, ) def _help(self) -> bool: if self.command_args.get('help'): self.manual.show('kiwi::system::boxbuild') return True return False def _get_kiwi_build_command(self) -> List[str]: """ Construct the kiwi system build command to run in the box from the global options and the arguments passed along with the kiwi subcommand of boxbuild """ kiwi_build_command = ['system', 'build'] translate_to_abspath = False for entry in self.command_args.get('system_build') or []: if translate_to_abspath: entry = os.path.abspath(os.path.normpath(entry)) translate_to_abspath = False if entry == '--description' or entry == '--target-dir': translate_to_abspath = True kiwi_build_command.append(entry) final_kiwi_build_command = [] if self.global_args.get('--debug'): final_kiwi_build_command.append('--debug') if self.global_args.get('--type'): final_kiwi_build_command.append('--type') final_kiwi_build_command.append(self.global_args['--type']) if self.global_args.get('--profile'): for profile in sorted(set(self.global_args['--profile'])): final_kiwi_build_command.append('--profile') final_kiwi_build_command.append(profile) if self.global_args.get('--kiwi-file'): final_kiwi_build_command.append('--kiwi-file') final_kiwi_build_command.append(self.global_args['--kiwi-file']) final_kiwi_build_command += kiwi_build_command missing_required_options = [ option for option in ['--description', '--target-dir'] if option not in final_kiwi_build_command ] if missing_required_options: raise KiwiBoxBuildError( 'Required option(s) missing in kiwi build command: {0}'.format( ', '.join(missing_required_options) ) ) log.info( 'Building with:{0} {1}'.format( os.linesep, final_kiwi_build_command ) ) return final_kiwi_build_command def _get_box_arch(self) -> str: box_arch = '' if self.command_args.get('--x86_64'): box_arch = 'x86_64' elif self.command_args.get('--aarch64'): box_arch = 'aarch64' return box_arch def _get_sharing_backend(self) -> str: if self.command_args.get('--virtiofs-sharing'): return 'virtiofs' if self.command_args.get('--sshfs-sharing'): return 'sshfs' return '9p' ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/system_build.py0000644000000000000000000003026515273675667014676 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import Any, List, Optional, Union import logging from itertools import zip_longest from urllib.parse import urlparse # project from kiwi.tasks.base import CliTask from kiwi.help import Help from kiwi.system.prepare import SystemPrepare from kiwi.system.setup import SystemSetup from kiwi.builder import ImageBuilder from kiwi.system.profile import Profile from kiwi.defaults import Defaults from kiwi.privileges import Privileges from kiwi.path import Path from kiwi.exceptions import KiwiCATargetDistributionError log: Any = logging.getLogger('kiwi') class SystemBuildTask(CliTask): """ Implements building of system images Attributes * :attr:`manual` Instance of Help """ def process(self) -> None: """ Build a system image from the specified description. The build command combines the prepare and create commands """ self.manual = Help() if self._help(): return Privileges.check_for_root_permissions() abs_target_dir_path = os.path.abspath(self.command_args['--target-dir']) build_dir = os.sep.join([abs_target_dir_path, 'build']) image_root = os.sep.join([build_dir, 'image-root']) Path.create(build_dir) if not self.global_args['--logfile']: log.set_logfile( os.sep.join([abs_target_dir_path, 'build', 'image-root.log']) ) self.load_xml_description( self.command_args['--description'], self.global_args['--kiwi-file'] ) build_checks = self.checks_before_command_args build_checks.update( { 'check_target_directory_not_in_shared_cache': [ abs_target_dir_path ], 'check_target_dir_on_unsupported_filesystem': [ abs_target_dir_path ], } ) self.run_checks(build_checks) if self.command_args['--set-type-attr']: for set_type_attr in self.command_args['--set-type-attr']: attribute, value = self.attr_token(set_type_attr) log.info(f'--> Set ') try: eval( f'self.xml_state.build_type.set_{attribute}("{value}")' ) except AttributeError as issue: log.error(f'Failed to set type attribute: {issue}') return if self.command_args['--set-release-version']: release_version = self.command_args['--set-release-version'] log.info(f'--> Set = {release_version}') section_overwrite = False for preferences in self.xml_state.get_preferences_sections(): section = preferences.get_release_version() if section: section[0] = release_version section_overwrite = True break if not section_overwrite: preferences = self.xml_state.get_preferences_sections()[0] preferences.add_release_version(release_version) if self.command_args['--ignore-repos']: self.xml_state.delete_repository_sections() elif self.command_args['--ignore-repos-used-for-build']: self.xml_state.delete_repository_sections_used_for_build() if self.command_args['--set-repo']: self.xml_state.set_repository( *self._get_repo_parameters( self.command_args['--set-repo'], self.command_args['--set-repo-credentials'], ) ) if self.command_args['--add-repo']: for add_repo, add_credentials in zip_longest( self.command_args['--add-repo'], self.command_args['--add-repo-credentials'], ): self.xml_state.add_repository( *self._get_repo_parameters(add_repo, add_credentials) ) if self.command_args['--set-container-tag']: self.xml_state.set_container_config_tag( self.command_args['--set-container-tag'] ) if self.command_args['--add-container-label']: for add_label in self.command_args['--add-container-label']: try: name, value = add_label.split('=', 1) self.xml_state.add_container_config_label(name, value) except Exception: log.warning( 'Container label {0} ignored. Invalid format: ' 'expected labelname=value'.format(add_label) ) if self.command_args['--set-container-derived-from']: self.xml_state.set_derived_from_image_uri( self.command_args['--set-container-derived-from'] ) if self.command_args['--ca-cert']: ca_certs = self.command_args['--ca-cert'] if ca_certs: target_distribution = ( self.command_args['--ca-target-distribution'] or self.xml_state.get_certificates_target_distribution() ) if not target_distribution or not Defaults.get_ca_update_map( target_distribution ): raise KiwiCATargetDistributionError( 'No or invalid CA target distribution, {} {}'.format( 'set via --ca-target-distribution.', 'allowed values are {}'.format( Defaults.get_ca_target_distributions() ), ) ) for certificate in ca_certs: self.xml_state.add_certificate( certificate, target_distribution ) self.run_checks(self.checks_after_command_args) log.info('Preparing new root system') with SystemPrepare( self.xml_state, image_root, self.command_args['--allow-existing-root'], ) as system: with system.setup_repositories( self.command_args['--clear-cache'], self.command_args['--signing-key'] + self.xml_state.get_repositories_signing_keys(), self.global_args['--target-arch'], ) as manager: system.install_bootstrap( manager, self.command_args['--add-bootstrap-package'] ) setup = SystemSetup(self.xml_state, image_root) setup.import_description() # call post_bootstrap.sh script if present setup.call_post_bootstrap_script() # Setup custom CA certificates after bootstrap package install system.setup_ca_certificates() system.install_system(manager) if self.command_args['--add-package']: system.install_packages( manager, self.command_args['--add-package'] ) if self.command_args['--delete-package']: system.delete_packages( manager, self.command_args['--delete-package'] ) profile = Profile(self.xml_state) defaults = Defaults() defaults.to_profile(profile) profile.create(Defaults.get_profile_file(image_root)) setup.import_overlay_files() setup.import_image_identifier() setup.setup_groups() setup.setup_users() setup.setup_keyboard_map() setup.setup_locale() setup.setup_plymouth_splash() setup.setup_timezone() setup.setup_permissions() setup.import_files() setup.setup_registry_import() # setup permanent image repositories after cleanup setup.import_repositories_marked_as_imageinclude() # call config.sh script if present setup.call_config_script() # if configured, assign SELinux labels setup.setup_selinux_file_contexts() # handle uninstall package requests, gracefully uninstall # with dependency cleanup system.pinch_system(force=False) # handle delete package requests, forced uninstall without # any dependency resolution system.pinch_system(force=True) # create file list of packages if requested setup.create_system_files() # delete any custom rpm macros created system.clean_package_manager_leftovers() setup.call_image_script() log.info('Creating system image') self.run_checks( { 'check_dracut_module_versions_compatible_to_kiwi': [image_root], 'check_kernel_flavors_installed': [image_root], } ) image_builder = ImageBuilder.new( self.xml_state, abs_target_dir_path, image_root, custom_args={ 'signing_keys': self.command_args['--signing-key'] + self.xml_state.get_repositories_signing_keys(), 'xz_options': self.runtime_config.get_xz_options(), }, ) result = image_builder.create() result.print_results() result.dump(os.sep.join([abs_target_dir_path, 'kiwi.result'])) def _help(self) -> Union[bool, Help]: if self.command_args['help']: self.manual.show('kiwi::system::build') else: return False return self.manual def _get_repo_parameters( self, tokens: str, credentials: Optional[str] ) -> List[Any]: parameters: List[Any] = self.eleventuple_token(tokens) signing_keys_index = 6 repo_source_index = 0 repo_type_index = 1 repo_alias_index = 2 if not parameters[repo_type_index]: # make sure to pass a None value if an empty string # is provided as repo type. This will cause no type # attribute to be set instead of an empty type which # is not allowed by the schema parameters[repo_type_index] = None if not parameters[repo_alias_index]: # make sure to pass a None value if an empty string # is provided as repo alias. This will cause no alias # attribute to be set instead of an empty type which # is not allowed by the schema parameters[repo_alias_index] = None if not parameters[signing_keys_index]: # make sure to pass empty list for signing_keys param parameters[signing_keys_index] = [] if credentials: if os.path.isfile(credentials): with open(credentials) as credentials_fd: credentials = credentials_fd.readline().strip(os.linesep) repo_source = parameters[repo_source_index] repo_scheme = urlparse(repo_source).scheme if repo_scheme: repo_source = repo_source.replace(f'{repo_scheme}://', '') repo_source = f'{repo_scheme}://{credentials}@{repo_source}' parameters[repo_source_index] = repo_source return parameters ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/system_create.py0000644000000000000000000000576515273675667015051 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import Union import logging # project from kiwi.tasks.base import CliTask from kiwi.help import Help from kiwi.builder import ImageBuilder from kiwi.system.setup import SystemSetup from kiwi.privileges import Privileges from kiwi.path import Path log = logging.getLogger('kiwi') class SystemCreateTask(CliTask): """ Implements creation of system images Attributes * :attr:`manual` Instance of Help """ def process(self) -> None: """ Create a system image from the specified root directory the root directory is the result of a system prepare command """ self.manual = Help() if self._help(): return Privileges.check_for_root_permissions() abs_target_dir_path = os.path.abspath(self.command_args['--target-dir']) abs_root_path = os.path.abspath(self.command_args['--root']) self.load_xml_description( abs_root_path, self.global_args['--kiwi-file'] ) self.run_checks( { 'check_target_directory_not_in_shared_cache': [abs_root_path], 'check_dracut_module_versions_compatible_to_kiwi': [ abs_root_path ], 'check_target_dir_on_unsupported_filesystem': [abs_root_path], 'check_kernel_flavors_installed': [abs_root_path], } ) log.info('Creating system image') if not os.path.exists(abs_target_dir_path): Path.create(abs_target_dir_path) setup = SystemSetup(xml_state=self.xml_state, root_dir=abs_root_path) setup.call_image_script() image_builder = ImageBuilder.new( self.xml_state, abs_target_dir_path, abs_root_path, custom_args={ 'signing_keys': self.command_args['--signing-key'], 'xz_options': self.runtime_config.get_xz_options(), }, ) result = image_builder.create() result.print_results() result.dump(os.sep.join([abs_target_dir_path, 'kiwi.result'])) def _help(self) -> Union[bool, Help]: if self.command_args['help']: self.manual.show('kiwi::system::create') else: return False return self.manual ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/system_prepare.py0000644000000000000000000002426515273675667015240 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import Any, List, Optional, Union import logging from itertools import zip_longest from urllib.parse import urlparse # project from kiwi.tasks.base import CliTask from kiwi.help import Help from kiwi.privileges import Privileges from kiwi.system.prepare import SystemPrepare from kiwi.system.setup import SystemSetup from kiwi.defaults import Defaults from kiwi.system.profile import Profile from kiwi.exceptions import KiwiCATargetDistributionError log = logging.getLogger('kiwi') class SystemPrepareTask(CliTask): """ Implements preparation and installation of a new root system Attributes * :attr:`manual` Instance of Help """ def process(self) -> None: """ Prepare and install a new system for chroot access """ self.manual = Help() if self._help(): return Privileges.check_for_root_permissions() self.load_xml_description( self.command_args['--description'], self.global_args['--kiwi-file'] ) abs_root_path = os.path.abspath(self.command_args['--root']) prepare_checks = self.checks_before_command_args prepare_checks.update( { 'check_target_directory_not_in_shared_cache': [abs_root_path], 'check_target_dir_on_unsupported_filesystem': [abs_root_path], } ) self.run_checks(prepare_checks) if self.command_args['--set-type-attr']: for set_type_attr in self.command_args['--set-type-attr']: attribute, value = self.attr_token(set_type_attr) log.info(f'--> Set ') try: eval( f'self.xml_state.build_type.set_{attribute}("{value}")' ) except AttributeError as issue: log.error(f'Failed to set type attribute: {issue}') return if self.command_args['--set-release-version']: release_version = self.command_args['--set-release-version'] log.info(f'--> Set = {release_version}') section_overwrite = False for preferences in self.xml_state.get_preferences_sections(): section = preferences.get_release_version() if section: section[0] = release_version section_overwrite = True break if not section_overwrite: preferences = self.xml_state.get_preferences_sections()[0] preferences.add_release_version(release_version) if self.command_args['--ignore-repos']: self.xml_state.delete_repository_sections() elif self.command_args['--ignore-repos-used-for-build']: self.xml_state.delete_repository_sections_used_for_build() if self.command_args['--set-repo']: self.xml_state.set_repository( *self._get_repo_parameters( self.command_args['--set-repo'], self.command_args['--set-repo-credentials'], ) ) if self.command_args['--add-repo']: for add_repo, add_credentials in zip_longest( self.command_args['--add-repo'], self.command_args['--add-repo-credentials'], ): self.xml_state.add_repository( *self._get_repo_parameters(add_repo, add_credentials) ) if self.command_args['--set-container-tag']: self.xml_state.set_container_config_tag( self.command_args['--set-container-tag'] ) if self.command_args['--add-container-label']: for add_label in self.command_args['--add-container-label']: try: name, value = add_label.split('=', 1) self.xml_state.add_container_config_label(name, value) except Exception: log.warning( 'Container label {0} ignored. Invalid format: ' 'expected labelname=value'.format(add_label) ) if self.command_args['--set-container-derived-from']: self.xml_state.set_derived_from_image_uri( self.command_args['--set-container-derived-from'] ) if self.command_args['--ca-cert']: ca_certs = self.command_args['--ca-cert'] if ca_certs: target_distribution = ( self.command_args['--ca-target-distribution'] or self.xml_state.get_certificates_target_distribution() ) if not target_distribution or not Defaults.get_ca_update_map( target_distribution ): raise KiwiCATargetDistributionError( 'No or invalid CA target distribution, {} {}'.format( 'set via --ca-target-distribution.', 'allowed values are {}'.format( Defaults.get_ca_target_distributions() ), ) ) for certificate in ca_certs: self.xml_state.add_certificate( certificate, target_distribution ) self.run_checks(self.checks_after_command_args) log.info('Preparing system') with SystemPrepare( self.xml_state, abs_root_path, self.command_args['--allow-existing-root'], ) as system: with system.setup_repositories( self.command_args['--clear-cache'], self.command_args['--signing-key'] + self.xml_state.get_repositories_signing_keys(), self.global_args['--target-arch'], ) as manager: system.install_bootstrap( manager, self.command_args['--add-bootstrap-package'] ) setup = SystemSetup(self.xml_state, abs_root_path) setup.import_description() # call post_bootstrap.sh script if present setup.call_post_bootstrap_script() # Setup custom CA certificates after bootstrap package install system.setup_ca_certificates() system.install_system(manager) if self.command_args['--add-package']: system.install_packages( manager, self.command_args['--add-package'] ) if self.command_args['--delete-package']: system.delete_packages( manager, self.command_args['--delete-package'] ) profile = Profile(self.xml_state) defaults = Defaults() defaults.to_profile(profile) profile.create(Defaults.get_profile_file(abs_root_path)) setup.import_overlay_files() setup.import_image_identifier() setup.setup_groups() setup.setup_users() setup.setup_keyboard_map() setup.setup_locale() setup.setup_plymouth_splash() setup.setup_timezone() setup.setup_permissions() setup.import_files() setup.setup_registry_import() # setup permanent image repositories after cleanup setup.import_repositories_marked_as_imageinclude() # call config.sh script if present setup.call_config_script() # if configured, assign SELinux labels setup.setup_selinux_file_contexts() # handle uninstall package requests, gracefully uninstall # with dependency cleanup system.pinch_system(force=False) # handle delete package requests, forced uninstall without # any dependency resolution system.pinch_system(force=True) # create file list of packages if requested setup.create_system_files() # delete any custom rpm macros created system.clean_package_manager_leftovers() def _help(self) -> Union[bool, Help]: if self.command_args['help']: self.manual.show('kiwi::system::prepare') else: return False return self.manual def _get_repo_parameters( self, tokens: str, credentials: Optional[str] ) -> List[Any]: parameters: List[Any] = self.eleventuple_token(tokens) signing_keys_index = 6 repo_source_index = 0 if not parameters[signing_keys_index]: # make sure to pass empty list for signing_keys param parameters[signing_keys_index] = [] if credentials: if os.path.isfile(credentials): with open(credentials) as credentials_fd: credentials = credentials_fd.readline().strip(os.linesep) repo_source = parameters[repo_source_index] repo_scheme = urlparse(repo_source).scheme if repo_scheme: repo_source = repo_source.replace(f'{repo_scheme}://', '') repo_source = f'{repo_scheme}://{credentials}@{repo_source}' parameters[repo_source_index] = repo_source return parameters ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/system_stackbuild.py0000644000000000000000000001472015273675667015722 0ustar00# Copyright (c) 2021 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import sys import logging from unittest.mock import patch from typing import List # project from kiwi.help import Help from kiwi.privileges import Privileges from kiwi.tasks.base import CliTask from kiwi.tasks.system_create import SystemCreateTask from kiwi.tasks.system_build import SystemBuildTask from kiwi.command import Command from kiwi.path import Path from kiwi.utils.sync import DataSync from kiwi.defaults import Defaults from kiwi.exceptions import ( KiwiStackBuildTargetDirExists, KiwiStackBuildRootSyncFailed, ) log = logging.getLogger('kiwi') class SystemStackbuildTask(CliTask): """ Implements building of system images based on one or more stash containers stacked together as the image root tree Attributes * :attr:`manual` Instance of Help """ def process(self) -> None: """ Sync the given stash containers into the image root tree and run the kiwi build command if a description is given, or the kiwi create command to rebuild from the stash """ self.manual = Help() if self.command_args.get('help') is True: return self.manual.show('kiwi::system::stackbuild') Privileges.check_for_root_permissions() if self.command_args.get('--stash'): image_root_dir = os.path.join( self.command_args['--target-dir'], 'build', 'image-root' ) if os.path.exists(image_root_dir): raise KiwiStackBuildTargetDirExists( f'image root dir: {image_root_dir!r} already exists' ) Path.create(image_root_dir) for stash_name in self.command_args['--stash']: if self.command_args.get('--from-registry'): log.info( 'Fetching stash {0!r} from registry {1!r}'.format( stash_name, self.command_args['--from-registry'] ) ) Command.run( [ 'podman', 'pull', os.path.join( self.command_args['--from-registry'], stash_name ), ] ) try: log.info(f'Mounting stash: {stash_name!r}') stash_mount_point = Command.run( ['podman', 'image', 'mount', stash_name] ).output.strip() root = DataSync(stash_mount_point + os.sep, image_root_dir) log.info( 'Syncing stash root {0!r} to image root {1!r}'.format( stash_mount_point, image_root_dir ) ) root.sync_data(options=Defaults.get_sync_options()) except Exception as issue: raise KiwiStackBuildRootSyncFailed(issue) finally: log.info(f'Umount stash: {stash_name!r}') Command.run( ['podman', 'image', 'umount', '--force', stash_name], raise_on_error=False, ) kiwi_task: CliTask if self.command_args.get('--description'): with patch.object( sys, 'argv', self._get_kiwi_command( [ 'system', 'build', '--description', self.command_args['--description'], '--target-dir', self.command_args['--target-dir'], '--allow-existing-root', ] ), ): kiwi_task = SystemBuildTask(should_perform_task_setup=False) else: with patch.object( sys, 'argv', self._get_kiwi_command( [ 'system', 'create', '--root', image_root_dir, '--target-dir', self.command_args['--target-dir'], ] ), ): kiwi_task = SystemCreateTask( should_perform_task_setup=False ) kiwi_task.process() def _get_kiwi_command(self, kiwi_command: List[str]) -> List[str]: """ Construct the kiwi build or create command from the global options, the given command and the arguments passed along with the kiwi subcommand of stackbuild """ final_kiwi_command = ['kiwi-ng'] if self.global_args.get('--type'): final_kiwi_command.append('--type') final_kiwi_command.append(self.global_args['--type']) if self.global_args.get('--profile'): for profile in sorted(set(self.global_args['--profile'])): final_kiwi_command.append('--profile') final_kiwi_command.append(profile) if self.global_args.get('--kiwi-file'): final_kiwi_command.append('--kiwi-file') final_kiwi_command.append(self.global_args['--kiwi-file']) final_kiwi_command += kiwi_command final_kiwi_command += ( self.command_args.get('system_build_or_create') or [] ) log.debug( 'Building with:{0} {1}'.format(os.linesep, final_kiwi_command) ) return final_kiwi_command ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/system_stash.py0000644000000000000000000001257115273675667014721 0ustar00# Copyright (c) 2021 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from textwrap import dedent # project from kiwi.help import Help from kiwi.tasks.base import CliTask from kiwi.privileges import Privileges from kiwi.xml_description import XMLDescription from kiwi.xml_state import XMLState from kiwi.oci_tools import OCI from kiwi.utils.output import DataOutput from kiwi.command import Command from kiwi.path import Path from kiwi.stackbuild.defaults import StackBuildDefaults from kiwi.exceptions import KiwiStackBuildContainerNameInvalid log = logging.getLogger('kiwi') class SystemStashTask(CliTask): """ Implements storing of an image root tree as OCI container, called a stash Attributes * :attr:`manual` Instance of Help """ def process(self) -> None: """ Create a stash container from the given root directory or list the available stashes """ self.manual = Help() if self.command_args.get('help') is True: return self.manual.show('kiwi::system::stash') if self.command_args.get('--list') is True: stash_dir = StackBuildDefaults.get_stash_home() stashes = DataOutput( { stash_dir: ( os.listdir(stash_dir) if os.path.isdir(stash_dir) else [] ) } ) stashes.display() return if self.command_args.get('--root'): Privileges.check_for_root_permissions() log.info('Reading Image description') kiwi_description = os.path.join( self.command_args['--root'], 'image', 'config.xml' ) description = XMLDescription(kiwi_description) xml_state = XMLState(xml_data=description.load()) contact_info = xml_state.get_description_section() image_name = ( self.command_args.get('--container-name') or xml_state.xml_data.get_name() ) if not StackBuildDefaults.is_container_name_valid(image_name): message = dedent( '''\n Image name {0!r} cannot be used as container name Container names must start or end with a letter or number, and can contain only letters, numbers, and the dash (-) character. The name attribute in the KIWI description at: {1} does not conform to this requirement Please provide an alternative stash name via the --container-name option ''' ) raise KiwiStackBuildContainerNameInvalid( message.format(image_name, kiwi_description) ) stash_target_dir = SystemStashTask._create_stash_target_dir( image_name ) stash_container_file_name = os.path.join( stash_target_dir, f'{image_name}.tar' ) stash_container_tag = self.command_args.get('--tag') or 'latest' container_config = StackBuildDefaults.get_container_config( image_name, stash_container_tag, contact_info.author ) log.info('Initializing stash container') oci = OCI.new() if os.path.isfile(stash_container_file_name): log.info('--> Adding new layer on existing stash') oci.import_container_image( f'oci-archive:{stash_container_file_name}:' f'{image_name}:{stash_container_tag}' ) else: log.info('--> Creating initial layer') oci.init_container() oci.unpack() oci.sync_rootfs( self.command_args['--root'], StackBuildDefaults.get_stash_exclude_list(), ) oci.repack(container_config) oci.set_config(container_config) oci.post_process() log.info('Exporting stash container') oci.export_container_image( stash_container_file_name, 'oci-archive', f'{image_name}:{stash_container_tag}', ) log.info('Importing stash to local registry') Command.run(['podman', 'load', '-i', stash_container_file_name]) @staticmethod def _create_stash_target_dir(image_name: str) -> str: stash_target_dir = os.path.join( StackBuildDefaults.get_stash_home(), image_name ) Path.create(stash_target_dir) return stash_target_dir ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/tasks/system_update.py0000644000000000000000000000546415273675667015064 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import Union import logging # project from kiwi.tasks.base import CliTask from kiwi.privileges import Privileges from kiwi.help import Help from kiwi.system.prepare import SystemPrepare log = logging.getLogger('kiwi') class SystemUpdateTask(CliTask): """ Implements update and maintenance of root systems Attributes * :attr:`manual` Instance of Help """ def process(self) -> None: """ Update root system with latest repository updates and optionally allow to add or delete packages. the options to add or delete packages can be used multiple times """ self.manual = Help() if self._help(): return Privileges.check_for_root_permissions() abs_root_path = os.path.abspath(self.command_args['--root']) self.load_xml_description( abs_root_path, self.global_args['--kiwi-file'] ) package_requests = False if self.command_args['--add-package']: package_requests = True if self.command_args['--delete-package']: package_requests = True log.info('Updating system') with SystemPrepare( self.xml_state, abs_root_path, allow_existing=True ) as system: with system.setup_repositories( target_arch=self.global_args['--target-arch'] ) as manager: if not package_requests: system.update_system(manager) else: if self.command_args['--add-package']: system.install_packages( manager, self.command_args['--add-package'] ) if self.command_args['--delete-package']: system.delete_packages( manager, self.command_args['--delete-package'] ) def _help(self) -> Union[bool, Help]: if self.command_args['help']: self.manual.show('kiwi::system::update') else: return False return self.manual ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7522116 kiwi-11.1.8/kiwi/utils/__init__.py0000644000000000000000000000000015273675667013725 0ustar00././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/block.py0000644000000000000000000000611715273675667013277 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import re # project from kiwi.command import Command class BlockID: """ **Get information from a block device** :param str device: block device node name name. The device can also be specified as UUID= """ def __init__(self, device: str) -> None: uuid_format = re.match(r'^UUID=(.*)', device) if uuid_format: blkid_result = Command.run( ['blkid', '--uuid', uuid_format.group(1)] ) self.device = blkid_result.output.strip(os.linesep) else: self.device = device def get_label(self) -> str: """ Retrieve filesystem label from block device :return: block device label :rtype: str """ return self.get_blkid('LABEL') def get_uuid(self) -> str: """ Retrieve filesystem uuid from block device :return: uuid for the filesystem of the block device :rtype: str """ return self.get_blkid('UUID') def get_ptuuid(self) -> str: """ Retrieve partition uuid from block device :return: uuid of the partition table :rtype: str """ return self.get_blkid('PTUUID') def get_filesystem(self) -> str: """ Retrieve filesystem type from block device :return: filesystem type :rtype: str """ return self.get_blkid('TYPE') def get_partition_count(self) -> int: """ Retrieve number of partitions from block device :return: A number :rtype: int """ partition_count = 0 lsblk_result = Command.run( ['lsblk', '-r', '-o', 'NAME,TYPE', self.device] ) for line in lsblk_result.output.strip().split(os.linesep): if line.strip().endswith('part'): partition_count += 1 return partition_count def get_blkid(self, id_type: str) -> str: """ Retrieve information for specified metadata ID from block device :param string id_type: metadata ID, see man blkid for details :return: ID of the block device :rtype: str """ blkid_result = Command.run( ['blkid', self.device, '-s', id_type, '-o', 'value'], raise_on_error=False, ) return blkid_result.output.strip(os.linesep) if blkid_result else '' ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/checksum.py0000644000000000000000000001461215273675667014006 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from collections import namedtuple import hashlib import encodings.ascii as encoding from typing import Any, Callable, Optional # project from kiwi.api_helper import decommissioned from kiwi.utils.compress import Compress from kiwi.utils.primes import factors from kiwi.exceptions import KiwiFileNotFound class Checksum: """ **Manage checksum creation for files** :param str source_filename: source file name to build checksum for :param str checksum_filename: target file with checksum information """ def __init__(self, source_filename: str) -> None: if not os.path.exists(source_filename): raise KiwiFileNotFound( f'checksum source file {source_filename} not found' ) self.source_filename = source_filename self.checksum_filename = None self.ascii = encoding.getregentry().name def matches(self, checksum: str, filename: str) -> bool: """ Compare given checksum with reference checksum stored in the provided filename. If the checksum matches the method returns True, or False in case it does not match :param str checksum: checksum string to compare :param str filename: filename containing checksum :return: True or False :rtype: bool """ if not os.path.exists(filename): return False with open(filename, encoding=self.ascii) as checksum_file: checksum_from_file = checksum_file.read() # checksum is expected to be stored in the first field # separated by space, other information might contain # the filename or blocklist data which is not of interest # for the plain checksum match if checksum_from_file.split(' ')[0] == checksum: return True return False @decommissioned def md5(self, filename: Optional[str] = None) -> None: pass # pragma: no cover def sha256(self, filename: Optional[str] = None) -> str: """ Create sha256 checksum :param str filename: filename for checksum """ sha256_checksum = self._calculate_hash_hexdigest( hashlib.sha256(), self.source_filename ) if filename: self._create_checksum_file( sha256_checksum, filename, hashlib.sha256 ) return sha256_checksum def sha512(self, filename: Optional[str] = None) -> str: """ Create sha512 checksum :param str filename: filename for checksum """ sha512_checksum = self._calculate_hash_hexdigest( hashlib.sha512(), self.source_filename ) if filename: self._create_checksum_file( sha512_checksum, filename, hashlib.sha512 ) return sha512_checksum def _create_checksum_file( self, checksum: str, filename: str, haslib_method: Callable[[], 'hashlib._Hash'], ) -> None: """ Creates the text file that contains the checksum :param str checksum: checksum to include into the file :param str filename: filename of the output file """ compressed_blocks = None compress = Compress(self.source_filename) if compress.get_format(): compressed_blocks = self._block_list( os.path.getsize(self.source_filename) ) compress.uncompress(temporary=True) assert compress.uncompressed_filename is not None blocks = self._block_list( os.path.getsize(compress.uncompressed_filename) ) checksum = self._calculate_hash_hexdigest( haslib_method(), compress.uncompressed_filename ) else: blocks = self._block_list(os.path.getsize(self.source_filename)) with open(filename, encoding=self.ascii, mode='w') as checksum_file: if compressed_blocks: checksum_file.write( '%s %s %s %s %s\n' % ( checksum, blocks.blocks, blocks.blocksize, compressed_blocks.blocks, compressed_blocks.blocksize, ) ) else: checksum_file.write( f'{checksum} {blocks.blocks} {blocks.blocksize}\n' ) def _calculate_hash_hexdigest( self, digest: 'hashlib._Hash', filename: str, digest_blocks: int = 128 ) -> str: """ Calculates the hash hexadecimal digest for a given file. :param func digest: Digest function for hash calculation :param str filename: File to compute :param int digest_blocks: Number of blocks processed at a time """ chunk_size = digest_blocks * digest.block_size with open(filename, 'rb') as source: for chunk in iter(lambda: source.read(chunk_size), b''): digest.update(chunk) return digest.hexdigest() def _block_list(self, file_size: int) -> Any: """ Calculates the number of blocks and the block size for a given file size in bytes. :param int file_size: files size in bytes. :return: int:blocksize, int:blocks :rtype: tuple """ blocksize = 1 for factor in factors(file_size, 8192): if blocksize * factor > 8192: break blocksize *= factor blocks = int(file_size / blocksize) block_list = namedtuple('block_list', ['blocksize', 'blocks']) return block_list(blocksize=blocksize, blocks=blocks) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/codec.py0000644000000000000000000000413015273675667013253 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import logging # project from kiwi.exceptions import KiwiDecodingError log = logging.getLogger('kiwi') class Codec: """ **Performs conversions of literal byte sequences to strings** """ @staticmethod def decode(literal: bytes) -> str: """ Decodes the given literal with the default encoding. In case of failure attemps to decode using utf-8 charset with the 'replace' error strategy. :param bytes literal: literal to decode :return: decoded str :rtype: str """ if literal is None: return '' try: return Codec._wrapped_decode(literal) except Exception: log.warning("Failed decoding literal. Forcing UTF-8 decoding") try: return Codec._wrapped_decode( literal, encoding='utf_8', error_handling_schema='replace' ) except Exception: raise KiwiDecodingError('Locale setup is not utf-8 compatible') @staticmethod def _wrapped_decode( literal: bytes, encoding: str = '', error_handling_schema: str = '' ) -> str: # This decode wrapper is only implemented to facilitate unit testing if encoding: return literal.decode( encoding=encoding, errors=error_handling_schema ) else: return literal.decode() ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/command_capabilities.py0000644000000000000000000001167115273675667016335 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import re import logging from typing import List # project from kiwi.command import Command from kiwi.path import Path from kiwi.exceptions import KiwiCommandCapabilitiesError log = logging.getLogger('kiwi') class CommandCapabilities: """ **Validation of command version flags or version** Performs commands calls and parses the output so it can look specific flags on help message, check command version, etc. """ @staticmethod def has_option_in_help( call: str, flag: str, help_flags: List[str] = [], root: str = '', raise_on_error: bool = True, silent: bool = False, ) -> bool: """ Checks if the given flag is present in the help output of the given command. :param str call: the command to check :param str flag: the flag or substring to find in stdout :param list help_flags: a list with the required command arguments. :param str root: root directory of the env to validate :param bool raise_on_error: raises KiwiCommandCapabilitiesError and message if the specified flag does not occur on stdout/stderr of the command call :param bool silent: don't log parsing failures :return: True if the flag is found, False in any other case :rtype: bool """ help_args = help_flags or ['--help'] if root: arguments = ['chroot', root, call] + help_args else: arguments = [call] + help_args if raise_on_error and not Path.which( filename=call, access_mode=os.X_OK, root_dir=root or None ): raise KiwiCommandCapabilitiesError( f'Attempting to call "{arguments}" but {call} was not found' ) command = Command.run(arguments, raise_on_error=False) for line in command.output.splitlines(): if flag in line: return True for line in command.error.splitlines(): if flag in line: return True message = 'Could not find flag {} in {} output'.format(flag, call) if raise_on_error: raise KiwiCommandCapabilitiesError(message) if not silent: log.warning(message) return False @staticmethod def check_version( call: str, version_waterline: tuple, version_flags: List[str] = [], root: str = '', raise_on_error: bool = True, silent: bool = False, ) -> bool: """ Checks if the given command version is equal or higher than the given version tuple. :param str call: the command the check :param tuple version_waterline: minimum desired version of the command :param list version_flags: a list with the required command arguments. :param str root: root directory of the env to validate :param bool raise_on_error: control error behavior :param bool silent: don't log parsing failures :raises KiwiCommandCapabilitiesError: if raise_on_error is True and command execution fails or version can't be parsed. :return: True if the current command version is equal or higher to version_waterline :rtype: bool """ version_args = version_flags or ['--version'] if root: arguments = ['chroot', root, call] + version_args else: arguments = [call] + version_args version_info = None try: command = Command.run(arguments) for line in command.output.splitlines(): matches = re.findall(r'([0-9]+(\.[0-9]+)*)', line) if matches: match = max([m[0] for m in matches], key=len) version_info = tuple(int(elt) for elt in match.split('.')) break if version_info is None: raise Exception except Exception: message = 'Could not parse {0} version'.format(call) if raise_on_error: raise KiwiCommandCapabilitiesError(message) if not silent: log.warning(message) return False return version_info >= version_waterline ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/compress.py0000644000000000000000000001061415273675667014035 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from typing import List, Optional # project from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.defaults import Defaults from kiwi.exceptions import KiwiFileNotFound, KiwiCompressionFormatUnknown log = logging.getLogger('kiwi') class Compress: """ **File compression / decompression** :param bool keep_source: Request to keep the uncompressed source :param str source_filename: Source file name to compress :param list supported_zipper: List of supported compression tools :param str compressed_filename: Compressed file name path with compression suffix :param str uncompressed_filename: Uncompressed file name path """ def __init__( self, source_filename: str, keep_source_on_compress: bool = False ) -> None: if not os.path.exists(source_filename): raise KiwiFileNotFound( f'compression source file {source_filename} not found' ) self.keep_source = keep_source_on_compress self.source_filename = source_filename self.supported_zipper = ['xz', 'gzip'] self.compressed_filename: Optional[str] = None self.uncompressed_filename: Optional[str] = None def xz(self, options: Optional[List[str]] = None) -> str: """ Create XZ compressed file :param list options: custom xz compression options """ if not options: options = Defaults.get_xz_compression_options() assert options if self.keep_source: options.append('--keep') Command.run(['xz', '-f'] + options + [self.source_filename]) self.compressed_filename = self.source_filename + '.xz' return self.compressed_filename def gzip(self) -> str: """ Create gzip(max compression) compressed file """ options = ['-9'] if self.keep_source: options.append('--keep') Command.run(['gzip', '-f'] + options + [self.source_filename]) self.compressed_filename = self.source_filename + '.gz' return self.compressed_filename def uncompress(self, temporary: bool = False) -> str: """ Uncompress with format autodetection By default the original source file will be changed into the uncompressed variant. If temporary is set to True a temporary file is created instead :param bool temporary: uncompress to a temporary file """ zipper = self.get_format() if not zipper: raise KiwiCompressionFormatUnknown( f'could not detect compression format for {self.source_filename}' ) if not temporary: Command.run([zipper, '-d', self.source_filename]) self.uncompressed_filename = self.source_filename else: self.temp_file = Temporary().new_file() bash_command = [ zipper, '-c', '-d', self.source_filename, '>', self.temp_file.name, ] Command.run(['bash', '-c', ' '.join(bash_command)]) self.uncompressed_filename = self.temp_file.name return self.uncompressed_filename def get_format(self) -> Optional[str]: """ Detect compression format :return: compression format name or None if it couldn't be inferred :rtype: Optional[str] """ for zipper in self.supported_zipper: result = Command.run( [zipper, '-l', self.source_filename], raise_on_error=False ) if result.returncode == 0: return zipper return None ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/dir_files.py0000644000000000000000000000614315273675667014144 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from tempfile import NamedTemporaryFile from typing import Dict # project from kiwi.path import Path from kiwi.command import Command class DirFiles: """ **Directory File Manager** Connects registered files to a named temporary file and updates the contents of the given directory with the registered files in an atomic operation """ def __init__(self, dirname: str) -> None: self.dirname = dirname self.dirname_tmp = ''.join([self.dirname, '.tmp']) self.dirname_wipe = ''.join([self.dirname, '.wipe']) self.collection: Dict[str, str] = {} Path.wipe(self.dirname_tmp) def register(self, filename: str) -> str: """ Register given filename to be handled as a temporary file. The given filename gets overwritten with the contents of the temporary file on call of the commit method :param string filename: file path name :return: name of created temporary file :rtype: string """ tmpfile = NamedTemporaryFile() self.collection[os.path.basename(filename)] = tmpfile.name return tmpfile.name def deregister(self, filename: str) -> bool: """ Deregister filename from collection if present """ base_file_name = os.path.basename(filename) if self.collection.get(base_file_name): del self.collection[base_file_name] return True return False def commit(self) -> None: """ Update instance directory with contents of registered files Use an atomic operation that prepares a tmp directory with all registered files and move it to the directory given at instance creation time. Please note the operation is not fully atomic as it uses two move commands in a series """ Path.create(self.dirname_tmp) bash_command = ['cp', '-a', f'{self.dirname}/*', self.dirname_tmp] Command.run( ['bash', '-c', ' '.join(bash_command)], raise_on_error=False ) for origin, tmpname in list(self.collection.items()): Command.run( ['mv', tmpname, os.sep.join([self.dirname_tmp, origin])] ) Command.run(['mv', self.dirname, self.dirname_wipe]) Command.run(['mv', self.dirname_tmp, self.dirname]) Command.run(['rm', '-rf', self.dirname_wipe]) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/fetch_files.py0000644000000000000000000000564215273675667014462 0ustar00# Copyright (c) 2021 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import requests try: import progressbar2 as progressbar except ImportError: import progressbar import requests.packages.urllib3 from kiwi.exceptions import KiwiUriOpenError class FetchFiles: """ **Fetch File Manager** Fetches file(s) from a given URL to the local system """ def __init__(self) -> None: requests.packages.urllib3.disable_warnings() def wget(self, url: str, filename: str, chunk_size: int = 4096) -> None: """ Download content of given url to filename :param str url: URI :param str filename: local file path name :raises KiwiUriOpenError: if the download fails """ try: response = requests.request( 'GET', url, stream=True, data=None, headers=None ) response.raise_for_status() content_length = response.headers.get('Content-Length') if content_length: widgets = [ 'Loading: ', progressbar.Percentage(), ' ', progressbar.Bar(marker='#', left='[', right=']'), ' ', progressbar.ETA(), ' ', progressbar.FileTransferSpeed(), ] maxval = int(content_length) else: # server did not send the size of the content widgets = ['Loading: ', progressbar.FileTransferSpeed()] maxval = progressbar.UnknownLength progress = progressbar.ProgressBar( maxval=maxval, widgets=widgets ).start() processed = 0 with open(filename, 'wb') as data: for chunk in response.iter_content(chunk_size=chunk_size): if chunk: data.write(chunk) data.flush() processed += len(chunk) progress.update(processed) progress.finish() except requests.exceptions.RequestException as issue: raise KiwiUriOpenError( f'Download of {url} failed: {type(issue).__name__}: {issue}' ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/fstab.py0000644000000000000000000001055315273675667013303 0ustar00# Copyright (c) 2020 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import NamedTuple, List, Optional import logging import os # project from kiwi.path import Path log = logging.getLogger('kiwi') fstab_entry_type = NamedTuple( 'fstab_entry_type', [ ('fstype', str), ('mountpoint', str), ('device_spec', str), ('device_path', str), ('options', str), ('dump', str), ('fs_passno', str), ], ) class Fstab: """ **Managing fstab values** """ def __init__(self) -> None: self.fstab: List[fstab_entry_type] = [] def read(self, filename: str) -> None: """ Import specified fstab file Read the given fstab file and initialize a new entry list :param string filename: path to a fstab file """ self.fstab = [] with open(filename) as fstab: for line in fstab.readlines(): self.add_entry(line) def add_entry(self, line: str) -> None: new_entry = self._parse_entry(line) if new_entry: for entry in self.fstab: if entry.mountpoint == new_entry.mountpoint: log.warning( 'Mountpoint for "{0}" in use by "{1}", skipped'.format( self._file_entry(new_entry), self._file_entry(entry) ) ) return self.fstab.append(new_entry) def get_devices(self) -> List[fstab_entry_type]: return self.fstab def export(self, filename: str) -> None: """ Export entries, respect canonical mount order :param string filename: path to file name """ fstab_entries_by_path = {} for entry in self.fstab: fstab_entries_by_path[entry.mountpoint] = entry with open(filename, 'w') as fstab: for device_path in Path.sort_by_hierarchy( sorted(fstab_entries_by_path.keys()) ): entry = fstab_entries_by_path[device_path] fstab.write(self._file_entry(entry) + os.linesep) def _file_entry(self, entry: fstab_entry_type) -> str: return '{0} {1} {2} {3} {4} {5}'.format( entry.device_spec, entry.mountpoint, entry.fstype, entry.options, entry.dump, entry.fs_passno, ) def _parse_entry(self, line: str) -> Optional[fstab_entry_type]: data_record = line.split() if ( data_record and len(data_record) >= 6 and not data_record[0].startswith('#') ): device = data_record[0] mountpoint = data_record[1] fstype = data_record[2] options = data_record[3] dump = data_record[4] fs_passno = data_record[5] if device.startswith('UUID'): device_path = ''.join( ['/dev/disk/by-uuid/', device.split('=')[1]] ) elif device.startswith('LABEL'): device_path = ''.join( ['/dev/disk/by-label/', device.split('=')[1]] ) elif device.startswith('PARTUUID'): device_path = ''.join( ['/dev/disk/by-partuuid/', device.split('=')[1]] ) else: device_path = device return fstab_entry_type( fstype=fstype, mountpoint=mountpoint, device_path=device_path, device_spec=device, options=options, dump=dump, fs_passno=fs_passno, ) return None ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/os_release.py0000644000000000000000000000374115273675667014326 0ustar00# Copyright (c) 2024 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import csv from io import TextIOWrapper from typing import Iterable # project from kiwi.exceptions import KiwiOSReleaseImportError class OsRelease: """ **Read os-release information** """ def __init__(self, root_dir: str): self.data = {} os_release = root_dir + '/etc/os-release' try: with open(os_release) as osdata: reader = csv.reader(OsRelease._rip(osdata), delimiter='=') self.data = dict(reader) except Exception as issue: raise KiwiOSReleaseImportError( f'Import of {os_release} failed with {issue}' ) @staticmethod def _is_comment(line: str) -> bool: return line.startswith('#') @staticmethod def _is_whitespace(line: str) -> bool: return line.isspace() @staticmethod def _rip(csvfile: TextIOWrapper) -> Iterable[str]: for row in csvfile: if not OsRelease._is_comment(row) and not OsRelease._is_whitespace( row ): yield row def get(self, key: str) -> str: """ Return value for key or an empty string if not present :param string key: key name from os-release """ return self.data.get(key) or '' ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/output.py0000644000000000000000000000567515273675667013555 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import json import os import logging from typing import Dict, List, Optional, Union # project from kiwi.utils.temporary import Temporary from kiwi.path import Path log = logging.getLogger('kiwi') class DataOutput: """ **Converts dict or list variables to a print friendly json format** Output controller for data dictionary. The class expects a python dict or list to hold the data to become displayed. So far the output format is set to json :param data: python dict or list which holds the data :type data: dict, list :param str style: output style could be either standard or color """ def __init__( self, data: Union[Dict, List], style: str = 'standard' ) -> None: self.data = data self.style = style self.color_json = Path.which('pjson') def display(self) -> None: """ Show data in json output format and selected style """ self._json() @staticmethod def display_file(filename: str, message: Optional[str] = None) -> None: """ Show data from file """ if message: log.info(message) with open(filename) as data: print(data.read()) def _json(self) -> None: """ Show data in json output format and selected style """ if self.style == 'color': if self.color_json: self._color_json() else: log.warning('pjson for color output not installed') log.warning('run: pip install pjson') self._standard_json() else: self._standard_json() def _standard_json(self) -> None: """ Show data in plain json output format without any highlighting """ print( json.dumps( self.data, sort_keys=True, indent=4, separators=(',', ': ') ) ) def _color_json(self) -> None: """ Show data in json output format with nice color highlighting """ out_file = Temporary().new_file() out_file.write(json.dumps(self.data, sort_keys=True).encode()) out_file.flush() pjson_cmd = ''.join(['cat ', out_file.name, ' | pjson']) os.system(pjson_cmd) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/primes.py0000644000000000000000000000376415273675667013511 0ustar00# Copyright (c) 2021 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import math from typing import List, Iterator, Optional # initial list of prime numbers which will be extended as much as required # and reused in next calls _primes: List[int] = [2, 3, 5, 7, 11, 13, 17] def _update_primes(n: int) -> None: """ Extend the list of prime numbers if required. """ if n <= _primes[-1]: return _n = int(math.ceil(n**0.5)) _update_primes(_n) start = _primes[-1] + 1 for i in range(start, n + 1): if all(i % p for p in primes(_n)): _primes.append(i) def primes(number: int) -> Iterator[int]: """ Get prime numbers no greater than given number. :param int number: highest possible number to return. :rtype: int generator """ _update_primes(number) for p in _primes: if p <= number: yield p else: break def factors(number: int, max_factor: Optional[int] = None) -> Iterator[int]: _max = int(math.ceil(number**0.5)) _max = min(_max, max_factor or _max) _number = number for i in primes(_max): while _number % i == 0 and i <= _max: _number = _number // i _max = min(_max, int(math.ceil(_number**0.5))) yield i if _number != 1: if not max_factor or _number <= max_factor: yield _number ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/proxy.py0000644000000000000000000001246115273675667013365 0ustar00# Copyright (c) 2026 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import re import logging from configparser import ConfigParser from typing import Dict, List, Optional # project import kiwi.defaults as defaults from kiwi.command import Command from kiwi.path import Path from kiwi.utils.sysconfig import SysConfig log = logging.getLogger('kiwi') class HostProxy: """ **Provides the proxy setup of the host kiwi is called at** The proxy settings are taken from the environment of the kiwi process. Settings not present in the environment are completed from the host sysconfig proxy file if the proxy is enabled there. In addition the proxy setup of the host package manager configuration can be read for package managers which are called by kiwi with a custom configuration file :param str sysconfig_proxy: sysconfig proxy file path, defaults to HOST_SYSCONFIG_PROXY """ proxy_names = ['http_proxy', 'https_proxy', 'ftp_proxy', 'no_proxy'] def __init__(self, sysconfig_proxy: Optional[str] = None) -> None: self.proxy: Dict[str, str] = {} sysconfig = SysConfig(sysconfig_proxy or defaults.HOST_SYSCONFIG_PROXY) sysconfig_enabled = ( HostProxy._unquote(sysconfig.get('PROXY_ENABLED') or '') == 'yes' ) for name in HostProxy.proxy_names: value = os.environ.get(name) or os.environ.get(name.upper()) if not value and sysconfig_enabled: value = HostProxy._unquote(sysconfig.get(name.upper()) or '') if value: self.proxy[name] = value def has_proxy(self) -> bool: """ Check if a proxy server is configured on the host :return: True|False :rtype: bool """ return any(name != 'no_proxy' for name in self.proxy.keys()) def get_env(self) -> Dict[str, str]: """ Proxy environment variables in lower and upper case notation as different tools look for different variants :return: proxy environment variables :rtype: dict """ proxy_env = {} for name, value in self.proxy.items(): proxy_env[name] = value proxy_env[name.upper()] = value return proxy_env def get_sysconfig_data(self) -> str: """ Proxy setup in sysconfig proxy file format as it is read e.g. by libzypp :return: sysconfig proxy file content :rtype: str """ sysconfig_data = [ '# kiwi generated proxy config file', 'PROXY_ENABLED="{0}"'.format('yes' if self.has_proxy() else 'no'), ] for name in HostProxy.proxy_names: sysconfig_data.append( '{0}="{1}"'.format(name.upper(), self.proxy.get(name, '')) ) return os.linesep.join(sysconfig_data) + os.linesep @staticmethod def get_apt_config() -> List[str]: """ Acquire::{http,https,ftp}::Proxy settings from the host apt configuration in apt.conf format :return: list of apt config lines :rtype: list """ apt_proxy_config = [] if Path.which('apt-config'): result = Command.run(['apt-config', 'dump'], raise_on_error=False) if result.returncode == 0: for line in result.output.splitlines(): if re.match( r'^Acquire::(http|https|ftp)::Proxy(::\S+)? ".*";$', line, ): apt_proxy_config.append(line) return apt_proxy_config @staticmethod def get_dnf_config(dnf_config: Optional[str] = None) -> Dict[str, str]: """ proxy* settings from the main section of the host dnf configuration :param str dnf_config: dnf config file path, defaults to HOST_DNF_CONFIG :return: dnf proxy option names and values :rtype: dict """ dnf_proxy_config: Dict[str, str] = {} dnf_config = dnf_config or defaults.HOST_DNF_CONFIG host_config = ConfigParser(interpolation=None, strict=False) try: host_config.read(dnf_config) except Exception as issue: log.warning( f'Failed to read proxy setup from {dnf_config}: {issue}' ) return dnf_proxy_config if host_config.has_section('main'): for name, value in host_config.items('main'): if name.startswith('proxy'): dnf_proxy_config[name] = value return dnf_proxy_config @staticmethod def _unquote(value: str) -> str: return value.strip().strip('"\'') ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/rpm.py0000644000000000000000000001040415273675667012775 0ustar00# Copyright (c) 2019 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import re from typing import List, Optional # project from kiwi.command import Command from kiwi.defaults import Defaults from kiwi.path import Path class Rpm: """ **Helper methods to handle the rpm database configuration** """ def __init__( self, root_dir: Optional[str] = None, macro_file: Optional[str] = None ) -> None: self.root_dir = root_dir self.config: List[str] = [] self.custom_config: List[str] = [] self.macro_path = os.sep.join( [self.root_dir or '', Defaults.get_custom_rpm_macros_path()] ) self.macro_file = os.sep.join( [ self.macro_path, ( macro_file if macro_file else Defaults.get_custom_rpm_bootstrap_macro_name() ), ] ) def expand_query(self, key: str) -> str: """ Query database configuration and expand it """ if self.root_dir: rpmdb_call = Command.run( ['chroot', self.root_dir, 'rpm', '-E', key] ) else: rpmdb_call = Command.run(['rpm', '-E', key]) return rpmdb_call.output.strip() def get_query(self, key: str) -> Optional[str]: """ Query database configuration Extract the first match for the given key. The method expects the format of entries to match the regular expression: '.*key[\t ]+value' :param string key: query key name :returns: match or None if there isn't any match :rtype: string | None """ if not self.config: self.config = self._read_macro_configuration() item_list = list(filter(lambda item: key in item, self.config)) for item in item_list: match = re.match('.*{0}[\t ]+(.*)'.format(key), item) if match: return match.group(1) return None def set_config_value(self, key: str, value: Optional[str]) -> None: """ Set custom database configuration key/value pair :param string key: key name :param string value: key value name """ self.custom_config.append('%{0}\t{1}'.format(key, value)) def write_config(self) -> None: """ Write custom database configuration Write bootstrap macro file to the custom rpm macros path """ if self.custom_config: Path.create(self.macro_path) with open(self.macro_file, 'w') as macro: for entry in self.custom_config: macro.write('{0}{1}'.format(entry, os.linesep)) def wipe_config(self) -> None: """ Delete custom database configuration """ Path.wipe(self.macro_file) def _read_macro_configuration(self) -> List[str]: """ Read rpm database macro and configuration setup Please note we intentionally don't use 'rpm -E' here because it tries to expand the complete macro and if that is not possible it returns with the given unexpanded macro. There is no way to detect if the macro really existed or not. In addition for the use case of this class the macro should be read as it was configured and not its expanded form. """ if self.root_dir: rpmdb_call = Command.run( ['chroot', self.root_dir, 'rpmdb', '--showrc'] ) else: rpmdb_call = Command.run(['rpmdb', '--showrc']) return rpmdb_call.output.split(os.linesep) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/rpm_database.py0000644000000000000000000001436315273675667014631 0ustar00# Copyright (c) 2019 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import re from typing import Optional # project from kiwi.command import Command from kiwi.path import Path from kiwi.utils.rpm import Rpm class RpmDataBase: """ **Setup RPM database configuration** """ def __init__(self, root_dir: str, macro_file: Optional[str] = None) -> None: self.rpmdb_host = Rpm() self.rpmdb_image = Rpm(root_dir, macro_file) self.root_dir = root_dir def has_rpm(self) -> bool: """ Check if rpmdb binary was found in root_dir to indicate that the rpm system is present. """ rpm_bin = Path.which( 'rpmdb', root_dir=self.root_dir, access_mode=os.X_OK ) if not rpm_bin: return False return True def rebuild_database(self) -> None: """ Rebuild image rpm database taking current macro setup into account """ Command.run(['chroot', self.root_dir, 'rpmdb', '--rebuilddb']) def init_database(self) -> None: Command.run(['rpm', '--root', self.root_dir, '--initdb']) def set_macro_from_string(self, setting: str) -> None: """ Setup given macro setting in image rpm configuration. The following format for the setting is expected: macro_base_key_name%macro_value. If this expression is not matched the macro setup will be skipped. Please note the macro_base_key_name includes the name of the macro as rpm expects it exlcuding the leading '%' character. Also note macro defintions must happen before calling set_database_* methods in order to become effective :param string setting: macro key and value as one string """ match = re.match('(.*)%(.*)', setting) if match: self.rpmdb_image.set_config_value(match.group(1), match.group(2)) def write_config(self) -> None: self.rpmdb_image.write_config() def import_signing_key_to_image(self, key: str) -> None: """ Import the given signing key to the image rpm database """ Command.run( [ 'rpm', '--root', self.root_dir, '--import', key, '--dbpath', self.rpmdb_host.expand_query('%_dbpath'), ] ) def set_database_to_host_path(self) -> None: """ Setup dbpath to point to the host rpm dbpath configuration and write the configuration file """ self.rpmdb_image.set_config_value( '_dbpath', self.rpmdb_host.get_query('_dbpath') ) self.rpmdb_image.write_config() def link_database_to_host_path(self) -> None: """ Create a link from host database location to image database location. The link is only created if both locations differ and if the host database location does not exist. """ rpm_host_dbpath = self.rpmdb_host.expand_query('%_dbpath') rpm_image_dbpath = self.rpmdb_image.expand_query('%_dbpath') if rpm_host_dbpath != rpm_image_dbpath: root_rpm_host_dbpath = os.path.normpath( os.sep.join([self.root_dir, rpm_host_dbpath]) ) if not os.path.exists(root_rpm_host_dbpath): Path.create(os.path.dirname(root_rpm_host_dbpath)) host_to_root = ''.join( '../' for i in os.path.dirname(rpm_host_dbpath) .lstrip(os.sep) .split(os.sep) ) Command.run( [ 'ln', '-s', os.path.normpath( os.sep.join([host_to_root, rpm_image_dbpath]) ), root_rpm_host_dbpath, ] ) def set_database_to_image_path(self) -> None: """ Setup dbpath to point to the image rpm dbpath configuration Rebuild the database such that it gets moved to the standard path and delete KIWI's custom macro setup """ self.rpmdb_image.wipe_config() rpm_image_dbpath = self.rpmdb_image.expand_query('%_dbpath') rpm_host_dbpath = self.rpmdb_host.expand_query('%_dbpath') if rpm_image_dbpath != rpm_host_dbpath: root_rpm_image_dbpath = os.path.normpath( os.sep.join([self.root_dir, rpm_image_dbpath]) ) root_rpm_host_dbpath = os.path.normpath( os.sep.join([self.root_dir, rpm_host_dbpath]) ) if os.path.islink(root_rpm_host_dbpath): self.rebuild_database() return if os.path.islink(root_rpm_image_dbpath): os.unlink(root_rpm_image_dbpath) else: Path.wipe(root_rpm_image_dbpath) self.rpmdb_image.set_config_value('_dbpath', rpm_host_dbpath) self.rpmdb_image.set_config_value( '_dbpath_rebuild', self.rpmdb_image.get_query('_dbpath') ) self.rpmdb_image.write_config() self.rebuild_database() self.rpmdb_image.wipe_config() root_rpm_alternatives = os.sep.join( [root_rpm_host_dbpath, 'alternatives'] ) if os.path.exists(root_rpm_alternatives): Command.run( ['mv', root_rpm_alternatives, root_rpm_image_dbpath] ) Path.wipe(root_rpm_host_dbpath) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/signature.py0000644000000000000000000000521115273675667014200 0ustar00# Copyright (c) 2022 Marcus Schäfer. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # # project from kiwi.runtime_config import RuntimeConfig from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.exceptions import KiwiCredentialsError class Signature: """ **Create signatures** """ def __init__(self, filepath: str) -> None: """ Construct new Signature object :param str filepath: file path name """ self.filepath = filepath def sign(self) -> None: """ Create an openssl based signature from the given file name and attach it at the end of that filename. This method requires access to a private key for signing. The path to the private key is read from the kiwi runtime config file from the following section: credentials: - verification_metadata_signing_key_file: /path/to/pkey """ runtime_config = RuntimeConfig() signing_key_file = ( runtime_config.get_credentials_verification_metadata_signing_key_file() ) if not signing_key_file: raise KiwiCredentialsError( '{0} not configured in runtime config'.format( 'verification_metadata_signing_key_file' ) ) signature_file = Temporary().new_file() Command.run( [ 'openssl', 'dgst', '-sha256', '-sigopt', 'rsa_padding_mode:pss', '-sigopt', 'rsa_pss_saltlen:-1', '-sigopt', 'rsa_mgf1_md:sha256', '-sign', signing_key_file, '-out', signature_file.name, self.filepath, ] ) with open(signature_file.name, 'rb') as sig_fd: signature = sig_fd.read() with open(self.filepath, 'ab') as get_signed: get_signed.write(signature) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/size.py0000644000000000000000000000321615273675667013154 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re from kiwi.exceptions import KiwiSizeError class StringToSize: """ **Performs size convertions from strings to numbers** """ @staticmethod def to_bytes(size_value: str) -> int: """ Convert the given string representig a size into the appropriate number of bytes. :param str size_value: a size in bytes or specified with m=MB or g=GB :return: the number of bytes represented by size_value string :rtype: int """ size_format = r'^(\d+)([gGmM]{0,1})$' size = re.search(size_format, size_value) if not size: raise KiwiSizeError( 'unsupported size format {0}, must match {1}'.format( size_value, size_format ) ) size_base = int(size.group(1)) size_unit = {'g': 3, 'm': 2}.get(size.group(2).lower()) return size_base * (1024**size_unit) if size_unit else size_base ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/sparse.py0000644000000000000000000000246315273675667013502 0ustar00# Copyright (c) 2026 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os # project from kiwi.command import Command from kiwi.path import Path class SparseFile: """ **Create sparse files** """ @staticmethod def create(filename: str, size: str) -> None: if Path.which(filename='qemu-img', access_mode=os.X_OK): Command.run(['qemu-img', 'create', filename, size]) else: Command.run( [ 'dd', 'if=/dev/null', f'of={filename}', 'bs=1', 'count=0', f'seek={size}', ] ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/sync.py0000644000000000000000000001647615273675667013172 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import re import errno import logging from stat import ST_MODE from typing import List, Optional # project from kiwi.command import Command from kiwi.runtime_config import RuntimeConfig log = logging.getLogger('kiwi') class DataSync: """ **Sync data from a source directory to a target directory** """ def __init__(self, source_dir: str, target_dir: str) -> None: """ Create a new DataSync instance and initialize sync source and target :param str source_dir: source directory path name :param str target_dir: target directory path name """ self.source_dir = source_dir self.target_dir = target_dir def sync_data( self, options: Optional[List[str]] = None, exclude: Optional[List[str]] = None, force_trailing_slash: bool = False, ) -> None: """ Sync data from source to target using the rsync protocol :param list options: rsync options :param list exclude: file patterns to exclude :param bool force_trailing_slash: add '/' to source_dir if not present A speciality of the rsync tool is that it behaves differently if the given source_dir ends with a '/' or not. If it ends with a slash the data structure below will be synced to the target_dir. If it does not end with a slash the source_dir and its contents are synced to the target_dir. For example .. code:: bash source └── some_data 1. $ rsync -a source target target └── source └── some_data 2. $ rsync -a source/ target target └── some_data The parameter force_trailing_slash can be used to make sure rsync behaves like shown in the second case. If set to true a '/' is appended to the given source_dir if not already present """ if force_trailing_slash and not self.source_dir.endswith(os.sep): self.source_dir += os.sep target_entry_permissions = None exclude_options = [] rsync_options = [] if options: rsync_options = options if RuntimeConfig().get_sync_sparse(): rsync_options = rsync_options + self._get_sparse_options( rsync_options ) if not self.target_supports_extended_attributes(): warn_me = False if '--xattrs' in rsync_options: rsync_options.remove('--xattrs') warn_me = True if '--acls' in rsync_options: rsync_options.remove('--acls') warn_me = True if warn_me: log.warning( 'Extended attributes not supported for target: {}'.format( self.target_dir ) ) if exclude: for item in exclude: exclude_options.append('--exclude') exclude_options.append('/' + item) if os.path.exists(self.target_dir): target_entry_permissions = os.stat(self.target_dir)[ST_MODE] Command.run( ['rsync'] + rsync_options + exclude_options + [self.source_dir, self.target_dir] ) if target_entry_permissions: # rsync applies the permissions of the source directory # also to the target directory which is unwanted because # only permissions of the files and directories from the # source directory and its contents should be transfered # but not from the source directory itself. Therefore # the permission bits of the target directory before the # sync are applied back after sync to ensure they have # not changed os.chmod(self.target_dir, target_entry_permissions) def _get_sparse_options(self, rsync_options: List[str]) -> List[str]: """ Provide the --sparse option if it is both wanted and usable The option turns sequences of null bytes into holes on the target. It is skipped if the caller already asked for it, and it is skipped with a warning if it cannot be combined with the options the caller provided: * rsync releases before 3.1.3 reject --sparse together with --inplace. kiwi syncs with --inplace, so on such a host the combination would abort the build. * --preallocate defeats the purpose, because every file is allocated in full before it is written. The result occupies the space of a dense file while a hole detecting reader still sees holes, which is worse than not asking for sparse at all. :param list rsync_options: options provided by the caller :return: list of options to add :rtype: list """ if '--sparse' in rsync_options: return [] if '--preallocate' in rsync_options: log.warning( 'Sparse data sync not used: incompatible with --preallocate' ) return [] if ( '--inplace' in rsync_options and not self._rsync_supports_sparse_inplace() ): log.warning( 'Sparse data sync not used: rsync too old to combine ' '--sparse with --inplace, 3.1.3 or later is required' ) return [] return ['--sparse'] @staticmethod def _rsync_supports_sparse_inplace() -> bool: """ Check if the host rsync allows --sparse together with --inplace :return: True or False :rtype: bool """ try: version_text = Command.run(['rsync', '--version']).output version = re.search(r'version (\d+)\.(\d+)\.(\d+)', version_text) if not version: return False return tuple(int(part) for part in version.groups()) >= (3, 1, 3) except Exception as issue: log.warning('Could not detect rsync version: {0}'.format(issue)) return False def target_supports_extended_attributes(self) -> bool: """ Check if the target directory supports extended filesystem attributes :return: True or False :rtype: bool """ try: os.getxattr(self.target_dir, 'user.mime_type') except OSError as issue: if issue.errno == errno.ENOTSUP: return False except Exception: # ignore any other exception here pass return True ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/sysconfig.py0000644000000000000000000000604515273675667014211 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import Dict, List, Optional, Union class SysConfig: """ **Read and Write sysconfig style files** :param str source_file: source file path """ def __init__(self, source_file: str) -> None: self.source_file = source_file self.data_dict: Dict[str, str] = {} self.data_list: List[str] = [] self._read() def __setitem__(self, key: str, value: Union[str, int]) -> None: # values are written to the file in their string format if key not in self.data_dict: self.data_list.append(key) self.data_dict[key] = format(value) def __getitem__(self, key: str) -> str: return self.data_dict[key] def __contains__(self, key: str) -> bool: return key in self.data_dict def get(self, key: str) -> Optional[str]: return self.data_dict.get(key) def write(self) -> None: """ Write back source file with changed content but in same order """ with open(self.source_file, 'w') as source: for line in self.data_list: if line in self.data_dict: key = line value = self.data_dict[key] source.write('{0}={1}'.format(key, value)) else: source.write(line) source.write(os.linesep) def _read(self) -> None: """ Read file into a list and a key/value dictionary Only lines which are not considered a comment and containing the structure key=value are parsed into the key/value dictionary. In order to keep the order of lines a list is stored too. Those lines matching the key/value format are stored with their key in the list as a placeholder """ if os.path.exists(self.source_file): with open(self.source_file) as source: for line in source.readlines(): line = line.strip() if '#' not in line and '=' in line: elements = line.split('=') key = elements.pop(0).strip() value = '='.join(elements) self.data_dict[key] = value self.data_list.append(key) else: self.data_list.append(line) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/temporary.py0000644000000000000000000000266415273675667014232 0ustar00# Copyright (c) 2021 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from typing import IO, NamedTuple from tempfile import NamedTemporaryFile, TemporaryDirectory # project import kiwi.defaults as defaults class TmpT(NamedTuple): name: str class Temporary: """ **Provides namespace to handle temporary files and directories** """ def __init__(self, path: str = '', prefix: str = ''): self.prefix = prefix if prefix else 'kiwi_' self.path = path or defaults.TEMP_DIR def new_file(self) -> IO[bytes]: return NamedTemporaryFile(dir=self.path, prefix=self.prefix) def new_dir(self) -> TemporaryDirectory: return TemporaryDirectory(dir=self.path, prefix=self.prefix) def unmanaged_file(self) -> TmpT: return TmpT(name=f'{self.path}/{self.prefix}') ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/toenv.py0000644000000000000000000000356215273675667013341 0ustar00# Copyright (c) 2024 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import csv import os from io import TextIOWrapper from typing import Iterable # project from kiwi.exceptions import KiwiEnvImportError class ToEnv: """ **Read env file and merge with os.environ** """ def __init__(self, root_dir: str, envfile: str): self.data = {} env_file = f'{root_dir}/{envfile}' if os.path.isfile(env_file): try: with open(env_file) as osdata: reader = csv.reader(ToEnv._rip(osdata), delimiter='=') self.data = dict(reader) except Exception as issue: raise KiwiEnvImportError( f'Import of {envfile} failed with {issue}' ) if self.data: os.environ.update(self.data) @staticmethod def _is_comment(line: str) -> bool: return line.startswith('#') @staticmethod def _is_whitespace(line: str) -> bool: return line.isspace() @staticmethod def _rip(csvfile: TextIOWrapper) -> Iterable[str]: for row in csvfile: if not ToEnv._is_comment(row) and not ToEnv._is_whitespace(row): yield row ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/utils/veritysetup.py0000644000000000000000000002166015273675667014610 0ustar00# Copyright (c) 2022 Marcus Schäfer. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from typing import Optional, Dict, IO # project import kiwi.defaults as defaults from kiwi.utils.signature import Signature from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.utils.block import BlockID from kiwi.exceptions import KiwiOffsetError class VeritySetup: """ **Create block level verification data on file or device** """ def __init__( self, image_filepath: str, data_blocks: Optional[int] = None, hash_offset: int = 0, ) -> None: """ Construct new VeritySetup :param str image_filepath: block device node or filename :param int data_blocks: Number of blocks to verify, if not provided the whole image_filepath is used :param int hash_offset: Optional offset to start writing verity hash. If not specified it is assumed image_filepath is a file and not a block special such that the offset is calculated from the size of the file """ self.image_filepath = image_filepath self.data_blocks = data_blocks self.verity_hash_offset = hash_offset or os.path.getsize( self.image_filepath ) self.verity_dict: Dict[str, str] = {} self.verification_metadata_file: Optional[IO[bytes]] = None def format(self) -> Dict[str, str]: """ Run veritysetup on the given device node or filename and store the verification information onto the same device node or filename :return: veritysetup result information in key/value format :rtype: dict """ verity_call = Command.run( [ 'veritysetup', 'format', self.image_filepath, self.image_filepath, f'--hash-offset={self.verity_hash_offset}', f'--hash-block-size={defaults.VERITY_HASH_BLOCKSIZE}', ] + ( [ f'--data-blocks={self.data_blocks}', f'--data-block-size={defaults.VERITY_DATA_BLOCKSIZE}', ] if self.data_blocks else [] ) ) for line in verity_call.output.split(os.linesep): try: # strip out any space, tabs, newlines line = ''.join(line.split()) # split out key:value based data key, value = line.split(':', 2) self.verity_dict[key] = value except ValueError: # ignore any occurrence for which split failed pass return self.verity_dict def get_hash_byte_size(self) -> int: """ Run veritysetup into a temporary file to estimate the required bytesize :return: a byte value :rtype: int """ temp_file = Temporary().new_file() Command.run( [ 'veritysetup', 'format', self.image_filepath, temp_file.name, f'--hash-block-size={defaults.VERITY_HASH_BLOCKSIZE}', ] + ( [ f'--data-blocks={self.data_blocks}', f'--data-block-size={defaults.VERITY_DATA_BLOCKSIZE}', ] if self.data_blocks else [] ) ) return os.path.getsize(temp_file.name) def get_block_storage_filesystem(self) -> str: """ Retrieve filesystem type from image_filepath. The method only returns a value if image_filepath at construction time of the VeritySetup object is a block device containing a filesystem :rtype: blkid TYPE value or empty string :return: str """ try: return BlockID(self.image_filepath).get_filesystem() except Exception: return '' def write_verification_metadata(self, device_node: str) -> None: """ Write metadata block beginning at getsize64() - defaults.DM_METADATA_OFFSET of the given device_node :param str device_node: block device node name """ if self.verification_metadata_file: meta_data_size = os.path.getsize( self.verification_metadata_file.name ) if meta_data_size > defaults.DM_METADATA_OFFSET: raise KiwiOffsetError( 'Metadata size of {0}b exceeds {1}b limit'.format( meta_data_size, defaults.DM_METADATA_OFFSET ) ) with open(self.verification_metadata_file.name, 'rb') as meta: with open(device_node, 'r+b') as target: # seek --defaults.DM_METADATA_OFFSET from the # end to reach the metadata start # Please note, writing of the metadata block can destroy # the filesystem on the device_node if it was not created # with a smaller size than the device_node, you have been # warned. target.seek(-defaults.DM_METADATA_OFFSET, 2) target.write(meta.read()) def create_verity_verification_metadata(self) -> None: """ Create a metadata block containing information for dm_verity verification in the following format: |header_string|0xFF|dm_verity_credentials|0xFF|0x0| header_string: '{version} {fstype} ro verity' dm_verity_credentials: '{hash_type} {data_blksize} {hash_blksize} {data_blocks} {hash_start_block} {algorithm} {root_hash} {salt}' Please note, writing of the metadata block can destroy the filesystem on the device_node if it was not created with a smaller size than the device_node ! """ metadata_format_version = defaults.DM_METADATA_FORMAT_VERSION filesystem = self.get_block_storage_filesystem() if filesystem and self.verity_dict: header_string = '{0} {1} ro verity'.format( metadata_format_version, filesystem ) hash_start_block = int( self.verity_hash_offset / int(self.verity_dict['Hashblocksize']) ) dm_verity_credentials = '{0} {1} {2} {3} {4} {5} {6} {7}'.format( self.verity_dict['Hashtype'], self.verity_dict['Datablocksize'], self.verity_dict['Hashblocksize'], self.verity_dict['Datablocks'], hash_start_block, self.verity_dict['Hashalgorithm'], self.verity_dict['Roothash'], self.verity_dict['Salt'], ) self.verification_metadata_file = Temporary().new_file() with open(self.verification_metadata_file.name, 'wb') as meta: meta.write(header_string.encode("ascii")) meta.write(b'\xff') meta.write(dm_verity_credentials.encode("ascii")) meta.write(b'\xff') meta.write(b'\0') def sign_verification_metadata(self) -> None: """ Create an openssl based signature from the metadata block and attach it at the end of the block. """ if self.verification_metadata_file: Signature(self.verification_metadata_file.name).sign() def store_credentials( self, credentials_filepath: str, target_block_id: BlockID ) -> None: """ Store verification credentials and other metadata to the given credentials_filepath :param str credentials_filepath: file path name :param BlockID target_block_id: instance of BlockID of the target storage device """ if self.verity_dict: with open(credentials_filepath, 'w') as verity: for key in sorted(self.verity_dict.keys()): verity.write(f'{key}: {self.verity_dict[key]}{os.linesep}') verity.write(f'Root hashoffset: {self.verity_hash_offset}') verity.write(os.linesep) verity.write('Superblock:') verity.write(os.linesep) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/version.py0000644000000000000000000000146415273675667012532 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # """ Global version information used in kiwi and the package """ __version__ = '11.1.8' __githash__ = '$Format:%H$' ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.752808 kiwi-11.1.8/kiwi/volume_manager/__init__.py0000644000000000000000000000430415273675667015601 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from typing import Dict, List, Optional from abc import ABCMeta, abstractmethod # project from kiwi.volume_manager.base import VolumeManagerBase from kiwi.exceptions import KiwiVolumeManagerSetupError class VolumeManager(metaclass=ABCMeta): """ **VolumeManager factory** :param str name: volume management name :param dict device_map: dictionary of low level DeviceProvider intances :param str root_dir: root directory path name :param list volumes: list of volumes from :class:`XMLState::get_volumes()` :param dict custom_args: dictionary of custom volume manager arguments """ @abstractmethod def __init__(self) -> None: return None # pragma: no cover @staticmethod def new( name: str, device_map: object, root_dir: str, volumes: List, custom_args: Optional[Dict] = None, ) -> VolumeManagerBase: name_map = {'lvm': 'LVM', 'btrfs': 'Btrfs'} try: volume_manager = importlib.import_module( 'kiwi.volume_manager.{0}'.format(name) ) module_name = 'VolumeManager{0}'.format(name_map[name]) return volume_manager.__dict__[module_name]( device_map, root_dir, volumes, custom_args ) except Exception as issue: raise KiwiVolumeManagerSetupError( 'Support for {0} volume manager not implemented: {1}'.format( name, issue ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7537186 kiwi-11.1.8/kiwi/volume_manager/base.py0000644000000000000000000003465715273675667014772 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from collections import namedtuple from tempfile import TemporaryDirectory from types import TracebackType from typing import Any, Dict, List, Optional, Type import logging import os # project from kiwi.utils.temporary import Temporary from kiwi.command import Command from kiwi.storage.device_provider import DeviceProvider from kiwi.mount_manager import MountManager from kiwi.utils.sync import DataSync from kiwi.path import Path from kiwi.system.size import SystemSize from kiwi.defaults import Defaults from kiwi.xml_state import volume_type from kiwi.exceptions import KiwiVolumeManagerSetupError log = logging.getLogger('kiwi') class VolumeManagerBase(DeviceProvider): """ **Implements base class for volume management interface** :param object device_map: dictionary of low level DeviceProvider intances :param str root_dir: root directory path name :param list volumes: list of volumes from :class:`XMLState::get_volumes()` :param dict custom_args: custom volume manager arguments for all volume manager and filesystem specific tasks :raises KiwiVolumeManagerSetupError: if the given root_dir doesn't exist """ def __init__( self, device_map: Dict[str, DeviceProvider], root_dir: str, volumes: List[volume_type], custom_args: Optional[Dict[str, Any]] = None, ) -> None: self.temp_directories: List[TemporaryDirectory] = [] #: all volumes are combined into one mountpoint. This is #: needed at sync_data time. How to mount the volumes is #: special to the volume management class self.mountpoint: Optional[str] = None #: dictionary of mapped DeviceProviders self.device_map = device_map #: the underlaying device provider self.device_provider_root = device_map['root'] #: root directory path name self.root_dir = root_dir #: list of volumes from :class:`XMLState::get_volumes()` self.volumes = volumes #: volume group name self.volume_group: Optional[str] = None #: filesystem name the volumes were created with. Only known #: after an explicit create_volumes() call self.filesystem_name: str = '' #: map volume name to device node self.volume_map: Dict[str, str] = {} #: list of volume MountManager's self.mount_list: List[MountManager] = [] #: main storage device node name self.device = self.device_provider_root.get_device() if not os.path.exists(root_dir): raise KiwiVolumeManagerSetupError( f'given root directory {root_dir} does not exist' ) #: custom arguments passed to setup the volumes self.custom_args: Dict[str, Any] = {} #: custom filesystem creation and mount arguments, subset of the #: custom_args information suitable to be passed to a #: FileSystem instance self.custom_filesystem_args: Dict[str, Any] = { 'create_options': [], 'mount_options': [], } if custom_args and 'fs_create_options' in custom_args: self.custom_filesystem_args['create_options'] = custom_args[ 'fs_create_options' ] if custom_args and 'fs_mount_options' in custom_args: self.custom_filesystem_args['mount_options'] = custom_args[ 'fs_mount_options' ] if custom_args and 'fs_create_options' in custom_args: self.custom_filesystem_args['create_options'] = custom_args[ 'fs_create_options' ] self.post_init(custom_args) def __enter__(self) -> 'VolumeManagerBase': return self def post_init(self, custom_args: Optional[Dict[str, Any]]) -> None: """ Post initialization method Implementation in specialized volume manager class if required :param dict custom_args: unused """ pass def setup(self, name: Optional[str] = None) -> None: """ Implements setup required prior to the creation of volumes Implementation in specialized volume manager class required :param str name: unused """ raise NotImplementedError def create_volumes(self, filesystem_name: str) -> None: """ Implements creation of volumes Implementation in specialized volume manager class required :param str filesystem_name: unused """ raise NotImplementedError def apply_attributes_on_volume( self, toplevel: str, volume: volume_type ) -> None: for attribute in volume.attributes: if attribute == 'no-copy-on-write': log.info( '--> setting {0} for {1}'.format(attribute, volume.realpath) ) Command.run( [ 'chattr', '+C', os.path.normpath(toplevel + os.sep + volume.realpath), ] ) def get_fstab( self, persistency_type: str, filesystem_name: str ) -> List[str]: """ Implements setup of the fstab entries. The method should return a list of fstab compatible entries :param str persistency_type: unused :param str filesystem_name: unused """ raise NotImplementedError def get_volumes(self) -> Dict: """ Implements return of dictionary of volumes and their mount options """ raise NotImplementedError def mount_volumes(self) -> None: """ Implements mounting of all volumes below one master directory Implementation in specialized volume manager class required """ raise NotImplementedError def umount_volumes(self) -> None: """ Implements umounting of all volumes Implementation in specialized volume manager class required """ raise NotImplementedError def umount(self) -> None: """ Consistency layer with regards to FileSystem classes Invokes umount_volumes """ self.umount_volumes() def mount(self) -> None: """ Consistency layer with regards to FileSystem classes Invokes mount_volumes """ self.mount_volumes() def is_loop(self) -> bool: """ Check if storage provider is loop based The information is taken from the storage provider. If the storage provider is loop based the volume manager is it too :return: True of False :rtype: bool """ return self.device_provider_root.is_loop() def get_device(self) -> Dict[str, DeviceProvider]: """ Return current DeviceProvider dictionary :return: device_map :rtype: dict """ return self.device_map def create_volume_paths_in_root_dir(self) -> None: """ Implements creation of volume paths in the given root directory """ for volume in self.volumes: if volume.realpath and volume.realpath not in ['/', 'swap']: volume_image_path = os.path.normpath( self.root_dir + os.sep + volume.realpath ) if not os.path.exists(volume_image_path): # not existing volume paths will be created in the image # root directory. This happens hidden to the user but is # imho ok because the path is explicitly configured as a # volume Path.create(volume_image_path) def get_canonical_volume_list(self) -> Any: """ Implements hierarchical sorting of volumes according to their paths and provides information about the volume configured as the one eating all the rest space :return: list of canonical_volume_type tuples :rtype: list """ canonical_volume_type = namedtuple( 'canonical_volume_type', ['volumes', 'full_size_volume'] ) volume_paths = {} full_size_volume = None for volume in self.volumes: if volume.fullsize: full_size_volume = volume elif volume.realpath: volume_paths[volume.realpath] = volume volume_list = [] for realpath in Path.sort_by_hierarchy(sorted(volume_paths.keys())): volume_list.append(volume_paths[realpath]) return canonical_volume_type( volumes=volume_list, full_size_volume=full_size_volume ) def get_volume_mbsize( self, volume: volume_type, all_volumes: List[volume_type], filesystem_name: str, resize_on_boot: bool = False, ) -> int: """ Implements size lookup for the given path and desired filesystem according to the specified size type :param tuple volume: volume to check size for :param list all_volumes: list of all volume tuples :param str filesystem_name: filesystem name :param resize_on_boot: specify the time of the resize. If the resize happens at boot time the volume size is only the minimum size to just store the data. If the volume size is fixed and does not change at boot time the returned size is the requested size which can be greater than the minimum needed size. :return: mbsize :rtype: int """ [size_type, volume_mbsize] = volume.size.split(':') lookup_path = volume.realpath lookup_abspath = os.path.normpath( os.sep.join([self.root_dir, lookup_path]) ) mbsize = int(volume_mbsize) if resize_on_boot: # If resize_on_boot is true, the disk is self expandable and # will resize to the configured sizes on first boot # Therefore the requested size is set to null and we add # the required minimum size for just storing the data size_type = 'freespace' mbsize = Defaults.get_min_volume_mbytes(filesystem_name) if size_type == 'freespace' and os.path.exists(lookup_abspath): exclude_paths = [] for volume in all_volumes: volume_path = volume.realpath if lookup_path == volume_path: continue if lookup_path == os.sep: # exclude any sub volume path if lookup_path is / exclude_paths.append( os.path.normpath(self.root_dir + os.sep + volume_path) ) elif volume_path.startswith(lookup_path): # exclude any sub volume path below lookup_path exclude_paths.append( os.path.normpath(self.root_dir + os.sep + volume_path) ) volume_size = SystemSize(lookup_abspath) if mbsize != Defaults.get_min_volume_mbytes(filesystem_name): mbsize += Defaults.get_min_volume_mbytes(filesystem_name) mbsize += volume_size.customize( volume_size.accumulate_mbyte_file_sizes(exclude_paths), filesystem_name, ) return mbsize def get_mountpoint(self) -> Optional[str]: """ Provides mount point directory Effective use of the directory is guaranteed only after sync_data :return: directory path name :rtype: string """ return self.mountpoint def get_root_volume_name(self) -> str: """ Provides name of the root volume This is by default set to '/'. Volume Managers that supports the concept of sub-volumes overrides this method :return: directory path name :rtype: string """ return '/' def sync_data( self, exclude: Optional[List[str]] = None ) -> Optional[MountManager]: """ Implements sync of root directory to mounted volumes :param list exclude: file patterns to exclude :return: If a mount was created, then a context manager implementing the unmount is returned. """ if not self.mountpoint: return None root_mount = MountManager(device="", mountpoint=self.mountpoint) if not root_mount.is_mounted(): self.mount_volumes() data = DataSync(self.root_dir, self.mountpoint) data.sync_data( options=Defaults.get_sync_options(), exclude=exclude or [] ) return root_mount def create_verity_layer( self, blocks: Optional[int] = None, filename: Optional[str] = None ) -> None: """ veritysetup on LVM devices is not supported """ raise NotImplementedError def create_verification_metadata(self, device_node: str = '') -> None: """ Write verification block on LVM devices is not supported """ raise NotImplementedError def set_property_readonly_root(self) -> None: """ Implements setup of read-only root property """ raise KiwiVolumeManagerSetupError('read only property not supported') def setup_mountpoint(self) -> None: """ Implements creation of a master directory holding the mounts of all volumes """ self.mountpoint_tempdir = Temporary(prefix='kiwi_volumes.').new_dir() self.mountpoint = self.mountpoint_tempdir.name self.temp_directories.append(self.mountpoint_tempdir) def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: pass ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7537186 kiwi-11.1.8/kiwi/volume_manager/btrfs.py0000644000000000000000000004647615273675667015202 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import re import os import logging from types import TracebackType from typing import Any, Dict, List, Optional, Type # project from kiwi.command import Command from kiwi.volume_manager.base import VolumeManagerBase from kiwi.mount_manager import MountManager from kiwi.storage.mapped_device import MappedDevice from kiwi.filesystem import FileSystem from kiwi.utils.sync import DataSync from kiwi.utils.block import BlockID from kiwi.path import Path from kiwi.defaults import Defaults from kiwi.snapshot_manager import SnapshotManager from kiwi.snapshot_manager.base import SnapshotManagerBase from kiwi.exceptions import KiwiVolumeRootIDError, KiwiVolumeManagerSetupError log = logging.getLogger('kiwi') class VolumeManagerBtrfs(VolumeManagerBase): """ Implements btrfs sub-volume management :param list subvol_mount_list: list of mounted btrfs subvolumes :param object toplevel_mount: :class:`MountManager` for root mountpoint """ def post_init(self, custom_args: Optional[Dict[str, Any]]) -> None: """ Post initialization method Store custom btrfs initialization arguments :param dict custom_args: custom btrfs volume manager arguments """ if custom_args: self.custom_args = custom_args else: self.custom_args = {} if 'root_label' not in self.custom_args: self.custom_args['root_label'] = 'ROOT' if 'root_is_snapper_snapshot' not in self.custom_args: self.custom_args['root_is_snapper_snapshot'] = False if 'btrfs_default_volume_requested' not in self.custom_args: self.custom_args['btrfs_default_volume_requested'] = True if 'root_is_readonly_snapshot' not in self.custom_args: self.custom_args['root_is_readonly_snapshot'] = False if 'root_is_subvolume' not in self.custom_args: self.custom_args['root_is_subvolume'] = None if 'quota_groups' not in self.custom_args: self.custom_args['quota_groups'] = False self.root_volume_name = '/' self.default_volume_name = self.root_volume_name if self._has_root_volume(): self.root_volume_name = '@' canonical_volume_list = self.get_canonical_volume_list() for volume in canonical_volume_list.volumes: if volume.is_root_volume and volume.name: self.root_volume_name = volume.name self.default_volume_name = self.root_volume_name if ( self.custom_args['root_is_snapper_snapshot'] and self.root_volume_name == '/' ): log.warning( 'root_is_snapper_snapshot requires a toplevel sub-volume' ) log.warning('root_is_snapper_snapshot has been disabled') self.custom_args['root_is_snapper_snapshot'] = False self.snapper: Optional[SnapshotManagerBase] = None self.subvol_mount_list: List[MountManager] = [] self.toplevel_mount: Optional[MountManager] = None self.root_volume_mount: Optional[MountManager] = None self.snapshots_root_mount: Optional[MountManager] = None def setup(self, name: Optional[str] = None) -> None: """ Setup btrfs volume management In case of btrfs an optional toplevel subvolume is created and marked as default volume. If snapshots are activated via the custom_args the setup method also creates the .snapshots/1/snapshot subvolumes. There is no concept of a volume manager name, thus the name argument is not used for btrfs :param string name: unused """ self.setup_mountpoint() assert self.mountpoint is not None with FileSystem.new( name='btrfs', device_provider=MappedDevice( device=self.device, device_provider=self.device_provider_root ), custom_args=self.custom_filesystem_args, ) as filesystem: filesystem.create_on_device(label=self.custom_args['root_label']) self.toplevel_mount = MountManager( device=self.device, mountpoint=self.mountpoint ) self.toplevel_mount.mount(self.custom_filesystem_args['mount_options']) if self.custom_args['quota_groups']: Command.run(['btrfs', 'quota', 'enable', self.mountpoint]) if self.root_volume_name != '/': root_volume = self.mountpoint + f'/{self.root_volume_name}' Command.run(['btrfs', 'subvolume', 'create', root_volume]) if self.custom_args['root_is_snapper_snapshot']: self.snapper = SnapshotManager.new( 'snapper', self.device, self.root_dir, self.mountpoint, self.root_volume_name, {'quota_groups': self.custom_args['quota_groups']}, ) mounts = self.snapper.create_first_snapshot() for mnt in mounts: self.subvol_mount_list.append(mnt) # make sure the snapshot appears as proper (/) in the chroot self.snapshots_root_mount = MountManager( device=self.get_mountpoint(), mountpoint=self.get_mountpoint() ) self.default_volume_name = self.snapper.get_default_snapshot_name() elif self.root_volume_name != '/': self._set_default_volume(self.root_volume_name) # make sure the root volume appears as proper (/) in the chroot root_dir = os.path.normpath( os.sep.join([self.mountpoint, self.get_root_volume_name()]) ) self.root_volume_mount = MountManager( device=root_dir, mountpoint=root_dir ) self.root_volume_mount.bind_mount() def get_root_volume_name(self) -> str: """ Provides name of the root volume :return: directory path name :rtype: string """ return self.default_volume_name def create_volumes(self, filesystem_name: str) -> None: """ Create configured btrfs subvolumes Any btrfs subvolume is of the same btrfs filesystem. There is no way to have different filesystems per btrfs subvolume. Thus the filesystem_name has no effect for btrfs :param string filesystem_name: unused """ log.info('Creating %s sub volumes', filesystem_name) self.create_volume_paths_in_root_dir() canonical_volume_list = self.get_canonical_volume_list() if canonical_volume_list.full_size_volume: # put an eventual fullsize volume to the volume list # because there is no extra handling required for it on btrfs canonical_volume_list.volumes.append( canonical_volume_list.full_size_volume ) for volume in canonical_volume_list.volumes: if volume.is_root_volume: # the btrfs root volume has been created as # part of the setup procedure pass else: log.info('--> sub volume %s', volume.realpath) assert self.mountpoint is not None toplevel = os.path.normpath( self.mountpoint + os.sep + self.root_volume_name ) if volume.parent: toplevel = os.path.normpath( self.mountpoint + os.sep + volume.parent ) Path.create( os.path.dirname( os.path.normpath(toplevel + os.sep + volume.realpath) ) ) Command.run( [ 'btrfs', 'subvolume', 'create', os.path.normpath(toplevel + os.sep + volume.realpath), ] ) self._apply_quota( os.path.normpath(toplevel + os.sep + volume.realpath), volume.attributes, ) self.apply_attributes_on_volume(toplevel, volume) volume_mountpoint = toplevel root_is_snapper_snapshot = self.custom_args[ 'root_is_snapper_snapshot' ] attributes = { 'parent': volume.parent or '', 'subvol_path': os.path.normpath( toplevel.replace(self.mountpoint, '') + os.sep + volume.realpath ).lstrip(os.sep), 'subvol_name': volume.name, } if root_is_snapper_snapshot: volume_mountpoint = ( self.mountpoint + f'/{self.root_volume_name}/.snapshots/1/snapshot/' ) attributes = { 'subvol_path': os.path.normpath( self.root_volume_name + os.sep + volume.realpath ), 'subvol_name': os.path.normpath( self.root_volume_name + os.sep + volume.realpath ), } volume_mount = MountManager( device=self.device, attributes=attributes, mountpoint=os.path.normpath( os.sep.join( [ volume_mountpoint, ( self.root_volume_name if not root_is_snapper_snapshot else '' ), volume.realpath, ] ) ), ) self.subvol_mount_list.append(volume_mount) def get_fstab( self, persistency_type: str = 'by-label', filesystem_name: str = '' ) -> List[str]: """ Implements creation of the fstab entries. The method returns a list of fstab compatible entries :param string persistency_type: by-label | by-uuid :param string filesystem_name: unused :return: list of fstab entries :rtype: list """ fstab_entries = [] mount_options = self.custom_filesystem_args['mount_options'] or [ 'defaults' ] block_operation = BlockID(self.device) blkid_type = 'LABEL' if persistency_type == 'by-label' else 'UUID' device_id = block_operation.get_blkid(blkid_type) for volume_mount in self.subvol_mount_list: mount_point = volume_mount.get_attributes()['subvol_path'] # Delete root_volume_name from mountpoint path if present if self.root_volume_name != '/' and mount_point.startswith( self.root_volume_name ): mount_point = mount_point.replace(self.root_volume_name, '') mount_entry_options = mount_options + [ 'subvol=' + volume_mount.get_attributes()['subvol_path'].lstrip(os.sep) ] fs_check = self._is_volume_enabled_for_fs_check( volume_mount.mountpoint ) fstab_entry = ' '.join( [ blkid_type + '=' + device_id, ( mount_point if mount_point.startswith(os.sep) else f'{os.sep}{mount_point}' ), 'btrfs', ','.join(mount_entry_options), '0 {fs_passno}'.format(fs_passno='2' if fs_check else '0'), ] ) fstab_entries.append(fstab_entry) return fstab_entries def get_volumes(self) -> Dict: """ Return dict of volumes :return: volumes dictionary :rtype: dict """ volumes = {} for volume_mount in self.subvol_mount_list: subvol_path = volume_mount.get_attributes()['subvol_path'] subvol_options = ','.join( ['subvol=' + subvol_path] + self.custom_filesystem_args['mount_options'] ) subvol_path = ( subvol_path.replace(self.root_volume_name, '') if self.root_volume_name != '/' else subvol_path ) volumes[subvol_path] = { 'volume_options': subvol_options, 'volume_device': volume_mount.device, } return volumes def mount_volumes(self) -> None: """ Mount btrfs subvolumes """ assert self.toplevel_mount is not None self.toplevel_mount.mount(self.custom_filesystem_args['mount_options']) for volume_mount in self.subvol_mount_list: if not os.path.exists(volume_mount.mountpoint): Path.create(volume_mount.mountpoint) if self.snapshots_root_mount: self.snapshots_root_mount.bind_mount() subvol_path = volume_mount.get_attributes()['subvol_path'] subvol_options = ','.join( ['subvol=' + subvol_path] + self.custom_filesystem_args['mount_options'] ) volume_mount.mount(options=[subvol_options]) def umount_volumes(self) -> None: """ Umount btrfs subvolumes """ for volume_mount in reversed(self.subvol_mount_list): if volume_mount.is_mounted(): volume_mount.umount() if self.snapshots_root_mount and self.snapshots_root_mount.is_mounted(): self.snapshots_root_mount.umount() if self.root_volume_mount: self.root_volume_mount.umount() assert self.toplevel_mount is not None if self.toplevel_mount.is_mounted(): self.toplevel_mount.umount() def get_mountpoint(self) -> str: """ Provides btrfs root mount point directory Effective use of the directory is guaranteed only after sync_data :return: directory path name :rtype: string """ if not self.mountpoint: raise KiwiVolumeManagerSetupError("No mountpoint exists") sync_target: List[str] = [self.mountpoint] if self.root_volume_name != '/': sync_target.append(self.root_volume_name) if self.custom_args.get('root_is_snapper_snapshot'): sync_target.extend(['.snapshots', '1', 'snapshot']) return os.path.join(*sync_target) def sync_data(self, exclude: Optional[List[str]] = None) -> None: """ Sync data into btrfs filesystem If snapshots are activated the root filesystem is synced into the first snapshot :param list exclude: files to exclude from sync """ if self.toplevel_mount: sync_target = self.get_mountpoint() data = DataSync(self.root_dir, sync_target) data.sync_data( options=Defaults.get_sync_options(), exclude=exclude or [] ) if self.custom_args['root_is_snapper_snapshot']: assert self.snapper is not None self.snapper.setup_first_snapshot() def set_property_readonly_root(self) -> None: """ Sets the root volume to be a readonly filesystem """ root_is_snapper_snapshot = self.custom_args['root_is_snapper_snapshot'] root_is_readonly_snapshot = self.custom_args[ 'root_is_readonly_snapshot' ] if root_is_snapper_snapshot and root_is_readonly_snapshot: sync_target = self.get_mountpoint() Command.run(['btrfs', 'property', 'set', sync_target, 'ro', 'true']) def _apply_quota(self, volume_path: str, attributes: List[str]) -> None: for attribute in attributes: if attribute.startswith('quota='): quota = attribute.split('=')[1] Command.run( ['btrfs', 'quota', 'enable', '--simple', volume_path] ) Command.run(['btrfs', 'qgroup', 'limit', quota, volume_path]) def _has_root_volume(self) -> bool: has_root_volume = bool(self.custom_args['root_is_subvolume']) if self.custom_args['root_is_subvolume'] is None: # root volume not explicitly configured, will # be enabled by default but this is going to change # in the future. Print a deprecation message to inform # the user about a potential behavior change log.warning("Implicitly creating root volume") log.warning("--> Future versions of kiwi will not do this anymore") log.warning("--> Please specify btrfs_root_is_subvolume true|false") has_root_volume = True return has_root_volume def _is_volume_enabled_for_fs_check(self, mountpoint: str) -> bool: for volume in self.volumes: if volume.realpath in mountpoint: if 'enable-for-filesystem-check' in volume.attributes: return True return False def _set_default_volume(self, default_volume: str) -> None: assert self.mountpoint is not None subvolume_list_call = Command.run( ['btrfs', 'subvolume', 'list', self.mountpoint] ) for subvolume in subvolume_list_call.output.split('\n'): id_search = re.search(r'ID (\d+) .*path (.*)', subvolume) if id_search: volume_id = id_search.group(1) volume_path = id_search.group(2) if volume_path == default_volume: if self.custom_args['btrfs_default_volume_requested']: Command.run( [ 'btrfs', 'subvolume', 'set-default', volume_id, self.mountpoint, ] ) self.default_volume_name = default_volume return raise KiwiVolumeRootIDError( f'Failed to find btrfs volume: {default_volume}' ) def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: if self.root_volume_mount: self.root_volume_mount.umount() if self.toplevel_mount: self.umount_volumes() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7537186 kiwi-11.1.8/kiwi/volume_manager/lvm.py0000644000000000000000000003721615273675667014650 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os import logging from types import TracebackType from typing import Any, Dict, List, Optional, Type # project import kiwi.defaults as defaults from kiwi.defaults import Defaults from kiwi.volume_manager.base import VolumeManagerBase from kiwi.command import Command from kiwi.mount_manager import MountManager from kiwi.storage.device_provider import DeviceProvider from kiwi.storage.mapped_device import MappedDevice from kiwi.filesystem import FileSystem from kiwi.filesystem.base import FileSystemBase from kiwi.path import Path from kiwi.exceptions import KiwiVolumeGroupConflict, KiwiCommandError log = logging.getLogger('kiwi') class VolumeManagerLVM(VolumeManagerBase): """ **Implements LVM volume management** """ def post_init(self, custom_args: Optional[Dict[str, Any]]) -> None: """ Post initialization method Store custom lvm initialization arguments :param list custom_args: custom lvm volume manager arguments """ if custom_args: self.custom_args = custom_args else: self.custom_args = {} if 'root_label' not in self.custom_args: self.custom_args['root_label'] = 'ROOT' if 'resize_on_boot' not in self.custom_args: self.custom_args['resize_on_boot'] = False if self.custom_filesystem_args['mount_options']: self.mount_options = self.custom_filesystem_args['mount_options'][0] else: self.mount_options = 'defaults' self.lvm_tool_options = [ '--config', 'devices/external_device_info_source=none', ] def get_device(self) -> Dict[str, DeviceProvider]: """ Dictionary of MappedDevice instances per volume Note: The mapping requires an explicit create_volumes() call :return: root plus volume device map :rtype: dict """ device_map: Dict[str, DeviceProvider] = {} for volume_name, volume_node in list(self.volume_map.items()): if self._is_root_volume(volume_name): # root volume device takes precedence over the # root partition device from the disk. Therefore use # the same key to put them on the same level volume_name = 'root' if self._is_swap_volume(volume_name): # swap volume device takes precedence over the # swap partition device from the disk. Therefore use # the same key to put them on the same level volume_name = 'swap' device_map[volume_name] = MappedDevice( device=volume_node, device_provider=self.device_provider_root ) return device_map def setup(self, volume_group_name: Optional[str] = None) -> None: """ Setup lvm volume management In case of LVM a new volume group is created on a PV initialized storage device :param str name: volume group name, the default name if not set """ volume_group_name = ( volume_group_name or Defaults.get_default_volume_group_name() ) self.setup_mountpoint() if self._volume_group_in_use_on_host_system(volume_group_name): raise KiwiVolumeGroupConflict( f'Requested volume group {volume_group_name} is in use on this host' ) log.info('Creating volume group %s', volume_group_name) Command.run( command=['vgremove'] + self.lvm_tool_options + ['--force', volume_group_name], raise_on_error=False, ) Command.run(['pvcreate'] + self.lvm_tool_options + [self.device]) Command.run( ['vgcreate'] + self.lvm_tool_options + [volume_group_name, self.device] ) self.volume_group = volume_group_name @staticmethod def _create_volume_no_zero( lvm_tool_options: List[str], lvcreate_args: List[str] ) -> None: """ Create an LV using specified arguments to lvcreate The LV will be created with the '-Zn' option prepended to the arguments, which disables the zeroing of the new device's header; this action will fail when running in an environment where udev is not enabled, such as in a chroot'd Open Build Service build. Since the backing device for a kiwi LVM device is a zero filled qemu-img created file, there should be no negative side effects to skipping the zeroing of this header block. Then we run 'vgscan --mknodes' to ensure that any /dev nodes have been created for the new LV. :param list lvcreate_args: list of lvcreate arguments. """ log.debug('--> running "lvcreate -Zn %s"', " ".join(lvcreate_args)) Command.run(['lvcreate'] + lvm_tool_options + ['-Zn'] + lvcreate_args) log.debug('--> running "vgscan --mknodes" to create missing nodes') Command.run(['vgscan'] + lvm_tool_options + ['--mknodes']) def create_volumes(self, filesystem_name: str) -> None: """ Create configured lvm volumes and filesystems All volumes receive the same filesystem :param str filesystem_name: volumes filesystem name """ log.info('Creating volumes(%s)', filesystem_name) self.filesystem_name = filesystem_name self.create_volume_paths_in_root_dir() canonical_volume_list = self.get_canonical_volume_list() for volume in canonical_volume_list.volumes: volume_mbsize = self.get_volume_mbsize( volume, self.volumes, filesystem_name, self.custom_args['resize_on_boot'], ) log.info('--> volume %s with %s MB', volume.name, volume_mbsize) assert self.volume_group is not None self._create_volume_no_zero( self.lvm_tool_options, [ '-L', format(volume_mbsize), '-n', volume.name, self.volume_group, ], ) self.apply_attributes_on_volume(self.root_dir, volume) self._add_to_volume_map(volume.name) if volume.label != 'SWAP': self._create_filesystem( volume.name, volume.label, filesystem_name ) self._add_to_mount_list(volume.name, volume.realpath) if canonical_volume_list.full_size_volume: full_size_volume = canonical_volume_list.full_size_volume log.info('--> fullsize volume %s', full_size_volume.name) assert self.volume_group is not None self._create_volume_no_zero( self.lvm_tool_options, [ '-l', '+100%FREE', '-n', full_size_volume.name, self.volume_group, ], ) self._add_to_volume_map(full_size_volume.name) self._create_filesystem( full_size_volume.name, full_size_volume.label, filesystem_name ) self._add_to_mount_list( full_size_volume.name, full_size_volume.realpath ) # re-order mount_list by mountpoint hierarchy # This is needed because the handling of the fullsize volume and # all other volumes is outside of the canonical order. If the # fullsize volume forms a nested structure together with another # volume the volume mount list must be re-ordered to avoid # mounting the volumes in the wrong order volume_paths = {} for volume_mount in self.mount_list: volume_paths[volume_mount.mountpoint] = volume_mount self.mount_list = [] for mount_path in Path.sort_by_hierarchy(sorted(volume_paths.keys())): self.mount_list.append(volume_paths[mount_path]) def get_fstab( self, persistency_type: str = 'by-label', filesystem_name: str = '' ) -> List[str]: """ Implements creation of the fstab entries. The method returns a list of fstab compatible entries :param str persistency_type: unused :param str filesystem_name: volumes filesystem name :return: fstab entries :rtype: list """ fstab_entries = [] for volume_mount in self.mount_list: volume_name = self._get_volume_name_from_volume_map( volume_mount.device ) if not self._is_root_volume(volume_name): path_start_index = len(defaults.TEMP_DIR.split(os.sep)) + 1 mount_path = os.sep.join( volume_mount.mountpoint.split(os.sep)[path_start_index:] ) fs_check = self._is_volume_enabled_for_fs_check(volume_name) if not mount_path.startswith(os.sep): mount_path = os.sep + mount_path fstab_entry = ' '.join( [ volume_mount.device, mount_path, filesystem_name, self.mount_options, '0 {fs_passno}'.format( fs_passno='2' if fs_check else '0' ), ] ) fstab_entries.append(fstab_entry) return fstab_entries def get_volumes(self) -> Dict: """ Return dict of volumes :return: volumes dictionary :rtype: dict """ volumes = {} path_start_index = len(defaults.TEMP_DIR.split(os.sep)) + 1 for volume_mount in self.mount_list: mount_path = os.sep.join( volume_mount.mountpoint.split(os.sep)[path_start_index:] ) if mount_path: volumes[mount_path] = { 'volume_options': self.mount_options, 'volume_device': volume_mount.device, } return volumes def mount_volumes(self) -> None: """ Mount lvm volumes The volumes are mounted with the options from the image description, plus any option the filesystem implementation declares as needed for a sparse data sync. The latter are not part of self.mount_options and therefore cannot reach the fstab of the image, which is built from that attribute. """ mount_options = FileSystemBase.merge_install_mount_options( FileSystem.sparse_install_mount_options(self.filesystem_name), [self.mount_options], ) for volume_mount in self.mount_list: Path.create(volume_mount.mountpoint) volume_mount.mount(options=mount_options) def umount_volumes(self) -> None: """ Umount lvm volumes """ for volume_mount in reversed(self.mount_list): if volume_mount.is_mounted(): volume_mount.umount() def _is_volume_enabled_for_fs_check( self, volume_name: Optional[str] ) -> bool: for volume in self.volumes: if volume_name == volume.name: if 'enable-for-filesystem-check' in volume.attributes: return True return False def _create_filesystem( self, volume_name: str, volume_label: Optional[str], filesystem_name: str, ) -> None: device_node = self.volume_map[volume_name] if self._is_root_volume(volume_name) and not volume_label: # if there is no @root volume definition for the root volume, # perform a second lookup of a label specified via the # rootfs_label from the type setup volume_label = self.custom_args['root_label'] with FileSystem.new( name=filesystem_name, device_provider=MappedDevice( device=device_node, device_provider=self.device_provider_root ), custom_args=self.custom_filesystem_args, ) as filesystem: filesystem.create_on_device(label=volume_label) def _add_to_mount_list(self, volume_name: str, realpath: str) -> None: device_node = self.volume_map[volume_name] assert self.mountpoint is not None if self._is_root_volume(volume_name): # root volume must be first in the list self.mount_list.insert( 0, MountManager(device=device_node, mountpoint=self.mountpoint) ) else: self.mount_list.append( MountManager( device=device_node, mountpoint=self.mountpoint + '/' + realpath, ) ) def _add_to_volume_map(self, volume_name: str) -> None: assert self.volume_group is not None self.volume_map[volume_name] = ''.join( ['/dev/', self.volume_group, '/', volume_name] ) def _get_volume_name_from_volume_map(self, device: str) -> Optional[str]: for volume_name, volume_path in self.volume_map.items(): if volume_path == device: return volume_name return None def _volume_group_in_use_on_host_system( self, volume_group_name: str ) -> bool: vgs_call = Command.run( [ 'vgs', '--noheadings', '--select', 'vg_name={0}'.format(volume_group_name), ] ) if vgs_call.output: # if vgs returned some information on the selected volume # group name, this indicates the group is in use return True else: # if vgs returned no information on the selected volume # group name, it is considered to be not used return False def _is_root_volume(self, volume_name: Optional[str]) -> Optional[bool]: for volume in self.volumes: if volume_name == volume.name and volume.is_root_volume: return True return None def _is_swap_volume(self, volume_name: str) -> Optional[bool]: for volume in self.volumes: if volume_name == volume.name and volume.label == 'SWAP': return True return None def __exit__( self, exc_type: Optional[Type[BaseException]], exc_value: Optional[BaseException], traceback: Optional[TracebackType], ) -> None: if self.volume_group: try: self.umount_volumes() Command.run( ['vgchange'] + self.lvm_tool_options + ['-an', self.volume_group] ) except KiwiCommandError as issue: log.error( 'volume group {0} detach failed with {1}'.format( self.volume_group, issue ) ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7537186 kiwi-11.1.8/kiwi/xml_description.py0000644000000000000000000002262015273675667014245 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import importlib from typing import Dict, Any, Optional import os import logging from xml.dom import minidom from lxml import etree # project from kiwi.utils.temporary import Temporary from kiwi.markup import Markup from kiwi.defaults import Defaults from kiwi import xml_parse from kiwi.command import Command from kiwi.exceptions import ( KiwiCommandError, KiwiSchemaImportError, KiwiValidationError, KiwiDescriptionInvalid, KiwiDataStructureError, KiwiExtensionError, KiwiCommandNotFound, ) log = logging.getLogger('kiwi') class XMLDescription: """ **Implements data management for the image description** Supported description markup languages are XML, YAML, JSON and INI. The provided input file is converted into XML, transformed to the current RelaxNG schema via XSLT and validated against this result. * XSLT Style Sheet processing to apply on this version of kiwi * Schema Validation based on RelaxNG schema * Loading XML data into internal data structures Attributes :param str description: path to description file :param str derived_from: path to base description file """ def __init__( self, description: str = '', derived_from: Optional[str] = None ): log.info(f'Loading XML description: {description}') self.markup = Markup.new(description) self.description = self.markup.get_xml_description() self.derived_from = derived_from self.description_origin = description self.extension_data: Dict = {} def load(self) -> Any: """ Read XML description, validate it against the schema and the schematron rules and pass it to the autogenerated(generateDS) parser. :return: instance of XML toplevel domain (image) :rtype: object """ isoschematron = None schematron = None try: isoschematron = importlib.import_module( Defaults.get_schematron_module_name() ) except Exception as error: log.warning(f"schematron validation skipped: {error}") try: schema_doc = etree.parse(Defaults.get_schema_file()) relaxng = etree.RelaxNG(schema_doc) if isoschematron: schematron = isoschematron.Schematron( schema_doc, store_report=True ) except Exception as issue: raise KiwiSchemaImportError(issue) try: description = etree.parse(self.description) validation_rng = relaxng.validate(description) if schematron: validation_schematron = schematron.validate(description) except Exception as issue: raise KiwiValidationError(issue) if not validation_rng: XMLDescription._get_relaxng_validation_details( Defaults.get_schema_file(), self.description, relaxng.error_log ) if schematron and not validation_schematron: XMLDescription._get_schematron_validation_details( schematron.validation_report ) if not validation_rng or (schematron and not validation_schematron): log.debug(open(self.description).read()) raise KiwiDescriptionInvalid( 'Failed to validate schema and/or schematron rules. ' 'Use --debug for more details' ) parse_result = self._parse() if parse_result.get_extension(): extension_namespace_map = ( description.getroot().xpath('extension')[0].nsmap ) for namespace_name in extension_namespace_map: extensions_for_namespace = description.getroot().xpath( 'extension/{namespace}:*'.format(namespace=namespace_name), namespaces=extension_namespace_map, ) if extensions_for_namespace: # one toplevel entry point per extension via xmlns if len(extensions_for_namespace) > 1: raise KiwiExtensionError( 'Multiple toplevel sections for "{0}" found'.format( namespace_name ) ) # store extension xml data parse tree for this namespace self.extension_data[namespace_name] = etree.ElementTree( extensions_for_namespace[0] ) # validate extension xml data try: xml_catalog = Command.run( [ 'xmlcatalog', '/etc/xml/catalog', extension_namespace_map[namespace_name], ] ) extension_schema = xml_catalog.output.rstrip().replace( 'file://', '' ) extension_relaxng = etree.RelaxNG( etree.parse(extension_schema) ) except Exception as issue: raise KiwiExtensionError( 'Extension schema error: {0}'.format(issue) ) validation_result = extension_relaxng.validate( self.extension_data[namespace_name] ) if not validation_result: xml_data_unformatted = etree.tostring( self.extension_data[namespace_name], encoding='utf-8', ) xml_data_domtree = minidom.parseString( xml_data_unformatted ) extension_file = Temporary().new_file() with open(extension_file.name, 'w') as xml_data: xml_data.write(xml_data_domtree.toprettyxml()) XMLDescription._get_relaxng_validation_details( extension_schema, extension_file.name, extension_relaxng.error_log, ) raise KiwiExtensionError( 'Schema validation for extension XML data failed' ) return parse_result def get_extension_xml_data(self, namespace_name: str) -> Any: """ Return the xml etree parse result for the specified extension namespace :param str namespace_name: name of the extension namespace :return: result of etree.parse :rtype: object """ return self.extension_data.get(namespace_name) @staticmethod def _get_relaxng_validation_details( schema_file: str, description_file: str, error_log: etree._ListErrorLog ) -> None: """ Run jing program to validate description against the schema Jing provides detailed error information in case of a schema validation failure. If jing is not present the standard error_log as provided from the raw XML libraries is used """ try: Command.run(['jing', schema_file, description_file]) except KiwiCommandError as issue: log.info('RelaxNG validation failed. See jing report:') log.info('--> {0}'.format(issue)) except KiwiCommandNotFound as issue: log.warning(issue) log.warning('For detailed schema validation report, install: jing') log.info('Showing only raw library error log:') log.info('--> {0}'.format(error_log)) @staticmethod def _get_schematron_validation_details( validation_report: etree._ElementTree, ) -> None: """ Extract error message form the schematron validation report :param etree validation_report: the schematron validation report """ nspaces = validation_report.getroot().nsmap log.info('Schematron validation failed:') for msg in validation_report.xpath( '//svrl:failed-assert/svrl:text', namespaces=nspaces ): log.info('--> %s', msg.text) def _parse(self) -> Any: try: parse = xml_parse.parse(self.description, True) parse.description_dir = self.description_origin and os.path.dirname( self.description_origin ) parse.derived_description_dir = self.derived_from return parse except Exception as issue: raise KiwiDataStructureError(issue) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7537186 kiwi-11.1.8/kiwi/xml_parse.py0000644000000000000000000240273615273675667013050 0ustar00#!/usr/bin/env python # -*- coding: utf-8 -*- # # Generated by generateDS.py version 2.29.24. # Python 3.11.14 (main, Nov 20 2025, 22:16:35) [GCC] # # Command line options: # ('-f', '') # ('--external-encoding', 'utf-8') # ('--no-dates', '') # ('--no-warnings', '') # ('-o', 'kiwi/xml_parse.py') # # Command line arguments: # kiwi/schema/kiwi_for_generateDS.xsd # # Command line: # /home/ms/.cache/pypoetry/virtualenvs/kiwi-XEM4Fy69-py3.11/bin/generateDS.py -f --external-encoding="utf-8" --no-dates --no-warnings -o "kiwi/xml_parse.py" kiwi/schema/kiwi_for_generateDS.xsd # # Current working directory (os.getcwd()): # kiwi # import sys import re as re_ import base64 import datetime as datetime_ import warnings as warnings_ try: from lxml import etree as etree_ except ImportError: from xml.etree import ElementTree as etree_ Validate_simpletypes_ = True if sys.version_info.major == 2: BaseStrType_ = basestring else: BaseStrType_ = str def parsexml_(infile, parser=None, **kwargs): if parser is None: # Use the lxml ElementTree compatible parser so that, e.g., # we ignore comments. try: parser = etree_.ETCompatXMLParser() except AttributeError: # fallback to xml.etree parser = etree_.XMLParser() doc = etree_.parse(infile, parser=parser, **kwargs) return doc def parsexmlstring_(instring, parser=None, **kwargs): if parser is None: # Use the lxml ElementTree compatible parser so that, e.g., # we ignore comments. try: parser = etree_.ETCompatXMLParser() except AttributeError: # fallback to xml.etree parser = etree_.XMLParser() element = etree_.fromstring(instring, parser=parser, **kwargs) return element # # Namespace prefix definition table (and other attributes, too) # # The module generatedsnamespaces, if it is importable, must contain # a dictionary named GeneratedsNamespaceDefs. This Python dictionary # should map element type names (strings) to XML schema namespace prefix # definitions. The export method for any class for which there is # a namespace prefix definition, will export that definition in the # XML representation of that element. See the export method of # any generated element type class for a example of the use of this # table. # A sample table is: # # # File: generatedsnamespaces.py # # GenerateDSNamespaceDefs = { # "ElementtypeA": "http://www.xxx.com/namespaceA", # "ElementtypeB": "http://www.xxx.com/namespaceB", # } # try: from generatedsnamespaces import ( GenerateDSNamespaceDefs as GenerateDSNamespaceDefs_, ) except ImportError: GenerateDSNamespaceDefs_ = {} # # The root super-class for element type classes # # Calls to the methods in these classes are generated by generateDS.py. # You can replace these methods by re-implementing the following class # in a module named generatedssuper.py. try: from generatedssuper import GeneratedsSuper except ImportError as exp: class GeneratedsSuper(object): tzoff_pattern = re_.compile(r'(\+|-)((0\d|1[0-3]):[0-5]\d|14:00)$') class _FixedOffsetTZ(datetime_.tzinfo): def __init__(self, offset, name): self.__offset = datetime_.timedelta(minutes=offset) self.__name = name def utcoffset(self, dt): return self.__offset def tzname(self, dt): return self.__name def dst(self, dt): return None def gds_format_string(self, input_data, input_name=''): return input_data def gds_validate_string(self, input_data, node=None, input_name=''): if not input_data: return '' else: return input_data def gds_format_base64(self, input_data, input_name=''): return base64.b64encode(input_data) def gds_validate_base64(self, input_data, node=None, input_name=''): return input_data def gds_format_integer(self, input_data, input_name=''): return '%d' % input_data def gds_validate_integer(self, input_data, node=None, input_name=''): return input_data def gds_format_integer_list(self, input_data, input_name=''): return '%s' % ' '.join(input_data) def gds_validate_integer_list( self, input_data, node=None, input_name='' ): values = input_data.split() for value in values: try: int(value) except (TypeError, ValueError): raise_parse_error(node, 'Requires sequence of integers') return values def gds_format_float(self, input_data, input_name=''): return ('%.15f' % input_data).rstrip('0') def gds_validate_float(self, input_data, node=None, input_name=''): return input_data def gds_format_float_list(self, input_data, input_name=''): return '%s' % ' '.join(input_data) def gds_validate_float_list(self, input_data, node=None, input_name=''): values = input_data.split() for value in values: try: float(value) except (TypeError, ValueError): raise_parse_error(node, 'Requires sequence of floats') return values def gds_format_double(self, input_data, input_name=''): return '%e' % input_data def gds_validate_double(self, input_data, node=None, input_name=''): return input_data def gds_format_double_list(self, input_data, input_name=''): return '%s' % ' '.join(input_data) def gds_validate_double_list( self, input_data, node=None, input_name='' ): values = input_data.split() for value in values: try: float(value) except (TypeError, ValueError): raise_parse_error(node, 'Requires sequence of doubles') return values def gds_format_boolean(self, input_data, input_name=''): return ('%s' % input_data).lower() def gds_validate_boolean(self, input_data, node=None, input_name=''): return input_data def gds_format_boolean_list(self, input_data, input_name=''): return '%s' % ' '.join(input_data) def gds_validate_boolean_list( self, input_data, node=None, input_name='' ): values = input_data.split() for value in values: if value not in ( 'true', '1', 'false', '0', ): raise_parse_error( node, 'Requires sequence of booleans ' '("true", "1", "false", "0")', ) return values def gds_validate_datetime(self, input_data, node=None, input_name=''): return input_data def gds_format_datetime(self, input_data, input_name=''): if input_data.microsecond == 0: _svalue = '%04d-%02d-%02dT%02d:%02d:%02d' % ( input_data.year, input_data.month, input_data.day, input_data.hour, input_data.minute, input_data.second, ) else: _svalue = '%04d-%02d-%02dT%02d:%02d:%02d.%s' % ( input_data.year, input_data.month, input_data.day, input_data.hour, input_data.minute, input_data.second, ('%f' % (float(input_data.microsecond) / 1000000))[2:], ) if input_data.tzinfo is not None: tzoff = input_data.tzinfo.utcoffset(input_data) if tzoff is not None: total_seconds = tzoff.seconds + (86400 * tzoff.days) if total_seconds == 0: _svalue += 'Z' else: if total_seconds < 0: _svalue += '-' total_seconds *= -1 else: _svalue += '+' hours = total_seconds // 3600 minutes = (total_seconds - (hours * 3600)) // 60 _svalue += '{0:02d}:{1:02d}'.format(hours, minutes) return _svalue @classmethod def gds_parse_datetime(cls, input_data): tz = None if input_data[-1] == 'Z': tz = GeneratedsSuper._FixedOffsetTZ(0, 'UTC') input_data = input_data[:-1] else: results = GeneratedsSuper.tzoff_pattern.search(input_data) if results is not None: tzoff_parts = results.group(2).split(':') tzoff = int(tzoff_parts[0]) * 60 + int(tzoff_parts[1]) if results.group(1) == '-': tzoff *= -1 tz = GeneratedsSuper._FixedOffsetTZ(tzoff, results.group(0)) input_data = input_data[:-6] time_parts = input_data.split('.') if len(time_parts) > 1: micro_seconds = int(float('0.' + time_parts[1]) * 1000000) input_data = '%s.%s' % ( time_parts[0], "{}".format(micro_seconds).rjust(6, "0"), ) dt = datetime_.datetime.strptime( input_data, '%Y-%m-%dT%H:%M:%S.%f' ) else: dt = datetime_.datetime.strptime( input_data, '%Y-%m-%dT%H:%M:%S' ) dt = dt.replace(tzinfo=tz) return dt def gds_validate_date(self, input_data, node=None, input_name=''): return input_data def gds_format_date(self, input_data, input_name=''): _svalue = '%04d-%02d-%02d' % ( input_data.year, input_data.month, input_data.day, ) try: if input_data.tzinfo is not None: tzoff = input_data.tzinfo.utcoffset(input_data) if tzoff is not None: total_seconds = tzoff.seconds + (86400 * tzoff.days) if total_seconds == 0: _svalue += 'Z' else: if total_seconds < 0: _svalue += '-' total_seconds *= -1 else: _svalue += '+' hours = total_seconds // 3600 minutes = (total_seconds - (hours * 3600)) // 60 _svalue += '{0:02d}:{1:02d}'.format(hours, minutes) except AttributeError: pass return _svalue @classmethod def gds_parse_date(cls, input_data): tz = None if input_data[-1] == 'Z': tz = GeneratedsSuper._FixedOffsetTZ(0, 'UTC') input_data = input_data[:-1] else: results = GeneratedsSuper.tzoff_pattern.search(input_data) if results is not None: tzoff_parts = results.group(2).split(':') tzoff = int(tzoff_parts[0]) * 60 + int(tzoff_parts[1]) if results.group(1) == '-': tzoff *= -1 tz = GeneratedsSuper._FixedOffsetTZ(tzoff, results.group(0)) input_data = input_data[:-6] dt = datetime_.datetime.strptime(input_data, '%Y-%m-%d') dt = dt.replace(tzinfo=tz) return dt.date() def gds_validate_time(self, input_data, node=None, input_name=''): return input_data def gds_format_time(self, input_data, input_name=''): if input_data.microsecond == 0: _svalue = '%02d:%02d:%02d' % ( input_data.hour, input_data.minute, input_data.second, ) else: _svalue = '%02d:%02d:%02d.%s' % ( input_data.hour, input_data.minute, input_data.second, ('%f' % (float(input_data.microsecond) / 1000000))[2:], ) if input_data.tzinfo is not None: tzoff = input_data.tzinfo.utcoffset(input_data) if tzoff is not None: total_seconds = tzoff.seconds + (86400 * tzoff.days) if total_seconds == 0: _svalue += 'Z' else: if total_seconds < 0: _svalue += '-' total_seconds *= -1 else: _svalue += '+' hours = total_seconds // 3600 minutes = (total_seconds - (hours * 3600)) // 60 _svalue += '{0:02d}:{1:02d}'.format(hours, minutes) return _svalue def gds_validate_simple_patterns(self, patterns, target): # pat is a list of lists of strings/patterns. # The target value must match at least one of the patterns # in order for the test to succeed. found1 = True for patterns1 in patterns: found2 = False for patterns2 in patterns1: mo = re_.search(patterns2, target) if mo is not None and len(mo.group(0)) == len(target): found2 = True break if not found2: found1 = False break return found1 @classmethod def gds_parse_time(cls, input_data): tz = None if input_data[-1] == 'Z': tz = GeneratedsSuper._FixedOffsetTZ(0, 'UTC') input_data = input_data[:-1] else: results = GeneratedsSuper.tzoff_pattern.search(input_data) if results is not None: tzoff_parts = results.group(2).split(':') tzoff = int(tzoff_parts[0]) * 60 + int(tzoff_parts[1]) if results.group(1) == '-': tzoff *= -1 tz = GeneratedsSuper._FixedOffsetTZ(tzoff, results.group(0)) input_data = input_data[:-6] if len(input_data.split('.')) > 1: dt = datetime_.datetime.strptime(input_data, '%H:%M:%S.%f') else: dt = datetime_.datetime.strptime(input_data, '%H:%M:%S') dt = dt.replace(tzinfo=tz) return dt.time() def gds_str_lower(self, instring): return instring.lower() def get_path_(self, node): path_list = [] self.get_path_list_(node, path_list) path_list.reverse() path = '/'.join(path_list) return path Tag_strip_pattern_ = re_.compile(r'\{.*\}') def get_path_list_(self, node, path_list): if node is None: return tag = GeneratedsSuper.Tag_strip_pattern_.sub('', node.tag) if tag: path_list.append(tag) self.get_path_list_(node.getparent(), path_list) def get_class_obj_(self, node, default_class=None): class_obj1 = default_class if 'xsi' in node.nsmap: classname = node.get('{%s}type' % node.nsmap['xsi']) if classname is not None: names = classname.split(':') if len(names) == 2: classname = names[1] class_obj2 = globals().get(classname) if class_obj2 is not None: class_obj1 = class_obj2 return class_obj1 def gds_build_any(self, node, type_name=None): return None @classmethod def gds_reverse_node_mapping(cls, mapping): return dict(((v, k) for k, v in mapping.iteritems())) @staticmethod def gds_encode(instring): if sys.version_info.major == 2: if ExternalEncoding: encoding = ExternalEncoding else: encoding = 'utf-8' return instring.encode(encoding) else: return instring @staticmethod def convert_unicode(instring): if isinstance(instring, str): result = quote_xml(instring) elif sys.version_info.major == 2 and isinstance(instring, unicode): result = quote_xml(instring).encode('utf8') else: result = GeneratedsSuper.gds_encode(str(instring)) return result def __eq__(self, other): if type(self) != type(other): return False return self.__dict__ == other.__dict__ def __ne__(self, other): return not self.__eq__(other) def getSubclassFromModule_(module, class_): '''Get the subclass of a class from a specific module.''' name = class_.__name__ + 'Sub' if hasattr(module, name): return getattr(module, name) else: return None # # If you have installed IPython you can uncomment and use the following. # IPython is available from http://ipython.scipy.org/. # ## from IPython.Shell import IPShellEmbed ## args = '' ## ipshell = IPShellEmbed(args, ## banner = 'Dropping into IPython', ## exit_msg = 'Leaving Interpreter, back to program.') # Then use the following line where and when you want to drop into the # IPython shell: # ipshell(' -- Entering ipshell.\nHit Ctrl-D to exit') # # Globals # ExternalEncoding = 'utf-8' Tag_pattern_ = re_.compile(r'({.*})?(.*)') String_cleanup_pat_ = re_.compile(r"[\n\r\s]+") Namespace_extract_pat_ = re_.compile(r'{(.*)}(.*)') CDATA_pattern_ = re_.compile(r"", re_.DOTALL) # Change this to redirect the generated superclass module to use a # specific subclass module. CurrentSubclassModule_ = None # # Support/utility functions. # def showIndent(outfile, level, pretty_print=True): if pretty_print: for idx in range(level): outfile.write(' ') def quote_xml(inStr): "Escape markup chars, but do not modify CDATA sections." if not inStr: return '' s1 = isinstance(inStr, BaseStrType_) and inStr or '%s' % inStr s2 = '' pos = 0 matchobjects = CDATA_pattern_.finditer(s1) for mo in matchobjects: s3 = s1[pos : mo.start()] s2 += quote_xml_aux(s3) s2 += s1[mo.start() : mo.end()] pos = mo.end() s3 = s1[pos:] s2 += quote_xml_aux(s3) return s2 def quote_xml_aux(inStr): s1 = inStr.replace('&', '&') s1 = s1.replace('<', '<') s1 = s1.replace('>', '>') return s1 def quote_attrib(inStr): s1 = isinstance(inStr, BaseStrType_) and inStr or '%s' % inStr s1 = s1.replace('&', '&') s1 = s1.replace('<', '<') s1 = s1.replace('>', '>') if '"' in s1: if "'" in s1: s1 = '"%s"' % s1.replace('"', """) else: s1 = "'%s'" % s1 else: s1 = '"%s"' % s1 return s1 def quote_python(inStr): s1 = inStr if s1.find("'") == -1: if s1.find('\n') == -1: return "'%s'" % s1 else: return "'''%s'''" % s1 else: if s1.find('"') != -1: s1 = s1.replace('"', '\\"') if s1.find('\n') == -1: return '"%s"' % s1 else: return '"""%s"""' % s1 def get_all_text_(node): if node.text is not None: text = node.text else: text = '' for child in node: if child.tail is not None: text += child.tail return text def find_attr_value_(attr_name, node): attrs = node.attrib attr_parts = attr_name.split(':') value = None if len(attr_parts) == 1: value = attrs.get(attr_name) elif len(attr_parts) == 2: prefix, name = attr_parts namespace = node.nsmap.get(prefix) if namespace is not None: value = attrs.get( '{%s}%s' % ( namespace, name, ) ) return value class GDSParseError(Exception): pass def raise_parse_error(node, msg): msg = '%s (element %s/line %d)' % ( msg, node.tag, node.sourceline, ) raise GDSParseError(msg) class MixedContainer: # Constants for category: CategoryNone = 0 CategoryText = 1 CategorySimple = 2 CategoryComplex = 3 # Constants for content_type: TypeNone = 0 TypeText = 1 TypeString = 2 TypeInteger = 3 TypeFloat = 4 TypeDecimal = 5 TypeDouble = 6 TypeBoolean = 7 TypeBase64 = 8 def __init__(self, category, content_type, name, value): self.category = category self.content_type = content_type self.name = name self.value = value def getCategory(self): return self.category def getContenttype(self, content_type): return self.content_type def getValue(self): return self.value def getName(self): return self.name def export(self, outfile, level, name, namespace, pretty_print=True): if self.category == MixedContainer.CategoryText: # Prevent exporting empty content as empty lines. if self.value.strip(): outfile.write(self.value) elif self.category == MixedContainer.CategorySimple: self.exportSimple(outfile, level, name) else: # category == MixedContainer.CategoryComplex self.value.export( outfile, level, namespace, name, pretty_print=pretty_print ) def exportSimple(self, outfile, level, name): if self.content_type == MixedContainer.TypeString: outfile.write('<%s>%s' % (self.name, self.value, self.name)) elif ( self.content_type == MixedContainer.TypeInteger or self.content_type == MixedContainer.TypeBoolean ): outfile.write('<%s>%d' % (self.name, self.value, self.name)) elif ( self.content_type == MixedContainer.TypeFloat or self.content_type == MixedContainer.TypeDecimal ): outfile.write('<%s>%f' % (self.name, self.value, self.name)) elif self.content_type == MixedContainer.TypeDouble: outfile.write('<%s>%g' % (self.name, self.value, self.name)) elif self.content_type == MixedContainer.TypeBase64: outfile.write( '<%s>%s' % (self.name, base64.b64encode(self.value), self.name) ) def to_etree(self, element): if self.category == MixedContainer.CategoryText: # Prevent exporting empty content as empty lines. if self.value.strip(): if len(element) > 0: if element[-1].tail is None: element[-1].tail = self.value else: element[-1].tail += self.value else: if element.text is None: element.text = self.value else: element.text += self.value elif self.category == MixedContainer.CategorySimple: subelement = etree_.SubElement(element, '%s' % self.name) subelement.text = self.to_etree_simple() else: # category == MixedContainer.CategoryComplex self.value.to_etree(element) def to_etree_simple(self): if self.content_type == MixedContainer.TypeString: text = self.value elif ( self.content_type == MixedContainer.TypeInteger or self.content_type == MixedContainer.TypeBoolean ): text = '%d' % self.value elif ( self.content_type == MixedContainer.TypeFloat or self.content_type == MixedContainer.TypeDecimal ): text = '%f' % self.value elif self.content_type == MixedContainer.TypeDouble: text = '%g' % self.value elif self.content_type == MixedContainer.TypeBase64: text = '%s' % base64.b64encode(self.value) return text def exportLiteral(self, outfile, level, name): if self.category == MixedContainer.CategoryText: showIndent(outfile, level) outfile.write( 'model_.MixedContainer(%d, %d, "%s", "%s"),\n' % (self.category, self.content_type, self.name, self.value) ) elif self.category == MixedContainer.CategorySimple: showIndent(outfile, level) outfile.write( 'model_.MixedContainer(%d, %d, "%s", "%s"),\n' % (self.category, self.content_type, self.name, self.value) ) else: # category == MixedContainer.CategoryComplex showIndent(outfile, level) outfile.write( 'model_.MixedContainer(%d, %d, "%s",\n' % ( self.category, self.content_type, self.name, ) ) self.value.exportLiteral(outfile, level + 1) showIndent(outfile, level) outfile.write(')\n') class MemberSpec_(object): def __init__( self, name='', data_type='', container=0, optional=0, child_attrs=None, choice=None, ): self.name = name self.data_type = data_type self.container = container self.child_attrs = child_attrs self.choice = choice self.optional = optional def set_name(self, name): self.name = name def get_name(self): return self.name def set_data_type(self, data_type): self.data_type = data_type def get_data_type_chain(self): return self.data_type def get_data_type(self): if isinstance(self.data_type, list): if len(self.data_type) > 0: return self.data_type[-1] else: return 'xs:string' else: return self.data_type def set_container(self, container): self.container = container def get_container(self): return self.container def set_child_attrs(self, child_attrs): self.child_attrs = child_attrs def get_child_attrs(self): return self.child_attrs def set_choice(self, choice): self.choice = choice def get_choice(self): return self.choice def set_optional(self, optional): self.optional = optional def get_optional(self): return self.optional def _cast(typ, value): if typ is None or value is None: return value return typ(value) # # Data representation classes. # class k_packagemanager_content(object): APK = 'apk' APT = 'apt' ZYPPER = 'zypper' DNF_4 = 'dnf4' DNF_5 = 'dnf5' MICRODNF = 'microdnf' PACMAN = 'pacman' class k_source(GeneratedsSuper): subclass = None superclass = None def __init__(self, source=None): self.original_tagname_ = None self.source = source def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, k_source) if subclass is not None: return subclass(*args_, **kwargs_) if k_source.subclass: return k_source.subclass(*args_, **kwargs_) else: return k_source(*args_, **kwargs_) factory = staticmethod(factory) def get_source(self): return self.source def set_source(self, source): self.source = source def hasContent_(self): if self.source is not None: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='k.source', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('k.source') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='k.source', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='k.source', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='k.source', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='k.source', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' if self.source is not None: self.source.export( outfile, level, namespaceprefix_, name_='source', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'source': obj_ = source.factory() obj_.build(child_) self.source = obj_ obj_.original_tagname_ = 'source' # end class k_source class image(GeneratedsSuper): """The root element of the configuration file""" subclass = None superclass = None def __init__( self, name=None, displayname=None, id=None, schemaversion=None, noNamespaceSchemaLocation=None, schemaLocation=None, include=None, certificates=None, description=None, preferences=None, profiles=None, users=None, drivers=None, strip=None, repository=None, containers=None, packages=None, extension=None, ): self.original_tagname_ = None self.name = _cast(None, name) self.displayname = _cast(None, displayname) self.id = _cast(None, id) self.schemaversion = _cast(None, schemaversion) self.noNamespaceSchemaLocation = _cast(None, noNamespaceSchemaLocation) self.schemaLocation = _cast(None, schemaLocation) if include is None: self.include = [] else: self.include = include if certificates is None: self.certificates = [] else: self.certificates = certificates if description is None: self.description = [] else: self.description = description if preferences is None: self.preferences = [] else: self.preferences = preferences if profiles is None: self.profiles = [] else: self.profiles = profiles if users is None: self.users = [] else: self.users = users if drivers is None: self.drivers = [] else: self.drivers = drivers if strip is None: self.strip = [] else: self.strip = strip if repository is None: self.repository = [] else: self.repository = repository if containers is None: self.containers = [] else: self.containers = containers if packages is None: self.packages = [] else: self.packages = packages if extension is None: self.extension = [] else: self.extension = extension def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, image) if subclass is not None: return subclass(*args_, **kwargs_) if image.subclass: return image.subclass(*args_, **kwargs_) else: return image(*args_, **kwargs_) factory = staticmethod(factory) def get_include(self): return self.include def set_include(self, include): self.include = include def add_include(self, value): self.include.append(value) def insert_include_at(self, index, value): self.include.insert(index, value) def replace_include_at(self, index, value): self.include[index] = value def get_certificates(self): return self.certificates def set_certificates(self, certificates): self.certificates = certificates def add_certificates(self, value): self.certificates.append(value) def insert_certificates_at(self, index, value): self.certificates.insert(index, value) def replace_certificates_at(self, index, value): self.certificates[index] = value def get_description(self): return self.description def set_description(self, description): self.description = description def add_description(self, value): self.description.append(value) def insert_description_at(self, index, value): self.description.insert(index, value) def replace_description_at(self, index, value): self.description[index] = value def get_preferences(self): return self.preferences def set_preferences(self, preferences): self.preferences = preferences def add_preferences(self, value): self.preferences.append(value) def insert_preferences_at(self, index, value): self.preferences.insert(index, value) def replace_preferences_at(self, index, value): self.preferences[index] = value def get_profiles(self): return self.profiles def set_profiles(self, profiles): self.profiles = profiles def add_profiles(self, value): self.profiles.append(value) def insert_profiles_at(self, index, value): self.profiles.insert(index, value) def replace_profiles_at(self, index, value): self.profiles[index] = value def get_users(self): return self.users def set_users(self, users): self.users = users def add_users(self, value): self.users.append(value) def insert_users_at(self, index, value): self.users.insert(index, value) def replace_users_at(self, index, value): self.users[index] = value def get_drivers(self): return self.drivers def set_drivers(self, drivers): self.drivers = drivers def add_drivers(self, value): self.drivers.append(value) def insert_drivers_at(self, index, value): self.drivers.insert(index, value) def replace_drivers_at(self, index, value): self.drivers[index] = value def get_strip(self): return self.strip def set_strip(self, strip): self.strip = strip def add_strip(self, value): self.strip.append(value) def insert_strip_at(self, index, value): self.strip.insert(index, value) def replace_strip_at(self, index, value): self.strip[index] = value def get_repository(self): return self.repository def set_repository(self, repository): self.repository = repository def add_repository(self, value): self.repository.append(value) def insert_repository_at(self, index, value): self.repository.insert(index, value) def replace_repository_at(self, index, value): self.repository[index] = value def get_containers(self): return self.containers def set_containers(self, containers): self.containers = containers def add_containers(self, value): self.containers.append(value) def insert_containers_at(self, index, value): self.containers.insert(index, value) def replace_containers_at(self, index, value): self.containers[index] = value def get_packages(self): return self.packages def set_packages(self, packages): self.packages = packages def add_packages(self, value): self.packages.append(value) def insert_packages_at(self, index, value): self.packages.insert(index, value) def replace_packages_at(self, index, value): self.packages[index] = value def get_extension(self): return self.extension def set_extension(self, extension): self.extension = extension def add_extension(self, value): self.extension.append(value) def insert_extension_at(self, index, value): self.extension.insert(index, value) def replace_extension_at(self, index, value): self.extension[index] = value def get_name(self): return self.name def set_name(self, name): self.name = name def get_displayname(self): return self.displayname def set_displayname(self, displayname): self.displayname = displayname def get_id(self): return self.id def set_id(self, id): self.id = id def get_schemaversion(self): return self.schemaversion def set_schemaversion(self, schemaversion): self.schemaversion = schemaversion def get_noNamespaceSchemaLocation(self): return self.noNamespaceSchemaLocation def set_noNamespaceSchemaLocation(self, noNamespaceSchemaLocation): self.noNamespaceSchemaLocation = noNamespaceSchemaLocation def get_schemaLocation(self): return self.schemaLocation def set_schemaLocation(self, schemaLocation): self.schemaLocation = schemaLocation def validate_safe_posix_name(self, value): # Validate type safe-posix-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_safe_posix_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_safe_posix_name_patterns_, ) ) validate_safe_posix_name_patterns_ = [['^[a-zA-Z0-9_\\-\\.]+$']] def hasContent_(self): if ( self.include or self.certificates or self.description or self.preferences or self.profiles or self.users or self.drivers or self.strip or self.repository or self.containers or self.packages or self.extension ): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='image', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('image') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='image' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='image', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='image', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write(' name=%s' % (quote_attrib(self.name),)) if ( self.displayname is not None and 'displayname' not in already_processed ): already_processed.add('displayname') outfile.write( ' displayname=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.displayname), input_name='displayname', ) ), ) ) if self.id is not None and 'id' not in already_processed: already_processed.add('id') outfile.write( ' id=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.id), input_name='id' ) ), ) ) if ( self.schemaversion is not None and 'schemaversion' not in already_processed ): already_processed.add('schemaversion') outfile.write( ' schemaversion=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.schemaversion), input_name='schemaversion', ) ), ) ) if ( self.noNamespaceSchemaLocation is not None and 'noNamespaceSchemaLocation' not in already_processed ): already_processed.add('noNamespaceSchemaLocation') outfile.write( ' noNamespaceSchemaLocation=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.noNamespaceSchemaLocation), input_name='noNamespaceSchemaLocation', ) ), ) ) if ( self.schemaLocation is not None and 'schemaLocation' not in already_processed ): already_processed.add('schemaLocation') outfile.write( ' schemaLocation=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.schemaLocation), input_name='schemaLocation', ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='image', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for include_ in self.include: include_.export( outfile, level, namespaceprefix_, name_='include', pretty_print=pretty_print, ) for certificates_ in self.certificates: certificates_.export( outfile, level, namespaceprefix_, name_='certificates', pretty_print=pretty_print, ) for description_ in self.description: description_.export( outfile, level, namespaceprefix_, name_='description', pretty_print=pretty_print, ) for preferences_ in self.preferences: preferences_.export( outfile, level, namespaceprefix_, name_='preferences', pretty_print=pretty_print, ) for profiles_ in self.profiles: profiles_.export( outfile, level, namespaceprefix_, name_='profiles', pretty_print=pretty_print, ) for users_ in self.users: users_.export( outfile, level, namespaceprefix_, name_='users', pretty_print=pretty_print, ) for drivers_ in self.drivers: drivers_.export( outfile, level, namespaceprefix_, name_='drivers', pretty_print=pretty_print, ) for strip_ in self.strip: strip_.export( outfile, level, namespaceprefix_, name_='strip', pretty_print=pretty_print, ) for repository_ in self.repository: repository_.export( outfile, level, namespaceprefix_, name_='repository', pretty_print=pretty_print, ) for containers_ in self.containers: containers_.export( outfile, level, namespaceprefix_, name_='containers', pretty_print=pretty_print, ) for packages_ in self.packages: packages_.export( outfile, level, namespaceprefix_, name_='packages', pretty_print=pretty_print, ) for extension_ in self.extension: extension_.export( outfile, level, namespaceprefix_, name_='extension', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value self.name = ' '.join(self.name.split()) self.validate_safe_posix_name( self.name ) # validate type safe-posix-name value = find_attr_value_('displayname', node) if value is not None and 'displayname' not in already_processed: already_processed.add('displayname') self.displayname = value value = find_attr_value_('id', node) if value is not None and 'id' not in already_processed: already_processed.add('id') self.id = value value = find_attr_value_('schemaversion', node) if value is not None and 'schemaversion' not in already_processed: already_processed.add('schemaversion') self.schemaversion = value self.schemaversion = ' '.join(self.schemaversion.split()) value = find_attr_value_('noNamespaceSchemaLocation', node) if ( value is not None and 'noNamespaceSchemaLocation' not in already_processed ): already_processed.add('noNamespaceSchemaLocation') self.noNamespaceSchemaLocation = value value = find_attr_value_('schemaLocation', node) if value is not None and 'schemaLocation' not in already_processed: already_processed.add('schemaLocation') self.schemaLocation = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'include': obj_ = include.factory() obj_.build(child_) self.include.append(obj_) obj_.original_tagname_ = 'include' elif nodeName_ == 'certificates': obj_ = certificates.factory() obj_.build(child_) self.certificates.append(obj_) obj_.original_tagname_ = 'certificates' elif nodeName_ == 'description': obj_ = description.factory() obj_.build(child_) self.description.append(obj_) obj_.original_tagname_ = 'description' elif nodeName_ == 'preferences': obj_ = preferences.factory() obj_.build(child_) self.preferences.append(obj_) obj_.original_tagname_ = 'preferences' elif nodeName_ == 'profiles': obj_ = profiles.factory() obj_.build(child_) self.profiles.append(obj_) obj_.original_tagname_ = 'profiles' elif nodeName_ == 'users': obj_ = users.factory() obj_.build(child_) self.users.append(obj_) obj_.original_tagname_ = 'users' elif nodeName_ == 'drivers': obj_ = drivers.factory() obj_.build(child_) self.drivers.append(obj_) obj_.original_tagname_ = 'drivers' elif nodeName_ == 'strip': obj_ = strip.factory() obj_.build(child_) self.strip.append(obj_) obj_.original_tagname_ = 'strip' elif nodeName_ == 'repository': obj_ = repository.factory() obj_.build(child_) self.repository.append(obj_) obj_.original_tagname_ = 'repository' elif nodeName_ == 'containers': obj_ = containers.factory() obj_.build(child_) self.containers.append(obj_) obj_.original_tagname_ = 'containers' elif nodeName_ == 'packages': obj_ = packages.factory() obj_.build(child_) self.packages.append(obj_) obj_.original_tagname_ = 'packages' elif nodeName_ == 'extension': obj_ = extension.factory() obj_.build(child_) self.extension.append(obj_) obj_.original_tagname_ = 'extension' # end class image class extension(GeneratedsSuper): """Define custom XML extensions""" subclass = None superclass = None def __init__(self, anytypeobjs_=None): self.original_tagname_ = None if anytypeobjs_ is None: self.anytypeobjs_ = [] else: self.anytypeobjs_ = anytypeobjs_ def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, extension) if subclass is not None: return subclass(*args_, **kwargs_) if extension.subclass: return extension.subclass(*args_, **kwargs_) else: return extension(*args_, **kwargs_) factory = staticmethod(factory) def get_anytypeobjs_(self): return self.anytypeobjs_ def set_anytypeobjs_(self, anytypeobjs_): self.anytypeobjs_ = anytypeobjs_ def add_anytypeobjs_(self, value): self.anytypeobjs_.append(value) def insert_anytypeobjs_(self, index, value): self._anytypeobjs_[index] = value def hasContent_(self): if self.anytypeobjs_: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='extension', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('extension') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='extension', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='extension', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='extension', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='extension', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for obj_ in self.anytypeobjs_: obj_.export( outfile, level, namespaceprefix_, pretty_print=pretty_print ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): obj_ = self.gds_build_any(child_, 'extension') if obj_ is not None: self.add_anytypeobjs_(obj_) # end class extension class archive(GeneratedsSuper): """Name of an image archive file (tarball)""" subclass = None superclass = None def __init__(self, name=None, bootinclude=None, target_dir=None): self.original_tagname_ = None self.name = _cast(None, name) self.bootinclude = _cast(bool, bootinclude) self.target_dir = _cast(None, target_dir) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, archive) if subclass is not None: return subclass(*args_, **kwargs_) if archive.subclass: return archive.subclass(*args_, **kwargs_) else: return archive(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_bootinclude(self): return self.bootinclude def set_bootinclude(self, bootinclude): self.bootinclude = bootinclude def get_target_dir(self): return self.target_dir def set_target_dir(self, target_dir): self.target_dir = target_dir def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='archive', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('archive') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='archive' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='archive', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='archive', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if ( self.bootinclude is not None and 'bootinclude' not in already_processed ): already_processed.add('bootinclude') outfile.write( ' bootinclude="%s"' % self.gds_format_boolean( self.bootinclude, input_name='bootinclude' ) ) if ( self.target_dir is not None and 'target_dir' not in already_processed ): already_processed.add('target_dir') outfile.write( ' target_dir=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.target_dir), input_name='target_dir', ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='archive', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('bootinclude', node) if value is not None and 'bootinclude' not in already_processed: already_processed.add('bootinclude') if value in ('true', '1'): self.bootinclude = True elif value in ('false', '0'): self.bootinclude = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('target_dir', node) if value is not None and 'target_dir' not in already_processed: already_processed.add('target_dir') self.target_dir = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class archive class file(GeneratedsSuper): """A Pointer to a File""" subclass = None superclass = None def __init__( self, name=None, target=None, owner=None, permissions=None, arch=None ): self.original_tagname_ = None self.name = _cast(None, name) self.target = _cast(None, target) self.owner = _cast(None, owner) self.permissions = _cast(None, permissions) self.arch = _cast(None, arch) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, file) if subclass is not None: return subclass(*args_, **kwargs_) if file.subclass: return file.subclass(*args_, **kwargs_) else: return file(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_target(self): return self.target def set_target(self, target): self.target = target def get_owner(self): return self.owner def set_owner(self, owner): self.owner = owner def get_permissions(self): return self.permissions def set_permissions(self, permissions): self.permissions = permissions def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='file', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('file') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='file' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='file', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='file', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.target is not None and 'target' not in already_processed: already_processed.add('target') outfile.write( ' target=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.target), input_name='target' ) ), ) ) if self.owner is not None and 'owner' not in already_processed: already_processed.add('owner') outfile.write( ' owner=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.owner), input_name='owner' ) ), ) ) if ( self.permissions is not None and 'permissions' not in already_processed ): already_processed.add('permissions') outfile.write( ' permissions=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.permissions), input_name='permissions', ) ), ) ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='file', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('target', node) if value is not None and 'target' not in already_processed: already_processed.add('target') self.target = value value = find_attr_value_('owner', node) if value is not None and 'owner' not in already_processed: already_processed.add('owner') self.owner = value value = find_attr_value_('permissions', node) if value is not None and 'permissions' not in already_processed: already_processed.add('permissions') self.permissions = value value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class file class ignore(GeneratedsSuper): """Ignores a Package""" subclass = None superclass = None def __init__(self, name=None, arch=None): self.original_tagname_ = None self.name = _cast(None, name) self.arch = _cast(None, arch) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, ignore) if subclass is not None: return subclass(*args_, **kwargs_) if ignore.subclass: return ignore.subclass(*args_, **kwargs_) else: return ignore(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='ignore', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('ignore') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='ignore' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='ignore', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='ignore', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='ignore', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class ignore class namedCollection(GeneratedsSuper): """Name of a Pattern for SUSE or a Group for RH""" subclass = None superclass = None def __init__(self, name=None, arch=None): self.original_tagname_ = None self.name = _cast(None, name) self.arch = _cast(None, arch) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, namedCollection ) if subclass is not None: return subclass(*args_, **kwargs_) if namedCollection.subclass: return namedCollection.subclass(*args_, **kwargs_) else: return namedCollection(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='namedCollection', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('namedCollection') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='namedCollection', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='namedCollection', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='namedCollection', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='namedCollection', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class namedCollection class collectionModule(GeneratedsSuper): subclass = None superclass = None def __init__(self, name=None, enable=None, stream=None, arch=None): self.original_tagname_ = None self.name = _cast(None, name) self.enable = _cast(bool, enable) self.stream = _cast(None, stream) self.arch = _cast(None, arch) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, collectionModule ) if subclass is not None: return subclass(*args_, **kwargs_) if collectionModule.subclass: return collectionModule.subclass(*args_, **kwargs_) else: return collectionModule(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_enable(self): return self.enable def set_enable(self, enable): self.enable = enable def get_stream(self): return self.stream def set_stream(self, stream): self.stream = stream def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def validate_safe_posix_name(self, value): # Validate type safe-posix-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_safe_posix_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_safe_posix_name_patterns_, ) ) validate_safe_posix_name_patterns_ = [['^[a-zA-Z0-9_\\-\\.]+$']] def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='collectionModule', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('collectionModule') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='collectionModule', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='collectionModule', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='collectionModule', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write(' name=%s' % (quote_attrib(self.name),)) if self.enable is not None and 'enable' not in already_processed: already_processed.add('enable') outfile.write( ' enable="%s"' % self.gds_format_boolean(self.enable, input_name='enable') ) if self.stream is not None and 'stream' not in already_processed: already_processed.add('stream') outfile.write(' stream=%s' % (quote_attrib(self.stream),)) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='collectionModule', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value self.name = ' '.join(self.name.split()) self.validate_safe_posix_name( self.name ) # validate type safe-posix-name value = find_attr_value_('enable', node) if value is not None and 'enable' not in already_processed: already_processed.add('enable') if value in ('true', '1'): self.enable = True elif value in ('false', '0'): self.enable = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('stream', node) if value is not None and 'stream' not in already_processed: already_processed.add('stream') self.stream = value self.stream = ' '.join(self.stream.split()) self.validate_safe_posix_name( self.stream ) # validate type safe-posix-name value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class collectionModule class product(GeneratedsSuper): """Name of a Product From openSUSE""" subclass = None superclass = None def __init__(self, name=None, arch=None): self.original_tagname_ = None self.name = _cast(None, name) self.arch = _cast(None, arch) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, product) if subclass is not None: return subclass(*args_, **kwargs_) if product.subclass: return product.subclass(*args_, **kwargs_) else: return product(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='product', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('product') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='product' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='product', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='product', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='product', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class product class option(GeneratedsSuper): """A commandline option specification""" subclass = None superclass = None def __init__(self, name=None, value=None): self.original_tagname_ = None self.name = _cast(None, name) self.value = _cast(None, value) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, option) if subclass is not None: return subclass(*args_, **kwargs_) if option.subclass: return option.subclass(*args_, **kwargs_) else: return option(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_value(self): return self.value def set_value(self, value): self.value = value def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='option', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('option') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='option' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='option', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='option', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.value is not None and 'value' not in already_processed: already_processed.add('value') outfile.write( ' value=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.value), input_name='value' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='option', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('value', node) if value is not None and 'value' not in already_processed: already_processed.add('value') self.value = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class option class shimoption(GeneratedsSuper): """A shim setup option specification""" subclass = None superclass = None def __init__(self, name=None, value=None): self.original_tagname_ = None self.name = _cast(None, name) self.value = _cast(None, value) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, shimoption ) if subclass is not None: return subclass(*args_, **kwargs_) if shimoption.subclass: return shimoption.subclass(*args_, **kwargs_) else: return shimoption(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_value(self): return self.value def set_value(self, value): self.value = value def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='shimoption', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('shimoption') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='shimoption', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='shimoption', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='shimoption', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.value is not None and 'value' not in already_processed: already_processed.add('value') outfile.write( ' value=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.value), input_name='value' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='shimoption', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('value', node) if value is not None and 'value' not in already_processed: already_processed.add('value') self.value = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class shimoption class installoption(GeneratedsSuper): """A install command option specification""" subclass = None superclass = None def __init__(self, name=None, value=None): self.original_tagname_ = None self.name = _cast(None, name) self.value = _cast(None, value) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, installoption ) if subclass is not None: return subclass(*args_, **kwargs_) if installoption.subclass: return installoption.subclass(*args_, **kwargs_) else: return installoption(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_value(self): return self.value def set_value(self, value): self.value = value def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='installoption', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('installoption') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='installoption', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='installoption', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='installoption', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.value is not None and 'value' not in already_processed: already_processed.add('value') outfile.write( ' value=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.value), input_name='value' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='installoption', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('value', node) if value is not None and 'value' not in already_processed: already_processed.add('value') self.value = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class installoption class configoption(GeneratedsSuper): """A config command option specification""" subclass = None superclass = None def __init__(self, name=None, value=None): self.original_tagname_ = None self.name = _cast(None, name) self.value = _cast(None, value) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, configoption ) if subclass is not None: return subclass(*args_, **kwargs_) if configoption.subclass: return configoption.subclass(*args_, **kwargs_) else: return configoption(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_value(self): return self.value def set_value(self, value): self.value = value def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='configoption', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('configoption') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='configoption', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='configoption', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='configoption', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.value is not None and 'value' not in already_processed: already_processed.add('value') outfile.write( ' value=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.value), input_name='value' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='configoption', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('value', node) if value is not None and 'value' not in already_processed: already_processed.add('value') self.value = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class configoption class package(GeneratedsSuper): """Name of an image Package""" subclass = None superclass = None def __init__(self, name=None, arch=None, bootdelete=None, bootinclude=None): self.original_tagname_ = None self.name = _cast(None, name) self.arch = _cast(None, arch) self.bootdelete = _cast(bool, bootdelete) self.bootinclude = _cast(bool, bootinclude) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, package) if subclass is not None: return subclass(*args_, **kwargs_) if package.subclass: return package.subclass(*args_, **kwargs_) else: return package(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def get_bootdelete(self): return self.bootdelete def set_bootdelete(self, bootdelete): self.bootdelete = bootdelete def get_bootinclude(self): return self.bootinclude def set_bootinclude(self, bootinclude): self.bootinclude = bootinclude def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='package', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('package') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='package' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='package', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='package', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) if ( self.bootdelete is not None and 'bootdelete' not in already_processed ): already_processed.add('bootdelete') outfile.write( ' bootdelete="%s"' % self.gds_format_boolean( self.bootdelete, input_name='bootdelete' ) ) if ( self.bootinclude is not None and 'bootinclude' not in already_processed ): already_processed.add('bootinclude') outfile.write( ' bootinclude="%s"' % self.gds_format_boolean( self.bootinclude, input_name='bootinclude' ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='package', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name value = find_attr_value_('bootdelete', node) if value is not None and 'bootdelete' not in already_processed: already_processed.add('bootdelete') if value in ('true', '1'): self.bootdelete = True elif value in ('false', '0'): self.bootdelete = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('bootinclude', node) if value is not None and 'bootinclude' not in already_processed: already_processed.add('bootinclude') if value in ('true', '1'): self.bootinclude = True elif value in ('false', '0'): self.bootinclude = False else: raise_parse_error(node, 'Bad boolean attribute') def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class package class profile(GeneratedsSuper): """Profiles creates a namespace on an image description and thus can be used to have one description with different profiles for example KDE and GNOME including different packages.""" subclass = None superclass = None def __init__( self, name=None, description=None, import_=None, arch=None, requires=None, ): self.original_tagname_ = None self.name = _cast(None, name) self.description = _cast(None, description) self.import_ = _cast(bool, import_) self.arch = _cast(None, arch) if requires is None: self.requires = [] else: self.requires = requires def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, profile) if subclass is not None: return subclass(*args_, **kwargs_) if profile.subclass: return profile.subclass(*args_, **kwargs_) else: return profile(*args_, **kwargs_) factory = staticmethod(factory) def get_requires(self): return self.requires def set_requires(self, requires): self.requires = requires def add_requires(self, value): self.requires.append(value) def insert_requires_at(self, index, value): self.requires.insert(index, value) def replace_requires_at(self, index, value): self.requires[index] = value def get_name(self): return self.name def set_name(self, name): self.name = name def get_description(self): return self.description def set_description(self, description): self.description = description def get_import(self): return self.import_ def set_import(self, import_): self.import_ = import_ def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if self.requires: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='profile', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('profile') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='profile' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='profile', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='profile', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if ( self.description is not None and 'description' not in already_processed ): already_processed.add('description') outfile.write( ' description=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.description), input_name='description', ) ), ) ) if self.import_ is not None and 'import_' not in already_processed: already_processed.add('import_') outfile.write( ' import="%s"' % self.gds_format_boolean(self.import_, input_name='import') ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='profile', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for requires_ in self.requires: requires_.export( outfile, level, namespaceprefix_, name_='requires', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('description', node) if value is not None and 'description' not in already_processed: already_processed.add('description') self.description = value value = find_attr_value_('import', node) if value is not None and 'import' not in already_processed: already_processed.add('import') if value in ('true', '1'): self.import_ = True elif value in ('false', '0'): self.import_ = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'requires': obj_ = requires.factory() obj_.build(child_) self.requires.append(obj_) obj_.original_tagname_ = 'requires' # end class profile class requires(GeneratedsSuper): """Requires is used to set profiles dependencies, with it a profile definition can be composed by other existing profiles.""" subclass = None superclass = None def __init__(self, profile=None, arch=None): self.original_tagname_ = None self.profile = _cast(None, profile) self.arch = _cast(None, arch) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, requires) if subclass is not None: return subclass(*args_, **kwargs_) if requires.subclass: return requires.subclass(*args_, **kwargs_) else: return requires(*args_, **kwargs_) factory = staticmethod(factory) def get_profile(self): return self.profile def set_profile(self, profile): self.profile = profile def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='requires', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('requires') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='requires', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='requires', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='requires', ): if self.profile is not None and 'profile' not in already_processed: already_processed.add('profile') outfile.write( ' profile=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.profile), input_name='profile' ) ), ) ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='requires', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('profile', node) if value is not None and 'profile' not in already_processed: already_processed.add('profile') self.profile = value value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class requires class containers(GeneratedsSuper): subclass = None superclass = None def __init__( self, profiles=None, arch=None, source=None, backend=None, container=None, ): self.original_tagname_ = None self.profiles = _cast(None, profiles) self.arch = _cast(None, arch) self.source = _cast(None, source) self.backend = _cast(None, backend) if container is None: self.container = [] else: self.container = container def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, containers ) if subclass is not None: return subclass(*args_, **kwargs_) if containers.subclass: return containers.subclass(*args_, **kwargs_) else: return containers(*args_, **kwargs_) factory = staticmethod(factory) def get_container(self): return self.container def set_container(self, container): self.container = container def add_container(self, value): self.container.append(value) def insert_container_at(self, index, value): self.container.insert(index, value) def replace_container_at(self, index, value): self.container[index] = value def get_profiles(self): return self.profiles def set_profiles(self, profiles): self.profiles = profiles def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def get_source(self): return self.source def set_source(self, source): self.source = source def get_backend(self): return self.backend def set_backend(self, backend): self.backend = backend def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if self.container: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='containers', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('containers') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='containers', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='containers', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='containers', ): if self.profiles is not None and 'profiles' not in already_processed: already_processed.add('profiles') outfile.write( ' profiles=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.profiles), input_name='profiles' ) ), ) ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) if self.source is not None and 'source' not in already_processed: already_processed.add('source') outfile.write( ' source=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.source), input_name='source' ) ), ) ) if self.backend is not None and 'backend' not in already_processed: already_processed.add('backend') outfile.write( ' backend=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.backend), input_name='backend' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='containers', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for container_ in self.container: container_.export( outfile, level, namespaceprefix_, name_='container', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('profiles', node) if value is not None and 'profiles' not in already_processed: already_processed.add('profiles') self.profiles = value value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name value = find_attr_value_('source', node) if value is not None and 'source' not in already_processed: already_processed.add('source') self.source = value value = find_attr_value_('backend', node) if value is not None and 'backend' not in already_processed: already_processed.add('backend') self.backend = value self.backend = ' '.join(self.backend.split()) def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'container': obj_ = container.factory() obj_.build(child_) self.container.append(obj_) obj_.original_tagname_ = 'container' # end class containers class container(GeneratedsSuper): subclass = None superclass = None def __init__( self, name=None, arch=None, path=None, tag=None, fetch_only=None ): self.original_tagname_ = None self.name = _cast(None, name) self.arch = _cast(None, arch) self.path = _cast(None, path) self.tag = _cast(None, tag) self.fetch_only = _cast(bool, fetch_only) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, container) if subclass is not None: return subclass(*args_, **kwargs_) if container.subclass: return container.subclass(*args_, **kwargs_) else: return container(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def get_path(self): return self.path def set_path(self, path): self.path = path def get_tag(self): return self.tag def set_tag(self, tag): self.tag = tag def get_fetch_only(self): return self.fetch_only def set_fetch_only(self, fetch_only): self.fetch_only = fetch_only def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='container', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('container') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='container', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='container', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='container', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) if self.path is not None and 'path' not in already_processed: already_processed.add('path') outfile.write( ' path=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.path), input_name='path' ) ), ) ) if self.tag is not None and 'tag' not in already_processed: already_processed.add('tag') outfile.write( ' tag=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.tag), input_name='tag' ) ), ) ) if ( self.fetch_only is not None and 'fetch_only' not in already_processed ): already_processed.add('fetch_only') outfile.write( ' fetch_only="%s"' % self.gds_format_boolean( self.fetch_only, input_name='fetch_only' ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='container', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name value = find_attr_value_('path', node) if value is not None and 'path' not in already_processed: already_processed.add('path') self.path = value value = find_attr_value_('tag', node) if value is not None and 'tag' not in already_processed: already_processed.add('tag') self.tag = value value = find_attr_value_('fetch_only', node) if value is not None and 'fetch_only' not in already_processed: already_processed.add('fetch_only') if value in ('true', '1'): self.fetch_only = True elif value in ('false', '0'): self.fetch_only = False else: raise_parse_error(node, 'Bad boolean attribute') def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class container class certificates(GeneratedsSuper): subclass = None superclass = None def __init__( self, profiles=None, target_distribution=None, certificate=None ): self.original_tagname_ = None self.profiles = _cast(None, profiles) self.target_distribution = _cast(None, target_distribution) if certificate is None: self.certificate = [] else: self.certificate = certificate def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, certificates ) if subclass is not None: return subclass(*args_, **kwargs_) if certificates.subclass: return certificates.subclass(*args_, **kwargs_) else: return certificates(*args_, **kwargs_) factory = staticmethod(factory) def get_certificate(self): return self.certificate def set_certificate(self, certificate): self.certificate = certificate def add_certificate(self, value): self.certificate.append(value) def insert_certificate_at(self, index, value): self.certificate.insert(index, value) def replace_certificate_at(self, index, value): self.certificate[index] = value def get_profiles(self): return self.profiles def set_profiles(self, profiles): self.profiles = profiles def get_target_distribution(self): return self.target_distribution def set_target_distribution(self, target_distribution): self.target_distribution = target_distribution def hasContent_(self): if self.certificate: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='certificates', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('certificates') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='certificates', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='certificates', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='certificates', ): if self.profiles is not None and 'profiles' not in already_processed: already_processed.add('profiles') outfile.write( ' profiles=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.profiles), input_name='profiles' ) ), ) ) if ( self.target_distribution is not None and 'target_distribution' not in already_processed ): already_processed.add('target_distribution') outfile.write( ' target_distribution=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.target_distribution), input_name='target_distribution', ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='certificates', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for certificate_ in self.certificate: certificate_.export( outfile, level, namespaceprefix_, name_='certificate', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('profiles', node) if value is not None and 'profiles' not in already_processed: already_processed.add('profiles') self.profiles = value value = find_attr_value_('target_distribution', node) if value is not None and 'target_distribution' not in already_processed: already_processed.add('target_distribution') self.target_distribution = value self.target_distribution = ' '.join( self.target_distribution.split() ) def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'certificate': obj_ = certificate.factory() obj_.build(child_) self.certificate.append(obj_) obj_.original_tagname_ = 'certificate' # end class certificates class certificate(GeneratedsSuper): subclass = None superclass = None def __init__(self, name=None): self.original_tagname_ = None self.name = _cast(None, name) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, certificate ) if subclass is not None: return subclass(*args_, **kwargs_) if certificate.subclass: return certificate.subclass(*args_, **kwargs_) else: return certificate(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='certificate', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('certificate') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='certificate', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='certificate', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='certificate', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='certificate', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class certificate class repository(k_source): """The Name of the Repository""" subclass = None superclass = k_source def __init__( self, source=None, type_=None, profiles=None, arch=None, alias=None, sourcetype=None, components=None, distribution=None, imageinclude=None, imageonly=None, repository_gpgcheck=None, customize=None, package_gpgcheck=None, priority=None, password=None, username=None, architectures=None, ): self.original_tagname_ = None super(repository, self).__init__( source, ) self.type_ = _cast(None, type_) self.profiles = _cast(None, profiles) self.arch = _cast(None, arch) self.alias = _cast(None, alias) self.sourcetype = _cast(None, sourcetype) self.components = _cast(None, components) self.distribution = _cast(None, distribution) self.imageinclude = _cast(bool, imageinclude) self.imageonly = _cast(bool, imageonly) self.repository_gpgcheck = _cast(bool, repository_gpgcheck) self.customize = _cast(None, customize) self.package_gpgcheck = _cast(bool, package_gpgcheck) self.priority = _cast(int, priority) self.password = _cast(None, password) self.username = _cast(None, username) self.architectures = _cast(None, architectures) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, repository ) if subclass is not None: return subclass(*args_, **kwargs_) if repository.subclass: return repository.subclass(*args_, **kwargs_) else: return repository(*args_, **kwargs_) factory = staticmethod(factory) def get_type(self): return self.type_ def set_type(self, type_): self.type_ = type_ def get_profiles(self): return self.profiles def set_profiles(self, profiles): self.profiles = profiles def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def get_alias(self): return self.alias def set_alias(self, alias): self.alias = alias def get_sourcetype(self): return self.sourcetype def set_sourcetype(self, sourcetype): self.sourcetype = sourcetype def get_components(self): return self.components def set_components(self, components): self.components = components def get_distribution(self): return self.distribution def set_distribution(self, distribution): self.distribution = distribution def get_imageinclude(self): return self.imageinclude def set_imageinclude(self, imageinclude): self.imageinclude = imageinclude def get_imageonly(self): return self.imageonly def set_imageonly(self, imageonly): self.imageonly = imageonly def get_repository_gpgcheck(self): return self.repository_gpgcheck def set_repository_gpgcheck(self, repository_gpgcheck): self.repository_gpgcheck = repository_gpgcheck def get_customize(self): return self.customize def set_customize(self, customize): self.customize = customize def get_package_gpgcheck(self): return self.package_gpgcheck def set_package_gpgcheck(self, package_gpgcheck): self.package_gpgcheck = package_gpgcheck def get_priority(self): return self.priority def set_priority(self, priority): self.priority = priority def get_password(self): return self.password def set_password(self, password): self.password = password def get_username(self): return self.username def set_username(self, username): self.username = username def get_architectures(self): return self.architectures def set_architectures(self, architectures): self.architectures = architectures def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def validate_safe_posix_name(self, value): # Validate type safe-posix-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_safe_posix_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_safe_posix_name_patterns_, ) ) validate_safe_posix_name_patterns_ = [['^[a-zA-Z0-9_\\-\\.]+$']] def hasContent_(self): if super(repository, self).hasContent_(): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='repository', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('repository') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='repository', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='repository', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='repository', ): super(repository, self).exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='repository', ) if self.type_ is not None and 'type_' not in already_processed: already_processed.add('type_') outfile.write( ' type=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.type_), input_name='type' ) ), ) ) if self.profiles is not None and 'profiles' not in already_processed: already_processed.add('profiles') outfile.write( ' profiles=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.profiles), input_name='profiles' ) ), ) ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) if self.alias is not None and 'alias' not in already_processed: already_processed.add('alias') outfile.write(' alias=%s' % (quote_attrib(self.alias),)) if ( self.sourcetype is not None and 'sourcetype' not in already_processed ): already_processed.add('sourcetype') outfile.write( ' sourcetype=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.sourcetype), input_name='sourcetype', ) ), ) ) if ( self.components is not None and 'components' not in already_processed ): already_processed.add('components') outfile.write( ' components=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.components), input_name='components', ) ), ) ) if ( self.distribution is not None and 'distribution' not in already_processed ): already_processed.add('distribution') outfile.write( ' distribution=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.distribution), input_name='distribution', ) ), ) ) if ( self.imageinclude is not None and 'imageinclude' not in already_processed ): already_processed.add('imageinclude') outfile.write( ' imageinclude="%s"' % self.gds_format_boolean( self.imageinclude, input_name='imageinclude' ) ) if self.imageonly is not None and 'imageonly' not in already_processed: already_processed.add('imageonly') outfile.write( ' imageonly="%s"' % self.gds_format_boolean( self.imageonly, input_name='imageonly' ) ) if ( self.repository_gpgcheck is not None and 'repository_gpgcheck' not in already_processed ): already_processed.add('repository_gpgcheck') outfile.write( ' repository_gpgcheck="%s"' % self.gds_format_boolean( self.repository_gpgcheck, input_name='repository_gpgcheck' ) ) if self.customize is not None and 'customize' not in already_processed: already_processed.add('customize') outfile.write( ' customize=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.customize), input_name='customize' ) ), ) ) if ( self.package_gpgcheck is not None and 'package_gpgcheck' not in already_processed ): already_processed.add('package_gpgcheck') outfile.write( ' package_gpgcheck="%s"' % self.gds_format_boolean( self.package_gpgcheck, input_name='package_gpgcheck' ) ) if self.priority is not None and 'priority' not in already_processed: already_processed.add('priority') outfile.write( ' priority="%s"' % self.gds_format_integer(self.priority, input_name='priority') ) if self.password is not None and 'password' not in already_processed: already_processed.add('password') outfile.write( ' password=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.password), input_name='password' ) ), ) ) if self.username is not None and 'username' not in already_processed: already_processed.add('username') outfile.write( ' username=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.username), input_name='username' ) ), ) ) if ( self.architectures is not None and 'architectures' not in already_processed ): already_processed.add('architectures') outfile.write( ' architectures=%s' % (quote_attrib(self.architectures),) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='repository', fromsubclass_=False, pretty_print=True, ): super(repository, self).exportChildren( outfile, level, namespaceprefix_, name_, True, pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('type', node) if value is not None and 'type' not in already_processed: already_processed.add('type') self.type_ = value self.type_ = ' '.join(self.type_.split()) value = find_attr_value_('profiles', node) if value is not None and 'profiles' not in already_processed: already_processed.add('profiles') self.profiles = value value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name value = find_attr_value_('alias', node) if value is not None and 'alias' not in already_processed: already_processed.add('alias') self.alias = value self.alias = ' '.join(self.alias.split()) self.validate_safe_posix_name( self.alias ) # validate type safe-posix-name value = find_attr_value_('sourcetype', node) if value is not None and 'sourcetype' not in already_processed: already_processed.add('sourcetype') self.sourcetype = value self.sourcetype = ' '.join(self.sourcetype.split()) value = find_attr_value_('components', node) if value is not None and 'components' not in already_processed: already_processed.add('components') self.components = value value = find_attr_value_('distribution', node) if value is not None and 'distribution' not in already_processed: already_processed.add('distribution') self.distribution = value value = find_attr_value_('imageinclude', node) if value is not None and 'imageinclude' not in already_processed: already_processed.add('imageinclude') if value in ('true', '1'): self.imageinclude = True elif value in ('false', '0'): self.imageinclude = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('imageonly', node) if value is not None and 'imageonly' not in already_processed: already_processed.add('imageonly') if value in ('true', '1'): self.imageonly = True elif value in ('false', '0'): self.imageonly = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('repository_gpgcheck', node) if value is not None and 'repository_gpgcheck' not in already_processed: already_processed.add('repository_gpgcheck') if value in ('true', '1'): self.repository_gpgcheck = True elif value in ('false', '0'): self.repository_gpgcheck = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('customize', node) if value is not None and 'customize' not in already_processed: already_processed.add('customize') self.customize = value value = find_attr_value_('package_gpgcheck', node) if value is not None and 'package_gpgcheck' not in already_processed: already_processed.add('package_gpgcheck') if value in ('true', '1'): self.package_gpgcheck = True elif value in ('false', '0'): self.package_gpgcheck = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('priority', node) if value is not None and 'priority' not in already_processed: already_processed.add('priority') try: self.priority = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) value = find_attr_value_('password', node) if value is not None and 'password' not in already_processed: already_processed.add('password') self.password = value value = find_attr_value_('username', node) if value is not None and 'username' not in already_processed: already_processed.add('username') self.username = value value = find_attr_value_('architectures', node) if value is not None and 'architectures' not in already_processed: already_processed.add('architectures') self.architectures = value self.architectures = ' '.join(self.architectures.split()) self.validate_arch_name( self.architectures ) # validate type arch-name super(repository, self).buildAttributes(node, attrs, already_processed) def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): super(repository, self).buildChildren(child_, node, nodeName_, True) pass # end class repository class signing(GeneratedsSuper): """The signing element holds information about repo/package signing keys""" subclass = None superclass = None def __init__(self, key=None): self.original_tagname_ = None self.key = _cast(None, key) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, signing) if subclass is not None: return subclass(*args_, **kwargs_) if signing.subclass: return signing.subclass(*args_, **kwargs_) else: return signing(*args_, **kwargs_) factory = staticmethod(factory) def get_key(self): return self.key def set_key(self, key): self.key = key def validate_simple_uri_type(self, value): # Validate type simple-uri-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_simple_uri_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_simple_uri_type_patterns_, ) ) validate_simple_uri_type_patterns_ = [ ['^(file:|this:|https:|http:|ftp:).*$'] ] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='signing', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('signing') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='signing' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='signing', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='signing', ): if self.key is not None and 'key' not in already_processed: already_processed.add('key') outfile.write(' key=%s' % (quote_attrib(self.key),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='signing', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('key', node) if value is not None and 'key' not in already_processed: already_processed.add('key') self.key = value self.key = ' '.join(self.key.split()) self.validate_simple_uri_type( self.key ) # validate type simple-uri-type def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class signing class source(GeneratedsSuper): """A Pointer to a data source. This can be a remote location as well as a path specification""" subclass = None superclass = None def __init__(self, path=None, signing=None): self.original_tagname_ = None self.path = _cast(None, path) if signing is None: self.signing = [] else: self.signing = signing def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, source) if subclass is not None: return subclass(*args_, **kwargs_) if source.subclass: return source.subclass(*args_, **kwargs_) else: return source(*args_, **kwargs_) factory = staticmethod(factory) def get_signing(self): return self.signing def set_signing(self, signing): self.signing = signing def add_signing(self, value): self.signing.append(value) def insert_signing_at(self, index, value): self.signing.insert(index, value) def replace_signing_at(self, index, value): self.signing[index] = value def get_path(self): return self.path def set_path(self, path): self.path = path def hasContent_(self): if self.signing: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='source', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('source') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='source' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='source', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='source', ): if self.path is not None and 'path' not in already_processed: already_processed.add('path') outfile.write( ' path=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.path), input_name='path' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='source', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for signing_ in self.signing: signing_.export( outfile, level, namespaceprefix_, name_='signing', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('path', node) if value is not None and 'path' not in already_processed: already_processed.add('path') self.path = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'signing': obj_ = signing.factory() obj_.build(child_) self.signing.append(obj_) obj_.original_tagname_ = 'signing' # end class source class size(GeneratedsSuper): """Specifies the Size of an Image in (M)egabyte or (G)igabyte If the attribute additive is set the value will be added to the required size of the image""" subclass = None superclass = None def __init__( self, unit=None, unpartitioned=None, additive=None, valueOf_=None ): self.original_tagname_ = None self.unit = _cast(None, unit) self.unpartitioned = _cast(int, unpartitioned) self.additive = _cast(bool, additive) self.valueOf_ = valueOf_ def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, size) if subclass is not None: return subclass(*args_, **kwargs_) if size.subclass: return size.subclass(*args_, **kwargs_) else: return size(*args_, **kwargs_) factory = staticmethod(factory) def get_unit(self): return self.unit def set_unit(self, unit): self.unit = unit def get_unpartitioned(self): return self.unpartitioned def set_unpartitioned(self, unpartitioned): self.unpartitioned = unpartitioned def get_additive(self): return self.additive def set_additive(self, additive): self.additive = additive def get_valueOf_(self): return self.valueOf_ def set_valueOf_(self, valueOf_): self.valueOf_ = valueOf_ def hasContent_(self): if 1 if type(self.valueOf_) in [int, float] else self.valueOf_: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='size', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('size') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='size' ) if self.hasContent_(): outfile.write('>') outfile.write(self.convert_unicode(self.valueOf_)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='size', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='size', ): if self.unit is not None and 'unit' not in already_processed: already_processed.add('unit') outfile.write( ' unit=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.unit), input_name='unit' ) ), ) ) if ( self.unpartitioned is not None and 'unpartitioned' not in already_processed ): already_processed.add('unpartitioned') outfile.write( ' unpartitioned="%s"' % self.gds_format_integer( self.unpartitioned, input_name='unpartitioned' ) ) if self.additive is not None and 'additive' not in already_processed: already_processed.add('additive') outfile.write( ' additive="%s"' % self.gds_format_boolean(self.additive, input_name='additive') ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='size', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) self.valueOf_ = get_all_text_(node) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('unit', node) if value is not None and 'unit' not in already_processed: already_processed.add('unit') self.unit = value self.unit = ' '.join(self.unit.split()) value = find_attr_value_('unpartitioned', node) if value is not None and 'unpartitioned' not in already_processed: already_processed.add('unpartitioned') try: self.unpartitioned = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.unpartitioned < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('additive', node) if value is not None and 'additive' not in already_processed: already_processed.add('additive') if value in ('true', '1'): self.additive = True elif value in ('false', '0'): self.additive = False else: raise_parse_error(node, 'Bad boolean attribute') def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class size class systemdisk(GeneratedsSuper): """Specify volumes and size attributes""" subclass = None superclass = None def __init__(self, name=None, preferlvm=None, volume=None): self.original_tagname_ = None self.name = _cast(None, name) self.preferlvm = _cast(bool, preferlvm) if volume is None: self.volume = [] else: self.volume = volume def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, systemdisk ) if subclass is not None: return subclass(*args_, **kwargs_) if systemdisk.subclass: return systemdisk.subclass(*args_, **kwargs_) else: return systemdisk(*args_, **kwargs_) factory = staticmethod(factory) def get_volume(self): return self.volume def set_volume(self, volume): self.volume = volume def add_volume(self, value): self.volume.append(value) def insert_volume_at(self, index, value): self.volume.insert(index, value) def replace_volume_at(self, index, value): self.volume[index] = value def get_name(self): return self.name def set_name(self, name): self.name = name def get_preferlvm(self): return self.preferlvm def set_preferlvm(self, preferlvm): self.preferlvm = preferlvm def hasContent_(self): if self.volume: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='systemdisk', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('systemdisk') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='systemdisk', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='systemdisk', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='systemdisk', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.preferlvm is not None and 'preferlvm' not in already_processed: already_processed.add('preferlvm') outfile.write( ' preferlvm="%s"' % self.gds_format_boolean( self.preferlvm, input_name='preferlvm' ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='systemdisk', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for volume_ in self.volume: volume_.export( outfile, level, namespaceprefix_, name_='volume', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('preferlvm', node) if value is not None and 'preferlvm' not in already_processed: already_processed.add('preferlvm') if value in ('true', '1'): self.preferlvm = True elif value in ('false', '0'): self.preferlvm = False else: raise_parse_error(node, 'Bad boolean attribute') def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'volume': obj_ = volume.factory() obj_.build(child_) self.volume.append(obj_) obj_.original_tagname_ = 'volume' # end class systemdisk class type_(GeneratedsSuper): """The Image Type of the Logical Extend""" subclass = None superclass = None def __init__( self, archive=None, eficsmpart_id=None, efipart_id=None, rootpart_id=None, bootpart_id=None, boot=None, bootfilesystem=None, firmware=None, bootkernel=None, bootpartition=None, bootpartsize=None, efipartsize=None, efimountoptions=None, efifatimagesize=None, eficsm=None, efiparttable=None, dosparttable_extended_layout=None, bootprofile=None, btrfs_quota_groups=None, btrfs_root_is_snapper_snapshot=None, btrfs_root_is_subvolume=None, btrfs_set_default_volume=None, btrfs_root_is_readonly_snapshot=None, compressed=None, devicepersistency=None, editbootconfig=None, editbootinstall=None, filesystem=None, flags=None, enclave_format=None, format=None, formatoptions=None, fsmountoptions=None, fscreateoptions=None, squashfscompression=None, erofscompression=None, gcelicense=None, hybridpersistent=None, hybridpersistent_filesystem=None, gpt_hybrid_mbr=None, force_mbr=None, apply_dps_codes=None, initrd_system=None, image=None, metadata_path=None, installboot=None, install_continue_on_timeout=None, installprovidefailsafe=None, installiso=None, installstick=None, installpxe=None, mediacheck=None, kernelcmdline=None, luks=None, luks_version=None, luksOS=None, luks_randomize=None, luks_pbkdf=None, mdraid=None, overlayroot=None, overlayroot_write_partition=None, overlayroot_readonly_filesystem=None, overlayroot_readonly_partsize=None, overlayroot_readonly_createoptions=None, verity_blocks=None, embed_verity_metadata=None, standalone_integrity=None, embed_integrity_metadata=None, integrity_legacy_hmac=None, integrity_metadata_key_description=None, integrity_keyfile=None, primary=None, ramonly=None, rootfs_label=None, spare_part=None, spare_part_mountpoint=None, spare_part_fs=None, spare_part_fs_attributes=None, spare_part_is_last=None, target_blocksize=None, target_removable=None, selinux_policy=None, vhdfixedtag=None, volid=None, application_id=None, wwid_wait_timeout=None, derived_from=None, delta_root=None, provide_system_files=None, require_system_files=None, ensure_empty_tmpdirs=None, xen_server=None, publisher=None, disk_start_sector=None, root_clone=None, boot_clone=None, bundle_format=None, bootloader=None, containerconfig=None, machine=None, oemconfig=None, size=None, systemdisk=None, partitions=None, vagrantconfig=None, installmedia=None, initrd=None, luksformat=None, ): self.original_tagname_ = None self.archive = _cast(bool, archive) self.eficsmpart_id = _cast(None, eficsmpart_id) self.efipart_id = _cast(None, efipart_id) self.rootpart_id = _cast(None, rootpart_id) self.bootpart_id = _cast(None, bootpart_id) self.boot = _cast(None, boot) self.bootfilesystem = _cast(None, bootfilesystem) self.firmware = _cast(None, firmware) self.bootkernel = _cast(None, bootkernel) self.bootpartition = _cast(bool, bootpartition) self.bootpartsize = _cast(int, bootpartsize) self.efipartsize = _cast(int, efipartsize) self.efimountoptions = _cast(None, efimountoptions) self.efifatimagesize = _cast(int, efifatimagesize) self.eficsm = _cast(bool, eficsm) self.efiparttable = _cast(None, efiparttable) self.dosparttable_extended_layout = _cast( bool, dosparttable_extended_layout ) self.bootprofile = _cast(None, bootprofile) self.btrfs_quota_groups = _cast(bool, btrfs_quota_groups) self.btrfs_root_is_snapper_snapshot = _cast( bool, btrfs_root_is_snapper_snapshot ) self.btrfs_root_is_subvolume = _cast(bool, btrfs_root_is_subvolume) self.btrfs_set_default_volume = _cast(bool, btrfs_set_default_volume) self.btrfs_root_is_readonly_snapshot = _cast( bool, btrfs_root_is_readonly_snapshot ) self.compressed = _cast(bool, compressed) self.devicepersistency = _cast(None, devicepersistency) self.editbootconfig = _cast(None, editbootconfig) self.editbootinstall = _cast(None, editbootinstall) self.filesystem = _cast(None, filesystem) self.flags = _cast(None, flags) self.enclave_format = _cast(None, enclave_format) self.format = _cast(None, format) self.formatoptions = _cast(None, formatoptions) self.fsmountoptions = _cast(None, fsmountoptions) self.fscreateoptions = _cast(None, fscreateoptions) self.squashfscompression = _cast(None, squashfscompression) self.erofscompression = _cast(None, erofscompression) self.gcelicense = _cast(None, gcelicense) self.hybridpersistent = _cast(bool, hybridpersistent) self.hybridpersistent_filesystem = _cast( None, hybridpersistent_filesystem ) self.gpt_hybrid_mbr = _cast(bool, gpt_hybrid_mbr) self.force_mbr = _cast(bool, force_mbr) self.apply_dps_codes = _cast(bool, apply_dps_codes) self.initrd_system = _cast(None, initrd_system) self.image = _cast(None, image) self.metadata_path = _cast(None, metadata_path) self.installboot = _cast(None, installboot) self.install_continue_on_timeout = _cast( bool, install_continue_on_timeout ) self.installprovidefailsafe = _cast(bool, installprovidefailsafe) self.installiso = _cast(bool, installiso) self.installstick = _cast(bool, installstick) self.installpxe = _cast(bool, installpxe) self.mediacheck = _cast(bool, mediacheck) self.kernelcmdline = _cast(None, kernelcmdline) self.luks = _cast(None, luks) self.luks_version = _cast(None, luks_version) self.luksOS = _cast(None, luksOS) self.luks_randomize = _cast(bool, luks_randomize) self.luks_pbkdf = _cast(None, luks_pbkdf) self.mdraid = _cast(None, mdraid) self.overlayroot = _cast(bool, overlayroot) self.overlayroot_write_partition = _cast( bool, overlayroot_write_partition ) self.overlayroot_readonly_filesystem = _cast( None, overlayroot_readonly_filesystem ) self.overlayroot_readonly_partsize = _cast( int, overlayroot_readonly_partsize ) self.overlayroot_readonly_createoptions = _cast( None, overlayroot_readonly_createoptions ) self.verity_blocks = _cast(None, verity_blocks) self.embed_verity_metadata = _cast(bool, embed_verity_metadata) self.standalone_integrity = _cast(bool, standalone_integrity) self.embed_integrity_metadata = _cast(bool, embed_integrity_metadata) self.integrity_legacy_hmac = _cast(bool, integrity_legacy_hmac) self.integrity_metadata_key_description = _cast( None, integrity_metadata_key_description ) self.integrity_keyfile = _cast(None, integrity_keyfile) self.primary = _cast(bool, primary) self.ramonly = _cast(bool, ramonly) self.rootfs_label = _cast(None, rootfs_label) self.spare_part = _cast(None, spare_part) self.spare_part_mountpoint = _cast(None, spare_part_mountpoint) self.spare_part_fs = _cast(None, spare_part_fs) self.spare_part_fs_attributes = _cast(None, spare_part_fs_attributes) self.spare_part_is_last = _cast(bool, spare_part_is_last) self.target_blocksize = _cast(int, target_blocksize) self.target_removable = _cast(bool, target_removable) self.selinux_policy = _cast(None, selinux_policy) self.vhdfixedtag = _cast(None, vhdfixedtag) self.volid = _cast(None, volid) self.application_id = _cast(None, application_id) self.wwid_wait_timeout = _cast(int, wwid_wait_timeout) self.derived_from = _cast(None, derived_from) self.delta_root = _cast(bool, delta_root) self.provide_system_files = _cast(bool, provide_system_files) self.require_system_files = _cast(bool, require_system_files) self.ensure_empty_tmpdirs = _cast(bool, ensure_empty_tmpdirs) self.xen_server = _cast(bool, xen_server) self.publisher = _cast(None, publisher) self.disk_start_sector = _cast(int, disk_start_sector) self.root_clone = _cast(None, root_clone) self.boot_clone = _cast(None, boot_clone) self.bundle_format = _cast(None, bundle_format) if bootloader is None: self.bootloader = [] else: self.bootloader = bootloader if containerconfig is None: self.containerconfig = [] else: self.containerconfig = containerconfig if machine is None: self.machine = [] else: self.machine = machine if oemconfig is None: self.oemconfig = [] else: self.oemconfig = oemconfig if size is None: self.size = [] else: self.size = size if systemdisk is None: self.systemdisk = [] else: self.systemdisk = systemdisk if partitions is None: self.partitions = [] else: self.partitions = partitions if vagrantconfig is None: self.vagrantconfig = [] else: self.vagrantconfig = vagrantconfig if installmedia is None: self.installmedia = [] else: self.installmedia = installmedia if initrd is None: self.initrd = [] else: self.initrd = initrd if luksformat is None: self.luksformat = [] else: self.luksformat = luksformat def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, type_) if subclass is not None: return subclass(*args_, **kwargs_) if type_.subclass: return type_.subclass(*args_, **kwargs_) else: return type_(*args_, **kwargs_) factory = staticmethod(factory) def get_bootloader(self): return self.bootloader def set_bootloader(self, bootloader): self.bootloader = bootloader def add_bootloader(self, value): self.bootloader.append(value) def insert_bootloader_at(self, index, value): self.bootloader.insert(index, value) def replace_bootloader_at(self, index, value): self.bootloader[index] = value def get_containerconfig(self): return self.containerconfig def set_containerconfig(self, containerconfig): self.containerconfig = containerconfig def add_containerconfig(self, value): self.containerconfig.append(value) def insert_containerconfig_at(self, index, value): self.containerconfig.insert(index, value) def replace_containerconfig_at(self, index, value): self.containerconfig[index] = value def get_machine(self): return self.machine def set_machine(self, machine): self.machine = machine def add_machine(self, value): self.machine.append(value) def insert_machine_at(self, index, value): self.machine.insert(index, value) def replace_machine_at(self, index, value): self.machine[index] = value def get_oemconfig(self): return self.oemconfig def set_oemconfig(self, oemconfig): self.oemconfig = oemconfig def add_oemconfig(self, value): self.oemconfig.append(value) def insert_oemconfig_at(self, index, value): self.oemconfig.insert(index, value) def replace_oemconfig_at(self, index, value): self.oemconfig[index] = value def get_size(self): return self.size def set_size(self, size): self.size = size def add_size(self, value): self.size.append(value) def insert_size_at(self, index, value): self.size.insert(index, value) def replace_size_at(self, index, value): self.size[index] = value def get_systemdisk(self): return self.systemdisk def set_systemdisk(self, systemdisk): self.systemdisk = systemdisk def add_systemdisk(self, value): self.systemdisk.append(value) def insert_systemdisk_at(self, index, value): self.systemdisk.insert(index, value) def replace_systemdisk_at(self, index, value): self.systemdisk[index] = value def get_partitions(self): return self.partitions def set_partitions(self, partitions): self.partitions = partitions def add_partitions(self, value): self.partitions.append(value) def insert_partitions_at(self, index, value): self.partitions.insert(index, value) def replace_partitions_at(self, index, value): self.partitions[index] = value def get_vagrantconfig(self): return self.vagrantconfig def set_vagrantconfig(self, vagrantconfig): self.vagrantconfig = vagrantconfig def add_vagrantconfig(self, value): self.vagrantconfig.append(value) def insert_vagrantconfig_at(self, index, value): self.vagrantconfig.insert(index, value) def replace_vagrantconfig_at(self, index, value): self.vagrantconfig[index] = value def get_installmedia(self): return self.installmedia def set_installmedia(self, installmedia): self.installmedia = installmedia def add_installmedia(self, value): self.installmedia.append(value) def insert_installmedia_at(self, index, value): self.installmedia.insert(index, value) def replace_installmedia_at(self, index, value): self.installmedia[index] = value def get_initrd(self): return self.initrd def set_initrd(self, initrd): self.initrd = initrd def add_initrd(self, value): self.initrd.append(value) def insert_initrd_at(self, index, value): self.initrd.insert(index, value) def replace_initrd_at(self, index, value): self.initrd[index] = value def get_luksformat(self): return self.luksformat def set_luksformat(self, luksformat): self.luksformat = luksformat def add_luksformat(self, value): self.luksformat.append(value) def insert_luksformat_at(self, index, value): self.luksformat.insert(index, value) def replace_luksformat_at(self, index, value): self.luksformat[index] = value def get_archive(self): return self.archive def set_archive(self, archive): self.archive = archive def get_eficsmpart_id(self): return self.eficsmpart_id def set_eficsmpart_id(self, eficsmpart_id): self.eficsmpart_id = eficsmpart_id def get_efipart_id(self): return self.efipart_id def set_efipart_id(self, efipart_id): self.efipart_id = efipart_id def get_rootpart_id(self): return self.rootpart_id def set_rootpart_id(self, rootpart_id): self.rootpart_id = rootpart_id def get_bootpart_id(self): return self.bootpart_id def set_bootpart_id(self, bootpart_id): self.bootpart_id = bootpart_id def get_boot(self): return self.boot def set_boot(self, boot): self.boot = boot def get_bootfilesystem(self): return self.bootfilesystem def set_bootfilesystem(self, bootfilesystem): self.bootfilesystem = bootfilesystem def get_firmware(self): return self.firmware def set_firmware(self, firmware): self.firmware = firmware def get_bootkernel(self): return self.bootkernel def set_bootkernel(self, bootkernel): self.bootkernel = bootkernel def get_bootpartition(self): return self.bootpartition def set_bootpartition(self, bootpartition): self.bootpartition = bootpartition def get_bootpartsize(self): return self.bootpartsize def set_bootpartsize(self, bootpartsize): self.bootpartsize = bootpartsize def get_efipartsize(self): return self.efipartsize def set_efipartsize(self, efipartsize): self.efipartsize = efipartsize def get_efimountoptions(self): return self.efimountoptions def set_efimountoptions(self, efimountoptions): self.efimountoptions = efimountoptions def get_efifatimagesize(self): return self.efifatimagesize def set_efifatimagesize(self, efifatimagesize): self.efifatimagesize = efifatimagesize def get_eficsm(self): return self.eficsm def set_eficsm(self, eficsm): self.eficsm = eficsm def get_efiparttable(self): return self.efiparttable def set_efiparttable(self, efiparttable): self.efiparttable = efiparttable def get_dosparttable_extended_layout(self): return self.dosparttable_extended_layout def set_dosparttable_extended_layout(self, dosparttable_extended_layout): self.dosparttable_extended_layout = dosparttable_extended_layout def get_bootprofile(self): return self.bootprofile def set_bootprofile(self, bootprofile): self.bootprofile = bootprofile def get_btrfs_quota_groups(self): return self.btrfs_quota_groups def set_btrfs_quota_groups(self, btrfs_quota_groups): self.btrfs_quota_groups = btrfs_quota_groups def get_btrfs_root_is_snapper_snapshot(self): return self.btrfs_root_is_snapper_snapshot def set_btrfs_root_is_snapper_snapshot( self, btrfs_root_is_snapper_snapshot ): self.btrfs_root_is_snapper_snapshot = btrfs_root_is_snapper_snapshot def get_btrfs_root_is_subvolume(self): return self.btrfs_root_is_subvolume def set_btrfs_root_is_subvolume(self, btrfs_root_is_subvolume): self.btrfs_root_is_subvolume = btrfs_root_is_subvolume def get_btrfs_set_default_volume(self): return self.btrfs_set_default_volume def set_btrfs_set_default_volume(self, btrfs_set_default_volume): self.btrfs_set_default_volume = btrfs_set_default_volume def get_btrfs_root_is_readonly_snapshot(self): return self.btrfs_root_is_readonly_snapshot def set_btrfs_root_is_readonly_snapshot( self, btrfs_root_is_readonly_snapshot ): self.btrfs_root_is_readonly_snapshot = btrfs_root_is_readonly_snapshot def get_compressed(self): return self.compressed def set_compressed(self, compressed): self.compressed = compressed def get_devicepersistency(self): return self.devicepersistency def set_devicepersistency(self, devicepersistency): self.devicepersistency = devicepersistency def get_editbootconfig(self): return self.editbootconfig def set_editbootconfig(self, editbootconfig): self.editbootconfig = editbootconfig def get_editbootinstall(self): return self.editbootinstall def set_editbootinstall(self, editbootinstall): self.editbootinstall = editbootinstall def get_filesystem(self): return self.filesystem def set_filesystem(self, filesystem): self.filesystem = filesystem def get_flags(self): return self.flags def set_flags(self, flags): self.flags = flags def get_enclave_format(self): return self.enclave_format def set_enclave_format(self, enclave_format): self.enclave_format = enclave_format def get_format(self): return self.format def set_format(self, format): self.format = format def get_formatoptions(self): return self.formatoptions def set_formatoptions(self, formatoptions): self.formatoptions = formatoptions def get_fsmountoptions(self): return self.fsmountoptions def set_fsmountoptions(self, fsmountoptions): self.fsmountoptions = fsmountoptions def get_fscreateoptions(self): return self.fscreateoptions def set_fscreateoptions(self, fscreateoptions): self.fscreateoptions = fscreateoptions def get_squashfscompression(self): return self.squashfscompression def set_squashfscompression(self, squashfscompression): self.squashfscompression = squashfscompression def get_erofscompression(self): return self.erofscompression def set_erofscompression(self, erofscompression): self.erofscompression = erofscompression def get_gcelicense(self): return self.gcelicense def set_gcelicense(self, gcelicense): self.gcelicense = gcelicense def get_hybridpersistent(self): return self.hybridpersistent def set_hybridpersistent(self, hybridpersistent): self.hybridpersistent = hybridpersistent def get_hybridpersistent_filesystem(self): return self.hybridpersistent_filesystem def set_hybridpersistent_filesystem(self, hybridpersistent_filesystem): self.hybridpersistent_filesystem = hybridpersistent_filesystem def get_gpt_hybrid_mbr(self): return self.gpt_hybrid_mbr def set_gpt_hybrid_mbr(self, gpt_hybrid_mbr): self.gpt_hybrid_mbr = gpt_hybrid_mbr def get_force_mbr(self): return self.force_mbr def set_force_mbr(self, force_mbr): self.force_mbr = force_mbr def get_apply_dps_codes(self): return self.apply_dps_codes def set_apply_dps_codes(self, apply_dps_codes): self.apply_dps_codes = apply_dps_codes def get_initrd_system(self): return self.initrd_system def set_initrd_system(self, initrd_system): self.initrd_system = initrd_system def get_image(self): return self.image def set_image(self, image): self.image = image def get_metadata_path(self): return self.metadata_path def set_metadata_path(self, metadata_path): self.metadata_path = metadata_path def get_installboot(self): return self.installboot def set_installboot(self, installboot): self.installboot = installboot def get_install_continue_on_timeout(self): return self.install_continue_on_timeout def set_install_continue_on_timeout(self, install_continue_on_timeout): self.install_continue_on_timeout = install_continue_on_timeout def get_installprovidefailsafe(self): return self.installprovidefailsafe def set_installprovidefailsafe(self, installprovidefailsafe): self.installprovidefailsafe = installprovidefailsafe def get_installiso(self): return self.installiso def set_installiso(self, installiso): self.installiso = installiso def get_installstick(self): return self.installstick def set_installstick(self, installstick): self.installstick = installstick def get_installpxe(self): return self.installpxe def set_installpxe(self, installpxe): self.installpxe = installpxe def get_mediacheck(self): return self.mediacheck def set_mediacheck(self, mediacheck): self.mediacheck = mediacheck def get_kernelcmdline(self): return self.kernelcmdline def set_kernelcmdline(self, kernelcmdline): self.kernelcmdline = kernelcmdline def get_luks(self): return self.luks def set_luks(self, luks): self.luks = luks def get_luks_version(self): return self.luks_version def set_luks_version(self, luks_version): self.luks_version = luks_version def get_luksOS(self): return self.luksOS def set_luksOS(self, luksOS): self.luksOS = luksOS def get_luks_randomize(self): return self.luks_randomize def set_luks_randomize(self, luks_randomize): self.luks_randomize = luks_randomize def get_luks_pbkdf(self): return self.luks_pbkdf def set_luks_pbkdf(self, luks_pbkdf): self.luks_pbkdf = luks_pbkdf def get_mdraid(self): return self.mdraid def set_mdraid(self, mdraid): self.mdraid = mdraid def get_overlayroot(self): return self.overlayroot def set_overlayroot(self, overlayroot): self.overlayroot = overlayroot def get_overlayroot_write_partition(self): return self.overlayroot_write_partition def set_overlayroot_write_partition(self, overlayroot_write_partition): self.overlayroot_write_partition = overlayroot_write_partition def get_overlayroot_readonly_filesystem(self): return self.overlayroot_readonly_filesystem def set_overlayroot_readonly_filesystem( self, overlayroot_readonly_filesystem ): self.overlayroot_readonly_filesystem = overlayroot_readonly_filesystem def get_overlayroot_readonly_partsize(self): return self.overlayroot_readonly_partsize def set_overlayroot_readonly_partsize(self, overlayroot_readonly_partsize): self.overlayroot_readonly_partsize = overlayroot_readonly_partsize def get_overlayroot_readonly_createoptions(self): return self.overlayroot_readonly_createoptions def set_overlayroot_readonly_createoptions( self, overlayroot_readonly_createoptions ): self.overlayroot_readonly_createoptions = ( overlayroot_readonly_createoptions ) def get_verity_blocks(self): return self.verity_blocks def set_verity_blocks(self, verity_blocks): self.verity_blocks = verity_blocks def get_embed_verity_metadata(self): return self.embed_verity_metadata def set_embed_verity_metadata(self, embed_verity_metadata): self.embed_verity_metadata = embed_verity_metadata def get_standalone_integrity(self): return self.standalone_integrity def set_standalone_integrity(self, standalone_integrity): self.standalone_integrity = standalone_integrity def get_embed_integrity_metadata(self): return self.embed_integrity_metadata def set_embed_integrity_metadata(self, embed_integrity_metadata): self.embed_integrity_metadata = embed_integrity_metadata def get_integrity_legacy_hmac(self): return self.integrity_legacy_hmac def set_integrity_legacy_hmac(self, integrity_legacy_hmac): self.integrity_legacy_hmac = integrity_legacy_hmac def get_integrity_metadata_key_description(self): return self.integrity_metadata_key_description def set_integrity_metadata_key_description( self, integrity_metadata_key_description ): self.integrity_metadata_key_description = ( integrity_metadata_key_description ) def get_integrity_keyfile(self): return self.integrity_keyfile def set_integrity_keyfile(self, integrity_keyfile): self.integrity_keyfile = integrity_keyfile def get_primary(self): return self.primary def set_primary(self, primary): self.primary = primary def get_ramonly(self): return self.ramonly def set_ramonly(self, ramonly): self.ramonly = ramonly def get_rootfs_label(self): return self.rootfs_label def set_rootfs_label(self, rootfs_label): self.rootfs_label = rootfs_label def get_spare_part(self): return self.spare_part def set_spare_part(self, spare_part): self.spare_part = spare_part def get_spare_part_mountpoint(self): return self.spare_part_mountpoint def set_spare_part_mountpoint(self, spare_part_mountpoint): self.spare_part_mountpoint = spare_part_mountpoint def get_spare_part_fs(self): return self.spare_part_fs def set_spare_part_fs(self, spare_part_fs): self.spare_part_fs = spare_part_fs def get_spare_part_fs_attributes(self): return self.spare_part_fs_attributes def set_spare_part_fs_attributes(self, spare_part_fs_attributes): self.spare_part_fs_attributes = spare_part_fs_attributes def get_spare_part_is_last(self): return self.spare_part_is_last def set_spare_part_is_last(self, spare_part_is_last): self.spare_part_is_last = spare_part_is_last def get_target_blocksize(self): return self.target_blocksize def set_target_blocksize(self, target_blocksize): self.target_blocksize = target_blocksize def get_target_removable(self): return self.target_removable def set_target_removable(self, target_removable): self.target_removable = target_removable def get_selinux_policy(self): return self.selinux_policy def set_selinux_policy(self, selinux_policy): self.selinux_policy = selinux_policy def get_vhdfixedtag(self): return self.vhdfixedtag def set_vhdfixedtag(self, vhdfixedtag): self.vhdfixedtag = vhdfixedtag def get_volid(self): return self.volid def set_volid(self, volid): self.volid = volid def get_application_id(self): return self.application_id def set_application_id(self, application_id): self.application_id = application_id def get_wwid_wait_timeout(self): return self.wwid_wait_timeout def set_wwid_wait_timeout(self, wwid_wait_timeout): self.wwid_wait_timeout = wwid_wait_timeout def get_derived_from(self): return self.derived_from def set_derived_from(self, derived_from): self.derived_from = derived_from def get_delta_root(self): return self.delta_root def set_delta_root(self, delta_root): self.delta_root = delta_root def get_provide_system_files(self): return self.provide_system_files def set_provide_system_files(self, provide_system_files): self.provide_system_files = provide_system_files def get_require_system_files(self): return self.require_system_files def set_require_system_files(self, require_system_files): self.require_system_files = require_system_files def get_ensure_empty_tmpdirs(self): return self.ensure_empty_tmpdirs def set_ensure_empty_tmpdirs(self, ensure_empty_tmpdirs): self.ensure_empty_tmpdirs = ensure_empty_tmpdirs def get_xen_server(self): return self.xen_server def set_xen_server(self, xen_server): self.xen_server = xen_server def get_publisher(self): return self.publisher def set_publisher(self, publisher): self.publisher = publisher def get_disk_start_sector(self): return self.disk_start_sector def set_disk_start_sector(self, disk_start_sector): self.disk_start_sector = disk_start_sector def get_root_clone(self): return self.root_clone def set_root_clone(self, root_clone): self.root_clone = root_clone def get_boot_clone(self): return self.boot_clone def set_boot_clone(self, boot_clone): self.boot_clone = boot_clone def get_bundle_format(self): return self.bundle_format def set_bundle_format(self, bundle_format): self.bundle_format = bundle_format def validate_number_type(self, value): # Validate type number-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_number_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_number_type_patterns_, ) ) validate_number_type_patterns_ = [['^\\d+$']] def validate_blocks_type(self, value): # Validate type blocks-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_blocks_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_blocks_type_patterns_, ) ) validate_blocks_type_patterns_ = [['^(\\d*|all)$']] def validate_partition_size_type(self, value): # Validate type partition-size-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_partition_size_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_partition_size_type_patterns_, ) ) validate_partition_size_type_patterns_ = [['^(\\d+|\\d+M|\\d+G)$']] def validate_fs_attributes(self, value): # Validate type fs_attributes, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_fs_attributes_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_fs_attributes_patterns_, ) ) validate_fs_attributes_patterns_ = [ [ '^(no-copy-on-write|synchronous-updates)(,(no-copy-on-write|synchronous-updates))*$' ] ] def validate_vhd_tag_type(self, value): # Validate type vhd-tag-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_vhd_tag_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_vhd_tag_type_patterns_, ) ) validate_vhd_tag_type_patterns_ = [ ['^[0-9a-f]{8}-([0-9a-f]{4}-){3}[0-9a-f]{12}$'] ] def validate_safe_posix_short_name(self, value): # Validate type safe-posix-short-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_safe_posix_short_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_safe_posix_short_name_patterns_, ) ) validate_safe_posix_short_name_patterns_ = [['^[a-zA-Z0-9_\\-\\.]{1,32}$']] def validate_ecma_119_achar_128_text(self, value): # Validate type ecma-119-achar-128-text, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_ecma_119_achar_128_text_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_ecma_119_achar_128_text_patterns_, ) ) validate_ecma_119_achar_128_text_patterns_ = [ ['^[a-zA-Z0-9!-/:-?_ ]{1,128}$'] ] def hasContent_(self): if ( self.bootloader or self.containerconfig or self.machine or self.oemconfig or self.size or self.systemdisk or self.partitions or self.vagrantconfig or self.installmedia or self.initrd or self.luksformat ): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='type', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('type') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='type' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='type', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='type', ): if self.archive is not None and 'archive' not in already_processed: already_processed.add('archive') outfile.write( ' archive="%s"' % self.gds_format_boolean(self.archive, input_name='archive') ) if ( self.eficsmpart_id is not None and 'eficsmpart_id' not in already_processed ): already_processed.add('eficsmpart_id') outfile.write( ' eficsmpart_id=%s' % (quote_attrib(self.eficsmpart_id),) ) if ( self.efipart_id is not None and 'efipart_id' not in already_processed ): already_processed.add('efipart_id') outfile.write(' efipart_id=%s' % (quote_attrib(self.efipart_id),)) if ( self.rootpart_id is not None and 'rootpart_id' not in already_processed ): already_processed.add('rootpart_id') outfile.write(' rootpart_id=%s' % (quote_attrib(self.rootpart_id),)) if ( self.bootpart_id is not None and 'bootpart_id' not in already_processed ): already_processed.add('bootpart_id') outfile.write(' bootpart_id=%s' % (quote_attrib(self.bootpart_id),)) if self.boot is not None and 'boot' not in already_processed: already_processed.add('boot') outfile.write( ' boot=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.boot), input_name='boot' ) ), ) ) if ( self.bootfilesystem is not None and 'bootfilesystem' not in already_processed ): already_processed.add('bootfilesystem') outfile.write( ' bootfilesystem=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.bootfilesystem), input_name='bootfilesystem', ) ), ) ) if self.firmware is not None and 'firmware' not in already_processed: already_processed.add('firmware') outfile.write( ' firmware=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.firmware), input_name='firmware' ) ), ) ) if ( self.bootkernel is not None and 'bootkernel' not in already_processed ): already_processed.add('bootkernel') outfile.write( ' bootkernel=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.bootkernel), input_name='bootkernel', ) ), ) ) if ( self.bootpartition is not None and 'bootpartition' not in already_processed ): already_processed.add('bootpartition') outfile.write( ' bootpartition="%s"' % self.gds_format_boolean( self.bootpartition, input_name='bootpartition' ) ) if ( self.bootpartsize is not None and 'bootpartsize' not in already_processed ): already_processed.add('bootpartsize') outfile.write( ' bootpartsize="%s"' % self.gds_format_integer( self.bootpartsize, input_name='bootpartsize' ) ) if ( self.efipartsize is not None and 'efipartsize' not in already_processed ): already_processed.add('efipartsize') outfile.write( ' efipartsize="%s"' % self.gds_format_integer( self.efipartsize, input_name='efipartsize' ) ) if ( self.efimountoptions is not None and 'efimountoptions' not in already_processed ): already_processed.add('efimountoptions') outfile.write( ' efimountoptions=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.efimountoptions), input_name='efimountoptions', ) ), ) ) if ( self.efifatimagesize is not None and 'efifatimagesize' not in already_processed ): already_processed.add('efifatimagesize') outfile.write( ' efifatimagesize="%s"' % self.gds_format_integer( self.efifatimagesize, input_name='efifatimagesize' ) ) if self.eficsm is not None and 'eficsm' not in already_processed: already_processed.add('eficsm') outfile.write( ' eficsm="%s"' % self.gds_format_boolean(self.eficsm, input_name='eficsm') ) if ( self.efiparttable is not None and 'efiparttable' not in already_processed ): already_processed.add('efiparttable') outfile.write( ' efiparttable=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.efiparttable), input_name='efiparttable', ) ), ) ) if ( self.dosparttable_extended_layout is not None and 'dosparttable_extended_layout' not in already_processed ): already_processed.add('dosparttable_extended_layout') outfile.write( ' dosparttable_extended_layout="%s"' % self.gds_format_boolean( self.dosparttable_extended_layout, input_name='dosparttable_extended_layout', ) ) if ( self.bootprofile is not None and 'bootprofile' not in already_processed ): already_processed.add('bootprofile') outfile.write( ' bootprofile=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.bootprofile), input_name='bootprofile', ) ), ) ) if ( self.btrfs_quota_groups is not None and 'btrfs_quota_groups' not in already_processed ): already_processed.add('btrfs_quota_groups') outfile.write( ' btrfs_quota_groups="%s"' % self.gds_format_boolean( self.btrfs_quota_groups, input_name='btrfs_quota_groups' ) ) if ( self.btrfs_root_is_snapper_snapshot is not None and 'btrfs_root_is_snapper_snapshot' not in already_processed ): already_processed.add('btrfs_root_is_snapper_snapshot') outfile.write( ' btrfs_root_is_snapper_snapshot="%s"' % self.gds_format_boolean( self.btrfs_root_is_snapper_snapshot, input_name='btrfs_root_is_snapper_snapshot', ) ) if ( self.btrfs_root_is_subvolume is not None and 'btrfs_root_is_subvolume' not in already_processed ): already_processed.add('btrfs_root_is_subvolume') outfile.write( ' btrfs_root_is_subvolume="%s"' % self.gds_format_boolean( self.btrfs_root_is_subvolume, input_name='btrfs_root_is_subvolume', ) ) if ( self.btrfs_set_default_volume is not None and 'btrfs_set_default_volume' not in already_processed ): already_processed.add('btrfs_set_default_volume') outfile.write( ' btrfs_set_default_volume="%s"' % self.gds_format_boolean( self.btrfs_set_default_volume, input_name='btrfs_set_default_volume', ) ) if ( self.btrfs_root_is_readonly_snapshot is not None and 'btrfs_root_is_readonly_snapshot' not in already_processed ): already_processed.add('btrfs_root_is_readonly_snapshot') outfile.write( ' btrfs_root_is_readonly_snapshot="%s"' % self.gds_format_boolean( self.btrfs_root_is_readonly_snapshot, input_name='btrfs_root_is_readonly_snapshot', ) ) if ( self.compressed is not None and 'compressed' not in already_processed ): already_processed.add('compressed') outfile.write( ' compressed="%s"' % self.gds_format_boolean( self.compressed, input_name='compressed' ) ) if ( self.devicepersistency is not None and 'devicepersistency' not in already_processed ): already_processed.add('devicepersistency') outfile.write( ' devicepersistency=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.devicepersistency), input_name='devicepersistency', ) ), ) ) if ( self.editbootconfig is not None and 'editbootconfig' not in already_processed ): already_processed.add('editbootconfig') outfile.write( ' editbootconfig=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.editbootconfig), input_name='editbootconfig', ) ), ) ) if ( self.editbootinstall is not None and 'editbootinstall' not in already_processed ): already_processed.add('editbootinstall') outfile.write( ' editbootinstall=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.editbootinstall), input_name='editbootinstall', ) ), ) ) if ( self.filesystem is not None and 'filesystem' not in already_processed ): already_processed.add('filesystem') outfile.write( ' filesystem=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.filesystem), input_name='filesystem', ) ), ) ) if self.flags is not None and 'flags' not in already_processed: already_processed.add('flags') outfile.write( ' flags=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.flags), input_name='flags' ) ), ) ) if ( self.enclave_format is not None and 'enclave_format' not in already_processed ): already_processed.add('enclave_format') outfile.write( ' enclave_format=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.enclave_format), input_name='enclave_format', ) ), ) ) if self.format is not None and 'format' not in already_processed: already_processed.add('format') outfile.write( ' format=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.format), input_name='format' ) ), ) ) if ( self.formatoptions is not None and 'formatoptions' not in already_processed ): already_processed.add('formatoptions') outfile.write( ' formatoptions=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.formatoptions), input_name='formatoptions', ) ), ) ) if ( self.fsmountoptions is not None and 'fsmountoptions' not in already_processed ): already_processed.add('fsmountoptions') outfile.write( ' fsmountoptions=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.fsmountoptions), input_name='fsmountoptions', ) ), ) ) if ( self.fscreateoptions is not None and 'fscreateoptions' not in already_processed ): already_processed.add('fscreateoptions') outfile.write( ' fscreateoptions=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.fscreateoptions), input_name='fscreateoptions', ) ), ) ) if ( self.squashfscompression is not None and 'squashfscompression' not in already_processed ): already_processed.add('squashfscompression') outfile.write( ' squashfscompression=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.squashfscompression), input_name='squashfscompression', ) ), ) ) if ( self.erofscompression is not None and 'erofscompression' not in already_processed ): already_processed.add('erofscompression') outfile.write( ' erofscompression=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.erofscompression), input_name='erofscompression', ) ), ) ) if ( self.gcelicense is not None and 'gcelicense' not in already_processed ): already_processed.add('gcelicense') outfile.write( ' gcelicense=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.gcelicense), input_name='gcelicense', ) ), ) ) if ( self.hybridpersistent is not None and 'hybridpersistent' not in already_processed ): already_processed.add('hybridpersistent') outfile.write( ' hybridpersistent="%s"' % self.gds_format_boolean( self.hybridpersistent, input_name='hybridpersistent' ) ) if ( self.hybridpersistent_filesystem is not None and 'hybridpersistent_filesystem' not in already_processed ): already_processed.add('hybridpersistent_filesystem') outfile.write( ' hybridpersistent_filesystem=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.hybridpersistent_filesystem), input_name='hybridpersistent_filesystem', ) ), ) ) if ( self.gpt_hybrid_mbr is not None and 'gpt_hybrid_mbr' not in already_processed ): already_processed.add('gpt_hybrid_mbr') outfile.write( ' gpt_hybrid_mbr="%s"' % self.gds_format_boolean( self.gpt_hybrid_mbr, input_name='gpt_hybrid_mbr' ) ) if self.force_mbr is not None and 'force_mbr' not in already_processed: already_processed.add('force_mbr') outfile.write( ' force_mbr="%s"' % self.gds_format_boolean( self.force_mbr, input_name='force_mbr' ) ) if ( self.apply_dps_codes is not None and 'apply_dps_codes' not in already_processed ): already_processed.add('apply_dps_codes') outfile.write( ' apply_dps_codes="%s"' % self.gds_format_boolean( self.apply_dps_codes, input_name='apply_dps_codes' ) ) if ( self.initrd_system is not None and 'initrd_system' not in already_processed ): already_processed.add('initrd_system') outfile.write( ' initrd_system=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.initrd_system), input_name='initrd_system', ) ), ) ) if self.image is not None and 'image' not in already_processed: already_processed.add('image') outfile.write( ' image=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.image), input_name='image' ) ), ) ) if ( self.metadata_path is not None and 'metadata_path' not in already_processed ): already_processed.add('metadata_path') outfile.write( ' metadata_path=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.metadata_path), input_name='metadata_path', ) ), ) ) if ( self.installboot is not None and 'installboot' not in already_processed ): already_processed.add('installboot') outfile.write( ' installboot=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.installboot), input_name='installboot', ) ), ) ) if ( self.install_continue_on_timeout is not None and 'install_continue_on_timeout' not in already_processed ): already_processed.add('install_continue_on_timeout') outfile.write( ' install_continue_on_timeout="%s"' % self.gds_format_boolean( self.install_continue_on_timeout, input_name='install_continue_on_timeout', ) ) if ( self.installprovidefailsafe is not None and 'installprovidefailsafe' not in already_processed ): already_processed.add('installprovidefailsafe') outfile.write( ' installprovidefailsafe="%s"' % self.gds_format_boolean( self.installprovidefailsafe, input_name='installprovidefailsafe', ) ) if ( self.installiso is not None and 'installiso' not in already_processed ): already_processed.add('installiso') outfile.write( ' installiso="%s"' % self.gds_format_boolean( self.installiso, input_name='installiso' ) ) if ( self.installstick is not None and 'installstick' not in already_processed ): already_processed.add('installstick') outfile.write( ' installstick="%s"' % self.gds_format_boolean( self.installstick, input_name='installstick' ) ) if ( self.installpxe is not None and 'installpxe' not in already_processed ): already_processed.add('installpxe') outfile.write( ' installpxe="%s"' % self.gds_format_boolean( self.installpxe, input_name='installpxe' ) ) if ( self.mediacheck is not None and 'mediacheck' not in already_processed ): already_processed.add('mediacheck') outfile.write( ' mediacheck="%s"' % self.gds_format_boolean( self.mediacheck, input_name='mediacheck' ) ) if ( self.kernelcmdline is not None and 'kernelcmdline' not in already_processed ): already_processed.add('kernelcmdline') outfile.write( ' kernelcmdline=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.kernelcmdline), input_name='kernelcmdline', ) ), ) ) if self.luks is not None and 'luks' not in already_processed: already_processed.add('luks') outfile.write( ' luks=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.luks), input_name='luks' ) ), ) ) if ( self.luks_version is not None and 'luks_version' not in already_processed ): already_processed.add('luks_version') outfile.write( ' luks_version=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.luks_version), input_name='luks_version', ) ), ) ) if self.luksOS is not None and 'luksOS' not in already_processed: already_processed.add('luksOS') outfile.write( ' luksOS=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.luksOS), input_name='luksOS' ) ), ) ) if ( self.luks_randomize is not None and 'luks_randomize' not in already_processed ): already_processed.add('luks_randomize') outfile.write( ' luks_randomize="%s"' % self.gds_format_boolean( self.luks_randomize, input_name='luks_randomize' ) ) if ( self.luks_pbkdf is not None and 'luks_pbkdf' not in already_processed ): already_processed.add('luks_pbkdf') outfile.write( ' luks_pbkdf=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.luks_pbkdf), input_name='luks_pbkdf', ) ), ) ) if self.mdraid is not None and 'mdraid' not in already_processed: already_processed.add('mdraid') outfile.write( ' mdraid=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.mdraid), input_name='mdraid' ) ), ) ) if ( self.overlayroot is not None and 'overlayroot' not in already_processed ): already_processed.add('overlayroot') outfile.write( ' overlayroot="%s"' % self.gds_format_boolean( self.overlayroot, input_name='overlayroot' ) ) if ( self.overlayroot_write_partition is not None and 'overlayroot_write_partition' not in already_processed ): already_processed.add('overlayroot_write_partition') outfile.write( ' overlayroot_write_partition="%s"' % self.gds_format_boolean( self.overlayroot_write_partition, input_name='overlayroot_write_partition', ) ) if ( self.overlayroot_readonly_filesystem is not None and 'overlayroot_readonly_filesystem' not in already_processed ): already_processed.add('overlayroot_readonly_filesystem') outfile.write( ' overlayroot_readonly_filesystem=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.overlayroot_readonly_filesystem), input_name='overlayroot_readonly_filesystem', ) ), ) ) if ( self.overlayroot_readonly_partsize is not None and 'overlayroot_readonly_partsize' not in already_processed ): already_processed.add('overlayroot_readonly_partsize') outfile.write( ' overlayroot_readonly_partsize="%s"' % self.gds_format_integer( self.overlayroot_readonly_partsize, input_name='overlayroot_readonly_partsize', ) ) if ( self.overlayroot_readonly_createoptions is not None and 'overlayroot_readonly_createoptions' not in already_processed ): already_processed.add('overlayroot_readonly_createoptions') outfile.write( ' overlayroot_readonly_createoptions=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib( self.overlayroot_readonly_createoptions ), input_name='overlayroot_readonly_createoptions', ) ), ) ) if ( self.verity_blocks is not None and 'verity_blocks' not in already_processed ): already_processed.add('verity_blocks') outfile.write( ' verity_blocks=%s' % (quote_attrib(self.verity_blocks),) ) if ( self.embed_verity_metadata is not None and 'embed_verity_metadata' not in already_processed ): already_processed.add('embed_verity_metadata') outfile.write( ' embed_verity_metadata="%s"' % self.gds_format_boolean( self.embed_verity_metadata, input_name='embed_verity_metadata', ) ) if ( self.standalone_integrity is not None and 'standalone_integrity' not in already_processed ): already_processed.add('standalone_integrity') outfile.write( ' standalone_integrity="%s"' % self.gds_format_boolean( self.standalone_integrity, input_name='standalone_integrity' ) ) if ( self.embed_integrity_metadata is not None and 'embed_integrity_metadata' not in already_processed ): already_processed.add('embed_integrity_metadata') outfile.write( ' embed_integrity_metadata="%s"' % self.gds_format_boolean( self.embed_integrity_metadata, input_name='embed_integrity_metadata', ) ) if ( self.integrity_legacy_hmac is not None and 'integrity_legacy_hmac' not in already_processed ): already_processed.add('integrity_legacy_hmac') outfile.write( ' integrity_legacy_hmac="%s"' % self.gds_format_boolean( self.integrity_legacy_hmac, input_name='integrity_legacy_hmac', ) ) if ( self.integrity_metadata_key_description is not None and 'integrity_metadata_key_description' not in already_processed ): already_processed.add('integrity_metadata_key_description') outfile.write( ' integrity_metadata_key_description=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib( self.integrity_metadata_key_description ), input_name='integrity_metadata_key_description', ) ), ) ) if ( self.integrity_keyfile is not None and 'integrity_keyfile' not in already_processed ): already_processed.add('integrity_keyfile') outfile.write( ' integrity_keyfile=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.integrity_keyfile), input_name='integrity_keyfile', ) ), ) ) if self.primary is not None and 'primary' not in already_processed: already_processed.add('primary') outfile.write( ' primary="%s"' % self.gds_format_boolean(self.primary, input_name='primary') ) if self.ramonly is not None and 'ramonly' not in already_processed: already_processed.add('ramonly') outfile.write( ' ramonly="%s"' % self.gds_format_boolean(self.ramonly, input_name='ramonly') ) if ( self.rootfs_label is not None and 'rootfs_label' not in already_processed ): already_processed.add('rootfs_label') outfile.write( ' rootfs_label=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.rootfs_label), input_name='rootfs_label', ) ), ) ) if ( self.spare_part is not None and 'spare_part' not in already_processed ): already_processed.add('spare_part') outfile.write(' spare_part=%s' % (quote_attrib(self.spare_part),)) if ( self.spare_part_mountpoint is not None and 'spare_part_mountpoint' not in already_processed ): already_processed.add('spare_part_mountpoint') outfile.write( ' spare_part_mountpoint=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.spare_part_mountpoint), input_name='spare_part_mountpoint', ) ), ) ) if ( self.spare_part_fs is not None and 'spare_part_fs' not in already_processed ): already_processed.add('spare_part_fs') outfile.write( ' spare_part_fs=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.spare_part_fs), input_name='spare_part_fs', ) ), ) ) if ( self.spare_part_fs_attributes is not None and 'spare_part_fs_attributes' not in already_processed ): already_processed.add('spare_part_fs_attributes') outfile.write( ' spare_part_fs_attributes=%s' % (quote_attrib(self.spare_part_fs_attributes),) ) if ( self.spare_part_is_last is not None and 'spare_part_is_last' not in already_processed ): already_processed.add('spare_part_is_last') outfile.write( ' spare_part_is_last="%s"' % self.gds_format_boolean( self.spare_part_is_last, input_name='spare_part_is_last' ) ) if ( self.target_blocksize is not None and 'target_blocksize' not in already_processed ): already_processed.add('target_blocksize') outfile.write( ' target_blocksize="%s"' % self.gds_format_integer( self.target_blocksize, input_name='target_blocksize' ) ) if ( self.target_removable is not None and 'target_removable' not in already_processed ): already_processed.add('target_removable') outfile.write( ' target_removable="%s"' % self.gds_format_boolean( self.target_removable, input_name='target_removable' ) ) if ( self.selinux_policy is not None and 'selinux_policy' not in already_processed ): already_processed.add('selinux_policy') outfile.write( ' selinux_policy=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.selinux_policy), input_name='selinux_policy', ) ), ) ) if ( self.vhdfixedtag is not None and 'vhdfixedtag' not in already_processed ): already_processed.add('vhdfixedtag') outfile.write(' vhdfixedtag=%s' % (quote_attrib(self.vhdfixedtag),)) if self.volid is not None and 'volid' not in already_processed: already_processed.add('volid') outfile.write(' volid=%s' % (quote_attrib(self.volid),)) if ( self.application_id is not None and 'application_id' not in already_processed ): already_processed.add('application_id') outfile.write( ' application_id=%s' % (quote_attrib(self.application_id),) ) if ( self.wwid_wait_timeout is not None and 'wwid_wait_timeout' not in already_processed ): already_processed.add('wwid_wait_timeout') outfile.write( ' wwid_wait_timeout="%s"' % self.gds_format_integer( self.wwid_wait_timeout, input_name='wwid_wait_timeout' ) ) if ( self.derived_from is not None and 'derived_from' not in already_processed ): already_processed.add('derived_from') outfile.write( ' derived_from=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.derived_from), input_name='derived_from', ) ), ) ) if ( self.delta_root is not None and 'delta_root' not in already_processed ): already_processed.add('delta_root') outfile.write( ' delta_root="%s"' % self.gds_format_boolean( self.delta_root, input_name='delta_root' ) ) if ( self.provide_system_files is not None and 'provide_system_files' not in already_processed ): already_processed.add('provide_system_files') outfile.write( ' provide_system_files="%s"' % self.gds_format_boolean( self.provide_system_files, input_name='provide_system_files' ) ) if ( self.require_system_files is not None and 'require_system_files' not in already_processed ): already_processed.add('require_system_files') outfile.write( ' require_system_files="%s"' % self.gds_format_boolean( self.require_system_files, input_name='require_system_files' ) ) if ( self.ensure_empty_tmpdirs is not None and 'ensure_empty_tmpdirs' not in already_processed ): already_processed.add('ensure_empty_tmpdirs') outfile.write( ' ensure_empty_tmpdirs="%s"' % self.gds_format_boolean( self.ensure_empty_tmpdirs, input_name='ensure_empty_tmpdirs' ) ) if ( self.xen_server is not None and 'xen_server' not in already_processed ): already_processed.add('xen_server') outfile.write( ' xen_server="%s"' % self.gds_format_boolean( self.xen_server, input_name='xen_server' ) ) if self.publisher is not None and 'publisher' not in already_processed: already_processed.add('publisher') outfile.write(' publisher=%s' % (quote_attrib(self.publisher),)) if ( self.disk_start_sector is not None and 'disk_start_sector' not in already_processed ): already_processed.add('disk_start_sector') outfile.write( ' disk_start_sector="%s"' % self.gds_format_integer( self.disk_start_sector, input_name='disk_start_sector' ) ) if ( self.root_clone is not None and 'root_clone' not in already_processed ): already_processed.add('root_clone') outfile.write(' root_clone=%s' % (quote_attrib(self.root_clone),)) if ( self.boot_clone is not None and 'boot_clone' not in already_processed ): already_processed.add('boot_clone') outfile.write(' boot_clone=%s' % (quote_attrib(self.boot_clone),)) if ( self.bundle_format is not None and 'bundle_format' not in already_processed ): already_processed.add('bundle_format') outfile.write( ' bundle_format=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.bundle_format), input_name='bundle_format', ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='type', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for bootloader_ in self.bootloader: bootloader_.export( outfile, level, namespaceprefix_, name_='bootloader', pretty_print=pretty_print, ) for containerconfig_ in self.containerconfig: containerconfig_.export( outfile, level, namespaceprefix_, name_='containerconfig', pretty_print=pretty_print, ) for machine_ in self.machine: machine_.export( outfile, level, namespaceprefix_, name_='machine', pretty_print=pretty_print, ) for oemconfig_ in self.oemconfig: oemconfig_.export( outfile, level, namespaceprefix_, name_='oemconfig', pretty_print=pretty_print, ) for size_ in self.size: size_.export( outfile, level, namespaceprefix_, name_='size', pretty_print=pretty_print, ) for systemdisk_ in self.systemdisk: systemdisk_.export( outfile, level, namespaceprefix_, name_='systemdisk', pretty_print=pretty_print, ) for partitions_ in self.partitions: partitions_.export( outfile, level, namespaceprefix_, name_='partitions', pretty_print=pretty_print, ) for vagrantconfig_ in self.vagrantconfig: vagrantconfig_.export( outfile, level, namespaceprefix_, name_='vagrantconfig', pretty_print=pretty_print, ) for installmedia_ in self.installmedia: installmedia_.export( outfile, level, namespaceprefix_, name_='installmedia', pretty_print=pretty_print, ) for initrd_ in self.initrd: initrd_.export( outfile, level, namespaceprefix_, name_='initrd', pretty_print=pretty_print, ) for luksformat_ in self.luksformat: luksformat_.export( outfile, level, namespaceprefix_, name_='luksformat', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('archive', node) if value is not None and 'archive' not in already_processed: already_processed.add('archive') if value in ('true', '1'): self.archive = True elif value in ('false', '0'): self.archive = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('eficsmpart_id', node) if value is not None and 'eficsmpart_id' not in already_processed: already_processed.add('eficsmpart_id') self.eficsmpart_id = value self.eficsmpart_id = ' '.join(self.eficsmpart_id.split()) self.validate_number_type( self.eficsmpart_id ) # validate type number-type value = find_attr_value_('efipart_id', node) if value is not None and 'efipart_id' not in already_processed: already_processed.add('efipart_id') self.efipart_id = value self.efipart_id = ' '.join(self.efipart_id.split()) self.validate_number_type( self.efipart_id ) # validate type number-type value = find_attr_value_('rootpart_id', node) if value is not None and 'rootpart_id' not in already_processed: already_processed.add('rootpart_id') self.rootpart_id = value self.rootpart_id = ' '.join(self.rootpart_id.split()) self.validate_number_type( self.rootpart_id ) # validate type number-type value = find_attr_value_('bootpart_id', node) if value is not None and 'bootpart_id' not in already_processed: already_processed.add('bootpart_id') self.bootpart_id = value self.bootpart_id = ' '.join(self.bootpart_id.split()) self.validate_number_type( self.bootpart_id ) # validate type number-type value = find_attr_value_('boot', node) if value is not None and 'boot' not in already_processed: already_processed.add('boot') self.boot = value value = find_attr_value_('bootfilesystem', node) if value is not None and 'bootfilesystem' not in already_processed: already_processed.add('bootfilesystem') self.bootfilesystem = value self.bootfilesystem = ' '.join(self.bootfilesystem.split()) value = find_attr_value_('firmware', node) if value is not None and 'firmware' not in already_processed: already_processed.add('firmware') self.firmware = value self.firmware = ' '.join(self.firmware.split()) value = find_attr_value_('bootkernel', node) if value is not None and 'bootkernel' not in already_processed: already_processed.add('bootkernel') self.bootkernel = value value = find_attr_value_('bootpartition', node) if value is not None and 'bootpartition' not in already_processed: already_processed.add('bootpartition') if value in ('true', '1'): self.bootpartition = True elif value in ('false', '0'): self.bootpartition = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('bootpartsize', node) if value is not None and 'bootpartsize' not in already_processed: already_processed.add('bootpartsize') try: self.bootpartsize = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.bootpartsize < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('efipartsize', node) if value is not None and 'efipartsize' not in already_processed: already_processed.add('efipartsize') try: self.efipartsize = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.efipartsize < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('efimountoptions', node) if value is not None and 'efimountoptions' not in already_processed: already_processed.add('efimountoptions') self.efimountoptions = value value = find_attr_value_('efifatimagesize', node) if value is not None and 'efifatimagesize' not in already_processed: already_processed.add('efifatimagesize') try: self.efifatimagesize = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.efifatimagesize < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('eficsm', node) if value is not None and 'eficsm' not in already_processed: already_processed.add('eficsm') if value in ('true', '1'): self.eficsm = True elif value in ('false', '0'): self.eficsm = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('efiparttable', node) if value is not None and 'efiparttable' not in already_processed: already_processed.add('efiparttable') self.efiparttable = value self.efiparttable = ' '.join(self.efiparttable.split()) value = find_attr_value_('dosparttable_extended_layout', node) if ( value is not None and 'dosparttable_extended_layout' not in already_processed ): already_processed.add('dosparttable_extended_layout') if value in ('true', '1'): self.dosparttable_extended_layout = True elif value in ('false', '0'): self.dosparttable_extended_layout = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('bootprofile', node) if value is not None and 'bootprofile' not in already_processed: already_processed.add('bootprofile') self.bootprofile = value value = find_attr_value_('btrfs_quota_groups', node) if value is not None and 'btrfs_quota_groups' not in already_processed: already_processed.add('btrfs_quota_groups') if value in ('true', '1'): self.btrfs_quota_groups = True elif value in ('false', '0'): self.btrfs_quota_groups = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('btrfs_root_is_snapper_snapshot', node) if ( value is not None and 'btrfs_root_is_snapper_snapshot' not in already_processed ): already_processed.add('btrfs_root_is_snapper_snapshot') if value in ('true', '1'): self.btrfs_root_is_snapper_snapshot = True elif value in ('false', '0'): self.btrfs_root_is_snapper_snapshot = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('btrfs_root_is_subvolume', node) if ( value is not None and 'btrfs_root_is_subvolume' not in already_processed ): already_processed.add('btrfs_root_is_subvolume') if value in ('true', '1'): self.btrfs_root_is_subvolume = True elif value in ('false', '0'): self.btrfs_root_is_subvolume = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('btrfs_set_default_volume', node) if ( value is not None and 'btrfs_set_default_volume' not in already_processed ): already_processed.add('btrfs_set_default_volume') if value in ('true', '1'): self.btrfs_set_default_volume = True elif value in ('false', '0'): self.btrfs_set_default_volume = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('btrfs_root_is_readonly_snapshot', node) if ( value is not None and 'btrfs_root_is_readonly_snapshot' not in already_processed ): already_processed.add('btrfs_root_is_readonly_snapshot') if value in ('true', '1'): self.btrfs_root_is_readonly_snapshot = True elif value in ('false', '0'): self.btrfs_root_is_readonly_snapshot = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('compressed', node) if value is not None and 'compressed' not in already_processed: already_processed.add('compressed') if value in ('true', '1'): self.compressed = True elif value in ('false', '0'): self.compressed = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('devicepersistency', node) if value is not None and 'devicepersistency' not in already_processed: already_processed.add('devicepersistency') self.devicepersistency = value self.devicepersistency = ' '.join(self.devicepersistency.split()) value = find_attr_value_('editbootconfig', node) if value is not None and 'editbootconfig' not in already_processed: already_processed.add('editbootconfig') self.editbootconfig = value value = find_attr_value_('editbootinstall', node) if value is not None and 'editbootinstall' not in already_processed: already_processed.add('editbootinstall') self.editbootinstall = value value = find_attr_value_('filesystem', node) if value is not None and 'filesystem' not in already_processed: already_processed.add('filesystem') self.filesystem = value self.filesystem = ' '.join(self.filesystem.split()) value = find_attr_value_('flags', node) if value is not None and 'flags' not in already_processed: already_processed.add('flags') self.flags = value self.flags = ' '.join(self.flags.split()) value = find_attr_value_('enclave_format', node) if value is not None and 'enclave_format' not in already_processed: already_processed.add('enclave_format') self.enclave_format = value self.enclave_format = ' '.join(self.enclave_format.split()) value = find_attr_value_('format', node) if value is not None and 'format' not in already_processed: already_processed.add('format') self.format = value self.format = ' '.join(self.format.split()) value = find_attr_value_('formatoptions', node) if value is not None and 'formatoptions' not in already_processed: already_processed.add('formatoptions') self.formatoptions = value value = find_attr_value_('fsmountoptions', node) if value is not None and 'fsmountoptions' not in already_processed: already_processed.add('fsmountoptions') self.fsmountoptions = value value = find_attr_value_('fscreateoptions', node) if value is not None and 'fscreateoptions' not in already_processed: already_processed.add('fscreateoptions') self.fscreateoptions = value value = find_attr_value_('squashfscompression', node) if value is not None and 'squashfscompression' not in already_processed: already_processed.add('squashfscompression') self.squashfscompression = value self.squashfscompression = ' '.join( self.squashfscompression.split() ) value = find_attr_value_('erofscompression', node) if value is not None and 'erofscompression' not in already_processed: already_processed.add('erofscompression') self.erofscompression = value value = find_attr_value_('gcelicense', node) if value is not None and 'gcelicense' not in already_processed: already_processed.add('gcelicense') self.gcelicense = value value = find_attr_value_('hybridpersistent', node) if value is not None and 'hybridpersistent' not in already_processed: already_processed.add('hybridpersistent') if value in ('true', '1'): self.hybridpersistent = True elif value in ('false', '0'): self.hybridpersistent = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('hybridpersistent_filesystem', node) if ( value is not None and 'hybridpersistent_filesystem' not in already_processed ): already_processed.add('hybridpersistent_filesystem') self.hybridpersistent_filesystem = value self.hybridpersistent_filesystem = ' '.join( self.hybridpersistent_filesystem.split() ) value = find_attr_value_('gpt_hybrid_mbr', node) if value is not None and 'gpt_hybrid_mbr' not in already_processed: already_processed.add('gpt_hybrid_mbr') if value in ('true', '1'): self.gpt_hybrid_mbr = True elif value in ('false', '0'): self.gpt_hybrid_mbr = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('force_mbr', node) if value is not None and 'force_mbr' not in already_processed: already_processed.add('force_mbr') if value in ('true', '1'): self.force_mbr = True elif value in ('false', '0'): self.force_mbr = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('apply_dps_codes', node) if value is not None and 'apply_dps_codes' not in already_processed: already_processed.add('apply_dps_codes') if value in ('true', '1'): self.apply_dps_codes = True elif value in ('false', '0'): self.apply_dps_codes = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('initrd_system', node) if value is not None and 'initrd_system' not in already_processed: already_processed.add('initrd_system') self.initrd_system = value self.initrd_system = ' '.join(self.initrd_system.split()) value = find_attr_value_('image', node) if value is not None and 'image' not in already_processed: already_processed.add('image') self.image = value self.image = ' '.join(self.image.split()) value = find_attr_value_('metadata_path', node) if value is not None and 'metadata_path' not in already_processed: already_processed.add('metadata_path') self.metadata_path = value value = find_attr_value_('installboot', node) if value is not None and 'installboot' not in already_processed: already_processed.add('installboot') self.installboot = value self.installboot = ' '.join(self.installboot.split()) value = find_attr_value_('install_continue_on_timeout', node) if ( value is not None and 'install_continue_on_timeout' not in already_processed ): already_processed.add('install_continue_on_timeout') if value in ('true', '1'): self.install_continue_on_timeout = True elif value in ('false', '0'): self.install_continue_on_timeout = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('installprovidefailsafe', node) if ( value is not None and 'installprovidefailsafe' not in already_processed ): already_processed.add('installprovidefailsafe') if value in ('true', '1'): self.installprovidefailsafe = True elif value in ('false', '0'): self.installprovidefailsafe = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('installiso', node) if value is not None and 'installiso' not in already_processed: already_processed.add('installiso') if value in ('true', '1'): self.installiso = True elif value in ('false', '0'): self.installiso = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('installstick', node) if value is not None and 'installstick' not in already_processed: already_processed.add('installstick') if value in ('true', '1'): self.installstick = True elif value in ('false', '0'): self.installstick = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('installpxe', node) if value is not None and 'installpxe' not in already_processed: already_processed.add('installpxe') if value in ('true', '1'): self.installpxe = True elif value in ('false', '0'): self.installpxe = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('mediacheck', node) if value is not None and 'mediacheck' not in already_processed: already_processed.add('mediacheck') if value in ('true', '1'): self.mediacheck = True elif value in ('false', '0'): self.mediacheck = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('kernelcmdline', node) if value is not None and 'kernelcmdline' not in already_processed: already_processed.add('kernelcmdline') self.kernelcmdline = value value = find_attr_value_('luks', node) if value is not None and 'luks' not in already_processed: already_processed.add('luks') self.luks = value value = find_attr_value_('luks_version', node) if value is not None and 'luks_version' not in already_processed: already_processed.add('luks_version') self.luks_version = value self.luks_version = ' '.join(self.luks_version.split()) value = find_attr_value_('luksOS', node) if value is not None and 'luksOS' not in already_processed: already_processed.add('luksOS') self.luksOS = value self.luksOS = ' '.join(self.luksOS.split()) value = find_attr_value_('luks_randomize', node) if value is not None and 'luks_randomize' not in already_processed: already_processed.add('luks_randomize') if value in ('true', '1'): self.luks_randomize = True elif value in ('false', '0'): self.luks_randomize = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('luks_pbkdf', node) if value is not None and 'luks_pbkdf' not in already_processed: already_processed.add('luks_pbkdf') self.luks_pbkdf = value self.luks_pbkdf = ' '.join(self.luks_pbkdf.split()) value = find_attr_value_('mdraid', node) if value is not None and 'mdraid' not in already_processed: already_processed.add('mdraid') self.mdraid = value self.mdraid = ' '.join(self.mdraid.split()) value = find_attr_value_('overlayroot', node) if value is not None and 'overlayroot' not in already_processed: already_processed.add('overlayroot') if value in ('true', '1'): self.overlayroot = True elif value in ('false', '0'): self.overlayroot = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('overlayroot_write_partition', node) if ( value is not None and 'overlayroot_write_partition' not in already_processed ): already_processed.add('overlayroot_write_partition') if value in ('true', '1'): self.overlayroot_write_partition = True elif value in ('false', '0'): self.overlayroot_write_partition = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('overlayroot_readonly_filesystem', node) if ( value is not None and 'overlayroot_readonly_filesystem' not in already_processed ): already_processed.add('overlayroot_readonly_filesystem') self.overlayroot_readonly_filesystem = value self.overlayroot_readonly_filesystem = ' '.join( self.overlayroot_readonly_filesystem.split() ) value = find_attr_value_('overlayroot_readonly_partsize', node) if ( value is not None and 'overlayroot_readonly_partsize' not in already_processed ): already_processed.add('overlayroot_readonly_partsize') try: self.overlayroot_readonly_partsize = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.overlayroot_readonly_partsize < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('overlayroot_readonly_createoptions', node) if ( value is not None and 'overlayroot_readonly_createoptions' not in already_processed ): already_processed.add('overlayroot_readonly_createoptions') self.overlayroot_readonly_createoptions = value value = find_attr_value_('verity_blocks', node) if value is not None and 'verity_blocks' not in already_processed: already_processed.add('verity_blocks') self.verity_blocks = value self.verity_blocks = ' '.join(self.verity_blocks.split()) self.validate_blocks_type( self.verity_blocks ) # validate type blocks-type value = find_attr_value_('embed_verity_metadata', node) if ( value is not None and 'embed_verity_metadata' not in already_processed ): already_processed.add('embed_verity_metadata') if value in ('true', '1'): self.embed_verity_metadata = True elif value in ('false', '0'): self.embed_verity_metadata = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('standalone_integrity', node) if ( value is not None and 'standalone_integrity' not in already_processed ): already_processed.add('standalone_integrity') if value in ('true', '1'): self.standalone_integrity = True elif value in ('false', '0'): self.standalone_integrity = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('embed_integrity_metadata', node) if ( value is not None and 'embed_integrity_metadata' not in already_processed ): already_processed.add('embed_integrity_metadata') if value in ('true', '1'): self.embed_integrity_metadata = True elif value in ('false', '0'): self.embed_integrity_metadata = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('integrity_legacy_hmac', node) if ( value is not None and 'integrity_legacy_hmac' not in already_processed ): already_processed.add('integrity_legacy_hmac') if value in ('true', '1'): self.integrity_legacy_hmac = True elif value in ('false', '0'): self.integrity_legacy_hmac = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('integrity_metadata_key_description', node) if ( value is not None and 'integrity_metadata_key_description' not in already_processed ): already_processed.add('integrity_metadata_key_description') self.integrity_metadata_key_description = value value = find_attr_value_('integrity_keyfile', node) if value is not None and 'integrity_keyfile' not in already_processed: already_processed.add('integrity_keyfile') self.integrity_keyfile = value value = find_attr_value_('primary', node) if value is not None and 'primary' not in already_processed: already_processed.add('primary') if value in ('true', '1'): self.primary = True elif value in ('false', '0'): self.primary = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('ramonly', node) if value is not None and 'ramonly' not in already_processed: already_processed.add('ramonly') if value in ('true', '1'): self.ramonly = True elif value in ('false', '0'): self.ramonly = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('rootfs_label', node) if value is not None and 'rootfs_label' not in already_processed: already_processed.add('rootfs_label') self.rootfs_label = value value = find_attr_value_('spare_part', node) if value is not None and 'spare_part' not in already_processed: already_processed.add('spare_part') self.spare_part = value self.spare_part = ' '.join(self.spare_part.split()) self.validate_partition_size_type( self.spare_part ) # validate type partition-size-type value = find_attr_value_('spare_part_mountpoint', node) if ( value is not None and 'spare_part_mountpoint' not in already_processed ): already_processed.add('spare_part_mountpoint') self.spare_part_mountpoint = value value = find_attr_value_('spare_part_fs', node) if value is not None and 'spare_part_fs' not in already_processed: already_processed.add('spare_part_fs') self.spare_part_fs = value self.spare_part_fs = ' '.join(self.spare_part_fs.split()) value = find_attr_value_('spare_part_fs_attributes', node) if ( value is not None and 'spare_part_fs_attributes' not in already_processed ): already_processed.add('spare_part_fs_attributes') self.spare_part_fs_attributes = value self.spare_part_fs_attributes = ' '.join( self.spare_part_fs_attributes.split() ) self.validate_fs_attributes( self.spare_part_fs_attributes ) # validate type fs_attributes value = find_attr_value_('spare_part_is_last', node) if value is not None and 'spare_part_is_last' not in already_processed: already_processed.add('spare_part_is_last') if value in ('true', '1'): self.spare_part_is_last = True elif value in ('false', '0'): self.spare_part_is_last = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('target_blocksize', node) if value is not None and 'target_blocksize' not in already_processed: already_processed.add('target_blocksize') try: self.target_blocksize = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.target_blocksize < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('target_removable', node) if value is not None and 'target_removable' not in already_processed: already_processed.add('target_removable') if value in ('true', '1'): self.target_removable = True elif value in ('false', '0'): self.target_removable = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('selinux_policy', node) if value is not None and 'selinux_policy' not in already_processed: already_processed.add('selinux_policy') self.selinux_policy = value self.selinux_policy = ' '.join(self.selinux_policy.split()) value = find_attr_value_('vhdfixedtag', node) if value is not None and 'vhdfixedtag' not in already_processed: already_processed.add('vhdfixedtag') self.vhdfixedtag = value self.vhdfixedtag = ' '.join(self.vhdfixedtag.split()) self.validate_vhd_tag_type( self.vhdfixedtag ) # validate type vhd-tag-type value = find_attr_value_('volid', node) if value is not None and 'volid' not in already_processed: already_processed.add('volid') self.volid = value self.volid = ' '.join(self.volid.split()) self.validate_safe_posix_short_name( self.volid ) # validate type safe-posix-short-name value = find_attr_value_('application_id', node) if value is not None and 'application_id' not in already_processed: already_processed.add('application_id') self.application_id = value self.application_id = ' '.join(self.application_id.split()) self.validate_ecma_119_achar_128_text( self.application_id ) # validate type ecma-119-achar-128-text value = find_attr_value_('wwid_wait_timeout', node) if value is not None and 'wwid_wait_timeout' not in already_processed: already_processed.add('wwid_wait_timeout') try: self.wwid_wait_timeout = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.wwid_wait_timeout < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('derived_from', node) if value is not None and 'derived_from' not in already_processed: already_processed.add('derived_from') self.derived_from = value value = find_attr_value_('delta_root', node) if value is not None and 'delta_root' not in already_processed: already_processed.add('delta_root') if value in ('true', '1'): self.delta_root = True elif value in ('false', '0'): self.delta_root = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('provide_system_files', node) if ( value is not None and 'provide_system_files' not in already_processed ): already_processed.add('provide_system_files') if value in ('true', '1'): self.provide_system_files = True elif value in ('false', '0'): self.provide_system_files = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('require_system_files', node) if ( value is not None and 'require_system_files' not in already_processed ): already_processed.add('require_system_files') if value in ('true', '1'): self.require_system_files = True elif value in ('false', '0'): self.require_system_files = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('ensure_empty_tmpdirs', node) if ( value is not None and 'ensure_empty_tmpdirs' not in already_processed ): already_processed.add('ensure_empty_tmpdirs') if value in ('true', '1'): self.ensure_empty_tmpdirs = True elif value in ('false', '0'): self.ensure_empty_tmpdirs = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('xen_server', node) if value is not None and 'xen_server' not in already_processed: already_processed.add('xen_server') if value in ('true', '1'): self.xen_server = True elif value in ('false', '0'): self.xen_server = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('publisher', node) if value is not None and 'publisher' not in already_processed: already_processed.add('publisher') self.publisher = value self.publisher = ' '.join(self.publisher.split()) self.validate_ecma_119_achar_128_text( self.publisher ) # validate type ecma-119-achar-128-text value = find_attr_value_('disk_start_sector', node) if value is not None and 'disk_start_sector' not in already_processed: already_processed.add('disk_start_sector') try: self.disk_start_sector = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) value = find_attr_value_('root_clone', node) if value is not None and 'root_clone' not in already_processed: already_processed.add('root_clone') self.root_clone = value self.root_clone = ' '.join(self.root_clone.split()) self.validate_number_type( self.root_clone ) # validate type number-type value = find_attr_value_('boot_clone', node) if value is not None and 'boot_clone' not in already_processed: already_processed.add('boot_clone') self.boot_clone = value self.boot_clone = ' '.join(self.boot_clone.split()) self.validate_number_type( self.boot_clone ) # validate type number-type value = find_attr_value_('bundle_format', node) if value is not None and 'bundle_format' not in already_processed: already_processed.add('bundle_format') self.bundle_format = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'bootloader': obj_ = bootloader.factory() obj_.build(child_) self.bootloader.append(obj_) obj_.original_tagname_ = 'bootloader' elif nodeName_ == 'containerconfig': obj_ = containerconfig.factory() obj_.build(child_) self.containerconfig.append(obj_) obj_.original_tagname_ = 'containerconfig' elif nodeName_ == 'machine': obj_ = machine.factory() obj_.build(child_) self.machine.append(obj_) obj_.original_tagname_ = 'machine' elif nodeName_ == 'oemconfig': obj_ = oemconfig.factory() obj_.build(child_) self.oemconfig.append(obj_) obj_.original_tagname_ = 'oemconfig' elif nodeName_ == 'size': obj_ = size.factory() obj_.build(child_) self.size.append(obj_) obj_.original_tagname_ = 'size' elif nodeName_ == 'systemdisk': obj_ = systemdisk.factory() obj_.build(child_) self.systemdisk.append(obj_) obj_.original_tagname_ = 'systemdisk' elif nodeName_ == 'partitions': obj_ = partitions.factory() obj_.build(child_) self.partitions.append(obj_) obj_.original_tagname_ = 'partitions' elif nodeName_ == 'vagrantconfig': obj_ = vagrantconfig.factory() obj_.build(child_) self.vagrantconfig.append(obj_) obj_.original_tagname_ = 'vagrantconfig' elif nodeName_ == 'installmedia': obj_ = installmedia.factory() obj_.build(child_) self.installmedia.append(obj_) obj_.original_tagname_ = 'installmedia' elif nodeName_ == 'initrd': obj_ = initrd.factory() obj_.build(child_) self.initrd.append(obj_) obj_.original_tagname_ = 'initrd' elif nodeName_ == 'luksformat': obj_ = luksformat.factory() obj_.build(child_) self.luksformat.append(obj_) obj_.original_tagname_ = 'luksformat' # end class type_ class user(GeneratedsSuper): """A User with Name, Password, Path to Its Home And Shell""" subclass = None superclass = None def __init__( self, groups=None, home=None, id=None, name=None, password=None, pwdformat=None, realname=None, shell=None, ): self.original_tagname_ = None self.groups = _cast(None, groups) self.home = _cast(None, home) self.id = _cast(int, id) self.name = _cast(None, name) self.password = _cast(None, password) self.pwdformat = _cast(None, pwdformat) self.realname = _cast(None, realname) self.shell = _cast(None, shell) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, user) if subclass is not None: return subclass(*args_, **kwargs_) if user.subclass: return user.subclass(*args_, **kwargs_) else: return user(*args_, **kwargs_) factory = staticmethod(factory) def get_groups(self): return self.groups def set_groups(self, groups): self.groups = groups def get_home(self): return self.home def set_home(self, home): self.home = home def get_id(self): return self.id def set_id(self, id): self.id = id def get_name(self): return self.name def set_name(self, name): self.name = name def get_password(self): return self.password def set_password(self, password): self.password = password def get_pwdformat(self): return self.pwdformat def set_pwdformat(self, pwdformat): self.pwdformat = pwdformat def get_realname(self): return self.realname def set_realname(self, realname): self.realname = realname def get_shell(self): return self.shell def set_shell(self, shell): self.shell = shell def validate_groups_list(self, value): # Validate type groups-list, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_groups_list_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_groups_list_patterns_, ) ) validate_groups_list_patterns_ = [ ['^[a-zA-Z0-9_\\-\\.:]+(,[a-zA-Z0-9_\\-\\.:]+)*$'] ] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='user', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('user') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='user' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='user', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='user', ): if self.groups is not None and 'groups' not in already_processed: already_processed.add('groups') outfile.write(' groups=%s' % (quote_attrib(self.groups),)) if self.home is not None and 'home' not in already_processed: already_processed.add('home') outfile.write( ' home=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.home), input_name='home' ) ), ) ) if self.id is not None and 'id' not in already_processed: already_processed.add('id') outfile.write( ' id="%s"' % self.gds_format_integer(self.id, input_name='id') ) if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.password is not None and 'password' not in already_processed: already_processed.add('password') outfile.write( ' password=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.password), input_name='password' ) ), ) ) if self.pwdformat is not None and 'pwdformat' not in already_processed: already_processed.add('pwdformat') outfile.write( ' pwdformat=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.pwdformat), input_name='pwdformat' ) ), ) ) if self.realname is not None and 'realname' not in already_processed: already_processed.add('realname') outfile.write( ' realname=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.realname), input_name='realname' ) ), ) ) if self.shell is not None and 'shell' not in already_processed: already_processed.add('shell') outfile.write( ' shell=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.shell), input_name='shell' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='user', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('groups', node) if value is not None and 'groups' not in already_processed: already_processed.add('groups') self.groups = value self.groups = ' '.join(self.groups.split()) self.validate_groups_list(self.groups) # validate type groups-list value = find_attr_value_('home', node) if value is not None and 'home' not in already_processed: already_processed.add('home') self.home = value value = find_attr_value_('id', node) if value is not None and 'id' not in already_processed: already_processed.add('id') try: self.id = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.id < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('password', node) if value is not None and 'password' not in already_processed: already_processed.add('password') self.password = value value = find_attr_value_('pwdformat', node) if value is not None and 'pwdformat' not in already_processed: already_processed.add('pwdformat') self.pwdformat = value self.pwdformat = ' '.join(self.pwdformat.split()) value = find_attr_value_('realname', node) if value is not None and 'realname' not in already_processed: already_processed.add('realname') self.realname = value value = find_attr_value_('shell', node) if value is not None and 'shell' not in already_processed: already_processed.add('shell') self.shell = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class user class vmdisk(GeneratedsSuper): """The VM disk definition.""" subclass = None superclass = None def __init__( self, disktype=None, controller=None, id=None, device=None, diskmode=None, ): self.original_tagname_ = None self.disktype = _cast(None, disktype) self.controller = _cast(None, controller) self.id = _cast(int, id) self.device = _cast(None, device) self.diskmode = _cast(None, diskmode) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, vmdisk) if subclass is not None: return subclass(*args_, **kwargs_) if vmdisk.subclass: return vmdisk.subclass(*args_, **kwargs_) else: return vmdisk(*args_, **kwargs_) factory = staticmethod(factory) def get_disktype(self): return self.disktype def set_disktype(self, disktype): self.disktype = disktype def get_controller(self): return self.controller def set_controller(self, controller): self.controller = controller def get_id(self): return self.id def set_id(self, id): self.id = id def get_device(self): return self.device def set_device(self, device): self.device = device def get_diskmode(self): return self.diskmode def set_diskmode(self, diskmode): self.diskmode = diskmode def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='vmdisk', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('vmdisk') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='vmdisk' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='vmdisk', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='vmdisk', ): if self.disktype is not None and 'disktype' not in already_processed: already_processed.add('disktype') outfile.write( ' disktype=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.disktype), input_name='disktype' ) ), ) ) if ( self.controller is not None and 'controller' not in already_processed ): already_processed.add('controller') outfile.write( ' controller=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.controller), input_name='controller', ) ), ) ) if self.id is not None and 'id' not in already_processed: already_processed.add('id') outfile.write( ' id="%s"' % self.gds_format_integer(self.id, input_name='id') ) if self.device is not None and 'device' not in already_processed: already_processed.add('device') outfile.write( ' device=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.device), input_name='device' ) ), ) ) if self.diskmode is not None and 'diskmode' not in already_processed: already_processed.add('diskmode') outfile.write( ' diskmode=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.diskmode), input_name='diskmode' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='vmdisk', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('disktype', node) if value is not None and 'disktype' not in already_processed: already_processed.add('disktype') self.disktype = value value = find_attr_value_('controller', node) if value is not None and 'controller' not in already_processed: already_processed.add('controller') self.controller = value self.controller = ' '.join(self.controller.split()) value = find_attr_value_('id', node) if value is not None and 'id' not in already_processed: already_processed.add('id') try: self.id = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.id < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('device', node) if value is not None and 'device' not in already_processed: already_processed.add('device') self.device = value value = find_attr_value_('diskmode', node) if value is not None and 'diskmode' not in already_processed: already_processed.add('diskmode') self.diskmode = value self.diskmode = ' '.join(self.diskmode.split()) def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class vmdisk class vmdvd(GeneratedsSuper): """The VM CD/DVD drive definition. You can setup either a scsi CD or an ide CD drive""" subclass = None superclass = None def __init__(self, controller=None, id=None): self.original_tagname_ = None self.controller = _cast(None, controller) self.id = _cast(int, id) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, vmdvd) if subclass is not None: return subclass(*args_, **kwargs_) if vmdvd.subclass: return vmdvd.subclass(*args_, **kwargs_) else: return vmdvd(*args_, **kwargs_) factory = staticmethod(factory) def get_controller(self): return self.controller def set_controller(self, controller): self.controller = controller def get_id(self): return self.id def set_id(self, id): self.id = id def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='vmdvd', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('vmdvd') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='vmdvd' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='vmdvd', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='vmdvd', ): if ( self.controller is not None and 'controller' not in already_processed ): already_processed.add('controller') outfile.write( ' controller=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.controller), input_name='controller', ) ), ) ) if self.id is not None and 'id' not in already_processed: already_processed.add('id') outfile.write( ' id="%s"' % self.gds_format_integer(self.id, input_name='id') ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='vmdvd', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('controller', node) if value is not None and 'controller' not in already_processed: already_processed.add('controller') self.controller = value self.controller = ' '.join(self.controller.split()) value = find_attr_value_('id', node) if value is not None and 'id' not in already_processed: already_processed.add('id') try: self.id = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.id < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class vmdvd class vmnic(GeneratedsSuper): """The VM network interface definition""" subclass = None superclass = None def __init__(self, driver=None, interface=None, mode=None, mac=None): self.original_tagname_ = None self.driver = _cast(None, driver) self.interface = _cast(None, interface) self.mode = _cast(None, mode) self.mac = _cast(None, mac) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, vmnic) if subclass is not None: return subclass(*args_, **kwargs_) if vmnic.subclass: return vmnic.subclass(*args_, **kwargs_) else: return vmnic(*args_, **kwargs_) factory = staticmethod(factory) def get_driver(self): return self.driver def set_driver(self, driver): self.driver = driver def get_interface(self): return self.interface def set_interface(self, interface): self.interface = interface def get_mode(self): return self.mode def set_mode(self, mode): self.mode = mode def get_mac(self): return self.mac def set_mac(self, mac): self.mac = mac def validate_mac_address_type(self, value): # Validate type mac-address-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_mac_address_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_mac_address_type_patterns_, ) ) validate_mac_address_type_patterns_ = [ ['^([0-9a-fA-F]{2}:){5}[0-9a-fA-F]{2}$'] ] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='vmnic', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('vmnic') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='vmnic' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='vmnic', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='vmnic', ): if self.driver is not None and 'driver' not in already_processed: already_processed.add('driver') outfile.write( ' driver=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.driver), input_name='driver' ) ), ) ) if self.interface is not None and 'interface' not in already_processed: already_processed.add('interface') outfile.write( ' interface=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.interface), input_name='interface' ) ), ) ) if self.mode is not None and 'mode' not in already_processed: already_processed.add('mode') outfile.write( ' mode=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.mode), input_name='mode' ) ), ) ) if self.mac is not None and 'mac' not in already_processed: already_processed.add('mac') outfile.write(' mac=%s' % (quote_attrib(self.mac),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='vmnic', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('driver', node) if value is not None and 'driver' not in already_processed: already_processed.add('driver') self.driver = value value = find_attr_value_('interface', node) if value is not None and 'interface' not in already_processed: already_processed.add('interface') self.interface = value value = find_attr_value_('mode', node) if value is not None and 'mode' not in already_processed: already_processed.add('mode') self.mode = value value = find_attr_value_('mac', node) if value is not None and 'mac' not in already_processed: already_processed.add('mac') self.mac = value self.mac = ' '.join(self.mac.split()) self.validate_mac_address_type( self.mac ) # validate type mac-address-type def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class vmnic class partition(GeneratedsSuper): """Specify custom partition in the partition table""" subclass = None superclass = None def __init__( self, part_id=None, name=None, size=None, partition_name=None, partition_type=None, mountpoint=None, filesystem=None, label=None, clone=None, ): self.original_tagname_ = None self.part_id = _cast(None, part_id) self.name = _cast(None, name) self.size = _cast(None, size) self.partition_name = _cast(None, partition_name) self.partition_type = _cast(None, partition_type) self.mountpoint = _cast(None, mountpoint) self.filesystem = _cast(None, filesystem) self.label = _cast(None, label) self.clone = _cast(None, clone) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, partition) if subclass is not None: return subclass(*args_, **kwargs_) if partition.subclass: return partition.subclass(*args_, **kwargs_) else: return partition(*args_, **kwargs_) factory = staticmethod(factory) def get_part_id(self): return self.part_id def set_part_id(self, part_id): self.part_id = part_id def get_name(self): return self.name def set_name(self, name): self.name = name def get_size(self): return self.size def set_size(self, size): self.size = size def get_partition_name(self): return self.partition_name def set_partition_name(self, partition_name): self.partition_name = partition_name def get_partition_type(self): return self.partition_type def set_partition_type(self, partition_type): self.partition_type = partition_type def get_mountpoint(self): return self.mountpoint def set_mountpoint(self, mountpoint): self.mountpoint = mountpoint def get_filesystem(self): return self.filesystem def set_filesystem(self, filesystem): self.filesystem = filesystem def get_label(self): return self.label def set_label(self, label): self.label = label def get_clone(self): return self.clone def set_clone(self, clone): self.clone = clone def validate_number_type(self, value): # Validate type number-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_number_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_number_type_patterns_, ) ) validate_number_type_patterns_ = [['^\\d+$']] def validate_partition_size_type(self, value): # Validate type partition-size-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_partition_size_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_partition_size_type_patterns_, ) ) validate_partition_size_type_patterns_ = [['^(\\d+|\\d+M|\\d+G)$']] def validate_safe_posix_short_name(self, value): # Validate type safe-posix-short-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_safe_posix_short_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_safe_posix_short_name_patterns_, ) ) validate_safe_posix_short_name_patterns_ = [['^[a-zA-Z0-9_\\-\\.]{1,32}$']] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='partition', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('partition') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='partition', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='partition', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='partition', ): if self.part_id is not None and 'part_id' not in already_processed: already_processed.add('part_id') outfile.write(' part_id=%s' % (quote_attrib(self.part_id),)) if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.size is not None and 'size' not in already_processed: already_processed.add('size') outfile.write(' size=%s' % (quote_attrib(self.size),)) if ( self.partition_name is not None and 'partition_name' not in already_processed ): already_processed.add('partition_name') outfile.write( ' partition_name=%s' % (quote_attrib(self.partition_name),) ) if ( self.partition_type is not None and 'partition_type' not in already_processed ): already_processed.add('partition_type') outfile.write( ' partition_type=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.partition_type), input_name='partition_type', ) ), ) ) if ( self.mountpoint is not None and 'mountpoint' not in already_processed ): already_processed.add('mountpoint') outfile.write( ' mountpoint=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.mountpoint), input_name='mountpoint', ) ), ) ) if ( self.filesystem is not None and 'filesystem' not in already_processed ): already_processed.add('filesystem') outfile.write( ' filesystem=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.filesystem), input_name='filesystem', ) ), ) ) if self.label is not None and 'label' not in already_processed: already_processed.add('label') outfile.write( ' label=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.label), input_name='label' ) ), ) ) if self.clone is not None and 'clone' not in already_processed: already_processed.add('clone') outfile.write(' clone=%s' % (quote_attrib(self.clone),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='partition', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('part_id', node) if value is not None and 'part_id' not in already_processed: already_processed.add('part_id') self.part_id = value self.part_id = ' '.join(self.part_id.split()) self.validate_number_type(self.part_id) # validate type number-type value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('size', node) if value is not None and 'size' not in already_processed: already_processed.add('size') self.size = value self.size = ' '.join(self.size.split()) self.validate_partition_size_type( self.size ) # validate type partition-size-type value = find_attr_value_('partition_name', node) if value is not None and 'partition_name' not in already_processed: already_processed.add('partition_name') self.partition_name = value self.partition_name = ' '.join(self.partition_name.split()) self.validate_safe_posix_short_name( self.partition_name ) # validate type safe-posix-short-name value = find_attr_value_('partition_type', node) if value is not None and 'partition_type' not in already_processed: already_processed.add('partition_type') self.partition_type = value self.partition_type = ' '.join(self.partition_type.split()) value = find_attr_value_('mountpoint', node) if value is not None and 'mountpoint' not in already_processed: already_processed.add('mountpoint') self.mountpoint = value value = find_attr_value_('filesystem', node) if value is not None and 'filesystem' not in already_processed: already_processed.add('filesystem') self.filesystem = value self.filesystem = ' '.join(self.filesystem.split()) value = find_attr_value_('label', node) if value is not None and 'label' not in already_processed: already_processed.add('label') self.label = value value = find_attr_value_('clone', node) if value is not None and 'clone' not in already_processed: already_processed.add('clone') self.clone = value self.clone = ' '.join(self.clone.split()) self.validate_number_type(self.clone) # validate type number-type def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class partition class volume(GeneratedsSuper): """Specify which parts of the filesystem should be on an extra volume.""" subclass = None superclass = None def __init__( self, copy_on_write=None, quota=None, filesystem_check=None, freespace=None, mountpoint=None, label=None, name=None, parent=None, size=None, arch=None, ): self.original_tagname_ = None self.copy_on_write = _cast(bool, copy_on_write) self.quota = _cast(None, quota) self.filesystem_check = _cast(bool, filesystem_check) self.freespace = _cast(None, freespace) self.mountpoint = _cast(None, mountpoint) self.label = _cast(None, label) self.name = _cast(None, name) self.parent = _cast(None, parent) self.size = _cast(None, size) self.arch = _cast(None, arch) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, volume) if subclass is not None: return subclass(*args_, **kwargs_) if volume.subclass: return volume.subclass(*args_, **kwargs_) else: return volume(*args_, **kwargs_) factory = staticmethod(factory) def get_copy_on_write(self): return self.copy_on_write def set_copy_on_write(self, copy_on_write): self.copy_on_write = copy_on_write def get_quota(self): return self.quota def set_quota(self, quota): self.quota = quota def get_filesystem_check(self): return self.filesystem_check def set_filesystem_check(self, filesystem_check): self.filesystem_check = filesystem_check def get_freespace(self): return self.freespace def set_freespace(self, freespace): self.freespace = freespace def get_mountpoint(self): return self.mountpoint def set_mountpoint(self, mountpoint): self.mountpoint = mountpoint def get_label(self): return self.label def set_label(self, label): self.label = label def get_name(self): return self.name def set_name(self, name): self.name = name def get_parent(self): return self.parent def set_parent(self, parent): self.parent = parent def get_size(self): return self.size def set_size(self, size): self.size = size def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def validate_partition_size_type(self, value): # Validate type partition-size-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_partition_size_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_partition_size_type_patterns_, ) ) validate_partition_size_type_patterns_ = [['^(\\d+|\\d+M|\\d+G)$']] def validate_volume_size_type(self, value): # Validate type volume-size-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_volume_size_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_volume_size_type_patterns_, ) ) validate_volume_size_type_patterns_ = [['^(\\d+|\\d+M|\\d+G|all)$']] def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='volume', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('volume') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='volume' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='volume', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='volume', ): if ( self.copy_on_write is not None and 'copy_on_write' not in already_processed ): already_processed.add('copy_on_write') outfile.write( ' copy_on_write="%s"' % self.gds_format_boolean( self.copy_on_write, input_name='copy_on_write' ) ) if self.quota is not None and 'quota' not in already_processed: already_processed.add('quota') outfile.write(' quota=%s' % (quote_attrib(self.quota),)) if ( self.filesystem_check is not None and 'filesystem_check' not in already_processed ): already_processed.add('filesystem_check') outfile.write( ' filesystem_check="%s"' % self.gds_format_boolean( self.filesystem_check, input_name='filesystem_check' ) ) if self.freespace is not None and 'freespace' not in already_processed: already_processed.add('freespace') outfile.write(' freespace=%s' % (quote_attrib(self.freespace),)) if ( self.mountpoint is not None and 'mountpoint' not in already_processed ): already_processed.add('mountpoint') outfile.write( ' mountpoint=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.mountpoint), input_name='mountpoint', ) ), ) ) if self.label is not None and 'label' not in already_processed: already_processed.add('label') outfile.write( ' label=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.label), input_name='label' ) ), ) ) if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.parent is not None and 'parent' not in already_processed: already_processed.add('parent') outfile.write( ' parent=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.parent), input_name='parent' ) ), ) ) if self.size is not None and 'size' not in already_processed: already_processed.add('size') outfile.write(' size=%s' % (quote_attrib(self.size),)) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='volume', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('copy_on_write', node) if value is not None and 'copy_on_write' not in already_processed: already_processed.add('copy_on_write') if value in ('true', '1'): self.copy_on_write = True elif value in ('false', '0'): self.copy_on_write = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('quota', node) if value is not None and 'quota' not in already_processed: already_processed.add('quota') self.quota = value self.quota = ' '.join(self.quota.split()) self.validate_partition_size_type( self.quota ) # validate type partition-size-type value = find_attr_value_('filesystem_check', node) if value is not None and 'filesystem_check' not in already_processed: already_processed.add('filesystem_check') if value in ('true', '1'): self.filesystem_check = True elif value in ('false', '0'): self.filesystem_check = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('freespace', node) if value is not None and 'freespace' not in already_processed: already_processed.add('freespace') self.freespace = value self.freespace = ' '.join(self.freespace.split()) self.validate_volume_size_type( self.freespace ) # validate type volume-size-type value = find_attr_value_('mountpoint', node) if value is not None and 'mountpoint' not in already_processed: already_processed.add('mountpoint') self.mountpoint = value value = find_attr_value_('label', node) if value is not None and 'label' not in already_processed: already_processed.add('label') self.label = value value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('parent', node) if value is not None and 'parent' not in already_processed: already_processed.add('parent') self.parent = value value = find_attr_value_('size', node) if value is not None and 'size' not in already_processed: already_processed.add('size') self.size = value self.size = ' '.join(self.size.split()) self.validate_volume_size_type( self.size ) # validate type volume-size-type value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class volume class include(GeneratedsSuper): subclass = None superclass = None def __init__(self, from_=None): self.original_tagname_ = None self.from_ = _cast(None, from_) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, include) if subclass is not None: return subclass(*args_, **kwargs_) if include.subclass: return include.subclass(*args_, **kwargs_) else: return include(*args_, **kwargs_) factory = staticmethod(factory) def get_from(self): return self.from_ def set_from(self, from_): self.from_ = from_ def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='include', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('include') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='include' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='include', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='include', ): if self.from_ is not None and 'from_' not in already_processed: already_processed.add('from_') outfile.write( ' from=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.from_), input_name='from' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='include', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('from', node) if value is not None and 'from' not in already_processed: already_processed.add('from') self.from_ = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class include class description(GeneratedsSuper): """A Short Description""" subclass = None superclass = None def __init__( self, type_=None, author=None, contact=None, specification=None, license=None, ): self.original_tagname_ = None self.type_ = _cast(None, type_) if author is None: self.author = [] else: self.author = author if contact is None: self.contact = [] else: self.contact = contact if specification is None: self.specification = [] else: self.specification = specification if license is None: self.license = [] else: self.license = license def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, description ) if subclass is not None: return subclass(*args_, **kwargs_) if description.subclass: return description.subclass(*args_, **kwargs_) else: return description(*args_, **kwargs_) factory = staticmethod(factory) def get_author(self): return self.author def set_author(self, author): self.author = author def add_author(self, value): self.author.append(value) def insert_author_at(self, index, value): self.author.insert(index, value) def replace_author_at(self, index, value): self.author[index] = value def get_contact(self): return self.contact def set_contact(self, contact): self.contact = contact def add_contact(self, value): self.contact.append(value) def insert_contact_at(self, index, value): self.contact.insert(index, value) def replace_contact_at(self, index, value): self.contact[index] = value def get_specification(self): return self.specification def set_specification(self, specification): self.specification = specification def add_specification(self, value): self.specification.append(value) def insert_specification_at(self, index, value): self.specification.insert(index, value) def replace_specification_at(self, index, value): self.specification[index] = value def get_license(self): return self.license def set_license(self, license): self.license = license def add_license(self, value): self.license.append(value) def insert_license_at(self, index, value): self.license.insert(index, value) def replace_license_at(self, index, value): self.license[index] = value def get_type(self): return self.type_ def set_type(self, type_): self.type_ = type_ def hasContent_(self): if self.author or self.contact or self.specification or self.license: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='description', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('description') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='description', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='description', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='description', ): if self.type_ is not None and 'type_' not in already_processed: already_processed.add('type_') outfile.write( ' type=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.type_), input_name='type' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='description', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for author_ in self.author: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(author_), input_name='author' ) ), eol_, ) ) for contact_ in self.contact: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(contact_), input_name='contact' ) ), eol_, ) ) for specification_ in self.specification: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(specification_), input_name='specification', ) ), eol_, ) ) for license_ in self.license: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(license_), input_name='license' ) ), eol_, ) ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('type', node) if value is not None and 'type' not in already_processed: already_processed.add('type') self.type_ = value self.type_ = ' '.join(self.type_.split()) def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'author': author_ = child_.text author_ = self.gds_validate_string(author_, node, 'author') self.author.append(author_) elif nodeName_ == 'contact': contact_ = child_.text contact_ = self.gds_validate_string(contact_, node, 'contact') self.contact.append(contact_) elif nodeName_ == 'specification': specification_ = child_.text specification_ = self.gds_validate_string( specification_, node, 'specification' ) self.specification.append(specification_) elif nodeName_ == 'license': license_ = child_.text license_ = self.gds_validate_string(license_, node, 'license') self.license.append(license_) # end class description class drivers(GeneratedsSuper): """A Collection of Driver Files""" subclass = None superclass = None def __init__(self, profiles=None, file=None): self.original_tagname_ = None self.profiles = _cast(None, profiles) if file is None: self.file = [] else: self.file = file def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, drivers) if subclass is not None: return subclass(*args_, **kwargs_) if drivers.subclass: return drivers.subclass(*args_, **kwargs_) else: return drivers(*args_, **kwargs_) factory = staticmethod(factory) def get_file(self): return self.file def set_file(self, file): self.file = file def add_file(self, value): self.file.append(value) def insert_file_at(self, index, value): self.file.insert(index, value) def replace_file_at(self, index, value): self.file[index] = value def get_profiles(self): return self.profiles def set_profiles(self, profiles): self.profiles = profiles def hasContent_(self): if self.file: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='drivers', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('drivers') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='drivers' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='drivers', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='drivers', ): if self.profiles is not None and 'profiles' not in already_processed: already_processed.add('profiles') outfile.write( ' profiles=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.profiles), input_name='profiles' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='drivers', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for file_ in self.file: file_.export( outfile, level, namespaceprefix_, name_='file', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('profiles', node) if value is not None and 'profiles' not in already_processed: already_processed.add('profiles') self.profiles = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'file': obj_ = file.factory() obj_.build(child_) self.file.append(obj_) obj_.original_tagname_ = 'file' # end class drivers class strip(GeneratedsSuper): """A Collection of files to strip""" subclass = None superclass = None def __init__(self, type_=None, profiles=None, file=None): self.original_tagname_ = None self.type_ = _cast(None, type_) self.profiles = _cast(None, profiles) if file is None: self.file = [] else: self.file = file def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, strip) if subclass is not None: return subclass(*args_, **kwargs_) if strip.subclass: return strip.subclass(*args_, **kwargs_) else: return strip(*args_, **kwargs_) factory = staticmethod(factory) def get_file(self): return self.file def set_file(self, file): self.file = file def add_file(self, value): self.file.append(value) def insert_file_at(self, index, value): self.file.insert(index, value) def replace_file_at(self, index, value): self.file[index] = value def get_type(self): return self.type_ def set_type(self, type_): self.type_ = type_ def get_profiles(self): return self.profiles def set_profiles(self, profiles): self.profiles = profiles def hasContent_(self): if self.file: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='strip', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('strip') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='strip' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='strip', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='strip', ): if self.type_ is not None and 'type_' not in already_processed: already_processed.add('type_') outfile.write( ' type=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.type_), input_name='type' ) ), ) ) if self.profiles is not None and 'profiles' not in already_processed: already_processed.add('profiles') outfile.write( ' profiles=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.profiles), input_name='profiles' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='strip', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for file_ in self.file: file_.export( outfile, level, namespaceprefix_, name_='file', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('type', node) if value is not None and 'type' not in already_processed: already_processed.add('type') self.type_ = value self.type_ = ' '.join(self.type_.split()) value = find_attr_value_('profiles', node) if value is not None and 'profiles' not in already_processed: already_processed.add('profiles') self.profiles = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'file': obj_ = file.factory() obj_.build(child_) self.file.append(obj_) obj_.original_tagname_ = 'file' # end class strip class bootloader(GeneratedsSuper): """The bootloader section is used to select the bootloader and to provide configuration parameters for it""" subclass = None superclass = None def __init__( self, name=None, bls=None, output_console=None, input_console=None, serial_line=None, video_mode=None, timeout=None, timeout_style=None, targettype=None, use_disk_password=None, grub_template=None, kernel_flavor=None, bootloadersettings=None, securelinux=None, ): self.original_tagname_ = None self.name = _cast(None, name) self.bls = _cast(bool, bls) self.output_console = _cast(None, output_console) self.input_console = _cast(None, input_console) self.serial_line = _cast(None, serial_line) self.video_mode = _cast(None, video_mode) self.timeout = _cast(int, timeout) self.timeout_style = _cast(None, timeout_style) self.targettype = _cast(None, targettype) self.use_disk_password = _cast(bool, use_disk_password) self.grub_template = _cast(None, grub_template) self.kernel_flavor = _cast(None, kernel_flavor) if bootloadersettings is None: self.bootloadersettings = [] else: self.bootloadersettings = bootloadersettings if securelinux is None: self.securelinux = [] else: self.securelinux = securelinux def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, bootloader ) if subclass is not None: return subclass(*args_, **kwargs_) if bootloader.subclass: return bootloader.subclass(*args_, **kwargs_) else: return bootloader(*args_, **kwargs_) factory = staticmethod(factory) def get_bootloadersettings(self): return self.bootloadersettings def set_bootloadersettings(self, bootloadersettings): self.bootloadersettings = bootloadersettings def add_bootloadersettings(self, value): self.bootloadersettings.append(value) def insert_bootloadersettings_at(self, index, value): self.bootloadersettings.insert(index, value) def replace_bootloadersettings_at(self, index, value): self.bootloadersettings[index] = value def get_securelinux(self): return self.securelinux def set_securelinux(self, securelinux): self.securelinux = securelinux def add_securelinux(self, value): self.securelinux.append(value) def insert_securelinux_at(self, index, value): self.securelinux.insert(index, value) def replace_securelinux_at(self, index, value): self.securelinux[index] = value def get_name(self): return self.name def set_name(self, name): self.name = name def get_bls(self): return self.bls def set_bls(self, bls): self.bls = bls def get_output_console(self): return self.output_console def set_output_console(self, output_console): self.output_console = output_console def get_input_console(self): return self.input_console def set_input_console(self, input_console): self.input_console = input_console def get_serial_line(self): return self.serial_line def set_serial_line(self, serial_line): self.serial_line = serial_line def get_video_mode(self): return self.video_mode def set_video_mode(self, video_mode): self.video_mode = video_mode def get_timeout(self): return self.timeout def set_timeout(self, timeout): self.timeout = timeout def get_timeout_style(self): return self.timeout_style def set_timeout_style(self, timeout_style): self.timeout_style = timeout_style def get_targettype(self): return self.targettype def set_targettype(self, targettype): self.targettype = targettype def get_use_disk_password(self): return self.use_disk_password def set_use_disk_password(self, use_disk_password): self.use_disk_password = use_disk_password def get_grub_template(self): return self.grub_template def set_grub_template(self, grub_template): self.grub_template = grub_template def get_kernel_flavor(self): return self.kernel_flavor def set_kernel_flavor(self, kernel_flavor): self.kernel_flavor = kernel_flavor def validate_grub_console_output(self, value): # Validate type grub_console_output, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_grub_console_output_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_grub_console_output_patterns_, ) ) validate_grub_console_output_patterns_ = [ [ '^(none|console|gfxterm|serial|vga_text|mda_text|morse|spkmodem)( (console|gfxterm|serial|vga_text|mda_text|morse|spkmodem))*$' ] ] def validate_grub_console_input(self, value): # Validate type grub_console_input, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_grub_console_input_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_grub_console_input_patterns_, ) ) validate_grub_console_input_patterns_ = [ [ '^(none|console|serial|at_keyboard|usb_keyboard)( (console|serial|at_keyboard|usb_keyboard))*$' ] ] def validate_kernel_flavor_list(self, value): # Validate type kernel-flavor-list, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_kernel_flavor_list_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_kernel_flavor_list_patterns_, ) ) validate_kernel_flavor_list_patterns_ = [ ['^[a-zA-Z0-9_\\-\\.]+(,[a-zA-Z0-9_\\-\\.]+)*$'] ] def hasContent_(self): if self.bootloadersettings or self.securelinux: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='bootloader', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('bootloader') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='bootloader', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='bootloader', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='bootloader', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.bls is not None and 'bls' not in already_processed: already_processed.add('bls') outfile.write( ' bls="%s"' % self.gds_format_boolean(self.bls, input_name='bls') ) if ( self.output_console is not None and 'output_console' not in already_processed ): already_processed.add('output_console') outfile.write( ' output_console=%s' % (quote_attrib(self.output_console),) ) if ( self.input_console is not None and 'input_console' not in already_processed ): already_processed.add('input_console') outfile.write( ' input_console=%s' % (quote_attrib(self.input_console),) ) if ( self.serial_line is not None and 'serial_line' not in already_processed ): already_processed.add('serial_line') outfile.write( ' serial_line=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.serial_line), input_name='serial_line', ) ), ) ) if ( self.video_mode is not None and 'video_mode' not in already_processed ): already_processed.add('video_mode') outfile.write( ' video_mode=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.video_mode), input_name='video_mode', ) ), ) ) if self.timeout is not None and 'timeout' not in already_processed: already_processed.add('timeout') outfile.write( ' timeout="%s"' % self.gds_format_integer(self.timeout, input_name='timeout') ) if ( self.timeout_style is not None and 'timeout_style' not in already_processed ): already_processed.add('timeout_style') outfile.write( ' timeout_style=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.timeout_style), input_name='timeout_style', ) ), ) ) if ( self.targettype is not None and 'targettype' not in already_processed ): already_processed.add('targettype') outfile.write( ' targettype=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.targettype), input_name='targettype', ) ), ) ) if ( self.use_disk_password is not None and 'use_disk_password' not in already_processed ): already_processed.add('use_disk_password') outfile.write( ' use_disk_password="%s"' % self.gds_format_boolean( self.use_disk_password, input_name='use_disk_password' ) ) if ( self.grub_template is not None and 'grub_template' not in already_processed ): already_processed.add('grub_template') outfile.write( ' grub_template=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.grub_template), input_name='grub_template', ) ), ) ) if ( self.kernel_flavor is not None and 'kernel_flavor' not in already_processed ): already_processed.add('kernel_flavor') outfile.write( ' kernel_flavor=%s' % (quote_attrib(self.kernel_flavor),) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='bootloader', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for bootloadersettings_ in self.bootloadersettings: bootloadersettings_.export( outfile, level, namespaceprefix_, name_='bootloadersettings', pretty_print=pretty_print, ) for securelinux_ in self.securelinux: securelinux_.export( outfile, level, namespaceprefix_, name_='securelinux', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value self.name = ' '.join(self.name.split()) value = find_attr_value_('bls', node) if value is not None and 'bls' not in already_processed: already_processed.add('bls') if value in ('true', '1'): self.bls = True elif value in ('false', '0'): self.bls = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('output_console', node) if value is not None and 'output_console' not in already_processed: already_processed.add('output_console') self.output_console = value self.output_console = ' '.join(self.output_console.split()) self.validate_grub_console_output( self.output_console ) # validate type grub_console_output value = find_attr_value_('input_console', node) if value is not None and 'input_console' not in already_processed: already_processed.add('input_console') self.input_console = value self.input_console = ' '.join(self.input_console.split()) self.validate_grub_console_input( self.input_console ) # validate type grub_console_input value = find_attr_value_('serial_line', node) if value is not None and 'serial_line' not in already_processed: already_processed.add('serial_line') self.serial_line = value value = find_attr_value_('video_mode', node) if value is not None and 'video_mode' not in already_processed: already_processed.add('video_mode') self.video_mode = value value = find_attr_value_('timeout', node) if value is not None and 'timeout' not in already_processed: already_processed.add('timeout') try: self.timeout = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.timeout < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('timeout_style', node) if value is not None and 'timeout_style' not in already_processed: already_processed.add('timeout_style') self.timeout_style = value self.timeout_style = ' '.join(self.timeout_style.split()) value = find_attr_value_('targettype', node) if value is not None and 'targettype' not in already_processed: already_processed.add('targettype') self.targettype = value self.targettype = ' '.join(self.targettype.split()) value = find_attr_value_('use_disk_password', node) if value is not None and 'use_disk_password' not in already_processed: already_processed.add('use_disk_password') if value in ('true', '1'): self.use_disk_password = True elif value in ('false', '0'): self.use_disk_password = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('grub_template', node) if value is not None and 'grub_template' not in already_processed: already_processed.add('grub_template') self.grub_template = value value = find_attr_value_('kernel_flavor', node) if value is not None and 'kernel_flavor' not in already_processed: already_processed.add('kernel_flavor') self.kernel_flavor = value self.kernel_flavor = ' '.join(self.kernel_flavor.split()) self.validate_kernel_flavor_list( self.kernel_flavor ) # validate type kernel-flavor-list def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'bootloadersettings': obj_ = bootloadersettings.factory() obj_.build(child_) self.bootloadersettings.append(obj_) obj_.original_tagname_ = 'bootloadersettings' elif nodeName_ == 'securelinux': obj_ = securelinux.factory() obj_.build(child_) self.securelinux.append(obj_) obj_.original_tagname_ = 'securelinux' # end class bootloader class containerconfig(GeneratedsSuper): """The containerconfig element provides metadata information to setup a container in order to be prepared for use with the container engine tool chain. container specific data should be provided in an additional subsection whereas this section provides globally useful container information.""" subclass = None superclass = None def __init__( self, name=None, tag=None, additionalnames=None, maintainer=None, user=None, workingdir=None, entrypoint=None, subcommand=None, expose=None, volumes=None, stopsignal=None, environment=None, labels=None, history=None, ): self.original_tagname_ = None self.name = _cast(None, name) self.tag = _cast(None, tag) self.additionalnames = _cast(None, additionalnames) self.maintainer = _cast(None, maintainer) self.user = _cast(None, user) self.workingdir = _cast(None, workingdir) if entrypoint is None: self.entrypoint = [] else: self.entrypoint = entrypoint if subcommand is None: self.subcommand = [] else: self.subcommand = subcommand if expose is None: self.expose = [] else: self.expose = expose if volumes is None: self.volumes = [] else: self.volumes = volumes if stopsignal is None: self.stopsignal = [] else: self.stopsignal = stopsignal if environment is None: self.environment = [] else: self.environment = environment if labels is None: self.labels = [] else: self.labels = labels if history is None: self.history = [] else: self.history = history def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, containerconfig ) if subclass is not None: return subclass(*args_, **kwargs_) if containerconfig.subclass: return containerconfig.subclass(*args_, **kwargs_) else: return containerconfig(*args_, **kwargs_) factory = staticmethod(factory) def get_entrypoint(self): return self.entrypoint def set_entrypoint(self, entrypoint): self.entrypoint = entrypoint def add_entrypoint(self, value): self.entrypoint.append(value) def insert_entrypoint_at(self, index, value): self.entrypoint.insert(index, value) def replace_entrypoint_at(self, index, value): self.entrypoint[index] = value def get_subcommand(self): return self.subcommand def set_subcommand(self, subcommand): self.subcommand = subcommand def add_subcommand(self, value): self.subcommand.append(value) def insert_subcommand_at(self, index, value): self.subcommand.insert(index, value) def replace_subcommand_at(self, index, value): self.subcommand[index] = value def get_expose(self): return self.expose def set_expose(self, expose): self.expose = expose def add_expose(self, value): self.expose.append(value) def insert_expose_at(self, index, value): self.expose.insert(index, value) def replace_expose_at(self, index, value): self.expose[index] = value def get_volumes(self): return self.volumes def set_volumes(self, volumes): self.volumes = volumes def add_volumes(self, value): self.volumes.append(value) def insert_volumes_at(self, index, value): self.volumes.insert(index, value) def replace_volumes_at(self, index, value): self.volumes[index] = value def get_stopsignal(self): return self.stopsignal def set_stopsignal(self, stopsignal): self.stopsignal = stopsignal def add_stopsignal(self, value): self.stopsignal.append(value) def insert_stopsignal_at(self, index, value): self.stopsignal.insert(index, value) def replace_stopsignal_at(self, index, value): self.stopsignal[index] = value def get_environment(self): return self.environment def set_environment(self, environment): self.environment = environment def add_environment(self, value): self.environment.append(value) def insert_environment_at(self, index, value): self.environment.insert(index, value) def replace_environment_at(self, index, value): self.environment[index] = value def get_labels(self): return self.labels def set_labels(self, labels): self.labels = labels def add_labels(self, value): self.labels.append(value) def insert_labels_at(self, index, value): self.labels.insert(index, value) def replace_labels_at(self, index, value): self.labels[index] = value def get_history(self): return self.history def set_history(self, history): self.history = history def add_history(self, value): self.history.append(value) def insert_history_at(self, index, value): self.history.insert(index, value) def replace_history_at(self, index, value): self.history[index] = value def get_name(self): return self.name def set_name(self, name): self.name = name def get_tag(self): return self.tag def set_tag(self, tag): self.tag = tag def get_additionalnames(self): return self.additionalnames def set_additionalnames(self, additionalnames): self.additionalnames = additionalnames def get_maintainer(self): return self.maintainer def set_maintainer(self, maintainer): self.maintainer = maintainer def get_user(self): return self.user def set_user(self, user): self.user = user def get_workingdir(self): return self.workingdir def set_workingdir(self, workingdir): self.workingdir = workingdir def hasContent_(self): if ( self.entrypoint or self.subcommand or self.expose or self.volumes or self.stopsignal or self.environment or self.labels or self.history ): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='containerconfig', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('containerconfig') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='containerconfig', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='containerconfig', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='containerconfig', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.tag is not None and 'tag' not in already_processed: already_processed.add('tag') outfile.write( ' tag=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.tag), input_name='tag' ) ), ) ) if ( self.additionalnames is not None and 'additionalnames' not in already_processed ): already_processed.add('additionalnames') outfile.write( ' additionalnames=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.additionalnames), input_name='additionalnames', ) ), ) ) if ( self.maintainer is not None and 'maintainer' not in already_processed ): already_processed.add('maintainer') outfile.write( ' maintainer=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.maintainer), input_name='maintainer', ) ), ) ) if self.user is not None and 'user' not in already_processed: already_processed.add('user') outfile.write( ' user=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.user), input_name='user' ) ), ) ) if ( self.workingdir is not None and 'workingdir' not in already_processed ): already_processed.add('workingdir') outfile.write( ' workingdir=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.workingdir), input_name='workingdir', ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='containerconfig', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for entrypoint_ in self.entrypoint: entrypoint_.export( outfile, level, namespaceprefix_, name_='entrypoint', pretty_print=pretty_print, ) for subcommand_ in self.subcommand: subcommand_.export( outfile, level, namespaceprefix_, name_='subcommand', pretty_print=pretty_print, ) for expose_ in self.expose: expose_.export( outfile, level, namespaceprefix_, name_='expose', pretty_print=pretty_print, ) for volumes_ in self.volumes: volumes_.export( outfile, level, namespaceprefix_, name_='volumes', pretty_print=pretty_print, ) for stopsignal_ in self.stopsignal: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(stopsignal_), input_name='stopsignal' ) ), eol_, ) ) for environment_ in self.environment: environment_.export( outfile, level, namespaceprefix_, name_='environment', pretty_print=pretty_print, ) for labels_ in self.labels: labels_.export( outfile, level, namespaceprefix_, name_='labels', pretty_print=pretty_print, ) for history_ in self.history: history_.export( outfile, level, namespaceprefix_, name_='history', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('tag', node) if value is not None and 'tag' not in already_processed: already_processed.add('tag') self.tag = value value = find_attr_value_('additionalnames', node) if value is not None and 'additionalnames' not in already_processed: already_processed.add('additionalnames') self.additionalnames = value value = find_attr_value_('maintainer', node) if value is not None and 'maintainer' not in already_processed: already_processed.add('maintainer') self.maintainer = value value = find_attr_value_('user', node) if value is not None and 'user' not in already_processed: already_processed.add('user') self.user = value value = find_attr_value_('workingdir', node) if value is not None and 'workingdir' not in already_processed: already_processed.add('workingdir') self.workingdir = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'entrypoint': obj_ = entrypoint.factory() obj_.build(child_) self.entrypoint.append(obj_) obj_.original_tagname_ = 'entrypoint' elif nodeName_ == 'subcommand': obj_ = subcommand.factory() obj_.build(child_) self.subcommand.append(obj_) obj_.original_tagname_ = 'subcommand' elif nodeName_ == 'expose': obj_ = expose.factory() obj_.build(child_) self.expose.append(obj_) obj_.original_tagname_ = 'expose' elif nodeName_ == 'volumes': obj_ = volumes.factory() obj_.build(child_) self.volumes.append(obj_) obj_.original_tagname_ = 'volumes' elif nodeName_ == 'stopsignal': stopsignal_ = child_.text stopsignal_ = self.gds_validate_string( stopsignal_, node, 'stopsignal' ) self.stopsignal.append(stopsignal_) elif nodeName_ == 'environment': obj_ = environment.factory() obj_.build(child_) self.environment.append(obj_) obj_.original_tagname_ = 'environment' elif nodeName_ == 'labels': obj_ = labels.factory() obj_.build(child_) self.labels.append(obj_) obj_.original_tagname_ = 'labels' elif nodeName_ == 'history': obj_ = history.factory() obj_.build(child_) self.history.append(obj_) obj_.original_tagname_ = 'history' # end class containerconfig class entrypoint(GeneratedsSuper): """Provides details for the entry point command. This includes the execution name and its parameters. Arguments can be optionally specified""" subclass = None superclass = None def __init__(self, execute=None, clear=None, argument=None): self.original_tagname_ = None self.execute = _cast(None, execute) self.clear = _cast(bool, clear) if argument is None: self.argument = [] else: self.argument = argument def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, entrypoint ) if subclass is not None: return subclass(*args_, **kwargs_) if entrypoint.subclass: return entrypoint.subclass(*args_, **kwargs_) else: return entrypoint(*args_, **kwargs_) factory = staticmethod(factory) def get_argument(self): return self.argument def set_argument(self, argument): self.argument = argument def add_argument(self, value): self.argument.append(value) def insert_argument_at(self, index, value): self.argument.insert(index, value) def replace_argument_at(self, index, value): self.argument[index] = value def get_execute(self): return self.execute def set_execute(self, execute): self.execute = execute def get_clear(self): return self.clear def set_clear(self, clear): self.clear = clear def hasContent_(self): if self.argument: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='entrypoint', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('entrypoint') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='entrypoint', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='entrypoint', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='entrypoint', ): if self.execute is not None and 'execute' not in already_processed: already_processed.add('execute') outfile.write( ' execute=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.execute), input_name='execute' ) ), ) ) if self.clear is not None and 'clear' not in already_processed: already_processed.add('clear') outfile.write( ' clear="%s"' % self.gds_format_boolean(self.clear, input_name='clear') ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='entrypoint', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for argument_ in self.argument: argument_.export( outfile, level, namespaceprefix_, name_='argument', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('execute', node) if value is not None and 'execute' not in already_processed: already_processed.add('execute') self.execute = value value = find_attr_value_('clear', node) if value is not None and 'clear' not in already_processed: already_processed.add('clear') if value in ('true', '1'): self.clear = True elif value in ('false', '0'): self.clear = False else: raise_parse_error(node, 'Bad boolean attribute') def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'argument': obj_ = argument.factory() obj_.build(child_) self.argument.append(obj_) obj_.original_tagname_ = 'argument' # end class entrypoint class subcommand(GeneratedsSuper): """Provides details for the subcommand command. This includes the execution name and its parameters. Arguments can be optionally specified. The subcommand is appended the command information from the entrypoint. It is in the responsibility of the author to make sure the combination of entrypoint and subcommand forms a valid execution command""" subclass = None superclass = None def __init__(self, execute=None, clear=None, argument=None): self.original_tagname_ = None self.execute = _cast(None, execute) self.clear = _cast(bool, clear) if argument is None: self.argument = [] else: self.argument = argument def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, subcommand ) if subclass is not None: return subclass(*args_, **kwargs_) if subcommand.subclass: return subcommand.subclass(*args_, **kwargs_) else: return subcommand(*args_, **kwargs_) factory = staticmethod(factory) def get_argument(self): return self.argument def set_argument(self, argument): self.argument = argument def add_argument(self, value): self.argument.append(value) def insert_argument_at(self, index, value): self.argument.insert(index, value) def replace_argument_at(self, index, value): self.argument[index] = value def get_execute(self): return self.execute def set_execute(self, execute): self.execute = execute def get_clear(self): return self.clear def set_clear(self, clear): self.clear = clear def hasContent_(self): if self.argument: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='subcommand', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('subcommand') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='subcommand', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='subcommand', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='subcommand', ): if self.execute is not None and 'execute' not in already_processed: already_processed.add('execute') outfile.write( ' execute=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.execute), input_name='execute' ) ), ) ) if self.clear is not None and 'clear' not in already_processed: already_processed.add('clear') outfile.write( ' clear="%s"' % self.gds_format_boolean(self.clear, input_name='clear') ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='subcommand', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for argument_ in self.argument: argument_.export( outfile, level, namespaceprefix_, name_='argument', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('execute', node) if value is not None and 'execute' not in already_processed: already_processed.add('execute') self.execute = value value = find_attr_value_('clear', node) if value is not None and 'clear' not in already_processed: already_processed.add('clear') if value in ('true', '1'): self.clear = True elif value in ('false', '0'): self.clear = False else: raise_parse_error(node, 'Bad boolean attribute') def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'argument': obj_ = argument.factory() obj_.build(child_) self.argument.append(obj_) obj_.original_tagname_ = 'argument' # end class subcommand class argument(GeneratedsSuper): """Provides details about a command argument""" subclass = None superclass = None def __init__(self, name=None): self.original_tagname_ = None self.name = _cast(None, name) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, argument) if subclass is not None: return subclass(*args_, **kwargs_) if argument.subclass: return argument.subclass(*args_, **kwargs_) else: return argument(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='argument', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('argument') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='argument', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='argument', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='argument', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='argument', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class argument class expose(GeneratedsSuper): """Provides details about network ports which should be exposed from the container. At least one port must be configured""" subclass = None superclass = None def __init__(self, port=None): self.original_tagname_ = None if port is None: self.port = [] else: self.port = port def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, expose) if subclass is not None: return subclass(*args_, **kwargs_) if expose.subclass: return expose.subclass(*args_, **kwargs_) else: return expose(*args_, **kwargs_) factory = staticmethod(factory) def get_port(self): return self.port def set_port(self, port): self.port = port def add_port(self, value): self.port.append(value) def insert_port_at(self, index, value): self.port.insert(index, value) def replace_port_at(self, index, value): self.port[index] = value def hasContent_(self): if self.port: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='expose', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('expose') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='expose' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='expose', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='expose', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='expose', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for port_ in self.port: port_.export( outfile, level, namespaceprefix_, name_='port', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'port': obj_ = port.factory() obj_.build(child_) self.port.append(obj_) obj_.original_tagname_ = 'port' # end class expose class port(GeneratedsSuper): """Provides details about an exposed port.""" subclass = None superclass = None def __init__(self, number=None): self.original_tagname_ = None self.number = _cast(None, number) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, port) if subclass is not None: return subclass(*args_, **kwargs_) if port.subclass: return port.subclass(*args_, **kwargs_) else: return port(*args_, **kwargs_) factory = staticmethod(factory) def get_number(self): return self.number def set_number(self, number): self.number = number def validate_portnum_type(self, value): # Validate type portnum-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_portnum_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_portnum_type_patterns_, ) ) validate_portnum_type_patterns_ = [['^(\\d+|\\d+/(udp|tcp))$']] def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='port', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('port') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='port' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='port', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='port', ): if self.number is not None and 'number' not in already_processed: already_processed.add('number') outfile.write(' number=%s' % (quote_attrib(self.number),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='port', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('number', node) if value is not None and 'number' not in already_processed: already_processed.add('number') self.number = value self.number = ' '.join(self.number.split()) self.validate_portnum_type( self.number ) # validate type portnum-type def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class port class volumes(GeneratedsSuper): """Provides details about storage volumes in the container At least one volume must be configured""" subclass = None superclass = None def __init__(self, volume=None): self.original_tagname_ = None if volume is None: self.volume = [] else: self.volume = volume def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, volumes) if subclass is not None: return subclass(*args_, **kwargs_) if volumes.subclass: return volumes.subclass(*args_, **kwargs_) else: return volumes(*args_, **kwargs_) factory = staticmethod(factory) def get_volume(self): return self.volume def set_volume(self, volume): self.volume = volume def add_volume(self, value): self.volume.append(value) def insert_volume_at(self, index, value): self.volume.insert(index, value) def replace_volume_at(self, index, value): self.volume[index] = value def hasContent_(self): if self.volume: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='volumes', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('volumes') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='volumes' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='volumes', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='volumes', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='volumes', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for volume_ in self.volume: volume_.export( outfile, level, namespaceprefix_, name_='volume', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'volume': obj_ = volume.factory() obj_.build(child_) self.volume.append(obj_) obj_.original_tagname_ = 'volume' # end class volumes class partitions(GeneratedsSuper): """Partition table entries within the custom area of the storage device""" subclass = None superclass = None def __init__(self, partition=None): self.original_tagname_ = None if partition is None: self.partition = [] else: self.partition = partition def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, partitions ) if subclass is not None: return subclass(*args_, **kwargs_) if partitions.subclass: return partitions.subclass(*args_, **kwargs_) else: return partitions(*args_, **kwargs_) factory = staticmethod(factory) def get_partition(self): return self.partition def set_partition(self, partition): self.partition = partition def add_partition(self, value): self.partition.append(value) def insert_partition_at(self, index, value): self.partition.insert(index, value) def replace_partition_at(self, index, value): self.partition[index] = value def hasContent_(self): if self.partition: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='partitions', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('partitions') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='partitions', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='partitions', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='partitions', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='partitions', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for partition_ in self.partition: partition_.export( outfile, level, namespaceprefix_, name_='partition', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'partition': obj_ = partition.factory() obj_.build(child_) self.partition.append(obj_) obj_.original_tagname_ = 'partition' # end class partitions class luksformat(GeneratedsSuper): """luksFormat option settings""" subclass = None superclass = None def __init__(self, option=None): self.original_tagname_ = None if option is None: self.option = [] else: self.option = option def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, luksformat ) if subclass is not None: return subclass(*args_, **kwargs_) if luksformat.subclass: return luksformat.subclass(*args_, **kwargs_) else: return luksformat(*args_, **kwargs_) factory = staticmethod(factory) def get_option(self): return self.option def set_option(self, option): self.option = option def add_option(self, value): self.option.append(value) def insert_option_at(self, index, value): self.option.insert(index, value) def replace_option_at(self, index, value): self.option[index] = value def hasContent_(self): if self.option: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='luksformat', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('luksformat') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='luksformat', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='luksformat', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='luksformat', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='luksformat', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for option_ in self.option: option_.export( outfile, level, namespaceprefix_, name_='option', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'option': obj_ = option.factory() obj_.build(child_) self.option.append(obj_) obj_.original_tagname_ = 'option' # end class luksformat class bootloadersettings(GeneratedsSuper): """Additional bootloader settings""" subclass = None superclass = None def __init__( self, shimoption=None, installoption=None, environment=None, configoption=None, ): self.original_tagname_ = None if shimoption is None: self.shimoption = [] else: self.shimoption = shimoption if installoption is None: self.installoption = [] else: self.installoption = installoption if environment is None: self.environment = [] else: self.environment = environment if configoption is None: self.configoption = [] else: self.configoption = configoption def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, bootloadersettings ) if subclass is not None: return subclass(*args_, **kwargs_) if bootloadersettings.subclass: return bootloadersettings.subclass(*args_, **kwargs_) else: return bootloadersettings(*args_, **kwargs_) factory = staticmethod(factory) def get_shimoption(self): return self.shimoption def set_shimoption(self, shimoption): self.shimoption = shimoption def add_shimoption(self, value): self.shimoption.append(value) def insert_shimoption_at(self, index, value): self.shimoption.insert(index, value) def replace_shimoption_at(self, index, value): self.shimoption[index] = value def get_installoption(self): return self.installoption def set_installoption(self, installoption): self.installoption = installoption def add_installoption(self, value): self.installoption.append(value) def insert_installoption_at(self, index, value): self.installoption.insert(index, value) def replace_installoption_at(self, index, value): self.installoption[index] = value def get_environment(self): return self.environment def set_environment(self, environment): self.environment = environment def add_environment(self, value): self.environment.append(value) def insert_environment_at(self, index, value): self.environment.insert(index, value) def replace_environment_at(self, index, value): self.environment[index] = value def get_configoption(self): return self.configoption def set_configoption(self, configoption): self.configoption = configoption def add_configoption(self, value): self.configoption.append(value) def insert_configoption_at(self, index, value): self.configoption.insert(index, value) def replace_configoption_at(self, index, value): self.configoption[index] = value def hasContent_(self): if ( self.shimoption or self.installoption or self.environment or self.configoption ): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='bootloadersettings', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('bootloadersettings') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='bootloadersettings', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='bootloadersettings', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='bootloadersettings', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='bootloadersettings', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for shimoption_ in self.shimoption: shimoption_.export( outfile, level, namespaceprefix_, name_='shimoption', pretty_print=pretty_print, ) for installoption_ in self.installoption: installoption_.export( outfile, level, namespaceprefix_, name_='installoption', pretty_print=pretty_print, ) for environment_ in self.environment: environment_.export( outfile, level, namespaceprefix_, name_='environment', pretty_print=pretty_print, ) for configoption_ in self.configoption: configoption_.export( outfile, level, namespaceprefix_, name_='configoption', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'shimoption': obj_ = shimoption.factory() obj_.build(child_) self.shimoption.append(obj_) obj_.original_tagname_ = 'shimoption' elif nodeName_ == 'installoption': obj_ = installoption.factory() obj_.build(child_) self.installoption.append(obj_) obj_.original_tagname_ = 'installoption' elif nodeName_ == 'environment': obj_ = environment.factory() obj_.build(child_) self.environment.append(obj_) obj_.original_tagname_ = 'environment' elif nodeName_ == 'configoption': obj_ = configoption.factory() obj_.build(child_) self.configoption.append(obj_) obj_.original_tagname_ = 'configoption' # end class bootloadersettings class securelinux(GeneratedsSuper): """securelinux contains all elements to describe data required to setup a secure linux execution process for the individual architecture in the scope of the bootloader process""" subclass = None superclass = None def __init__( self, hkd_ca_cert=None, hkd_sign_cert=None, hkd_cert=None, hkd_revocation_list=None, ): self.original_tagname_ = None self.hkd_ca_cert = _cast(None, hkd_ca_cert) self.hkd_sign_cert = _cast(None, hkd_sign_cert) if hkd_cert is None: self.hkd_cert = [] else: self.hkd_cert = hkd_cert if hkd_revocation_list is None: self.hkd_revocation_list = [] else: self.hkd_revocation_list = hkd_revocation_list def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, securelinux ) if subclass is not None: return subclass(*args_, **kwargs_) if securelinux.subclass: return securelinux.subclass(*args_, **kwargs_) else: return securelinux(*args_, **kwargs_) factory = staticmethod(factory) def get_hkd_cert(self): return self.hkd_cert def set_hkd_cert(self, hkd_cert): self.hkd_cert = hkd_cert def add_hkd_cert(self, value): self.hkd_cert.append(value) def insert_hkd_cert_at(self, index, value): self.hkd_cert.insert(index, value) def replace_hkd_cert_at(self, index, value): self.hkd_cert[index] = value def get_hkd_revocation_list(self): return self.hkd_revocation_list def set_hkd_revocation_list(self, hkd_revocation_list): self.hkd_revocation_list = hkd_revocation_list def add_hkd_revocation_list(self, value): self.hkd_revocation_list.append(value) def insert_hkd_revocation_list_at(self, index, value): self.hkd_revocation_list.insert(index, value) def replace_hkd_revocation_list_at(self, index, value): self.hkd_revocation_list[index] = value def get_hkd_ca_cert(self): return self.hkd_ca_cert def set_hkd_ca_cert(self, hkd_ca_cert): self.hkd_ca_cert = hkd_ca_cert def get_hkd_sign_cert(self): return self.hkd_sign_cert def set_hkd_sign_cert(self, hkd_sign_cert): self.hkd_sign_cert = hkd_sign_cert def hasContent_(self): if self.hkd_cert or self.hkd_revocation_list: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='securelinux', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('securelinux') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='securelinux', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='securelinux', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='securelinux', ): if ( self.hkd_ca_cert is not None and 'hkd_ca_cert' not in already_processed ): already_processed.add('hkd_ca_cert') outfile.write( ' hkd_ca_cert=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.hkd_ca_cert), input_name='hkd_ca_cert', ) ), ) ) if ( self.hkd_sign_cert is not None and 'hkd_sign_cert' not in already_processed ): already_processed.add('hkd_sign_cert') outfile.write( ' hkd_sign_cert=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.hkd_sign_cert), input_name='hkd_sign_cert', ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='securelinux', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for hkd_cert_ in self.hkd_cert: hkd_cert_.export( outfile, level, namespaceprefix_, name_='hkd_cert', pretty_print=pretty_print, ) for hkd_revocation_list_ in self.hkd_revocation_list: hkd_revocation_list_.export( outfile, level, namespaceprefix_, name_='hkd_revocation_list', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('hkd_ca_cert', node) if value is not None and 'hkd_ca_cert' not in already_processed: already_processed.add('hkd_ca_cert') self.hkd_ca_cert = value value = find_attr_value_('hkd_sign_cert', node) if value is not None and 'hkd_sign_cert' not in already_processed: already_processed.add('hkd_sign_cert') self.hkd_sign_cert = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'hkd_cert': obj_ = hkd_cert.factory() obj_.build(child_) self.hkd_cert.append(obj_) obj_.original_tagname_ = 'hkd_cert' elif nodeName_ == 'hkd_revocation_list': obj_ = hkd_revocation_list.factory() obj_.build(child_) self.hkd_revocation_list.append(obj_) obj_.original_tagname_ = 'hkd_revocation_list' # end class securelinux class hkd_cert(GeneratedsSuper): subclass = None superclass = None def __init__(self, name=None): self.original_tagname_ = None self.name = _cast(None, name) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, hkd_cert) if subclass is not None: return subclass(*args_, **kwargs_) if hkd_cert.subclass: return hkd_cert.subclass(*args_, **kwargs_) else: return hkd_cert(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='hkd_cert', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('hkd_cert') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='hkd_cert', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='hkd_cert', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='hkd_cert', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='hkd_cert', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class hkd_cert class hkd_revocation_list(GeneratedsSuper): subclass = None superclass = None def __init__(self, name=None): self.original_tagname_ = None self.name = _cast(None, name) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, hkd_revocation_list ) if subclass is not None: return subclass(*args_, **kwargs_) if hkd_revocation_list.subclass: return hkd_revocation_list.subclass(*args_, **kwargs_) else: return hkd_revocation_list(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='hkd_revocation_list', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('hkd_revocation_list') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='hkd_revocation_list', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='hkd_revocation_list', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='hkd_revocation_list', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='hkd_revocation_list', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class hkd_revocation_list class environment(GeneratedsSuper): """Provides details about the container/bootloader environment variables. At least one environment variable must be configured""" subclass = None superclass = None def __init__(self, env=None): self.original_tagname_ = None if env is None: self.env = [] else: self.env = env def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, environment ) if subclass is not None: return subclass(*args_, **kwargs_) if environment.subclass: return environment.subclass(*args_, **kwargs_) else: return environment(*args_, **kwargs_) factory = staticmethod(factory) def get_env(self): return self.env def set_env(self, env): self.env = env def add_env(self, value): self.env.append(value) def insert_env_at(self, index, value): self.env.insert(index, value) def replace_env_at(self, index, value): self.env[index] = value def hasContent_(self): if self.env: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='environment', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('environment') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='environment', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='environment', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='environment', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='environment', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for env_ in self.env: env_.export( outfile, level, namespaceprefix_, name_='env', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'env': obj_ = env.factory() obj_.build(child_) self.env.append(obj_) obj_.original_tagname_ = 'env' # end class environment class env(GeneratedsSuper): """Provides details about an environment variable""" subclass = None superclass = None def __init__(self, name=None, value=None): self.original_tagname_ = None self.name = _cast(None, name) self.value = _cast(None, value) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, env) if subclass is not None: return subclass(*args_, **kwargs_) if env.subclass: return env.subclass(*args_, **kwargs_) else: return env(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_value(self): return self.value def set_value(self, value): self.value = value def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='env', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('env') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='env' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='env', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='env', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.value is not None and 'value' not in already_processed: already_processed.add('value') outfile.write( ' value=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.value), input_name='value' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='env', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('value', node) if value is not None and 'value' not in already_processed: already_processed.add('value') self.value = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class env class labels(GeneratedsSuper): """Provides details about container labels At least one label must be configured""" subclass = None superclass = None def __init__(self, label=None): self.original_tagname_ = None if label is None: self.label = [] else: self.label = label def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, labels) if subclass is not None: return subclass(*args_, **kwargs_) if labels.subclass: return labels.subclass(*args_, **kwargs_) else: return labels(*args_, **kwargs_) factory = staticmethod(factory) def get_label(self): return self.label def set_label(self, label): self.label = label def add_label(self, value): self.label.append(value) def insert_label_at(self, index, value): self.label.insert(index, value) def replace_label_at(self, index, value): self.label[index] = value def hasContent_(self): if self.label: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='labels', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('labels') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='labels' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='labels', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='labels', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='labels', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for label_ in self.label: label_.export( outfile, level, namespaceprefix_, name_='label', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'label': obj_ = label.factory() obj_.build(child_) self.label.append(obj_) obj_.original_tagname_ = 'label' # end class labels class label(GeneratedsSuper): """Provides details about a container label""" subclass = None superclass = None def __init__(self, name=None, value=None): self.original_tagname_ = None self.name = _cast(None, name) self.value = _cast(None, value) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, label) if subclass is not None: return subclass(*args_, **kwargs_) if label.subclass: return label.subclass(*args_, **kwargs_) else: return label(*args_, **kwargs_) factory = staticmethod(factory) def get_name(self): return self.name def set_name(self, name): self.name = name def get_value(self): return self.value def set_value(self, value): self.value = value def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='label', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('label') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='label' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='label', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='label', ): if self.name is not None and 'name' not in already_processed: already_processed.add('name') outfile.write( ' name=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.name), input_name='name' ) ), ) ) if self.value is not None and 'value' not in already_processed: already_processed.add('value') outfile.write( ' value=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.value), input_name='value' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='label', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('name', node) if value is not None and 'name' not in already_processed: already_processed.add('name') self.name = value value = find_attr_value_('value', node) if value is not None and 'value' not in already_processed: already_processed.add('value') self.value = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class label class history(GeneratedsSuper): """Provides details about the container history. Includes the 'created by', 'author' as attributes and its content represents the 'comment' entry.""" subclass = None superclass = None def __init__( self, created_by=None, author=None, application_id=None, package_version=None, launcher=None, valueOf_=None, mixedclass_=None, content_=None, ): self.original_tagname_ = None self.created_by = _cast(None, created_by) self.author = _cast(None, author) self.application_id = _cast(None, application_id) self.package_version = _cast(None, package_version) self.launcher = _cast(None, launcher) self.valueOf_ = valueOf_ if mixedclass_ is None: self.mixedclass_ = MixedContainer else: self.mixedclass_ = mixedclass_ if content_ is None: self.content_ = [] else: self.content_ = content_ self.valueOf_ = valueOf_ def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, history) if subclass is not None: return subclass(*args_, **kwargs_) if history.subclass: return history.subclass(*args_, **kwargs_) else: return history(*args_, **kwargs_) factory = staticmethod(factory) def get_created_by(self): return self.created_by def set_created_by(self, created_by): self.created_by = created_by def get_author(self): return self.author def set_author(self, author): self.author = author def get_application_id(self): return self.application_id def set_application_id(self, application_id): self.application_id = application_id def get_package_version(self): return self.package_version def set_package_version(self, package_version): self.package_version = package_version def get_launcher(self): return self.launcher def set_launcher(self, launcher): self.launcher = launcher def get_valueOf_(self): return self.valueOf_ def set_valueOf_(self, valueOf_): self.valueOf_ = valueOf_ def validate_package_version_type(self, value): # Validate type package-version-type, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_package_version_type_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_package_version_type_patterns_, ) ) validate_package_version_type_patterns_ = [ [ '^(0|[1-9][0-9]{0,3}|[1-5][0-9]{4}|6[0-4][0-9]{3}|65[0-4][0-9]{2}|655[0-2][0-9]|6553[0-5])(\\.(0|[1-9][0-9]{0,3}|[1-5][0-9]{4}|6[0-4][0-9]{3}|65[0-4][0-9]{2}|655[0-2][0-9]|6553[0-5])){3}$' ] ] def hasContent_(self): if 1 if type(self.valueOf_) in [int, float] else self.valueOf_: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='history', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('history') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='history' ) outfile.write('>') self.exportChildren( outfile, level + 1, namespaceprefix_, name_, pretty_print=pretty_print, ) outfile.write(self.convert_unicode(self.valueOf_)) outfile.write('%s' % (namespaceprefix_, name_, eol_)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='history', ): if ( self.created_by is not None and 'created_by' not in already_processed ): already_processed.add('created_by') outfile.write( ' created_by=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.created_by), input_name='created_by', ) ), ) ) if self.author is not None and 'author' not in already_processed: already_processed.add('author') outfile.write( ' author=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.author), input_name='author' ) ), ) ) if ( self.application_id is not None and 'application_id' not in already_processed ): already_processed.add('application_id') outfile.write( ' application_id=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.application_id), input_name='application_id', ) ), ) ) if ( self.package_version is not None and 'package_version' not in already_processed ): already_processed.add('package_version') outfile.write( ' package_version=%s' % (quote_attrib(self.package_version),) ) if self.launcher is not None and 'launcher' not in already_processed: already_processed.add('launcher') outfile.write( ' launcher=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.launcher), input_name='launcher' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='history', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) self.valueOf_ = get_all_text_(node) if node.text is not None: obj_ = self.mixedclass_( MixedContainer.CategoryText, MixedContainer.TypeNone, '', node.text, ) self.content_.append(obj_) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('created_by', node) if value is not None and 'created_by' not in already_processed: already_processed.add('created_by') self.created_by = value value = find_attr_value_('author', node) if value is not None and 'author' not in already_processed: already_processed.add('author') self.author = value value = find_attr_value_('application_id', node) if value is not None and 'application_id' not in already_processed: already_processed.add('application_id') self.application_id = value value = find_attr_value_('package_version', node) if value is not None and 'package_version' not in already_processed: already_processed.add('package_version') self.package_version = value self.package_version = ' '.join(self.package_version.split()) self.validate_package_version_type( self.package_version ) # validate type package-version-type value = find_attr_value_('launcher', node) if value is not None and 'launcher' not in already_processed: already_processed.add('launcher') self.launcher = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if not fromsubclass_ and child_.tail is not None: obj_ = self.mixedclass_( MixedContainer.CategoryText, MixedContainer.TypeNone, '', child_.tail, ) self.content_.append(obj_) pass # end class history class oemconfig(GeneratedsSuper): """The oemconfig element specifies the OEM image configuration options which are used to repartition and setup the system disk.""" subclass = None superclass = None def __init__( self, oem_boot_title=None, oem_bootwait=None, oem_resize=None, oem_resize_once=None, oem_ramdisk_size=None, oem_device_filter=None, oem_nic_filter=None, oem_inplace_recovery=None, oem_kiwi_initrd=None, oem_multipath_scan=None, oem_vmcp_parmfile=None, oem_partition_install=None, oem_reboot=None, oem_reboot_interactive=None, oem_recovery=None, oem_recoveryID=None, oem_recovery_part_size=None, oem_shutdown=None, oem_shutdown_interactive=None, oem_silent_boot=None, oem_silent_install=None, oem_silent_verify=None, oem_skip_verify=None, oem_swap=None, oem_swapsize=None, oem_swapname=None, oem_systemsize=None, oem_unattended=None, oem_unattended_id=None, ): self.original_tagname_ = None if oem_boot_title is None: self.oem_boot_title = [] else: self.oem_boot_title = oem_boot_title if oem_bootwait is None: self.oem_bootwait = [] else: self.oem_bootwait = oem_bootwait if oem_resize is None: self.oem_resize = [] else: self.oem_resize = oem_resize if oem_resize_once is None: self.oem_resize_once = [] else: self.oem_resize_once = oem_resize_once if oem_ramdisk_size is None: self.oem_ramdisk_size = [] else: self.oem_ramdisk_size = oem_ramdisk_size if oem_device_filter is None: self.oem_device_filter = [] else: self.oem_device_filter = oem_device_filter if oem_nic_filter is None: self.oem_nic_filter = [] else: self.oem_nic_filter = oem_nic_filter if oem_inplace_recovery is None: self.oem_inplace_recovery = [] else: self.oem_inplace_recovery = oem_inplace_recovery if oem_kiwi_initrd is None: self.oem_kiwi_initrd = [] else: self.oem_kiwi_initrd = oem_kiwi_initrd if oem_multipath_scan is None: self.oem_multipath_scan = [] else: self.oem_multipath_scan = oem_multipath_scan if oem_vmcp_parmfile is None: self.oem_vmcp_parmfile = [] else: self.oem_vmcp_parmfile = oem_vmcp_parmfile if oem_partition_install is None: self.oem_partition_install = [] else: self.oem_partition_install = oem_partition_install if oem_reboot is None: self.oem_reboot = [] else: self.oem_reboot = oem_reboot if oem_reboot_interactive is None: self.oem_reboot_interactive = [] else: self.oem_reboot_interactive = oem_reboot_interactive if oem_recovery is None: self.oem_recovery = [] else: self.oem_recovery = oem_recovery if oem_recoveryID is None: self.oem_recoveryID = [] else: self.oem_recoveryID = oem_recoveryID if oem_recovery_part_size is None: self.oem_recovery_part_size = [] else: self.oem_recovery_part_size = oem_recovery_part_size if oem_shutdown is None: self.oem_shutdown = [] else: self.oem_shutdown = oem_shutdown if oem_shutdown_interactive is None: self.oem_shutdown_interactive = [] else: self.oem_shutdown_interactive = oem_shutdown_interactive if oem_silent_boot is None: self.oem_silent_boot = [] else: self.oem_silent_boot = oem_silent_boot if oem_silent_install is None: self.oem_silent_install = [] else: self.oem_silent_install = oem_silent_install if oem_silent_verify is None: self.oem_silent_verify = [] else: self.oem_silent_verify = oem_silent_verify if oem_skip_verify is None: self.oem_skip_verify = [] else: self.oem_skip_verify = oem_skip_verify if oem_swap is None: self.oem_swap = [] else: self.oem_swap = oem_swap if oem_swapsize is None: self.oem_swapsize = [] else: self.oem_swapsize = oem_swapsize if oem_swapname is None: self.oem_swapname = [] else: self.oem_swapname = oem_swapname if oem_systemsize is None: self.oem_systemsize = [] else: self.oem_systemsize = oem_systemsize if oem_unattended is None: self.oem_unattended = [] else: self.oem_unattended = oem_unattended if oem_unattended_id is None: self.oem_unattended_id = [] else: self.oem_unattended_id = oem_unattended_id def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, oemconfig) if subclass is not None: return subclass(*args_, **kwargs_) if oemconfig.subclass: return oemconfig.subclass(*args_, **kwargs_) else: return oemconfig(*args_, **kwargs_) factory = staticmethod(factory) def get_oem_boot_title(self): return self.oem_boot_title def set_oem_boot_title(self, oem_boot_title): self.oem_boot_title = oem_boot_title def add_oem_boot_title(self, value): self.oem_boot_title.append(value) def insert_oem_boot_title_at(self, index, value): self.oem_boot_title.insert(index, value) def replace_oem_boot_title_at(self, index, value): self.oem_boot_title[index] = value def get_oem_bootwait(self): return self.oem_bootwait def set_oem_bootwait(self, oem_bootwait): self.oem_bootwait = oem_bootwait def add_oem_bootwait(self, value): self.oem_bootwait.append(value) def insert_oem_bootwait_at(self, index, value): self.oem_bootwait.insert(index, value) def replace_oem_bootwait_at(self, index, value): self.oem_bootwait[index] = value def get_oem_resize(self): return self.oem_resize def set_oem_resize(self, oem_resize): self.oem_resize = oem_resize def add_oem_resize(self, value): self.oem_resize.append(value) def insert_oem_resize_at(self, index, value): self.oem_resize.insert(index, value) def replace_oem_resize_at(self, index, value): self.oem_resize[index] = value def get_oem_resize_once(self): return self.oem_resize_once def set_oem_resize_once(self, oem_resize_once): self.oem_resize_once = oem_resize_once def add_oem_resize_once(self, value): self.oem_resize_once.append(value) def insert_oem_resize_once_at(self, index, value): self.oem_resize_once.insert(index, value) def replace_oem_resize_once_at(self, index, value): self.oem_resize_once[index] = value def get_oem_ramdisk_size(self): return self.oem_ramdisk_size def set_oem_ramdisk_size(self, oem_ramdisk_size): self.oem_ramdisk_size = oem_ramdisk_size def add_oem_ramdisk_size(self, value): self.oem_ramdisk_size.append(value) def insert_oem_ramdisk_size_at(self, index, value): self.oem_ramdisk_size.insert(index, value) def replace_oem_ramdisk_size_at(self, index, value): self.oem_ramdisk_size[index] = value def get_oem_device_filter(self): return self.oem_device_filter def set_oem_device_filter(self, oem_device_filter): self.oem_device_filter = oem_device_filter def add_oem_device_filter(self, value): self.oem_device_filter.append(value) def insert_oem_device_filter_at(self, index, value): self.oem_device_filter.insert(index, value) def replace_oem_device_filter_at(self, index, value): self.oem_device_filter[index] = value def get_oem_nic_filter(self): return self.oem_nic_filter def set_oem_nic_filter(self, oem_nic_filter): self.oem_nic_filter = oem_nic_filter def add_oem_nic_filter(self, value): self.oem_nic_filter.append(value) def insert_oem_nic_filter_at(self, index, value): self.oem_nic_filter.insert(index, value) def replace_oem_nic_filter_at(self, index, value): self.oem_nic_filter[index] = value def get_oem_inplace_recovery(self): return self.oem_inplace_recovery def set_oem_inplace_recovery(self, oem_inplace_recovery): self.oem_inplace_recovery = oem_inplace_recovery def add_oem_inplace_recovery(self, value): self.oem_inplace_recovery.append(value) def insert_oem_inplace_recovery_at(self, index, value): self.oem_inplace_recovery.insert(index, value) def replace_oem_inplace_recovery_at(self, index, value): self.oem_inplace_recovery[index] = value def get_oem_kiwi_initrd(self): return self.oem_kiwi_initrd def set_oem_kiwi_initrd(self, oem_kiwi_initrd): self.oem_kiwi_initrd = oem_kiwi_initrd def add_oem_kiwi_initrd(self, value): self.oem_kiwi_initrd.append(value) def insert_oem_kiwi_initrd_at(self, index, value): self.oem_kiwi_initrd.insert(index, value) def replace_oem_kiwi_initrd_at(self, index, value): self.oem_kiwi_initrd[index] = value def get_oem_multipath_scan(self): return self.oem_multipath_scan def set_oem_multipath_scan(self, oem_multipath_scan): self.oem_multipath_scan = oem_multipath_scan def add_oem_multipath_scan(self, value): self.oem_multipath_scan.append(value) def insert_oem_multipath_scan_at(self, index, value): self.oem_multipath_scan.insert(index, value) def replace_oem_multipath_scan_at(self, index, value): self.oem_multipath_scan[index] = value def get_oem_vmcp_parmfile(self): return self.oem_vmcp_parmfile def set_oem_vmcp_parmfile(self, oem_vmcp_parmfile): self.oem_vmcp_parmfile = oem_vmcp_parmfile def add_oem_vmcp_parmfile(self, value): self.oem_vmcp_parmfile.append(value) def insert_oem_vmcp_parmfile_at(self, index, value): self.oem_vmcp_parmfile.insert(index, value) def replace_oem_vmcp_parmfile_at(self, index, value): self.oem_vmcp_parmfile[index] = value def get_oem_partition_install(self): return self.oem_partition_install def set_oem_partition_install(self, oem_partition_install): self.oem_partition_install = oem_partition_install def add_oem_partition_install(self, value): self.oem_partition_install.append(value) def insert_oem_partition_install_at(self, index, value): self.oem_partition_install.insert(index, value) def replace_oem_partition_install_at(self, index, value): self.oem_partition_install[index] = value def get_oem_reboot(self): return self.oem_reboot def set_oem_reboot(self, oem_reboot): self.oem_reboot = oem_reboot def add_oem_reboot(self, value): self.oem_reboot.append(value) def insert_oem_reboot_at(self, index, value): self.oem_reboot.insert(index, value) def replace_oem_reboot_at(self, index, value): self.oem_reboot[index] = value def get_oem_reboot_interactive(self): return self.oem_reboot_interactive def set_oem_reboot_interactive(self, oem_reboot_interactive): self.oem_reboot_interactive = oem_reboot_interactive def add_oem_reboot_interactive(self, value): self.oem_reboot_interactive.append(value) def insert_oem_reboot_interactive_at(self, index, value): self.oem_reboot_interactive.insert(index, value) def replace_oem_reboot_interactive_at(self, index, value): self.oem_reboot_interactive[index] = value def get_oem_recovery(self): return self.oem_recovery def set_oem_recovery(self, oem_recovery): self.oem_recovery = oem_recovery def add_oem_recovery(self, value): self.oem_recovery.append(value) def insert_oem_recovery_at(self, index, value): self.oem_recovery.insert(index, value) def replace_oem_recovery_at(self, index, value): self.oem_recovery[index] = value def get_oem_recoveryID(self): return self.oem_recoveryID def set_oem_recoveryID(self, oem_recoveryID): self.oem_recoveryID = oem_recoveryID def add_oem_recoveryID(self, value): self.oem_recoveryID.append(value) def insert_oem_recoveryID_at(self, index, value): self.oem_recoveryID.insert(index, value) def replace_oem_recoveryID_at(self, index, value): self.oem_recoveryID[index] = value def get_oem_recovery_part_size(self): return self.oem_recovery_part_size def set_oem_recovery_part_size(self, oem_recovery_part_size): self.oem_recovery_part_size = oem_recovery_part_size def add_oem_recovery_part_size(self, value): self.oem_recovery_part_size.append(value) def insert_oem_recovery_part_size_at(self, index, value): self.oem_recovery_part_size.insert(index, value) def replace_oem_recovery_part_size_at(self, index, value): self.oem_recovery_part_size[index] = value def get_oem_shutdown(self): return self.oem_shutdown def set_oem_shutdown(self, oem_shutdown): self.oem_shutdown = oem_shutdown def add_oem_shutdown(self, value): self.oem_shutdown.append(value) def insert_oem_shutdown_at(self, index, value): self.oem_shutdown.insert(index, value) def replace_oem_shutdown_at(self, index, value): self.oem_shutdown[index] = value def get_oem_shutdown_interactive(self): return self.oem_shutdown_interactive def set_oem_shutdown_interactive(self, oem_shutdown_interactive): self.oem_shutdown_interactive = oem_shutdown_interactive def add_oem_shutdown_interactive(self, value): self.oem_shutdown_interactive.append(value) def insert_oem_shutdown_interactive_at(self, index, value): self.oem_shutdown_interactive.insert(index, value) def replace_oem_shutdown_interactive_at(self, index, value): self.oem_shutdown_interactive[index] = value def get_oem_silent_boot(self): return self.oem_silent_boot def set_oem_silent_boot(self, oem_silent_boot): self.oem_silent_boot = oem_silent_boot def add_oem_silent_boot(self, value): self.oem_silent_boot.append(value) def insert_oem_silent_boot_at(self, index, value): self.oem_silent_boot.insert(index, value) def replace_oem_silent_boot_at(self, index, value): self.oem_silent_boot[index] = value def get_oem_silent_install(self): return self.oem_silent_install def set_oem_silent_install(self, oem_silent_install): self.oem_silent_install = oem_silent_install def add_oem_silent_install(self, value): self.oem_silent_install.append(value) def insert_oem_silent_install_at(self, index, value): self.oem_silent_install.insert(index, value) def replace_oem_silent_install_at(self, index, value): self.oem_silent_install[index] = value def get_oem_silent_verify(self): return self.oem_silent_verify def set_oem_silent_verify(self, oem_silent_verify): self.oem_silent_verify = oem_silent_verify def add_oem_silent_verify(self, value): self.oem_silent_verify.append(value) def insert_oem_silent_verify_at(self, index, value): self.oem_silent_verify.insert(index, value) def replace_oem_silent_verify_at(self, index, value): self.oem_silent_verify[index] = value def get_oem_skip_verify(self): return self.oem_skip_verify def set_oem_skip_verify(self, oem_skip_verify): self.oem_skip_verify = oem_skip_verify def add_oem_skip_verify(self, value): self.oem_skip_verify.append(value) def insert_oem_skip_verify_at(self, index, value): self.oem_skip_verify.insert(index, value) def replace_oem_skip_verify_at(self, index, value): self.oem_skip_verify[index] = value def get_oem_swap(self): return self.oem_swap def set_oem_swap(self, oem_swap): self.oem_swap = oem_swap def add_oem_swap(self, value): self.oem_swap.append(value) def insert_oem_swap_at(self, index, value): self.oem_swap.insert(index, value) def replace_oem_swap_at(self, index, value): self.oem_swap[index] = value def get_oem_swapsize(self): return self.oem_swapsize def set_oem_swapsize(self, oem_swapsize): self.oem_swapsize = oem_swapsize def add_oem_swapsize(self, value): self.oem_swapsize.append(value) def insert_oem_swapsize_at(self, index, value): self.oem_swapsize.insert(index, value) def replace_oem_swapsize_at(self, index, value): self.oem_swapsize[index] = value def get_oem_swapname(self): return self.oem_swapname def set_oem_swapname(self, oem_swapname): self.oem_swapname = oem_swapname def add_oem_swapname(self, value): self.oem_swapname.append(value) def insert_oem_swapname_at(self, index, value): self.oem_swapname.insert(index, value) def replace_oem_swapname_at(self, index, value): self.oem_swapname[index] = value def get_oem_systemsize(self): return self.oem_systemsize def set_oem_systemsize(self, oem_systemsize): self.oem_systemsize = oem_systemsize def add_oem_systemsize(self, value): self.oem_systemsize.append(value) def insert_oem_systemsize_at(self, index, value): self.oem_systemsize.insert(index, value) def replace_oem_systemsize_at(self, index, value): self.oem_systemsize[index] = value def get_oem_unattended(self): return self.oem_unattended def set_oem_unattended(self, oem_unattended): self.oem_unattended = oem_unattended def add_oem_unattended(self, value): self.oem_unattended.append(value) def insert_oem_unattended_at(self, index, value): self.oem_unattended.insert(index, value) def replace_oem_unattended_at(self, index, value): self.oem_unattended[index] = value def get_oem_unattended_id(self): return self.oem_unattended_id def set_oem_unattended_id(self, oem_unattended_id): self.oem_unattended_id = oem_unattended_id def add_oem_unattended_id(self, value): self.oem_unattended_id.append(value) def insert_oem_unattended_id_at(self, index, value): self.oem_unattended_id.insert(index, value) def replace_oem_unattended_id_at(self, index, value): self.oem_unattended_id[index] = value def hasContent_(self): if ( self.oem_boot_title or self.oem_bootwait or self.oem_resize or self.oem_resize_once or self.oem_ramdisk_size or self.oem_device_filter or self.oem_nic_filter or self.oem_inplace_recovery or self.oem_kiwi_initrd or self.oem_multipath_scan or self.oem_vmcp_parmfile or self.oem_partition_install or self.oem_reboot or self.oem_reboot_interactive or self.oem_recovery or self.oem_recoveryID or self.oem_recovery_part_size or self.oem_shutdown or self.oem_shutdown_interactive or self.oem_silent_boot or self.oem_silent_install or self.oem_silent_verify or self.oem_skip_verify or self.oem_swap or self.oem_swapsize or self.oem_swapname or self.oem_systemsize or self.oem_unattended or self.oem_unattended_id ): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='oemconfig', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('oemconfig') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='oemconfig', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='oemconfig', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='oemconfig', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='oemconfig', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for oem_boot_title_ in self.oem_boot_title: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(oem_boot_title_), input_name='oem-boot-title', ) ), eol_, ) ) for oem_bootwait_ in self.oem_bootwait: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_bootwait_, input_name='oem-bootwait' ), eol_, ) ) for oem_resize_ in self.oem_resize: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_resize_, input_name='oem-resize' ), eol_, ) ) for oem_resize_once_ in self.oem_resize_once: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_resize_once_, input_name='oem-resize-once' ), eol_, ) ) for oem_ramdisk_size_ in self.oem_ramdisk_size: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(oem_ramdisk_size_), input_name='oem-ramdisk-size', ) ), eol_, ) ) for oem_device_filter_ in self.oem_device_filter: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(oem_device_filter_), input_name='oem-device-filter', ) ), eol_, ) ) for oem_nic_filter_ in self.oem_nic_filter: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(oem_nic_filter_), input_name='oem-nic-filter', ) ), eol_, ) ) for oem_inplace_recovery_ in self.oem_inplace_recovery: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_inplace_recovery_, input_name='oem-inplace-recovery' ), eol_, ) ) for oem_kiwi_initrd_ in self.oem_kiwi_initrd: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_kiwi_initrd_, input_name='oem-kiwi-initrd' ), eol_, ) ) for oem_multipath_scan_ in self.oem_multipath_scan: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_multipath_scan_, input_name='oem-multipath-scan' ), eol_, ) ) for oem_vmcp_parmfile_ in self.oem_vmcp_parmfile: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(oem_vmcp_parmfile_), input_name='oem-vmcp-parmfile', ) ), eol_, ) ) for oem_partition_install_ in self.oem_partition_install: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_partition_install_, input_name='oem-partition-install', ), eol_, ) ) for oem_reboot_ in self.oem_reboot: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_reboot_, input_name='oem-reboot' ), eol_, ) ) for oem_reboot_interactive_ in self.oem_reboot_interactive: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_reboot_interactive_, input_name='oem-reboot-interactive', ), eol_, ) ) for oem_recovery_ in self.oem_recovery: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_recovery_, input_name='oem-recovery' ), eol_, ) ) for oem_recoveryID_ in self.oem_recoveryID: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_integer( oem_recoveryID_, input_name='oem-recoveryID' ), eol_, ) ) for oem_recovery_part_size_ in self.oem_recovery_part_size: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_integer( oem_recovery_part_size_, input_name='oem-recovery-part-size', ), eol_, ) ) for oem_shutdown_ in self.oem_shutdown: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_shutdown_, input_name='oem-shutdown' ), eol_, ) ) for oem_shutdown_interactive_ in self.oem_shutdown_interactive: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_shutdown_interactive_, input_name='oem-shutdown-interactive', ), eol_, ) ) for oem_silent_boot_ in self.oem_silent_boot: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_silent_boot_, input_name='oem-silent-boot' ), eol_, ) ) for oem_silent_install_ in self.oem_silent_install: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_silent_install_, input_name='oem-silent-install' ), eol_, ) ) for oem_silent_verify_ in self.oem_silent_verify: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_silent_verify_, input_name='oem-silent-verify' ), eol_, ) ) for oem_skip_verify_ in self.oem_skip_verify: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_skip_verify_, input_name='oem-skip-verify' ), eol_, ) ) for oem_swap_ in self.oem_swap: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean(oem_swap_, input_name='oem-swap'), eol_, ) ) for oem_swapsize_ in self.oem_swapsize: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_integer( oem_swapsize_, input_name='oem-swapsize' ), eol_, ) ) for oem_swapname_ in self.oem_swapname: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(oem_swapname_), input_name='oem-swapname' ) ), eol_, ) ) for oem_systemsize_ in self.oem_systemsize: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_integer( oem_systemsize_, input_name='oem-systemsize' ), eol_, ) ) for oem_unattended_ in self.oem_unattended: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( oem_unattended_, input_name='oem-unattended' ), eol_, ) ) for oem_unattended_id_ in self.oem_unattended_id: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(oem_unattended_id_), input_name='oem-unattended-id', ) ), eol_, ) ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'oem-boot-title': oem_boot_title_ = child_.text oem_boot_title_ = self.gds_validate_string( oem_boot_title_, node, 'oem_boot_title' ) self.oem_boot_title.append(oem_boot_title_) elif nodeName_ == 'oem-bootwait': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_bootwait') self.oem_bootwait.append(ival_) elif nodeName_ == 'oem-resize': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_resize') self.oem_resize.append(ival_) elif nodeName_ == 'oem-resize-once': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_resize_once') self.oem_resize_once.append(ival_) elif nodeName_ == 'oem-ramdisk-size': oem_ramdisk_size_ = child_.text oem_ramdisk_size_ = self.gds_validate_string( oem_ramdisk_size_, node, 'oem_ramdisk_size' ) self.oem_ramdisk_size.append(oem_ramdisk_size_) elif nodeName_ == 'oem-device-filter': oem_device_filter_ = child_.text oem_device_filter_ = self.gds_validate_string( oem_device_filter_, node, 'oem_device_filter' ) self.oem_device_filter.append(oem_device_filter_) elif nodeName_ == 'oem-nic-filter': oem_nic_filter_ = child_.text oem_nic_filter_ = self.gds_validate_string( oem_nic_filter_, node, 'oem_nic_filter' ) self.oem_nic_filter.append(oem_nic_filter_) elif nodeName_ == 'oem-inplace-recovery': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean( ival_, node, 'oem_inplace_recovery' ) self.oem_inplace_recovery.append(ival_) elif nodeName_ == 'oem-kiwi-initrd': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_kiwi_initrd') self.oem_kiwi_initrd.append(ival_) elif nodeName_ == 'oem-multipath-scan': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_multipath_scan') self.oem_multipath_scan.append(ival_) elif nodeName_ == 'oem-vmcp-parmfile': oem_vmcp_parmfile_ = child_.text oem_vmcp_parmfile_ = self.gds_validate_string( oem_vmcp_parmfile_, node, 'oem_vmcp_parmfile' ) self.oem_vmcp_parmfile.append(oem_vmcp_parmfile_) elif nodeName_ == 'oem-partition-install': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean( ival_, node, 'oem_partition_install' ) self.oem_partition_install.append(ival_) elif nodeName_ == 'oem-reboot': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_reboot') self.oem_reboot.append(ival_) elif nodeName_ == 'oem-reboot-interactive': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean( ival_, node, 'oem_reboot_interactive' ) self.oem_reboot_interactive.append(ival_) elif nodeName_ == 'oem-recovery': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_recovery') self.oem_recovery.append(ival_) elif nodeName_ == 'oem-recoveryID' and child_.text: sval_ = child_.text try: ival_ = int(sval_) except (TypeError, ValueError) as exp: raise_parse_error(child_, 'requires integer: %s' % exp) if ival_ < 0: raise_parse_error(child_, 'requires nonNegativeInteger') ival_ = self.gds_validate_integer(ival_, node, 'oem_recoveryID') self.oem_recoveryID.append(ival_) elif nodeName_ == 'oem-recovery-part-size' and child_.text: sval_ = child_.text try: ival_ = int(sval_) except (TypeError, ValueError) as exp: raise_parse_error(child_, 'requires integer: %s' % exp) if ival_ < 0: raise_parse_error(child_, 'requires nonNegativeInteger') ival_ = self.gds_validate_integer( ival_, node, 'oem_recovery_part_size' ) self.oem_recovery_part_size.append(ival_) elif nodeName_ == 'oem-shutdown': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_shutdown') self.oem_shutdown.append(ival_) elif nodeName_ == 'oem-shutdown-interactive': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean( ival_, node, 'oem_shutdown_interactive' ) self.oem_shutdown_interactive.append(ival_) elif nodeName_ == 'oem-silent-boot': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_silent_boot') self.oem_silent_boot.append(ival_) elif nodeName_ == 'oem-silent-install': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_silent_install') self.oem_silent_install.append(ival_) elif nodeName_ == 'oem-silent-verify': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_silent_verify') self.oem_silent_verify.append(ival_) elif nodeName_ == 'oem-skip-verify': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_skip_verify') self.oem_skip_verify.append(ival_) elif nodeName_ == 'oem-swap': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_swap') self.oem_swap.append(ival_) elif nodeName_ == 'oem-swapsize' and child_.text: sval_ = child_.text try: ival_ = int(sval_) except (TypeError, ValueError) as exp: raise_parse_error(child_, 'requires integer: %s' % exp) if ival_ < 0: raise_parse_error(child_, 'requires nonNegativeInteger') ival_ = self.gds_validate_integer(ival_, node, 'oem_swapsize') self.oem_swapsize.append(ival_) elif nodeName_ == 'oem-swapname': oem_swapname_ = child_.text oem_swapname_ = self.gds_validate_string( oem_swapname_, node, 'oem_swapname' ) self.oem_swapname.append(oem_swapname_) elif nodeName_ == 'oem-systemsize' and child_.text: sval_ = child_.text try: ival_ = int(sval_) except (TypeError, ValueError) as exp: raise_parse_error(child_, 'requires integer: %s' % exp) if ival_ < 0: raise_parse_error(child_, 'requires nonNegativeInteger') ival_ = self.gds_validate_integer(ival_, node, 'oem_systemsize') self.oem_systemsize.append(ival_) elif nodeName_ == 'oem-unattended': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'oem_unattended') self.oem_unattended.append(ival_) elif nodeName_ == 'oem-unattended-id': oem_unattended_id_ = child_.text oem_unattended_id_ = self.gds_validate_string( oem_unattended_id_, node, 'oem_unattended_id' ) self.oem_unattended_id.append(oem_unattended_id_) # end class oemconfig class vagrantconfig(GeneratedsSuper): """The vagrantconfig element specifies the Vagrant meta configuration options which are used inside a vagrant box""" subclass = None superclass = None def __init__( self, provider=None, virtualsize=None, boxname=None, virtualbox_guest_additions_present=None, embedded_vagrantfile=None, ): self.original_tagname_ = None self.provider = _cast(None, provider) self.virtualsize = _cast(int, virtualsize) self.boxname = _cast(None, boxname) self.virtualbox_guest_additions_present = _cast( bool, virtualbox_guest_additions_present ) self.embedded_vagrantfile = _cast(None, embedded_vagrantfile) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, vagrantconfig ) if subclass is not None: return subclass(*args_, **kwargs_) if vagrantconfig.subclass: return vagrantconfig.subclass(*args_, **kwargs_) else: return vagrantconfig(*args_, **kwargs_) factory = staticmethod(factory) def get_provider(self): return self.provider def set_provider(self, provider): self.provider = provider def get_virtualsize(self): return self.virtualsize def set_virtualsize(self, virtualsize): self.virtualsize = virtualsize def get_boxname(self): return self.boxname def set_boxname(self, boxname): self.boxname = boxname def get_virtualbox_guest_additions_present(self): return self.virtualbox_guest_additions_present def set_virtualbox_guest_additions_present( self, virtualbox_guest_additions_present ): self.virtualbox_guest_additions_present = ( virtualbox_guest_additions_present ) def get_embedded_vagrantfile(self): return self.embedded_vagrantfile def set_embedded_vagrantfile(self, embedded_vagrantfile): self.embedded_vagrantfile = embedded_vagrantfile def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='vagrantconfig', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('vagrantconfig') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='vagrantconfig', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='vagrantconfig', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='vagrantconfig', ): if self.provider is not None and 'provider' not in already_processed: already_processed.add('provider') outfile.write( ' provider=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.provider), input_name='provider' ) ), ) ) if ( self.virtualsize is not None and 'virtualsize' not in already_processed ): already_processed.add('virtualsize') outfile.write( ' virtualsize="%s"' % self.gds_format_integer( self.virtualsize, input_name='virtualsize' ) ) if self.boxname is not None and 'boxname' not in already_processed: already_processed.add('boxname') outfile.write( ' boxname=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.boxname), input_name='boxname' ) ), ) ) if ( self.virtualbox_guest_additions_present is not None and 'virtualbox_guest_additions_present' not in already_processed ): already_processed.add('virtualbox_guest_additions_present') outfile.write( ' virtualbox_guest_additions_present="%s"' % self.gds_format_boolean( self.virtualbox_guest_additions_present, input_name='virtualbox_guest_additions_present', ) ) if ( self.embedded_vagrantfile is not None and 'embedded_vagrantfile' not in already_processed ): already_processed.add('embedded_vagrantfile') outfile.write( ' embedded_vagrantfile=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.embedded_vagrantfile), input_name='embedded_vagrantfile', ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='vagrantconfig', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('provider', node) if value is not None and 'provider' not in already_processed: already_processed.add('provider') self.provider = value self.provider = ' '.join(self.provider.split()) value = find_attr_value_('virtualsize', node) if value is not None and 'virtualsize' not in already_processed: already_processed.add('virtualsize') try: self.virtualsize = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.virtualsize < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('boxname', node) if value is not None and 'boxname' not in already_processed: already_processed.add('boxname') self.boxname = value value = find_attr_value_('virtualbox_guest_additions_present', node) if ( value is not None and 'virtualbox_guest_additions_present' not in already_processed ): already_processed.add('virtualbox_guest_additions_present') if value in ('true', '1'): self.virtualbox_guest_additions_present = True elif value in ('false', '0'): self.virtualbox_guest_additions_present = False else: raise_parse_error(node, 'Bad boolean attribute') value = find_attr_value_('embedded_vagrantfile', node) if ( value is not None and 'embedded_vagrantfile' not in already_processed ): already_processed.add('embedded_vagrantfile') self.embedded_vagrantfile = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class vagrantconfig class installmedia(GeneratedsSuper): """The installmedia element defined the configuration parameters for the installation media of OEM images.""" subclass = None superclass = None def __init__(self, initrd=None): self.original_tagname_ = None if initrd is None: self.initrd = [] else: self.initrd = initrd def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, installmedia ) if subclass is not None: return subclass(*args_, **kwargs_) if installmedia.subclass: return installmedia.subclass(*args_, **kwargs_) else: return installmedia(*args_, **kwargs_) factory = staticmethod(factory) def get_initrd(self): return self.initrd def set_initrd(self, initrd): self.initrd = initrd def add_initrd(self, value): self.initrd.append(value) def insert_initrd_at(self, index, value): self.initrd.insert(index, value) def replace_initrd_at(self, index, value): self.initrd[index] = value def hasContent_(self): if self.initrd: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='installmedia', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('installmedia') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='installmedia', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='installmedia', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='installmedia', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='installmedia', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for initrd_ in self.initrd: initrd_.export( outfile, level, namespaceprefix_, name_='initrd', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'initrd': obj_ = initrd.factory() obj_.build(child_) self.initrd.append(obj_) obj_.original_tagname_ = 'initrd' # end class installmedia class initrd(GeneratedsSuper): """The initrd element defines the dracut modules configuration for the installation media.""" subclass = None superclass = None def __init__(self, action=None, dracut=None): self.original_tagname_ = None self.action = _cast(None, action) if dracut is None: self.dracut = [] else: self.dracut = dracut def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, initrd) if subclass is not None: return subclass(*args_, **kwargs_) if initrd.subclass: return initrd.subclass(*args_, **kwargs_) else: return initrd(*args_, **kwargs_) factory = staticmethod(factory) def get_dracut(self): return self.dracut def set_dracut(self, dracut): self.dracut = dracut def add_dracut(self, value): self.dracut.append(value) def insert_dracut_at(self, index, value): self.dracut.insert(index, value) def replace_dracut_at(self, index, value): self.dracut[index] = value def get_action(self): return self.action def set_action(self, action): self.action = action def hasContent_(self): if self.dracut: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='initrd', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('initrd') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='initrd' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='initrd', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='initrd', ): if self.action is not None and 'action' not in already_processed: already_processed.add('action') outfile.write( ' action=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.action), input_name='action' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='initrd', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for dracut_ in self.dracut: dracut_.export( outfile, level, namespaceprefix_, name_='dracut', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('action', node) if value is not None and 'action' not in already_processed: already_processed.add('action') self.action = value self.action = ' '.join(self.action.split()) def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'dracut': obj_ = dracut.factory() obj_.build(child_) self.dracut.append(obj_) obj_.original_tagname_ = 'dracut' # end class initrd class dracut(GeneratedsSuper): """A dracut module""" subclass = None superclass = None def __init__(self, module=None, driver=None, uefi=None): self.original_tagname_ = None self.module = _cast(None, module) self.driver = _cast(None, driver) self.uefi = _cast(bool, uefi) def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, dracut) if subclass is not None: return subclass(*args_, **kwargs_) if dracut.subclass: return dracut.subclass(*args_, **kwargs_) else: return dracut(*args_, **kwargs_) factory = staticmethod(factory) def get_module(self): return self.module def set_module(self, module): self.module = module def get_driver(self): return self.driver def set_driver(self, driver): self.driver = driver def get_uefi(self): return self.uefi def set_uefi(self, uefi): self.uefi = uefi def hasContent_(self): if (): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='dracut', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('dracut') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='dracut' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='dracut', pretty_print=pretty_print, ) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='dracut', ): if self.module is not None and 'module' not in already_processed: already_processed.add('module') outfile.write( ' module=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.module), input_name='module' ) ), ) ) if self.driver is not None and 'driver' not in already_processed: already_processed.add('driver') outfile.write( ' driver=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.driver), input_name='driver' ) ), ) ) if self.uefi is not None and 'uefi' not in already_processed: already_processed.add('uefi') outfile.write( ' uefi="%s"' % self.gds_format_boolean(self.uefi, input_name='uefi') ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='dracut', fromsubclass_=False, pretty_print=True, ): pass def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('module', node) if value is not None and 'module' not in already_processed: already_processed.add('module') self.module = value value = find_attr_value_('driver', node) if value is not None and 'driver' not in already_processed: already_processed.add('driver') self.driver = value value = find_attr_value_('uefi', node) if value is not None and 'uefi' not in already_processed: already_processed.add('uefi') if value in ('true', '1'): self.uefi = True elif value in ('false', '0'): self.uefi = False else: raise_parse_error(node, 'Bad boolean attribute') def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): pass # end class dracut class machine(GeneratedsSuper): """The machine element specifies VM guest configuration options which are used by the virtual machine when running the image.""" subclass = None superclass = None def __init__( self, min_memory=None, max_memory=None, min_cpu=None, max_cpu=None, ovftype=None, HWversion=None, arch=None, xen_loader=None, guestOS=None, memory=None, ncpus=None, vmconfig_entry=None, vmdisk=None, vmdvd=None, vmnic=None, ): self.original_tagname_ = None self.min_memory = _cast(int, min_memory) self.max_memory = _cast(int, max_memory) self.min_cpu = _cast(int, min_cpu) self.max_cpu = _cast(int, max_cpu) self.ovftype = _cast(None, ovftype) self.HWversion = _cast(int, HWversion) self.arch = _cast(None, arch) self.xen_loader = _cast(None, xen_loader) self.guestOS = _cast(None, guestOS) self.memory = _cast(int, memory) self.ncpus = _cast(int, ncpus) if vmconfig_entry is None: self.vmconfig_entry = [] else: self.vmconfig_entry = vmconfig_entry if vmdisk is None: self.vmdisk = [] else: self.vmdisk = vmdisk if vmdvd is None: self.vmdvd = [] else: self.vmdvd = vmdvd if vmnic is None: self.vmnic = [] else: self.vmnic = vmnic def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, machine) if subclass is not None: return subclass(*args_, **kwargs_) if machine.subclass: return machine.subclass(*args_, **kwargs_) else: return machine(*args_, **kwargs_) factory = staticmethod(factory) def get_vmconfig_entry(self): return self.vmconfig_entry def set_vmconfig_entry(self, vmconfig_entry): self.vmconfig_entry = vmconfig_entry def add_vmconfig_entry(self, value): self.vmconfig_entry.append(value) def insert_vmconfig_entry_at(self, index, value): self.vmconfig_entry.insert(index, value) def replace_vmconfig_entry_at(self, index, value): self.vmconfig_entry[index] = value def get_vmdisk(self): return self.vmdisk def set_vmdisk(self, vmdisk): self.vmdisk = vmdisk def add_vmdisk(self, value): self.vmdisk.append(value) def insert_vmdisk_at(self, index, value): self.vmdisk.insert(index, value) def replace_vmdisk_at(self, index, value): self.vmdisk[index] = value def get_vmdvd(self): return self.vmdvd def set_vmdvd(self, vmdvd): self.vmdvd = vmdvd def add_vmdvd(self, value): self.vmdvd.append(value) def insert_vmdvd_at(self, index, value): self.vmdvd.insert(index, value) def replace_vmdvd_at(self, index, value): self.vmdvd[index] = value def get_vmnic(self): return self.vmnic def set_vmnic(self, vmnic): self.vmnic = vmnic def add_vmnic(self, value): self.vmnic.append(value) def insert_vmnic_at(self, index, value): self.vmnic.insert(index, value) def replace_vmnic_at(self, index, value): self.vmnic[index] = value def get_min_memory(self): return self.min_memory def set_min_memory(self, min_memory): self.min_memory = min_memory def get_max_memory(self): return self.max_memory def set_max_memory(self, max_memory): self.max_memory = max_memory def get_min_cpu(self): return self.min_cpu def set_min_cpu(self, min_cpu): self.min_cpu = min_cpu def get_max_cpu(self): return self.max_cpu def set_max_cpu(self, max_cpu): self.max_cpu = max_cpu def get_ovftype(self): return self.ovftype def set_ovftype(self, ovftype): self.ovftype = ovftype def get_HWversion(self): return self.HWversion def set_HWversion(self, HWversion): self.HWversion = HWversion def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def get_xen_loader(self): return self.xen_loader def set_xen_loader(self, xen_loader): self.xen_loader = xen_loader def get_guestOS(self): return self.guestOS def set_guestOS(self, guestOS): self.guestOS = guestOS def get_memory(self): return self.memory def set_memory(self, memory): self.memory = memory def get_ncpus(self): return self.ncpus def set_ncpus(self, ncpus): self.ncpus = ncpus def hasContent_(self): if self.vmconfig_entry or self.vmdisk or self.vmdvd or self.vmnic: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='machine', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('machine') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='machine' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='machine', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='machine', ): if ( self.min_memory is not None and 'min_memory' not in already_processed ): already_processed.add('min_memory') outfile.write( ' min_memory="%s"' % self.gds_format_integer( self.min_memory, input_name='min_memory' ) ) if ( self.max_memory is not None and 'max_memory' not in already_processed ): already_processed.add('max_memory') outfile.write( ' max_memory="%s"' % self.gds_format_integer( self.max_memory, input_name='max_memory' ) ) if self.min_cpu is not None and 'min_cpu' not in already_processed: already_processed.add('min_cpu') outfile.write( ' min_cpu="%s"' % self.gds_format_integer(self.min_cpu, input_name='min_cpu') ) if self.max_cpu is not None and 'max_cpu' not in already_processed: already_processed.add('max_cpu') outfile.write( ' max_cpu="%s"' % self.gds_format_integer(self.max_cpu, input_name='max_cpu') ) if self.ovftype is not None and 'ovftype' not in already_processed: already_processed.add('ovftype') outfile.write( ' ovftype=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.ovftype), input_name='ovftype' ) ), ) ) if self.HWversion is not None and 'HWversion' not in already_processed: already_processed.add('HWversion') outfile.write( ' HWversion="%s"' % self.gds_format_integer( self.HWversion, input_name='HWversion' ) ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write( ' arch=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.arch), input_name='arch' ) ), ) ) if ( self.xen_loader is not None and 'xen_loader' not in already_processed ): already_processed.add('xen_loader') outfile.write( ' xen_loader=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.xen_loader), input_name='xen_loader', ) ), ) ) if self.guestOS is not None and 'guestOS' not in already_processed: already_processed.add('guestOS') outfile.write( ' guestOS=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.guestOS), input_name='guestOS' ) ), ) ) if self.memory is not None and 'memory' not in already_processed: already_processed.add('memory') outfile.write( ' memory="%s"' % self.gds_format_integer(self.memory, input_name='memory') ) if self.ncpus is not None and 'ncpus' not in already_processed: already_processed.add('ncpus') outfile.write( ' ncpus="%s"' % self.gds_format_integer(self.ncpus, input_name='ncpus') ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='machine', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for vmconfig_entry_ in self.vmconfig_entry: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(vmconfig_entry_), input_name='vmconfig-entry', ) ), eol_, ) ) for vmdisk_ in self.vmdisk: vmdisk_.export( outfile, level, namespaceprefix_, name_='vmdisk', pretty_print=pretty_print, ) for vmdvd_ in self.vmdvd: vmdvd_.export( outfile, level, namespaceprefix_, name_='vmdvd', pretty_print=pretty_print, ) for vmnic_ in self.vmnic: vmnic_.export( outfile, level, namespaceprefix_, name_='vmnic', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('min_memory', node) if value is not None and 'min_memory' not in already_processed: already_processed.add('min_memory') try: self.min_memory = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.min_memory < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('max_memory', node) if value is not None and 'max_memory' not in already_processed: already_processed.add('max_memory') try: self.max_memory = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.max_memory < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('min_cpu', node) if value is not None and 'min_cpu' not in already_processed: already_processed.add('min_cpu') try: self.min_cpu = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.min_cpu < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('max_cpu', node) if value is not None and 'max_cpu' not in already_processed: already_processed.add('max_cpu') try: self.max_cpu = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.max_cpu < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('ovftype', node) if value is not None and 'ovftype' not in already_processed: already_processed.add('ovftype') self.ovftype = value self.ovftype = ' '.join(self.ovftype.split()) value = find_attr_value_('HWversion', node) if value is not None and 'HWversion' not in already_processed: already_processed.add('HWversion') try: self.HWversion = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) value = find_attr_value_('xen_loader', node) if value is not None and 'xen_loader' not in already_processed: already_processed.add('xen_loader') self.xen_loader = value self.xen_loader = ' '.join(self.xen_loader.split()) value = find_attr_value_('guestOS', node) if value is not None and 'guestOS' not in already_processed: already_processed.add('guestOS') self.guestOS = value value = find_attr_value_('memory', node) if value is not None and 'memory' not in already_processed: already_processed.add('memory') try: self.memory = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.memory < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') value = find_attr_value_('ncpus', node) if value is not None and 'ncpus' not in already_processed: already_processed.add('ncpus') try: self.ncpus = int(value) except ValueError as exp: raise_parse_error(node, 'Bad integer attribute: %s' % exp) if self.ncpus < 0: raise_parse_error(node, 'Invalid NonNegativeInteger') def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'vmconfig-entry': vmconfig_entry_ = child_.text vmconfig_entry_ = self.gds_validate_string( vmconfig_entry_, node, 'vmconfig_entry' ) self.vmconfig_entry.append(vmconfig_entry_) elif nodeName_ == 'vmdisk': obj_ = vmdisk.factory() obj_.build(child_) self.vmdisk.append(obj_) obj_.original_tagname_ = 'vmdisk' elif nodeName_ == 'vmdvd': obj_ = vmdvd.factory() obj_.build(child_) self.vmdvd.append(obj_) obj_.original_tagname_ = 'vmdvd' elif nodeName_ == 'vmnic': obj_ = vmnic.factory() obj_.build(child_) self.vmnic.append(obj_) obj_.original_tagname_ = 'vmnic' # end class machine class packages(GeneratedsSuper): """Specifies Packages/Patterns Used in Different Stages""" subclass = None superclass = None def __init__( self, type_=None, profiles=None, patternType=None, bootstrap_package=None, archive=None, file=None, ignore=None, namedCollection=None, collectionModule=None, product=None, package=None, ): self.original_tagname_ = None self.type_ = _cast(None, type_) self.profiles = _cast(None, profiles) self.patternType = _cast(None, patternType) self.bootstrap_package = _cast(None, bootstrap_package) if archive is None: self.archive = [] else: self.archive = archive if file is None: self.file = [] else: self.file = file if ignore is None: self.ignore = [] else: self.ignore = ignore if namedCollection is None: self.namedCollection = [] else: self.namedCollection = namedCollection if collectionModule is None: self.collectionModule = [] else: self.collectionModule = collectionModule if product is None: self.product = [] else: self.product = product if package is None: self.package = [] else: self.package = package def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, packages) if subclass is not None: return subclass(*args_, **kwargs_) if packages.subclass: return packages.subclass(*args_, **kwargs_) else: return packages(*args_, **kwargs_) factory = staticmethod(factory) def get_archive(self): return self.archive def set_archive(self, archive): self.archive = archive def add_archive(self, value): self.archive.append(value) def insert_archive_at(self, index, value): self.archive.insert(index, value) def replace_archive_at(self, index, value): self.archive[index] = value def get_file(self): return self.file def set_file(self, file): self.file = file def add_file(self, value): self.file.append(value) def insert_file_at(self, index, value): self.file.insert(index, value) def replace_file_at(self, index, value): self.file[index] = value def get_ignore(self): return self.ignore def set_ignore(self, ignore): self.ignore = ignore def add_ignore(self, value): self.ignore.append(value) def insert_ignore_at(self, index, value): self.ignore.insert(index, value) def replace_ignore_at(self, index, value): self.ignore[index] = value def get_namedCollection(self): return self.namedCollection def set_namedCollection(self, namedCollection): self.namedCollection = namedCollection def add_namedCollection(self, value): self.namedCollection.append(value) def insert_namedCollection_at(self, index, value): self.namedCollection.insert(index, value) def replace_namedCollection_at(self, index, value): self.namedCollection[index] = value def get_collectionModule(self): return self.collectionModule def set_collectionModule(self, collectionModule): self.collectionModule = collectionModule def add_collectionModule(self, value): self.collectionModule.append(value) def insert_collectionModule_at(self, index, value): self.collectionModule.insert(index, value) def replace_collectionModule_at(self, index, value): self.collectionModule[index] = value def get_product(self): return self.product def set_product(self, product): self.product = product def add_product(self, value): self.product.append(value) def insert_product_at(self, index, value): self.product.insert(index, value) def replace_product_at(self, index, value): self.product[index] = value def get_package(self): return self.package def set_package(self, package): self.package = package def add_package(self, value): self.package.append(value) def insert_package_at(self, index, value): self.package.insert(index, value) def replace_package_at(self, index, value): self.package[index] = value def get_type(self): return self.type_ def set_type(self, type_): self.type_ = type_ def get_profiles(self): return self.profiles def set_profiles(self, profiles): self.profiles = profiles def get_patternType(self): return self.patternType def set_patternType(self, patternType): self.patternType = patternType def get_bootstrap_package(self): return self.bootstrap_package def set_bootstrap_package(self, bootstrap_package): self.bootstrap_package = bootstrap_package def hasContent_(self): if ( self.archive or self.file or self.ignore or self.namedCollection or self.collectionModule or self.product or self.package ): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='packages', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('packages') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='packages', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='packages', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='packages', ): if self.type_ is not None and 'type_' not in already_processed: already_processed.add('type_') outfile.write( ' type=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.type_), input_name='type' ) ), ) ) if self.profiles is not None and 'profiles' not in already_processed: already_processed.add('profiles') outfile.write( ' profiles=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.profiles), input_name='profiles' ) ), ) ) if ( self.patternType is not None and 'patternType' not in already_processed ): already_processed.add('patternType') outfile.write( ' patternType=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.patternType), input_name='patternType', ) ), ) ) if ( self.bootstrap_package is not None and 'bootstrap_package' not in already_processed ): already_processed.add('bootstrap_package') outfile.write( ' bootstrap_package=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.bootstrap_package), input_name='bootstrap_package', ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='packages', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for archive_ in self.archive: archive_.export( outfile, level, namespaceprefix_, name_='archive', pretty_print=pretty_print, ) for file_ in self.file: file_.export( outfile, level, namespaceprefix_, name_='file', pretty_print=pretty_print, ) for ignore_ in self.ignore: ignore_.export( outfile, level, namespaceprefix_, name_='ignore', pretty_print=pretty_print, ) for namedCollection_ in self.namedCollection: namedCollection_.export( outfile, level, namespaceprefix_, name_='namedCollection', pretty_print=pretty_print, ) for collectionModule_ in self.collectionModule: collectionModule_.export( outfile, level, namespaceprefix_, name_='collectionModule', pretty_print=pretty_print, ) for product_ in self.product: product_.export( outfile, level, namespaceprefix_, name_='product', pretty_print=pretty_print, ) for package_ in self.package: package_.export( outfile, level, namespaceprefix_, name_='package', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('type', node) if value is not None and 'type' not in already_processed: already_processed.add('type') self.type_ = value self.type_ = ' '.join(self.type_.split()) value = find_attr_value_('profiles', node) if value is not None and 'profiles' not in already_processed: already_processed.add('profiles') self.profiles = value value = find_attr_value_('patternType', node) if value is not None and 'patternType' not in already_processed: already_processed.add('patternType') self.patternType = value self.patternType = ' '.join(self.patternType.split()) value = find_attr_value_('bootstrap_package', node) if value is not None and 'bootstrap_package' not in already_processed: already_processed.add('bootstrap_package') self.bootstrap_package = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'archive': obj_ = archive.factory() obj_.build(child_) self.archive.append(obj_) obj_.original_tagname_ = 'archive' elif nodeName_ == 'file': obj_ = file.factory() obj_.build(child_) self.file.append(obj_) obj_.original_tagname_ = 'file' elif nodeName_ == 'ignore': obj_ = ignore.factory() obj_.build(child_) self.ignore.append(obj_) obj_.original_tagname_ = 'ignore' elif nodeName_ == 'namedCollection': obj_ = namedCollection.factory() obj_.build(child_) self.namedCollection.append(obj_) obj_.original_tagname_ = 'namedCollection' elif nodeName_ == 'collectionModule': obj_ = collectionModule.factory() obj_.build(child_) self.collectionModule.append(obj_) obj_.original_tagname_ = 'collectionModule' elif nodeName_ == 'product': obj_ = product.factory() obj_.build(child_) self.product.append(obj_) obj_.original_tagname_ = 'product' elif nodeName_ == 'package': obj_ = package.factory() obj_.build(child_) self.package.append(obj_) obj_.original_tagname_ = 'package' # end class packages class preferences(GeneratedsSuper): """Configuration Information Needed for Logical Extend All elements are optional since the combination of appropriate preference sections based on profiles combine to create on vaild definition""" subclass = None superclass = None def __init__( self, profiles=None, arch=None, bootsplash_theme=None, bootloader_theme=None, keytable=None, locale=None, packagemanager=None, release_version=None, rpm_locale_filtering=None, rpm_check_signatures=None, rpm_excludedocs=None, showlicense=None, timezone=None, type_=None, version=None, ): self.original_tagname_ = None self.profiles = _cast(None, profiles) self.arch = _cast(None, arch) if bootsplash_theme is None: self.bootsplash_theme = [] else: self.bootsplash_theme = bootsplash_theme if bootloader_theme is None: self.bootloader_theme = [] else: self.bootloader_theme = bootloader_theme if keytable is None: self.keytable = [] else: self.keytable = keytable if locale is None: self.locale = [] else: self.locale = locale if packagemanager is None: self.packagemanager = [] else: self.packagemanager = packagemanager if release_version is None: self.release_version = [] else: self.release_version = release_version if rpm_locale_filtering is None: self.rpm_locale_filtering = [] else: self.rpm_locale_filtering = rpm_locale_filtering if rpm_check_signatures is None: self.rpm_check_signatures = [] else: self.rpm_check_signatures = rpm_check_signatures if rpm_excludedocs is None: self.rpm_excludedocs = [] else: self.rpm_excludedocs = rpm_excludedocs if showlicense is None: self.showlicense = [] else: self.showlicense = showlicense if timezone is None: self.timezone = [] else: self.timezone = timezone if type_ is None: self.type_ = [] else: self.type_ = type_ if version is None: self.version = [] else: self.version = version def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_( CurrentSubclassModule_, preferences ) if subclass is not None: return subclass(*args_, **kwargs_) if preferences.subclass: return preferences.subclass(*args_, **kwargs_) else: return preferences(*args_, **kwargs_) factory = staticmethod(factory) def get_bootsplash_theme(self): return self.bootsplash_theme def set_bootsplash_theme(self, bootsplash_theme): self.bootsplash_theme = bootsplash_theme def add_bootsplash_theme(self, value): self.bootsplash_theme.append(value) def insert_bootsplash_theme_at(self, index, value): self.bootsplash_theme.insert(index, value) def replace_bootsplash_theme_at(self, index, value): self.bootsplash_theme[index] = value def get_bootloader_theme(self): return self.bootloader_theme def set_bootloader_theme(self, bootloader_theme): self.bootloader_theme = bootloader_theme def add_bootloader_theme(self, value): self.bootloader_theme.append(value) def insert_bootloader_theme_at(self, index, value): self.bootloader_theme.insert(index, value) def replace_bootloader_theme_at(self, index, value): self.bootloader_theme[index] = value def get_keytable(self): return self.keytable def set_keytable(self, keytable): self.keytable = keytable def add_keytable(self, value): self.keytable.append(value) def insert_keytable_at(self, index, value): self.keytable.insert(index, value) def replace_keytable_at(self, index, value): self.keytable[index] = value def get_locale(self): return self.locale def set_locale(self, locale): self.locale = locale def add_locale(self, value): self.locale.append(value) def insert_locale_at(self, index, value): self.locale.insert(index, value) def replace_locale_at(self, index, value): self.locale[index] = value def get_packagemanager(self): return self.packagemanager def set_packagemanager(self, packagemanager): self.packagemanager = packagemanager def add_packagemanager(self, value): self.packagemanager.append(value) def insert_packagemanager_at(self, index, value): self.packagemanager.insert(index, value) def replace_packagemanager_at(self, index, value): self.packagemanager[index] = value def get_release_version(self): return self.release_version def set_release_version(self, release_version): self.release_version = release_version def add_release_version(self, value): self.release_version.append(value) def insert_release_version_at(self, index, value): self.release_version.insert(index, value) def replace_release_version_at(self, index, value): self.release_version[index] = value def get_rpm_locale_filtering(self): return self.rpm_locale_filtering def set_rpm_locale_filtering(self, rpm_locale_filtering): self.rpm_locale_filtering = rpm_locale_filtering def add_rpm_locale_filtering(self, value): self.rpm_locale_filtering.append(value) def insert_rpm_locale_filtering_at(self, index, value): self.rpm_locale_filtering.insert(index, value) def replace_rpm_locale_filtering_at(self, index, value): self.rpm_locale_filtering[index] = value def get_rpm_check_signatures(self): return self.rpm_check_signatures def set_rpm_check_signatures(self, rpm_check_signatures): self.rpm_check_signatures = rpm_check_signatures def add_rpm_check_signatures(self, value): self.rpm_check_signatures.append(value) def insert_rpm_check_signatures_at(self, index, value): self.rpm_check_signatures.insert(index, value) def replace_rpm_check_signatures_at(self, index, value): self.rpm_check_signatures[index] = value def get_rpm_excludedocs(self): return self.rpm_excludedocs def set_rpm_excludedocs(self, rpm_excludedocs): self.rpm_excludedocs = rpm_excludedocs def add_rpm_excludedocs(self, value): self.rpm_excludedocs.append(value) def insert_rpm_excludedocs_at(self, index, value): self.rpm_excludedocs.insert(index, value) def replace_rpm_excludedocs_at(self, index, value): self.rpm_excludedocs[index] = value def get_showlicense(self): return self.showlicense def set_showlicense(self, showlicense): self.showlicense = showlicense def add_showlicense(self, value): self.showlicense.append(value) def insert_showlicense_at(self, index, value): self.showlicense.insert(index, value) def replace_showlicense_at(self, index, value): self.showlicense[index] = value def get_timezone(self): return self.timezone def set_timezone(self, timezone): self.timezone = timezone def add_timezone(self, value): self.timezone.append(value) def insert_timezone_at(self, index, value): self.timezone.insert(index, value) def replace_timezone_at(self, index, value): self.timezone[index] = value def get_type(self): return self.type_ def set_type(self, type_): self.type_ = type_ def add_type(self, value): self.type_.append(value) def insert_type_at(self, index, value): self.type_.insert(index, value) def replace_type_at(self, index, value): self.type_[index] = value def get_version(self): return self.version def set_version(self, version): self.version = version def add_version(self, value): self.version.append(value) def insert_version_at(self, index, value): self.version.insert(index, value) def replace_version_at(self, index, value): self.version[index] = value def get_profiles(self): return self.profiles def set_profiles(self, profiles): self.profiles = profiles def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if ( self.bootsplash_theme or self.bootloader_theme or self.keytable or self.locale or self.packagemanager or self.release_version or self.rpm_locale_filtering or self.rpm_check_signatures or self.rpm_excludedocs or self.showlicense or self.timezone or self.type_ or self.version ): return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='preferences', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('preferences') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='preferences', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='preferences', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='preferences', ): if self.profiles is not None and 'profiles' not in already_processed: already_processed.add('profiles') outfile.write( ' profiles=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.profiles), input_name='profiles' ) ), ) ) if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) def exportChildren( self, outfile, level, namespaceprefix_='', name_='preferences', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for bootsplash_theme_ in self.bootsplash_theme: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(bootsplash_theme_), input_name='bootsplash-theme', ) ), eol_, ) ) for bootloader_theme_ in self.bootloader_theme: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(bootloader_theme_), input_name='bootloader-theme', ) ), eol_, ) ) for keytable_ in self.keytable: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(keytable_), input_name='keytable' ) ), eol_, ) ) for locale_ in self.locale: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(locale_), input_name='locale' ) ), eol_, ) ) for packagemanager_ in self.packagemanager: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(packagemanager_), input_name='packagemanager', ) ), eol_, ) ) for release_version_ in self.release_version: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(release_version_), input_name='release-version', ) ), eol_, ) ) for rpm_locale_filtering_ in self.rpm_locale_filtering: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( rpm_locale_filtering_, input_name='rpm-locale-filtering' ), eol_, ) ) for rpm_check_signatures_ in self.rpm_check_signatures: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( rpm_check_signatures_, input_name='rpm-check-signatures' ), eol_, ) ) for rpm_excludedocs_ in self.rpm_excludedocs: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_format_boolean( rpm_excludedocs_, input_name='rpm-excludedocs' ), eol_, ) ) for showlicense_ in self.showlicense: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(showlicense_), input_name='showlicense' ) ), eol_, ) ) for timezone_ in self.timezone: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(timezone_), input_name='timezone' ) ), eol_, ) ) for type_ in self.type_: type_.export( outfile, level, namespaceprefix_, name_='type', pretty_print=pretty_print, ) for version_ in self.version: showIndent(outfile, level, pretty_print) outfile.write( '%s%s' % ( self.gds_encode( self.gds_format_string( quote_xml(version_), input_name='version' ) ), eol_, ) ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('profiles', node) if value is not None and 'profiles' not in already_processed: already_processed.add('profiles') self.profiles = value value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'bootsplash-theme': bootsplash_theme_ = child_.text bootsplash_theme_ = self.gds_validate_string( bootsplash_theme_, node, 'bootsplash_theme' ) self.bootsplash_theme.append(bootsplash_theme_) elif nodeName_ == 'bootloader-theme': bootloader_theme_ = child_.text bootloader_theme_ = self.gds_validate_string( bootloader_theme_, node, 'bootloader_theme' ) self.bootloader_theme.append(bootloader_theme_) elif nodeName_ == 'keytable': keytable_ = child_.text keytable_ = self.gds_validate_string(keytable_, node, 'keytable') self.keytable.append(keytable_) elif nodeName_ == 'locale': locale_ = child_.text if locale_: locale_ = re_.sub(String_cleanup_pat_, " ", locale_).strip() else: locale_ = "" locale_ = self.gds_validate_string(locale_, node, 'locale') self.locale.append(locale_) elif nodeName_ == 'packagemanager': packagemanager_ = child_.text if packagemanager_: packagemanager_ = re_.sub( String_cleanup_pat_, " ", packagemanager_ ).strip() else: packagemanager_ = "" packagemanager_ = self.gds_validate_string( packagemanager_, node, 'packagemanager' ) self.packagemanager.append(packagemanager_) elif nodeName_ == 'release-version': release_version_ = child_.text release_version_ = self.gds_validate_string( release_version_, node, 'release_version' ) self.release_version.append(release_version_) elif nodeName_ == 'rpm-locale-filtering': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean( ival_, node, 'rpm_locale_filtering' ) self.rpm_locale_filtering.append(ival_) elif nodeName_ == 'rpm-check-signatures': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean( ival_, node, 'rpm_check_signatures' ) self.rpm_check_signatures.append(ival_) elif nodeName_ == 'rpm-excludedocs': sval_ = child_.text if sval_ in ('true', '1'): ival_ = True elif sval_ in ('false', '0'): ival_ = False else: raise_parse_error(child_, 'requires boolean') ival_ = self.gds_validate_boolean(ival_, node, 'rpm_excludedocs') self.rpm_excludedocs.append(ival_) elif nodeName_ == 'showlicense': showlicense_ = child_.text showlicense_ = self.gds_validate_string( showlicense_, node, 'showlicense' ) self.showlicense.append(showlicense_) elif nodeName_ == 'timezone': timezone_ = child_.text timezone_ = self.gds_validate_string(timezone_, node, 'timezone') self.timezone.append(timezone_) elif nodeName_ == 'type': obj_ = type_.factory() obj_.build(child_) self.type_.append(obj_) obj_.original_tagname_ = 'type' elif nodeName_ == 'version': version_ = child_.text version_ = self.gds_validate_string(version_, node, 'version') self.version.append(version_) # end class preferences class profiles(GeneratedsSuper): """Namespace section which creates a namespace and the drivers can bind itself to one of the listed namespaces.""" subclass = None superclass = None def __init__(self, profile=None): self.original_tagname_ = None if profile is None: self.profile = [] else: self.profile = profile def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, profiles) if subclass is not None: return subclass(*args_, **kwargs_) if profiles.subclass: return profiles.subclass(*args_, **kwargs_) else: return profiles(*args_, **kwargs_) factory = staticmethod(factory) def get_profile(self): return self.profile def set_profile(self, profile): self.profile = profile def add_profile(self, value): self.profile.append(value) def insert_profile_at(self, index, value): self.profile.insert(index, value) def replace_profile_at(self, index, value): self.profile[index] = value def hasContent_(self): if self.profile: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='profiles', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('profiles') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='profiles', ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='profiles', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='profiles', ): pass def exportChildren( self, outfile, level, namespaceprefix_='', name_='profiles', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for profile_ in self.profile: profile_.export( outfile, level, namespaceprefix_, name_='profile', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): pass def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'profile': obj_ = profile.factory() obj_.build(child_) self.profile.append(obj_) obj_.original_tagname_ = 'profile' # end class profiles class users(GeneratedsSuper): """A List of Users""" subclass = None superclass = None def __init__(self, arch=None, profiles=None, user=None): self.original_tagname_ = None self.arch = _cast(None, arch) self.profiles = _cast(None, profiles) if user is None: self.user = [] else: self.user = user def factory(*args_, **kwargs_): if CurrentSubclassModule_ is not None: subclass = getSubclassFromModule_(CurrentSubclassModule_, users) if subclass is not None: return subclass(*args_, **kwargs_) if users.subclass: return users.subclass(*args_, **kwargs_) else: return users(*args_, **kwargs_) factory = staticmethod(factory) def get_user(self): return self.user def set_user(self, user): self.user = user def add_user(self, value): self.user.append(value) def insert_user_at(self, index, value): self.user.insert(index, value) def replace_user_at(self, index, value): self.user[index] = value def get_arch(self): return self.arch def set_arch(self, arch): self.arch = arch def get_profiles(self): return self.profiles def set_profiles(self, profiles): self.profiles = profiles def validate_arch_name(self, value): # Validate type arch-name, a restriction on xs:token. if value is not None and Validate_simpletypes_: if not self.gds_validate_simple_patterns( self.validate_arch_name_patterns_, value ): warnings_.warn( 'Value "%s" does not match xsd pattern restrictions: %s' % ( value.encode('utf-8'), self.validate_arch_name_patterns_, ) ) validate_arch_name_patterns_ = [['^.*$']] def hasContent_(self): if self.user: return True else: return False def export( self, outfile, level, namespaceprefix_='', name_='users', namespacedef_='', pretty_print=True, ): imported_ns_def_ = GenerateDSNamespaceDefs_.get('users') if imported_ns_def_ is not None: namespacedef_ = imported_ns_def_ if pretty_print: eol_ = '\n' else: eol_ = '' if self.original_tagname_ is not None: name_ = self.original_tagname_ showIndent(outfile, level, pretty_print) outfile.write( '<%s%s%s' % ( namespaceprefix_, name_, namespacedef_ and ' ' + namespacedef_ or '', ) ) already_processed = set() self.exportAttributes( outfile, level, already_processed, namespaceprefix_, name_='users' ) if self.hasContent_(): outfile.write('>%s' % (eol_,)) self.exportChildren( outfile, level + 1, namespaceprefix_='', name_='users', pretty_print=pretty_print, ) showIndent(outfile, level, pretty_print) outfile.write('%s' % (namespaceprefix_, name_, eol_)) else: outfile.write('/>%s' % (eol_,)) def exportAttributes( self, outfile, level, already_processed, namespaceprefix_='', name_='users', ): if self.arch is not None and 'arch' not in already_processed: already_processed.add('arch') outfile.write(' arch=%s' % (quote_attrib(self.arch),)) if self.profiles is not None and 'profiles' not in already_processed: already_processed.add('profiles') outfile.write( ' profiles=%s' % ( self.gds_encode( self.gds_format_string( quote_attrib(self.profiles), input_name='profiles' ) ), ) ) def exportChildren( self, outfile, level, namespaceprefix_='', name_='users', fromsubclass_=False, pretty_print=True, ): if pretty_print: eol_ = '\n' else: eol_ = '' for user_ in self.user: user_.export( outfile, level, namespaceprefix_, name_='user', pretty_print=pretty_print, ) def build(self, node): already_processed = set() self.buildAttributes(node, node.attrib, already_processed) for child in node: nodeName_ = Tag_pattern_.match(child.tag).groups()[-1] self.buildChildren(child, node, nodeName_) return self def buildAttributes(self, node, attrs, already_processed): value = find_attr_value_('arch', node) if value is not None and 'arch' not in already_processed: already_processed.add('arch') self.arch = value self.arch = ' '.join(self.arch.split()) self.validate_arch_name(self.arch) # validate type arch-name value = find_attr_value_('profiles', node) if value is not None and 'profiles' not in already_processed: already_processed.add('profiles') self.profiles = value def buildChildren(self, child_, node, nodeName_, fromsubclass_=False): if nodeName_ == 'user': obj_ = user.factory() obj_.build(child_) self.user.append(obj_) obj_.original_tagname_ = 'user' # end class users GDSClassesMapping = {} USAGE_TEXT = """ Usage: python .py [ -s ] """ def usage(): print(USAGE_TEXT) sys.exit(1) def get_root_tag(node): tag = Tag_pattern_.match(node.tag).groups()[-1] rootClass = GDSClassesMapping.get(tag) if rootClass is None: rootClass = globals().get(tag) return tag, rootClass def parse(inFileName, silence=False): parser = None doc = parsexml_(inFileName, parser) rootNode = doc.getroot() rootTag, rootClass = get_root_tag(rootNode) if rootClass is None: rootTag = 'k_source' rootClass = k_source rootObj = rootClass.factory() rootObj.build(rootNode) # Enable Python to collect the space used by the DOM. doc = None if not silence: sys.stdout.write('\n') rootObj.export( sys.stdout, 0, name_=rootTag, namespacedef_='', pretty_print=True ) return rootObj def parseEtree(inFileName, silence=False): parser = None doc = parsexml_(inFileName, parser) rootNode = doc.getroot() rootTag, rootClass = get_root_tag(rootNode) if rootClass is None: rootTag = 'k_source' rootClass = k_source rootObj = rootClass.factory() rootObj.build(rootNode) # Enable Python to collect the space used by the DOM. doc = None mapping = {} rootElement = rootObj.to_etree(None, name_=rootTag, mapping_=mapping) reverse_mapping = rootObj.gds_reverse_node_mapping(mapping) if not silence: content = etree_.tostring( rootElement, pretty_print=True, xml_declaration=True, encoding="utf-8", ) sys.stdout.write(content) sys.stdout.write('\n') return rootObj, rootElement, mapping, reverse_mapping def parseString(inString, silence=False): '''Parse a string, create the object tree, and export it. Arguments: - inString -- A string. This XML fragment should not start with an XML declaration containing an encoding. - silence -- A boolean. If False, export the object. Returns -- The root object in the tree. ''' parser = None rootNode = parsexmlstring_(inString, parser) rootTag, rootClass = get_root_tag(rootNode) if rootClass is None: rootTag = 'k_source' rootClass = k_source rootObj = rootClass.factory() rootObj.build(rootNode) # Enable Python to collect the space used by the DOM. if not silence: sys.stdout.write('\n') rootObj.export(sys.stdout, 0, name_=rootTag, namespacedef_='') return rootObj def parseLiteral(inFileName, silence=False): parser = None doc = parsexml_(inFileName, parser) rootNode = doc.getroot() rootTag, rootClass = get_root_tag(rootNode) if rootClass is None: rootTag = 'k_source' rootClass = k_source rootObj = rootClass.factory() rootObj.build(rootNode) # Enable Python to collect the space used by the DOM. doc = None if not silence: sys.stdout.write('#from xml_parse import *\n\n') sys.stdout.write('import xml_parse as model_\n\n') sys.stdout.write('rootObj = model_.rootClass(\n') rootObj.exportLiteral(sys.stdout, 0, name_=rootTag) sys.stdout.write(')\n') return rootObj def main(): args = sys.argv[1:] if len(args) == 1: parse(args[0]) else: usage() if __name__ == '__main__': # import pdb; pdb.set_trace() main() __all__ = [ "archive", "argument", "bootloader", "bootloadersettings", "certificate", "certificates", "collectionModule", "configoption", "container", "containerconfig", "containers", "description", "dracut", "drivers", "entrypoint", "env", "environment", "expose", "extension", "file", "history", "hkd_cert", "hkd_revocation_list", "ignore", "image", "include", "initrd", "installmedia", "installoption", "k_source", "label", "labels", "luksformat", "machine", "namedCollection", "oemconfig", "option", "package", "packages", "partition", "partitions", "port", "preferences", "product", "profile", "profiles", "repository", "requires", "securelinux", "shimoption", "signing", "size", "source", "strip", "subcommand", "systemdisk", "type_", "user", "users", "vagrantconfig", "vmdisk", "vmdvd", "vmnic", "volume", "volumes", ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7543156 kiwi-11.1.8/kiwi/xml_state.py0000644000000000000000000036055215273675667013053 0ustar00# Copyright (c) 2015 SUSE Linux GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # import os from urllib.parse import urlparse from typing import ( List, Optional, Any, Dict, NamedTuple, Callable, TypedDict, Union, cast, ) import re import logging import copy from textwrap import dedent # project import kiwi.defaults as defaults from kiwi import xml_parse from kiwi.storage.disk import ptable_entry_type from kiwi.system.uri import Uri from kiwi.defaults import Defaults from kiwi.utils.size import StringToSize from kiwi.command import Command from kiwi.exceptions import ( KiwiProfileNotFound, KiwiTypeNotFound, KiwiDistributionNameError, KiwiFileAccessError, KiwiUriStyleUnknown, ) log = logging.getLogger('kiwi') description_type = NamedTuple( 'description_type', [('author', str), ('contact', str), ('specification', str)], ) package_type = NamedTuple( 'package_type', [ ('packages_section', xml_parse.packages), ('package_section', xml_parse.package), ], ) size_type = NamedTuple('size_type', [('mbytes', int), ('additive', str)]) volume_type = NamedTuple( 'volume_type', [ ('name', str), ('parent', str), ('size', str), ('realpath', str), ('mountpoint', Optional[str]), ('fullsize', bool), ('label', Optional[str]), ('attributes', list), ('is_root_volume', bool), ], ) class DracutT(NamedTuple): uefi: bool modules: List[str] drivers: List[str] class FileT(NamedTuple): target: str owner: str permissions: str class ContainerT(NamedTuple): name: str backend: str container_file: str fetch_only: bool fetch_command: Callable load_command: List[str] class HostKeyCertificateT(TypedDict): hkd_cert: List[str] hkd_revocation_list: List[str] hkd_ca_cert: str hkd_sign_cert: str class XMLState: """ **Implements methods to get stateful information from the XML data** :param object xml_data: parse result from XMLDescription.load() :param list profiles: list of used profiles :param object build_type: build section reference """ def __init__( self, xml_data: Any, profiles: Optional[List] = None, build_type: Any = None, ) -> None: self.root_partition_uuid: Optional[str] = None self.root_filesystem_uuid: Optional[str] = None self.host_architecture = defaults.PLATFORM_MACHINE self.xml_data = xml_data self.profiles = self._used_profiles(profiles) self.build_type = self._build_type_section(build_type) self.resolve_this_path() def get_preferences_sections(self) -> List: """ All preferences sections for the selected profiles that match the host architecture :return: list of section reference(s) :rtype: list """ preferences_list = [] for preferences in self._profiled(self.xml_data.get_preferences()): if self.preferences_matches_host_architecture(preferences): preferences_list.append(preferences) return preferences_list def get_description_section(self) -> description_type: """ The description section :return: description_type tuple providing the elements author contact and specification :rtype: tuple """ description = self.xml_data.get_description()[0] return description_type( author=description.get_author()[0], contact=description.get_contact()[0], specification=description.get_specification()[0].strip(), ) def get_users_sections(self) -> List: """ All users sections for the selected profiles :return: list of section reference(s) :rtype: list """ users = [] for users_section in self._profiled(self.xml_data.get_users()): if self.users_matches_host_architecture(users_section): users.append(users_section) return users def get_build_type_bundle_format(self) -> str: """ Return bundle_format for build type The bundle_format string is validated against the available name tags from kiwi.system.result::result_name_tags. :return: bundle format string :rtype: str """ return self.build_type.get_bundle_format() def get_build_type_name(self) -> str: """ Default build type name :return: Content of image attribute from build type :rtype: str """ return self.build_type.get_image() def btrfs_default_volume_requested(self) -> bool: """ Check if setting a default volume for btrfs is requested """ if self.build_type.get_btrfs_set_default_volume() is False: # Setting a default volume is explicitly switched off return False else: # In any other case (True | None) a default volume # is wanted and will be set return True def get_image_version(self) -> str: """ Image version from preferences section. Multiple occurences of version in preferences sections are not forbidden, however only the first version found defines the final image version :return: Content of section :rtype: str """ for preferences in self.get_preferences_sections(): version = preferences.get_version() if version: return version[0] return '' def get_initrd_system(self) -> str: """ Name of initrd system to use Depending on the image type a specific initrd system is either pre selected or free of choice according to the XML type setup. :return: 'dracut', 'kiwi' or 'none' :rtype: str """ pre_selection_map = { 'vmx': 'dracut', 'oem': 'dracut', 'iso': 'dracut', 'kis': 'dracut', 'pxe': 'kiwi', } build_type = self.get_build_type_name() default_initrd_system = pre_selection_map.get(build_type) or 'none' if build_type == 'iso': # iso type always use dracut as initrd system return default_initrd_system # Allow to choose for any other build type return self.build_type.get_initrd_system() or default_initrd_system def get_locale(self) -> Optional[List]: """ Gets list of locale names if configured. Takes the first locale setup from the existing preferences sections into account. :return: List of names or None :rtype: list|None """ for preferences in self.get_preferences_sections(): locale_section = preferences.get_locale() if locale_section: return locale_section[0].split(',') return None def get_rpm_locale(self) -> Optional[List]: """ Gets list of locale names to filter out by rpm if rpm-locale-filtering is switched on the the list always contains: [POSIX, C, C.UTF-8] and is extended by the optionaly configured locale :return: List of names or None :rtype: list|None """ if self.get_rpm_locale_filtering(): rpm_locale = ['POSIX', 'C', 'C.UTF-8'] configured_locale = self.get_locale() if configured_locale: for locale in configured_locale: rpm_locale.append(locale) return rpm_locale return None def get_rpm_locale_filtering(self) -> bool: """ Gets the rpm-locale-filtering configuration flag. Returns False if not present. :return: True or False :rtype: bool """ for preferences in self.get_preferences_sections(): locale_filtering = preferences.get_rpm_locale_filtering() if locale_filtering: return locale_filtering[0] return False def get_rpm_excludedocs(self) -> bool: """ Gets the rpm-excludedocs configuration flag. Returns False if not present. :return: True or False :rtype: bool """ for preferences in self.get_preferences_sections(): exclude_docs = preferences.get_rpm_excludedocs() if exclude_docs: return exclude_docs[0] return False def get_rpm_check_signatures(self) -> bool: """ Gets the rpm-check-signatures configuration flag. Returns False if not present. :return: True or False :rtype: bool """ for preferences in self.get_preferences_sections(): check_signatures = preferences.get_rpm_check_signatures() if check_signatures: return check_signatures[0] return False def get_package_manager(self) -> str: """ Get configured package manager from selected preferences section :return: Content of the section :rtype: str """ for preferences in self.get_preferences_sections(): package_manager = preferences.get_packagemanager() if package_manager: return package_manager[0] return Defaults.get_default_package_manager() def get_release_version(self) -> str: """ Get configured release version from selected preferences section :return: Content of the section or '' :rtype: str """ release_version = '' for preferences in self.get_preferences_sections(): release_version = preferences.get_release_version() if release_version: release_version = release_version[0] break return release_version def get_packages_sections(self, section_types: List) -> List: """ List of packages sections matching given section type(s) :param list section_types: type name(s) from packages sections :return: list of section reference(s) :rtype: list """ result = [] packages_sections = self._profiled(self.xml_data.get_packages()) for packages in packages_sections: packages_type = packages.get_type() if packages_type in section_types: result.append(packages) return result def requires_matches_host_architecture(self, requires: Any) -> bool: """ Tests if the given profile requires section is applicable for the current host architecture. If no architecture is specified within the section it is considered as a match returning True. Note: The XML section pointer must provide an arch attribute :param section: XML section object :return: True or False :rtype: bool """ return self._section_matches_host_architecture(requires) def volume_matches_host_architecture(self, volume: Any) -> bool: """ Tests if the given volume section is applicable for the current host architecture. If no architecture is specified within the section it is considered as a match returning True. Note: The XML section pointer must provide an arch attribute :param section: XML section object :return: True or False :rtype: bool """ return self._section_matches_host_architecture(volume) def package_matches_host_architecture(self, package: Any) -> bool: """ Tests if the given package section is applicable for the current host architecture. If no architecture is specified within the section it is considered as a match returning True. Note: The XML section pointer must provide an arch attribute :param section: XML section object :return: True or False :rtype: bool """ return self._section_matches_host_architecture(package) def users_matches_host_architecture(self, users: Any) -> bool: """ Tests if the given users section is applicable for the current host architecture. If no architecture is specified within the section it is considered as a match returning True. Note: The XML section pointer must provide an arch attribute :param section: XML section object :return: True or False :rtype: bool """ return self._section_matches_host_architecture(users) def collection_matches_host_architecture(self, collection: Any) -> bool: """ Tests if the given namedcollection section is applicable for the current host architecture. If no architecture is specified within the section it is considered as a match returning True. Note: The XML section pointer must provide an arch attribute :param section: XML section object :return: True or False :rtype: bool """ return self._section_matches_host_architecture(collection) def profile_matches_host_architecture(self, profile: Any) -> bool: """ Tests if the given profile section is applicable for the current host architecture. If no architecture is specified within the section it is considered as a match returning True. Note: The XML section pointer must provide an arch attribute :param section: XML section object :return: True or False :rtype: bool """ return self._section_matches_host_architecture(profile) def preferences_matches_host_architecture(self, preferences: Any) -> bool: """ Tests if the given preferences section is applicable for the current host architecture. If no architecture is specified within the section it is considered as a match returning True. Note: The XML section pointer must provide an arch attribute :param section: XML section object :return: True or False :rtype: bool """ return self._section_matches_host_architecture(preferences) def repository_matches_host_architecture(self, repository: Any) -> bool: """ Tests if the given repository section is applicable for the current host architecture. If no architecture is specified within the section it is considered as a match returning True. Note: The XML section pointer must provide an arch attribute :param section: XML section object :return: True or False :rtype: bool """ return self._section_matches_host_architecture(repository) def containers_matches_host_architecture(self, containers: Any) -> bool: """ Tests if the given containers section is applicable for the current host architecture. If no arch attribute is provided in the section it is considered as a match and returns: True. :param section: XML section object :return: True or False :rtype: bool """ return self._section_matches_host_architecture(containers) def container_matches_host_architecture(self, container: Any) -> bool: """ Tests if the given container section is applicable for the current host architecture. If no arch attribute is provided in the section it is considered as a match and returns: True. :param section: XML section object :return: True or False :rtype: bool """ return self._section_matches_host_architecture(container) def get_package_sections( self, packages_sections: List ) -> List[package_type]: """ List of package sections from the given packages sections. Each list element contains a tuple with the section reference and the section this package belongs to If a package entry specfies an architecture, it is only taken if the host architecture matches the configured architecture :param list packages_sections: :return: Contains list of package_type tuples .. code:: python [package_type(packages_section=object, package_section=object)] :rtype: list """ result = [] if packages_sections: for packages_section in packages_sections: package_list = packages_section.get_package() if package_list: for package in package_list: if self.package_matches_host_architecture(package): result.append( package_type( packages_section=packages_section, package_section=package, ) ) return result def get_to_become_deleted_packages(self, force: bool = True) -> List: """ List of package names from the type="delete" or type="uninstall" packages section(s) :param bool force: return "delete" type if True, "uninstall" type otherwise :return: package names :rtype: list """ result = [] to_become_deleted_packages_sections = self.get_packages_sections( ['delete' if force else 'uninstall'] ) package_list = self.get_package_sections( to_become_deleted_packages_sections ) if package_list: for package in package_list: result.append(package.package_section.get_name()) return sorted(list(set(result))) def get_bootstrap_packages_sections(self) -> List: """ List of packages sections matching type="bootstrap" :return: list of section reference(s) :rtype: list """ return self.get_packages_sections(['bootstrap']) def get_image_packages_sections(self) -> List: """ List of packages sections matching type="image" :return: list of section reference(s) :rtype: list """ return self.get_packages_sections(['image']) def get_bootstrap_packages( self, plus_packages: Optional[List] = None ) -> List: """ List of package names from the type="bootstrap" packages section(s) The list gets the selected package manager appended if there is a request to install packages inside of the image via a chroot operation :param list plus_packages: list of additional packages :return: package names :rtype: list """ result = [] bootstrap_packages_sections = self.get_bootstrap_packages_sections() package_list = self.get_package_sections(bootstrap_packages_sections) if package_list: for package in package_list: result.append(package.package_section.get_name().strip()) if self.get_system_packages(): package_manager_name = self.get_package_manager() if package_manager_name == 'dnf4': # The package name for dnf4 is just dnf. Thus # the name must be adapted in this case package_manager_name = 'dnf' elif package_manager_name == 'apk': package_manager_name = 'apk-tools' result.append(package_manager_name) if plus_packages: result += plus_packages return sorted(list(set(result))) def get_system_packages(self) -> List: """ List of package names from the packages sections matching type="image" and type=build_type :return: package names :rtype: list """ result = [] image_packages_sections = self.get_packages_sections( ['image', self.get_build_type_name()] ) package_list = self.get_package_sections(image_packages_sections) if package_list: for package in package_list: result.append(package.package_section.get_name().strip()) return sorted(list(set(result))) def get_bootstrap_files(self) -> Dict[str, FileT]: """ List of file names from the type="bootstrap" packages section(s) :return: file names :rtype: dict """ result = {} bootstrap_packages_sections = self.get_bootstrap_packages_sections() if bootstrap_packages_sections: for bootstrap_packages_section in bootstrap_packages_sections: file_list = bootstrap_packages_section.get_file() or [] for file in file_list: result[file.get_name()] = FileT( target=file.get_target() or '', owner=file.get_owner() or '', permissions=file.get_permissions() or '', ) return result def get_system_files(self) -> Dict[str, FileT]: """ List of file names from the packages sections matching type="image" and type=build_type :return: file names :rtype: dict """ result = {} image_packages_sections = self.get_packages_sections( ['image', self.get_build_type_name()] ) for packages in image_packages_sections: for file in packages.get_file(): result[file.get_name()] = FileT( target=file.get_target() or '', owner=file.get_owner() or '', permissions=file.get_permissions() or '', ) return result def get_bootstrap_archives(self) -> List: """ List of archive names from the type="bootstrap" packages section(s) :return: archive names :rtype: list """ result = [] bootstrap_packages_sections = self.get_bootstrap_packages_sections() if bootstrap_packages_sections: for bootstrap_packages_section in bootstrap_packages_sections: archive_list = bootstrap_packages_section.get_archive() if archive_list: for archive in archive_list: result.append(archive.get_name().strip()) return sorted(result) def get_system_archives(self) -> List: """ List of archive names from the packages sections matching type="image" and type=build_type :return: archive names :rtype: list """ result = [] image_packages_sections = self.get_packages_sections( ['image', self.get_build_type_name()] ) for packages in image_packages_sections: for archive in packages.get_archive(): result.append(archive.get_name().strip()) return sorted(result) def get_ignore_packages(self, section_type: str) -> List: """ List of ignore package names from the packages sections matching section_type and type=build_type :return: package names :rtype: list """ result = [] image_packages_sections = self.get_packages_sections( [section_type, self.get_build_type_name()] ) for packages in image_packages_sections: for package in packages.get_ignore(): if self.package_matches_host_architecture(package): result.append(package.get_name().strip()) return sorted(result) def get_system_files_ignore_packages(self) -> List[str]: """ List of ignore package names from the type="systemfiles" packages section(s) :return: package names :rtype: list """ return self.get_ignore_packages('systemfiles') def get_system_ignore_packages(self) -> List: """ List of ignore package names from the packages sections matching type="image" and type=build_type :return: package names :rtype: list """ return self.get_ignore_packages('image') def get_bootstrap_ignore_packages(self) -> List: """ List of ignore package names from the packages sections matching type="image" and type=build_type :return: package names :rtype: list """ return self.get_ignore_packages('bootstrap') def get_bootstrap_package_name(self) -> str: """ bootstrap_package name from type="bootstrap" packages section :return: bootstrap_package name :rtype: str """ typed_packages_sections = self.get_packages_sections( ['bootstrap', self.get_build_type_name()] ) bootstrap_package = '' for packages in typed_packages_sections: bootstrap_package = packages.get_bootstrap_package() if bootstrap_package: break return bootstrap_package def get_collection_type(self, section_type: str = 'image') -> str: """ Collection type from packages sections matching given section type. If no collection type is specified the default collection type is set to: onlyRequired :param str section_type: type name from packages section :return: collection type name :rtype: str """ typed_packages_sections = self.get_packages_sections( [section_type, self.get_build_type_name()] ) collection_type = 'onlyRequired' for packages in typed_packages_sections: packages_collection_type = packages.get_patternType() if packages_collection_type: collection_type = packages_collection_type break return collection_type def get_bootstrap_collection_type(self) -> str: """ Collection type for packages sections matching type="bootstrap" :return: collection type name :rtype: str """ return self.get_collection_type('bootstrap') def get_system_collection_type(self) -> str: """ Collection type for packages sections matching type="image" :return: collection type name :rtype: str """ return self.get_collection_type('image') def get_collection_modules(self) -> Dict[str, List[str]]: """ Dict of collection modules to enable and/or disable :return: Dict of the form: .. code:: python { 'enable': [ "module:stream", "module" ], 'disable': [ "module" ] } :rtype: dict """ modules: Dict[str, List[str]] = {'disable': [], 'enable': []} for packages in self.get_bootstrap_packages_sections(): for collection_module in packages.get_collectionModule(): module_name = collection_module.get_name() if collection_module.get_enable() is False: modules['disable'].append(module_name) else: stream = collection_module.get_stream() if stream: modules['enable'].append(f'{module_name}:{stream}') else: modules['enable'].append(module_name) return modules def get_collections(self, section_type: str = 'image') -> List: """ List of collection names from the packages sections matching type=section_type and type=build_type :return: collection names :rtype: list """ result = [] typed_packages_sections = self.get_packages_sections( [section_type, self.get_build_type_name()] ) for packages in typed_packages_sections: for collection in packages.get_namedCollection(): if self.collection_matches_host_architecture(collection): result.append(collection.get_name()) return sorted(list(set(result))) def get_bootstrap_collections(self) -> List: """ List of collection names from the packages sections matching type="bootstrap" :return: collection names :rtype: list """ return self.get_collections('bootstrap') def get_system_collections(self) -> List: """ List of collection names from the packages sections matching type="image" :return: collection names :rtype: list """ return self.get_collections('image') def get_products(self, section_type: str = 'image') -> List: """ List of product names from the packages sections matching type=section_type and type=build_type :param str section_type: type name from packages section :return: product names :rtype: list """ result = [] typed_packages_sections = self.get_packages_sections( [section_type, self.get_build_type_name()] ) for packages in typed_packages_sections: for product in packages.get_product(): result.append(product.get_name()) return list(set(result)) def get_bootstrap_products(self) -> List: """ List of product names from the packages sections matching type="bootstrap" :return: product names :rtype: list """ return self.get_products('bootstrap') def get_system_products(self) -> List: """ List of product names from the packages sections matching type="image" :return: product names :rtype: list """ return self.get_products('image') def is_xen_server(self) -> bool: """ Check if build type domain setup specifies a Xen Server (dom0) :return: True or False :rtype: bool """ return self.build_type.get_xen_server() def is_xen_guest(self) -> bool: """ Check if build type setup specifies a Xen Guest (domX) The check is based on the architecture, the firmware and xen_loader configuration values: * We only support Xen setup on the x86_64 architecture * Firmware pointing to ec2 means the image is targeted to run in Amazon EC2 which is a Xen guest * Machine setup with a xen_loader attribute also indicates a Xen guest target :return: True or False :rtype: bool """ if self.host_architecture != 'x86_64': # We only support Xen stuff on x86_64 return False firmware = self.build_type.get_firmware() machine_section = self.get_build_type_machine_section() if firmware and firmware in Defaults.get_ec2_capable_firmware_names(): # the image is targeted to run in Amazon EC2 which is a Xen system return True elif machine_section and machine_section.get_xen_loader(): # the image provides a machine section with a guest loader setup return True return False def get_build_type_partitions_section(self) -> Any: """ First partitions section from the build type section :return: section reference :rtype: xml_parse::partitions """ partitions_sections = self.build_type.get_partitions() if partitions_sections: return partitions_sections[0] return None def get_build_type_system_disk_section(self) -> Any: """ First system disk section from the build type section :return: section reference :rtype: xml_parse::systemdisk """ systemdisk_sections = self.build_type.get_systemdisk() if systemdisk_sections: return systemdisk_sections[0] return None def get_build_type_machine_section(self) -> Any: """ First machine section from the build type section :return: section reference :rtype: xml_parse::machine """ machine_sections = self.build_type.get_machine() if machine_sections: return machine_sections[0] return None def get_build_type_vagrant_config_section(self) -> Any: """ First vagrantconfig section from the build type section :return: section reference :rtype: xml_parse::vagrantconfig """ vagrant_config_sections = self.build_type.get_vagrantconfig() if vagrant_config_sections: return vagrant_config_sections[0] return None def get_vagrant_config_virtualbox_guest_additions(self) -> bool: """ Attribute virtualbox_guest_additions_present from the first vagrantconfig section. :return: True|False :rtype: bool """ vagrant_config_sections = self.get_build_type_vagrant_config_section() if not vagrant_config_sections.virtualbox_guest_additions_present: return Defaults.get_vagrant_config_virtualbox_guest_additions() else: return vagrant_config_sections.virtualbox_guest_additions_present def get_build_type_vmdisk_section(self) -> Any: """ First vmdisk section from the first machine section in the build type section :return: section reference :rtype: xml_parse::vmdisk """ machine_section = self.get_build_type_machine_section() if machine_section: vmdisk_sections = machine_section.get_vmdisk() if vmdisk_sections: return vmdisk_sections[0] return None def get_build_type_vmnic_entries(self) -> List: """ vmnic section(s) from the first machine section in the build type section :return: list of section reference(s) :rtype: list """ machine_section = self.get_build_type_machine_section() if machine_section: return machine_section.get_vmnic() else: return [] def get_build_type_vmdvd_section(self) -> Any: """ First vmdvd section from the first machine section in the build type section :return: section reference :rtype: xml_parse::vmdvd """ machine_section = self.get_build_type_machine_section() if machine_section: vmdvd_sections = machine_section.get_vmdvd() if vmdvd_sections: return vmdvd_sections[0] return None def get_build_type_vmconfig_entries(self) -> List: """ List of vmconfig-entry section values from the first machine section in the build type section :return: section reference(s) :rtype: list """ machine_section = self.get_build_type_machine_section() if machine_section: vmconfig_entries = machine_section.get_vmconfig_entry() if vmconfig_entries: return vmconfig_entries return [] def get_build_type_bootloader_section(self) -> Any: """ First bootloader section from the build type section :return: section reference :rtype: xml_parse::bootloader """ bootloader_sections = self.build_type.get_bootloader() if bootloader_sections: return bootloader_sections[0] return None def get_build_type_bootloader_name(self) -> str: """ Return bootloader name for selected build type :return: bootloader name :rtype: str """ bootloader = self.get_build_type_bootloader_section() return ( bootloader.get_name() if bootloader else Defaults.get_default_bootloader() ) def get_build_type_bootloader_bls(self) -> bool: """ Return bootloader bls setting for selected build type :return: True or False :rtype: bool """ bootloader = self.get_build_type_bootloader_section() if bootloader and bootloader.get_bls() is not None: return bootloader.get_bls() return True def get_build_type_bootloader_console(self) -> List[str]: """ Return bootloader console setting for selected build type :return: list of console settings for output (first element) and input (second element) :rtype: list """ result = ['', ''] bootloader = self.get_build_type_bootloader_section() if bootloader: console_out = bootloader.get_output_console() console_in = bootloader.get_input_console() console_in = console_in if console_in else console_out result = [ console_out if console_out and console_out != 'none' else '', console_in if console_in and console_in != 'none' else '', ] return result def get_build_type_bootloader_serial_line_setup(self) -> Optional[str]: """ Return bootloader serial line setup parameters for the selected build type :return: serial line setup :rtype: str """ bootloader = self.get_build_type_bootloader_section() if bootloader: return bootloader.get_serial_line() return None def get_build_type_bootloader_video_mode(self) -> str: """ Return bootloader video mode for the selected build type. If not specified the method returns "auto" as default mode name. :return: video mode name or auto :rtype: str """ bootloader = self.get_build_type_bootloader_section() if bootloader and (video_mode := bootloader.get_video_mode()): return video_mode return 'auto' def get_build_type_bootloader_timeout(self) -> Optional[int]: """ Return bootloader timeout setting for selected build type :return: timeout seconds :rtype: int """ bootloader = self.get_build_type_bootloader_section() if bootloader: return bootloader.get_timeout() return None def get_build_type_bootloader_timeout_style(self) -> Optional[str]: """ Return bootloader timeout style setting for selected build type :return: timeout_style string :rtype: str """ bootloader = self.get_build_type_bootloader_section() if bootloader: return bootloader.get_timeout_style() return None def get_build_type_bootloader_targettype(self) -> Optional[str]: """ Return bootloader target type setting. Only relevant for the zipl bootloader because zipl is installed differently depending on the storage target it runs later :return: target type string :rtype: str """ bootloader = self.get_build_type_bootloader_section() if bootloader: return bootloader.get_targettype() return None def get_build_type_bootloader_kernel_flavors(self) -> List[str]: """ Return the kernel flavors to create a boot menu entry for, in the order of the menu entries. The first flavor provides the default menu entry. A flavor listed more than once is only taken into account once :return: list of kernel flavor names, empty if not configured :rtype: list """ kernel_flavors: List[str] = [] bootloader = self.get_build_type_bootloader_section() if bootloader and bootloader.get_kernel_flavor(): for flavor in bootloader.get_kernel_flavor().split(','): flavor = flavor.strip() if flavor and flavor not in kernel_flavors: kernel_flavors.append(flavor) return kernel_flavors def get_build_type_bootloader_settings_section(self) -> Any: """ First bootloadersettings section from the build type bootloader section :return: section reference :rtype: xml_parse::bootloadersettings """ bootloader_section = self.get_build_type_bootloader_section() bootloader_settings_section = None if bootloader_section and bootloader_section.get_bootloadersettings(): bootloader_settings_section = ( bootloader_section.get_bootloadersettings()[0] ) return bootloader_settings_section def get_build_type_bootloader_securelinux_section(self) -> List[Any]: """ First securelinux section from the build type bootloader section :return: section reference :rtype: xml_parse::securelinux """ bootloader_section = self.get_build_type_bootloader_section() bootloader_securelinux_section = [] if bootloader_section and bootloader_section.get_securelinux(): bootloader_securelinux_section = ( bootloader_section.get_securelinux() ) return bootloader_securelinux_section def get_build_type_bootloader_environment_variables(self) -> List[str]: """ List of bootloader variables from the build type > bootloader > bootloadersettings section """ variable_list = [] bootloader_settings_section = ( self.get_build_type_bootloader_settings_section() ) if bootloader_settings_section: environment = bootloader_settings_section.get_environment() if environment and environment[0].get_env(): for env in environment[0].get_env(): variable_list.append( '{}{}'.format( env.get_name(), f'={env.get_value()}' if env.get_value() else '', ) ) return variable_list def get_bootloader_options(self, option_type: str) -> List[str]: """ List of custom options used in the process to run bootloader setup workloads """ result: List[str] = [] bootloader_settings = self.get_build_type_bootloader_settings_section() if bootloader_settings: options = [] if option_type == 'shim': options = bootloader_settings.get_shimoption() elif option_type == 'install': options = bootloader_settings.get_installoption() elif option_type == 'config': options = bootloader_settings.get_configoption() for option in options: result.append(option.get_name()) if option.get_value(): result.append(option.get_value()) return result def get_bootloader_shim_options(self) -> List[str]: """ List of custom options used in the process to setup secure boot """ return self.get_bootloader_options('shim') def get_bootloader_install_options(self) -> List[str]: """ List of custom options used in the bootloader installation """ return self.get_bootloader_options('install') def get_bootloader_config_options(self) -> List[str]: """ List of custom options used in the bootloader configuration """ return self.get_bootloader_options('config') def get_build_type_bootloader_use_disk_password(self) -> bool: """ Indicate whether the bootloader configuration should use the password protecting the encrypted root volume. :return: True|False :rtype: bool """ bootloader = self.get_build_type_bootloader_section() if bootloader: return bootloader.get_use_disk_password() return False def get_build_type_oemconfig_section(self) -> Any: """ First oemconfig section from the build type section :return: section reference :rtype: xml_parse::oemconfig """ oemconfig_sections = self.build_type.get_oemconfig() if oemconfig_sections: return oemconfig_sections[0] return None def get_oemconfig_oem_resize(self) -> bool: """ State value to activate/deactivate disk resize. Returns a boolean value if specified or True to set resize on by default :return: Content of section value :rtype: bool """ oemconfig = self.get_build_type_oemconfig_section() if oemconfig and oemconfig.get_oem_resize(): return oemconfig.get_oem_resize()[0] else: return True def get_oemconfig_oem_systemsize(self) -> int: """ State value to retrieve root partition size :return: Content of section value :rtype: int """ oemconfig = self.get_build_type_oemconfig_section() if oemconfig and oemconfig.get_oem_systemsize(): return int(oemconfig.get_oem_systemsize()[0]) else: return 0 def get_oemconfig_oem_multipath_scan(self) -> bool: """ State value to activate multipath maps. Returns a boolean value if specified or False :return: Content of section value :rtype: bool """ oemconfig = self.get_build_type_oemconfig_section() if oemconfig and oemconfig.get_oem_multipath_scan(): return oemconfig.get_oem_multipath_scan()[0] return False def get_oemconfig_swap_mbytes(self) -> Optional[int]: """ Return swapsize in MB if requested or None Operates on the value of oem-swap and if set to true returns the given size or the default value. :return: Content of section value or default :rtype: int """ oemconfig = self.get_build_type_oemconfig_section() if oemconfig and oemconfig.get_oem_swap(): swap_requested = oemconfig.get_oem_swap()[0] if swap_requested: swapsize = oemconfig.get_oem_swapsize() if swapsize: return swapsize[0] else: return Defaults.get_swapsize_mbytes() return None def get_oemconfig_swap_name(self) -> str: """ Return the swap space name Operates on the value of oem-swapname and if set returns the configured name or the default name: LVSwap The name of the swap space is used only if the image is configured to use the LVM volume manager. In this case swap is a volume and the volume takes a name. In any other case the given name will have no effect. :return: Content of section value or default :rtype: str """ oemconfig = self.get_build_type_oemconfig_section() if oemconfig and oemconfig.get_oem_swapname(): return oemconfig.get_oem_swapname()[0] return 'LVSwap' def get_build_type_containerconfig_section(self) -> Any: """ First containerconfig section from the build type section :return: section reference :rtype: xml_parse::containerconfig """ container_config_sections = self.build_type.get_containerconfig() if container_config_sections: return container_config_sections[0] return None def get_dracut_config(self, action: str) -> DracutT: """ Get dracut initrd config for the specified action """ uefi = False modules = [] drivers = [] initrd_sections = self.build_type.get_initrd() for initrd_section in initrd_sections: if initrd_section.get_action() == action: for dracut in initrd_section.get_dracut(): uefi = bool(dracut.get_uefi()) if dracut.get_module(): modules.append(dracut.get_module()) if dracut.get_driver(): drivers.append(dracut.get_driver()) return DracutT(uefi=uefi, modules=modules, drivers=drivers) def get_installmedia_initrd_modules(self, action: str) -> List[str]: """ Gets the list of modules to append in installation initrds :return: a list of dracut module names :rtype: list """ modules: List[str] = [] installmedia = self.build_type.get_installmedia() if not installmedia: return modules initrd_sections = installmedia[0].get_initrd() for initrd_section in initrd_sections: if initrd_section.get_action() == action: for module in initrd_section.get_dracut(): if module.get_module(): modules.append(module.get_module()) return modules def get_installmedia_initrd_drivers(self, action: str) -> List[str]: """ Gets the list of drivers to append in installation initrds :return: a list of dracut driver names :rtype: list """ drivers: List[str] = [] installmedia = self.build_type.get_installmedia() if not installmedia: return drivers initrd_sections = installmedia[0].get_initrd() for initrd_section in initrd_sections: if initrd_section.get_action() == action: for driver in initrd_section.get_dracut(): if driver.get_driver(): drivers.append(driver.get_driver()) return drivers def get_build_type_size( self, include_unpartitioned: bool = False ) -> Optional[size_type]: """ Size information from the build type section. If no unit is set the value is treated as mbytes :param bool include_unpartitioned: sets if the unpartitioned area should be included in the computed size or not :return: mbytes :rtype: int """ size_section = self.build_type.get_size() if size_section: unit = size_section[0].get_unit() additive = size_section[0].get_additive() unpartitioned = size_section[0].get_unpartitioned() value = int(size_section[0].get_valueOf_()) if not include_unpartitioned and unpartitioned is not None: value -= unpartitioned if unit == 'G': value *= 1024 return size_type(mbytes=value, additive=additive) return None def get_build_type_unpartitioned_bytes(self) -> int: """ Size of the unpartitioned area for image in megabytes :return: mbytes :rtype: int """ size_section = self.build_type.get_size() if size_section: unit = size_section[0].get_unit() or 'M' unpartitioned = size_section[0].get_unpartitioned() or 0 return StringToSize.to_bytes('{0}{1}'.format(unpartitioned, unit)) return 0 def get_disk_start_sector(self) -> int: """ First disk sector number to be used by the first disk partition. :return: number :rtype: int """ disk_start_sector = self.build_type.get_disk_start_sector() if disk_start_sector is None: disk_start_sector = Defaults.get_default_disk_start_sector() return disk_start_sector def get_build_type_spare_part_size(self) -> Optional[int]: """ Size information for the spare_part size from the build type. If no unit is set the value is treated as mbytes :return: mbytes :rtype: int """ spare_part_size = self.build_type.get_spare_part() if spare_part_size: return cast(int, self._to_mega_byte(spare_part_size)) return None def get_build_type_spare_part_fs_attributes(self) -> Optional[List]: """ Build type specific list of filesystem attributes applied to the spare partition. :return: list of strings or empty list :rtype: list """ spare_part_attributes = self.build_type.get_spare_part_fs_attributes() if spare_part_attributes: return spare_part_attributes.strip().split(',') return None def get_build_type_format_options(self) -> Dict: """ Disk format options returned as a dictionary :return: format options :rtype: dict """ result = {} format_options = self.build_type.get_formatoptions() if format_options: for option in format_options.split(','): key_value_list = option.split('=') if len(key_value_list) == 2: result[key_value_list[0]] = key_value_list[1] else: result[key_value_list[0]] = None return result def get_volume_group_name(self) -> str: """ Volume group name from selected section :return: volume group name :rtype: str """ systemdisk_section = self.get_build_type_system_disk_section() volume_group_name = None if systemdisk_section: volume_group_name = systemdisk_section.get_name() if not volume_group_name: volume_group_name = Defaults.get_default_volume_group_name() return volume_group_name def get_users(self) -> List: """ List of configured users. Each entry in the list is a single xml_parse::user instance. :return: list of section reference(s) :rtype: list """ users_list = [] users_names_added = [] for users_section in self.get_users_sections(): for user in users_section.get_user(): if user.get_name() not in users_names_added: users_list.append(user) users_names_added.append(user.get_name()) return users_list def get_user_groups(self, user_name: str) -> List[str]: """ List of group names matching specified user Each entry in the list is the name of a group and optionally its group ID separated by a colon, that the specified user belongs to. The first item in the list is the login or primary group. The list will be empty if no groups are specified in the description file. :return: groups data for the given user :rtype: list """ groups_list = [] for users_section in self.get_users_sections(): for user in users_section.get_user(): if user.get_name() == user_name: user_groups = user.get_groups() if user_groups: groups_list += user.get_groups().split(',') # order of list items matter, thus we don't use set() here # better faster, nicer solutions welcome :) result_group_list = [] for item in groups_list: if item not in result_group_list: result_group_list.append(item) return result_group_list def get_container_config(self) -> Dict: """ Dictionary of containerconfig information Takes attributes and subsection data from the selected section and stores it in a dictionary """ container_config = self._match_docker_base_data() container_config.update(self._match_docker_entrypoint()) container_config.update(self._match_docker_subcommand()) container_config.update(self._match_docker_expose_ports()) container_config.update(self._match_docker_volumes()) container_config.update(self._match_docker_stopsignal()) container_config.update(self._match_docker_environment()) container_config.update(self._match_docker_labels()) container_config.update(self._match_docker_history()) desc = self.get_description_section() author_contact = "{0} <{1}>".format(desc.author, desc.contact) if 'history' not in container_config: container_config['history'] = {} if 'author' not in container_config['history']: container_config['history']['author'] = author_contact if 'maintainer' not in container_config: container_config['maintainer'] = author_contact return container_config def set_container_config_tag(self, tag: str) -> None: """ Set new tag name in containerconfig section In order to set a new tag value an existing containerconfig and tag setup is required :param str tag: tag name """ container_config_section = self.get_build_type_containerconfig_section() if container_config_section and container_config_section.get_tag(): container_config_section.set_tag(tag) else: message = dedent( '''\n No section and/or tag attribute configured In order to set the tag {0} as new container tag, an initial containerconfig section including a tag setup is required ''' ) log.warning(message.format(tag)) def add_container_config_label(self, label_name: str, value: str) -> None: """ Adds a new label in the containerconfig section, if a label with the same name is already defined in containerconfig it gets overwritten by this method. :param str label_name: the string representing the label name :param str value: the value of the label """ if self.get_build_type_name() not in ['docker', 'oci']: message = dedent( '''\n Labels can only be configured for container image types docker and oci. ''' ) log.warning(message) return container_config_section = self.get_build_type_containerconfig_section() if not container_config_section: container_config_section = xml_parse.containerconfig( name=Defaults.get_default_container_name(), tag=Defaults.get_default_container_tag(), ) self.build_type.set_containerconfig([container_config_section]) labels = container_config_section.get_labels() if not labels: labels = [xml_parse.labels()] label_names = [] for label in labels[0].get_label(): label_names.append(label.get_name()) if label_name in label_names: labels[0].replace_label_at( label_names.index(label_name), xml_parse.label(label_name, value), ) else: labels[0].add_label(xml_parse.label(label_name, value)) container_config_section.set_labels(labels) def get_partitions(self) -> Dict[str, ptable_entry_type]: """ Dictionary of configured partitions. Each entry in the dict references a ptable_entry_type Each key in the dict references the name of the partition entry as handled by KIWI :return: Contains dict of ptable_entry_type tuples .. code:: python { 'NAME': ptable_entry_type( mbsize=int, clone=int, partition_name=str, partition_type=str, partition_id=Optional[int], mountpoint=str, filesystem=str, label=str ) } :rtype: dict """ partitions: Dict[str, ptable_entry_type] = {} partitions_section = self.get_build_type_partitions_section() if not partitions_section: return partitions for partition in partitions_section.get_partition(): name = partition.get_name() partition_name = partition.get_partition_name() or f'p.lx{name}' partitions[name] = ptable_entry_type( mbsize=cast(int, self._to_mega_byte(partition.get_size())), clone=( int(partition.get_clone()) if partition.get_clone() else 0 ), partition_name=partition_name, partition_type=partition.get_partition_type() or 't.linux', partition_id=( int(partition.get_part_id()) if partition.get_part_id() else None ), mountpoint=partition.get_mountpoint(), filesystem=partition.get_filesystem(), label=partition.get_label() or '', ) return partitions def get_host_key_certificates(self) -> List[HostKeyCertificateT]: cc_result = [] securelinux_list = self.get_build_type_bootloader_securelinux_section() for securelinux in securelinux_list: cc_certificates: HostKeyCertificateT = { 'hkd_cert': [], 'hkd_revocation_list': [], 'hkd_ca_cert': securelinux.get_hkd_ca_cert(), 'hkd_sign_cert': securelinux.get_hkd_sign_cert(), } for hkd_cert in securelinux.get_hkd_cert(): cc_certificates['hkd_cert'].append(hkd_cert.get_name()) for hkd_revocation_list in securelinux.get_hkd_revocation_list(): cc_certificates['hkd_revocation_list'].append( hkd_revocation_list.get_name() ) cc_result.append(cc_certificates) return cc_result def get_containers(self) -> List[ContainerT]: containers = [] def build_fetch_command( root_dir: str, container_uri: str = '', container_file_name: str = '', container_endpoint: str = '', ) -> None: pass # pragma: nocover for containers_section in self.get_containers_sections(): for container in containers_section.get_container(): if self.container_matches_host_architecture(container): fetch_command = build_fetch_command load_command = [] container_tag = container.get_tag() or 'latest' container_path = container.get_path() or '' container_endpoint = os.path.normpath( '{0}/{1}/{2}:{3}'.format( containers_section.get_source(), container_path, container.name, container_tag, ) ) container_file_name = '{0}/{1}_{2}'.format( defaults.LOCAL_CONTAINERS, container.name, container_tag ) container_backend = containers_section.get_backend() or '' if container_backend in [ 'podman', 'docker', 'container-snap', ]: if Defaults.is_buildservice_worker(): container_uri = Uri( 'obsrepositories:/{0}'.format( container_endpoint ), 'container', ).translate() def build_fetch_command( root_dir: str, container_uri: str = container_uri, container_file_name: str = container_file_name, container_endpoint: str = container_endpoint, ) -> None: def perform() -> None: Command.run( [ 'cp', '{0}.ociarchive'.format( container_uri ), os.path.normpath( '{0}/{1}'.format( root_dir, container_file_name, ) ), ] ) perform() fetch_command = build_fetch_command else: def build_fetch_command( root_dir: str, container_uri: str = '', container_file_name: str = container_file_name, container_endpoint: str = container_endpoint, ) -> None: def perform() -> None: Command.run( [ 'chroot', root_dir, '/usr/bin/skopeo', 'copy', 'docker://{0}'.format( container_endpoint ), 'oci-archive:{0}:{1}'.format( container_file_name, container_endpoint, ), ] ) perform() fetch_command = build_fetch_command if not container.get_fetch_only(): load_command = [ f'/usr/bin/{container_backend}', 'load', '-i', container_file_name, ] containers.append( ContainerT( name=f'{container.name}_{container_tag}', backend=container_backend, container_file=container_file_name, fetch_only=bool(container.get_fetch_only()), fetch_command=fetch_command, load_command=load_command, ) ) return containers def get_volumes(self) -> List[volume_type]: """ List of configured systemdisk volumes. Each entry in the list is a tuple with the following information * name: name of the volume * size: size of the volume * realpath: system path to lookup volume data. If no mountpoint is set the volume name is used as data path. * mountpoint: volume mount point and volume data path * fullsize: takes all space True|False * attributes: list of volume attributes handled via chattr :return: Contains list of volume_type tuples .. code:: python [ volume_type( name=volume_name, parent=volume_parent, size=volume_size, realpath=path, mountpoint=path, fullsize=True, label=volume_label, attributes=['no-copy-on-write'], is_root_volume=True|False ) ] :rtype: list """ volume_type_list: List[volume_type] = [] systemdisk_section = self.get_build_type_system_disk_section() selected_filesystem = self.build_type.get_filesystem() swap_mbytes = self.get_oemconfig_swap_mbytes() swap_name = self.get_oemconfig_swap_name() if not systemdisk_section: return volume_type_list volumes = systemdisk_section.get_volume() have_root_volume_setup = False have_full_size_volume = False if volumes: for volume in volumes: if not self.volume_matches_host_architecture(volume): continue # volume setup for a full qualified volume with name and # mountpoint information. See below for exceptions name = volume.get_name() parent = volume.get_parent() or '' mountpoint = volume.get_mountpoint() realpath = mountpoint size = volume.get_size() freespace = volume.get_freespace() fullsize = False label = volume.get_label() attributes = [] is_root_volume = False if volume.get_quota(): attributes.append(f'quota={volume.get_quota()}') if volume.get_copy_on_write() is False: # by default copy-on-write is switched on for any # filesystem. Thus only if no copy on write is requested # the attribute is handled attributes.append('no-copy-on-write') if volume.get_filesystem_check() is True: # by default filesystem check is switched off for any # filesystem except the rootfs. Thus only if filesystem # check is requested the attribute is handled attributes.append('enable-for-filesystem-check') if '@root' in name: # setup root volume, it takes an optional volume # name if specified as @root=name and has no specific # mountpoint. The default name is set to # defaults.ROOT_VOLUME_NAME if no other root volume # name is provided mountpoint = None realpath = '/' is_root_volume = True root_volume_expression = re.match(r'@root=(.+)', name) if root_volume_expression: name = root_volume_expression.group(1) else: name = defaults.ROOT_VOLUME_NAME have_root_volume_setup = True elif not mountpoint: # setup volume without mountpoint. In this case the name # attribute is used as mountpoint path and a name for the # volume is created from that path information mountpoint = name realpath = mountpoint name = self._to_volume_name(name) if size: size = 'size:' + format(self._to_mega_byte(size)) elif freespace: size = 'freespace:' + format(self._to_mega_byte(freespace)) else: size = 'freespace:' + format( Defaults.get_min_volume_mbytes(selected_filesystem) ) if ':all' in size: size = None fullsize = True have_full_size_volume = True volume_type_list.append( volume_type( name=name, parent=parent, size=size, fullsize=fullsize, mountpoint=mountpoint, realpath=realpath, label=label, attributes=attributes, is_root_volume=is_root_volume, ) ) if not have_root_volume_setup: # There must always be a root volume setup. It will be the # full size volume if no other volume has this setup volume_management = self.get_volume_management() root_volume_name = ( defaults.ROOT_VOLUME_NAME if volume_management == 'lvm' else '' ) if have_full_size_volume: size = 'freespace:' + format( Defaults.get_min_volume_mbytes(selected_filesystem) ) fullsize = False else: size = None fullsize = True volume_type_list.append( volume_type( name=root_volume_name, parent='', size=size, fullsize=fullsize, mountpoint=None, realpath='/', label=None, attributes=[], is_root_volume=True, ) ) if swap_mbytes and self.get_volume_management() == 'lvm': volume_type_list.append( volume_type( name=swap_name, parent='', size='size:{0}'.format(swap_mbytes), fullsize=False, mountpoint=None, realpath='swap', label='SWAP', attributes=[], is_root_volume=False, ) ) return volume_type_list def get_volume_management(self) -> Optional[str]: """ Provides information which volume management system is used :return: name of volume manager :rtype: str """ volume_filesystems = ['btrfs'] selected_filesystem = self.build_type.get_filesystem() selected_system_disk = self.get_build_type_system_disk_section() volume_management = None if selected_system_disk and selected_system_disk.get_preferlvm(): # LVM volume management is preferred, use it volume_management = 'lvm' elif selected_filesystem in volume_filesystems and selected_system_disk: # specified filesystem has its own volume management system volume_management = selected_filesystem elif selected_system_disk: # systemdisk section is specified with non volume capable # filesystem and no volume management preference. So let's # use LVM by default volume_management = 'lvm' return volume_management def get_drivers_list(self) -> List: """ List of driver names from all drivers sections matching configured profiles :return: driver names :rtype: list """ drivers_sections = self._profiled(self.xml_data.get_drivers()) result = [] if drivers_sections: for driver in drivers_sections: for file_section in driver.get_file(): result.append(file_section.get_name()) return result def get_strip_list(self, section_type: str) -> List: """ List of strip names matching the given section type and profiles :param str section_type: type name from packages section :return: strip names :rtype: list """ strip_sections = self._profiled(self.xml_data.get_strip()) result = [] if strip_sections: for strip in strip_sections: if strip.get_type() == section_type: for file_section in strip.get_file(): result.append(file_section.get_name()) return result def get_strip_files_to_delete(self) -> List: """ Items to delete from strip section :return: item names :rtype: list """ return self.get_strip_list('delete') def get_strip_tools_to_keep(self) -> List: """ Tools to keep from strip section :return: tool names :rtype: list """ return self.get_strip_list('tools') def get_strip_libraries_to_keep(self) -> List: """ Libraries to keep from strip section :return: librarie names :rtype: list """ return self.get_strip_list('libs') def get_include_section_reference_file_names(self) -> List[str]: """ List of all section file name references :return: List[str] :rtype: list """ include_files = [] for include in self.xml_data.get_include(): include_files.append(include.get_from()) return include_files def get_repository_sections(self) -> List: """ List of all repository sections for the selected profiles that matches the host architecture :return: section reference(s) :rtype: list """ repository_list = [] for repository in self._profiled(self.xml_data.get_repository()): if self.repository_matches_host_architecture(repository): repository_list.append(repository) return repository_list def get_containers_sections(self) -> List: """ List of all containers sections for the selected profiles that matches the host architecture :return: section reference(s) :rtype: list """ containers_list = [] for containers in self._profiled(self.xml_data.get_containers()): if self.containers_matches_host_architecture(containers): containers_list.append(containers) return containers_list def get_repository_sections_used_for_build(self) -> List: """ List of all repositorys sections used to build the image and matching configured profiles. :return: section reference(s) :rtype: list """ repos = self.get_repository_sections() return list(repo for repo in repos if not repo.get_imageonly()) def get_repository_sections_used_in_image(self) -> List: """ List of all repositorys sections to be configured in the resulting image matching configured profiles. :return: section reference(s) :rtype: list """ repos = self.get_repository_sections() return list( repo for repo in repos if repo.get_imageinclude() or repo.get_imageonly() ) def delete_repository_sections(self) -> None: """ Delete all repository sections matching configured profiles """ self.xml_data.set_repository([]) def delete_repository_sections_used_for_build(self) -> None: """ Delete all repository sections used to build the image matching configured profiles """ used_for_build = self.get_repository_sections_used_for_build() all_repos = self.get_repository_sections() self.xml_data.set_repository( [repo for repo in all_repos if repo not in used_for_build] ) def get_repositories_signing_keys(self) -> List[str]: """ Get list of signing keys specified on the repositories :raises KiwiUriStyleUnknown: if a local key is not specified as absolute file: URI """ key_file_list: List[str] = [] for repository in self.get_repository_sections() or []: for key_url in self.get_repository_signing_keys(repository): if key_url not in key_file_list: key_file_list.append(key_url) return key_file_list def get_repository_signing_keys( self, repository: xml_parse.repository ) -> List[str]: """ Get list of signing keys specified on the given repository :param repository: section reference :raises KiwiUriStyleUnknown: if a local key is not specified as absolute file: URI """ key_file_list: List[str] = [] release_version = self.get_release_version() release_vars = ['$releasever', '${releasever}'] for signing in repository.get_source().get_signing() or []: key_url = signing.get_key() uri = urlparse(key_url) is_absolute_path = uri.netloc in ( '', 'localhost', ) and uri.path.startswith(os.sep) if uri.scheme == 'file' and not is_absolute_path: # RFC8089: file URIs only support absolute paths raise KiwiUriStyleUnknown( f'Invalid signing key URI {key_url}: file URIs ' 'must specify an absolute path like file:/path ' 'or file:///path. Use this://path for a key file ' 'relative to the image description directory' ) normalized_key_url = Uri(key_url).translate() if release_version: for release_var in release_vars: if release_var in normalized_key_url: normalized_key_url = normalized_key_url.replace( release_var, release_version ) if normalized_key_url not in key_file_list: key_file_list.append(normalized_key_url) return key_file_list def set_repository( self, repo_source: str, repo_type: str, repo_alias: str, repo_prio: str, repo_imageinclude: bool = False, repo_package_gpgcheck: Optional[bool] = None, repo_signing_keys: List[str] = [], components: Optional[str] = None, distribution: Optional[str] = None, repo_gpgcheck: Optional[bool] = None, repo_sourcetype: Optional[str] = None, ) -> None: """ Overwrite repository data of the first repository :param str repo_source: repository URI :param str repo_type: type name defined by schema :param str repo_alias: alias name :param str repo_prio: priority number, package manager specific :param bool repo_imageinclude: setup repository inside of the image :param bool repo_package_gpgcheck: enable/disable package gpg checks :param list repo_signing_keys: list of signing key file names :param str components: component names for debian repos :param str distribution: base distribution name for debian repos :param bool repo_gpgcheck: enable/disable repo gpg checks """ repository_sections = self.get_repository_sections() if repository_sections: repository = repository_sections[0] if repo_alias: repository.set_alias(repo_alias) if repo_type: repository.set_type(repo_type) if repo_source: repository.get_source().set_path(repo_source) if repo_prio: repository.set_priority(int(repo_prio)) if repo_imageinclude: repository.set_imageinclude(repo_imageinclude) if repo_package_gpgcheck is not None: repository.set_package_gpgcheck(repo_package_gpgcheck) if repo_signing_keys: repository.get_source().set_signing( [xml_parse.signing(key=k) for k in repo_signing_keys] ) if components: repository.set_components(components) if distribution: repository.set_distribution(distribution) if repo_gpgcheck is not None: repository.set_repository_gpgcheck(repo_gpgcheck) if repo_sourcetype: repository.set_sourcetype(repo_sourcetype) def add_repository( self, repo_source: str, repo_type: str, repo_alias: Optional[str] = None, repo_prio: str = '', repo_imageinclude: bool = False, repo_package_gpgcheck: Optional[bool] = None, repo_signing_keys: List[str] = [], components: Optional[str] = None, distribution: Optional[str] = None, repo_gpgcheck: Optional[bool] = None, repo_sourcetype: Optional[str] = None, ) -> None: """ Add a new repository section at the end of the list :param str repo_source: repository URI :param str repo_type: type name defined by schema :param str repo_alias: alias name :param str repo_prio: priority number, package manager specific :param bool repo_imageinclude: setup repository inside of the image :param bool repo_package_gpgcheck: enable/disable package gpg checks :param list repo_signing_keys: list of signing key file names :param str components: component names for debian repos :param str distribution: base distribution name for debian repos :param bool repo_gpgcheck: enable/disable repo gpg checks """ priority_number: Optional[int] = None try: priority_number = int(repo_prio) except Exception: pass self.xml_data.add_repository( xml_parse.repository( type_=repo_type, alias=repo_alias, priority=priority_number, source=xml_parse.source( path=repo_source, signing=[ xml_parse.signing(key=k) for k in repo_signing_keys ], ), imageinclude=repo_imageinclude, package_gpgcheck=repo_package_gpgcheck, repository_gpgcheck=repo_gpgcheck, components=components, distribution=distribution, sourcetype=repo_sourcetype, ) ) def add_certificate(self, cert_file: str, target_distribution: str) -> None: """ Add to main section The main section will be created if it does not exist. Also setup the target_distribution in the resulting main section. """ certificates_section = self._profiled(self.xml_data.get_certificates()) if not certificates_section: self.xml_data.set_certificates( [ xml_parse.certificates( target_distribution=target_distribution, certificate=[xml_parse.certificate(name=cert_file)], ) ] ) else: certificates_section[0].set_target_distribution(target_distribution) certificates_section[0].add_certificate( xml_parse.certificate(name=cert_file) ) def get_certificates(self) -> List[str]: """ Read list of certificates """ cert_list = [] certificates_section = self._profiled(self.xml_data.get_certificates()) if certificates_section: for certificate in certificates_section[0].get_certificate(): cert_list.append(certificate.get_name()) return sorted(list(set(cert_list))) def get_certificates_target_distribution(self) -> str: """ Read CA target distribution """ target_distribution = '' certificates_section = self._profiled(self.xml_data.get_certificates()) if certificates_section: target_distribution = certificates_section[ 0 ].get_target_distribution() return target_distribution def resolve_this_path(self) -> None: """ Resolve any this:// repo source path and repo signing key into the path representing the target inside of the image description directory """ for repository in self.get_repository_sections() or []: repo_source = repository.get_source() repo_path = repo_source.get_path() if repo_path.startswith('this://'): repo_path = repo_path.replace('this://', '') repo_source.set_path( 'dir://{0}'.format( os.path.realpath( os.path.join( self.xml_data.description_dir, repo_path ) ) ) ) for signing in repo_source.get_signing() or []: key_path = signing.get_key() if key_path.startswith('this://'): key_path = key_path.replace('this://', '') signing.set_key( 'file://{0}'.format( os.path.realpath( os.path.join( self.xml_data.description_dir, key_path ) ) ) ) def copy_displayname(self, target_state: Any) -> None: """ Copy image displayname from this xml state to the target xml state :param object target_state: XMLState instance """ displayname = self.xml_data.get_displayname() if displayname: target_state.xml_data.set_displayname(displayname) def copy_name(self, target_state: Any) -> None: """ Copy image name from this xml state to the target xml state :param object target_state: XMLState instance """ target_state.xml_data.set_name(self.xml_data.get_name()) def copy_drivers_sections(self, target_state: Any) -> None: """ Copy drivers sections from this xml state to the target xml state :param object target_state: XMLState instance """ drivers_sections = self._profiled(self.xml_data.get_drivers()) if drivers_sections: for drivers_section in drivers_sections: target_state.xml_data.add_drivers(drivers_section) def copy_systemdisk_section(self, target_state: Any) -> None: """ Copy systemdisk sections from this xml state to the target xml state :param object target_state: XMLState instance """ systemdisk_section = self.get_build_type_system_disk_section() if systemdisk_section: target_state.build_type.set_systemdisk([systemdisk_section]) def copy_strip_sections(self, target_state: Any) -> None: """ Copy strip sections from this xml state to the target xml state :param object target_state: XMLState instance """ strip_sections = self._profiled(self.xml_data.get_strip()) if strip_sections: for strip_section in strip_sections: target_state.xml_data.add_strip(strip_section) def copy_machine_section(self, target_state: Any) -> None: """ Copy machine sections from this xml state to the target xml state :param object target_state: XMLState instance """ machine_section = self.get_build_type_machine_section() if machine_section: target_state.build_type.set_machine([machine_section]) def copy_bootloader_section(self, target_state: Any) -> None: """ Copy bootloader section from this xml state to the target xml state :param object target_state: XMLState instance """ bootloader_section = self.get_build_type_bootloader_section() if bootloader_section: target_state.build_type.set_bootloader([bootloader_section]) def copy_oemconfig_section(self, target_state: Any) -> None: """ Copy oemconfig sections from this xml state to the target xml state :param object target_state: XMLState instance """ oemconfig_section = self.get_build_type_oemconfig_section() if oemconfig_section: target_state.build_type.set_oemconfig([oemconfig_section]) def copy_repository_sections( self, target_state: Any, wipe: bool = False ) -> None: """ Copy repository sections from this xml state to the target xml state :param object target_state: XMLState instance :param bool wipe: delete all repos in target prior to copy """ repository_sections = self._profiled(self.xml_data.get_repository()) if repository_sections: if wipe: target_state.xml_data.set_repository([]) for repository_section in repository_sections: repository_copy = copy.deepcopy(repository_section) # profiles are not copied because they might not exist # in the target description repository_copy.set_profiles(None) target_state.xml_data.add_repository(repository_copy) def copy_preferences_subsections( self, section_names: List, target_state: Any ) -> None: """ Copy subsections of the preferences sections, matching given section names, from this xml state to the target xml state :param list section_names: preferences subsection names :param object target_state: XMLState instance """ target_preferences_sections = target_state.get_preferences_sections() if target_preferences_sections: target_preferences_section = target_preferences_sections[0] for preferences_section in self.get_preferences_sections(): for section_name in section_names: get_section_method = getattr( preferences_section, 'get_' + section_name ) section = get_section_method() if section: set_section_method = getattr( target_preferences_section, 'set_' + section_name ) set_section_method(section) def copy_build_type_attributes( self, attribute_names: List, target_state: Any ) -> None: """ Copy specified attributes from this build type section to the target xml state build type section :param list attribute_names: type section attributes :param object target_state: XMLState instance """ for attribute in attribute_names: get_type_method = getattr(self.build_type, 'get_' + attribute) attribute_value = get_type_method() if attribute_value: set_type_method = getattr( target_state.build_type, 'set_' + attribute ) set_type_method(attribute_value) def copy_bootincluded_packages(self, target_state: Any) -> None: """ Copy packages marked as bootinclude to the packages type=bootstrap section in the target xml state. The package will also be removed from the packages type=delete section in the target xml state if present there :param object target_state: XMLState instance """ target_packages_sections = ( target_state.get_bootstrap_packages_sections() ) if target_packages_sections: target_packages_section = target_packages_sections[0] package_names_added = [] packages_sections = self.get_packages_sections( ['image', 'bootstrap', self.get_build_type_name()] ) package_list = self.get_package_sections(packages_sections) if package_list: for package in package_list: if package.package_section.get_bootinclude(): target_packages_section.add_package( xml_parse.package( name=package.package_section.get_name() ) ) package_names_added.append( package.package_section.get_name() ) delete_packages_sections = target_state.get_packages_sections( ['delete'] ) package_list = self.get_package_sections(delete_packages_sections) if package_list: for package in package_list: package_name = package.package_section.get_name() if package_name in package_names_added: package.packages_section.package.remove( package.package_section ) def copy_bootincluded_archives(self, target_state: Any) -> None: """ Copy archives marked as bootinclude to the packages type=bootstrap section in the target xml state :param object target_state: XMLState instance """ target_bootstrap_packages_sections = ( target_state.get_bootstrap_packages_sections() ) if target_bootstrap_packages_sections: target_bootstrap_packages_section = ( target_bootstrap_packages_sections[0] ) packages_sections = self.get_packages_sections( ['image', 'bootstrap', self.get_build_type_name()] ) for packages_section in packages_sections: archive_list = packages_section.get_archive() if archive_list: for archive in archive_list: if archive.get_bootinclude(): target_bootstrap_packages_section.add_archive( xml_parse.archive(name=archive.get_name()) ) def copy_bootdelete_packages(self, target_state: Any) -> None: """ Copy packages marked as bootdelete to the packages type=delete section in the target xml state :param object target_state: XMLState instance """ target_delete_packages_sections = target_state.get_packages_sections( ['delete'] ) if not target_delete_packages_sections: target_delete_packages_sections = [ xml_parse.packages(type_='delete') ] target_state.xml_data.add_packages( target_delete_packages_sections[0] ) target_delete_packages_section = target_delete_packages_sections[0] packages_sections = self.get_packages_sections( ['image', 'bootstrap', self.get_build_type_name()] ) package_list = self.get_package_sections(packages_sections) if package_list: for package in package_list: if package.package_section.get_bootdelete(): target_delete_packages_section.add_package( xml_parse.package( name=package.package_section.get_name() ) ) def get_distribution_name_from_boot_attribute(self) -> str: """ Extract the distribution name from the boot attribute of the build type section. If no boot attribute is configured or the contents does not match the kiwi defined naming schema for boot image descriptions, an exception is thrown :return: lowercase distribution name :rtype: str """ boot_attribute = self.build_type.get_boot() if not boot_attribute: raise KiwiDistributionNameError( 'No boot attribute to extract distribution name from found' ) boot_attribute_format = '^.*-(.*)$' boot_attribute_expression = re.match( boot_attribute_format, boot_attribute ) if not boot_attribute_expression: raise KiwiDistributionNameError( 'Boot attribute "%s" does not match expected format %s' % (boot_attribute, boot_attribute_format) ) return boot_attribute_expression.group(1).lower() def get_fs_mount_option_list(self) -> List: """ List of root filesystem mount options The list contains one element with the information from the fsmountoptions attribute. The value there is passed along to the -o mount option :return: max one element list with mount option string :rtype: list """ option_list = [] mount_options = self.build_type.get_fsmountoptions() if mount_options: option_list = [mount_options] return option_list def get_efi_mount_option_list(self) -> List: """ List of EFI partition mount options The list contains one element with the information from the efimountoptions attribute. The value there is used as the mount options of the EFI partition in fstab :return: max one element list with mount option string :rtype: list """ option_list = [] mount_options = self.build_type.get_efimountoptions() if mount_options: option_list = [mount_options] return option_list def get_fs_create_option_list(self) -> List: """ List of root filesystem creation options The list contains elements with the information from the fscreateoptions attribute string that got split into its substring components :return: list with create options :rtype: list """ option_list = [] create_options = self.build_type.get_fscreateoptions() if create_options: option_list = create_options.split() return option_list def get_fs_readonly_create_option_list(self) -> List: """ List of overlay read-only root filesystem creation options The list contains elements with the information from the overlayroot_readonly_createoptions attribute string that got split into its substring components. These options are passed to the tool that builds the overlay read-only root filesystem (e.g. mkfs.erofs / mksquashfs), for example a larger pcluster via the erofs -C option. :return: list with create options :rtype: list """ option_list = [] create_options = ( self.build_type.get_overlayroot_readonly_createoptions() ) if create_options: option_list = create_options.split() return option_list def get_luks_credentials(self) -> Optional[str]: """ Return key or passphrase credentials to open the luks pool :return: data :rtype: str """ data = self.build_type.get_luks() if data: keyfile_name = None try: # try to interpret data as an URI uri = Uri(data) if not uri.is_remote(): keyfile_name = uri.translate() except Exception: # this doesn't look like a valid URI, continue as just data pass if keyfile_name: try: with open(keyfile_name) as keyfile: return keyfile.read() except Exception as issue: raise KiwiFileAccessError( f'Failed to read from {keyfile_name!r}: {issue}' ) return data def get_luks_format_options(self) -> List[str]: """ Return list of luks format options :return: list of options :rtype: list """ result = [] luksversion = self.build_type.get_luks_version() luksformat = self.build_type.get_luksformat() luks_pbkdf = self.build_type.get_luks_pbkdf() if luksversion: result.append('--type') result.append(luksversion) if luksformat: for option in luksformat[0].get_option(): result.append(option.get_name()) if option.get_value(): result.append(option.get_value()) if luks_pbkdf: # Allow to override the pbkdf algorithm that cryptsetup # uses by default. Cryptsetup may use argon2i by default, # which is not supported by all bootloaders. result.append('--pbkdf') result.append(luks_pbkdf) return result def get_derived_from_image_uri(self) -> List[Uri]: """ Uri object(s) of derived image if configured Specific image types can be based on one ore more derived images. This method returns the location of this image(s) when configured in the XML description :return: List of Uri instances :rtype: list """ image_uris = [] derived_images = self.build_type.get_derived_from() if derived_images: for derived_image in derived_images.split(','): image_uris.append(Uri(derived_image, repo_type='container')) return image_uris def set_derived_from_image_uri(self, uri: str) -> None: """ Set derived_from attribute to a new value In order to set a new value the derived_from attribute must be already present in the image configuration :param str uri: URI """ if self.build_type.get_derived_from(): self.build_type.set_derived_from(uri) else: message = dedent( '''\n No derived_from attribute configured in image In order to set the uri {0} as base container reference an initial derived_from attribute must be set in the type section ''' ) log.warning(message.format(uri)) def set_root_partition_uuid(self, uuid: str) -> None: """ Store PARTUUID provided in uuid as state information :param str uuid: PARTUUID """ self.root_partition_uuid = uuid def get_root_partition_uuid(self) -> Optional[str]: """ Return preserved PARTUUID """ return self.root_partition_uuid def set_root_filesystem_uuid(self, uuid: str) -> None: """ Store UUID provided in uuid as state information :param str uuid: UUID """ self.root_filesystem_uuid = uuid def get_root_filesystem_uuid(self) -> Optional[str]: """ Return preserved UUID """ return self.root_filesystem_uuid @staticmethod def get_archives_target_dirs( packages_sections_names: Optional[List[xml_parse.packages]], ) -> Dict: """ Dict of archive names and target dirs for packages section(s), if any :return: archive names and its target dir :rtype: dict """ result = {} if packages_sections_names: for package_section_name in packages_sections_names: for archive in package_section_name.get_archive(): result[archive.get_name().strip()] = ( archive.get_target_dir() ) return result def get_bootstrap_archives_target_dirs(self) -> Dict: """ Dict of archive names and target dirs from the type="bootstrap" packages section(s) :return: archive names and its target dir :rtype: dict """ return self.get_archives_target_dirs( self.get_packages_sections(['bootstrap']) ) def get_system_archives_target_dirs(self) -> Dict: """ Dict of archive names and its target dir from the packages sections matching type="image" and type=build_type :return: archive names and its target dir :rtype: dict """ return self.get_archives_target_dirs( self.get_packages_sections(['image', self.get_build_type_name()]) ) def _used_profiles(self, profiles: Optional[List[str]] = None) -> List[str]: """ return list of profiles to use. The method looks up the profiles section in the XML description and searches for profiles matching the architecture. If no arch specifier is set the profile is considered to be valid for any arch If the profiles argument is not set only profiles marked with the attribute import=true will be selected. Profiles specified in the argument will take the highest priority and causes to skip the lookup of import profiles in the XML description :param list profiles: selected profile names """ available_profiles = dict() import_profiles = [] for profiles_section in self.xml_data.get_profiles(): for profile in profiles_section.get_profile(): if self.profile_matches_host_architecture(profile): name = profile.get_name() available_profiles[name] = profile if profile.get_import(): import_profiles.append(name) if not profiles: return import_profiles else: resolved_profiles: List[str] = [] for profile in profiles: resolved_profiles += self._solve_profile_dependencies( profile, available_profiles, resolved_profiles ) return resolved_profiles def _section_matches_host_architecture(self, section: Any) -> bool: architectures = section.get_arch() if architectures: if self.host_architecture not in architectures.split(','): return False return True def _match_docker_base_data(self) -> Dict: container_config_section = self.get_build_type_containerconfig_section() container_base = {} if container_config_section: name = container_config_section.get_name() tag = container_config_section.get_tag() maintainer = container_config_section.get_maintainer() user = container_config_section.get_user() workingdir = container_config_section.get_workingdir() additional_names = container_config_section.get_additionalnames() if name: container_base['container_name'] = name if tag: container_base['container_tag'] = tag if additional_names: container_base['additional_names'] = additional_names.split(',') if maintainer: container_base['maintainer'] = maintainer if user: container_base['user'] = user if workingdir: container_base['workingdir'] = workingdir return container_base def _match_docker_entrypoint(self) -> Dict: container_config_section = self.get_build_type_containerconfig_section() container_entry = {} if container_config_section: entrypoint = container_config_section.get_entrypoint() if entrypoint and entrypoint[0].get_execute(): container_entry['entry_command'] = [entrypoint[0].get_execute()] argument_list = entrypoint[0].get_argument() if argument_list: for argument in argument_list: container_entry['entry_command'].append( argument.get_name() ) elif entrypoint and entrypoint[0].get_clear(): container_entry['entry_command'] = [] return container_entry def _match_docker_subcommand(self) -> Dict: container_config_section = self.get_build_type_containerconfig_section() container_subcommand = {} if container_config_section: subcommand = container_config_section.get_subcommand() if subcommand and subcommand[0].get_execute(): container_subcommand['entry_subcommand'] = [ subcommand[0].get_execute() ] argument_list = subcommand[0].get_argument() if argument_list: for argument in argument_list: container_subcommand['entry_subcommand'].append( argument.get_name() ) elif subcommand and subcommand[0].get_clear(): container_subcommand['entry_subcommand'] = [] return container_subcommand def _match_docker_expose_ports(self) -> Dict: container_config_section = self.get_build_type_containerconfig_section() container_expose: Dict[str, List[str]] = {} if container_config_section: expose = container_config_section.get_expose() if expose and expose[0].get_port(): container_expose['expose_ports'] = [] for port in expose[0].get_port(): container_expose['expose_ports'].append( format(port.get_number()) ) return container_expose def _match_docker_volumes(self) -> Dict: container_config_section = self.get_build_type_containerconfig_section() container_volumes: Dict[str, List[str]] = {} if container_config_section: volumes = container_config_section.get_volumes() if volumes and volumes[0].get_volume(): container_volumes['volumes'] = [] for volume in volumes[0].get_volume(): container_volumes['volumes'].append(volume.get_name()) return container_volumes def _match_docker_stopsignal(self) -> dict: container_config_section = self.get_build_type_containerconfig_section() container_stopsignal = {} if container_config_section: stopsignal_section = container_config_section.get_stopsignal() if stopsignal_section: container_stopsignal['stopsignal'] = stopsignal_section[0] return container_stopsignal def _match_docker_environment(self) -> Dict: container_config_section = self.get_build_type_containerconfig_section() container_env: Dict[str, Dict[str, str]] = {} if container_config_section: environment = container_config_section.get_environment() if environment and environment[0].get_env(): container_env['environment'] = {} for env in environment[0].get_env(): container_env['environment'][ env.get_name() ] = env.get_value() return container_env def _match_docker_labels(self) -> Dict: container_config_section = self.get_build_type_containerconfig_section() container_labels: Dict[str, Dict[str, str]] = {} if container_config_section: labels = container_config_section.get_labels() if labels and labels[0].get_label(): container_labels['labels'] = {} for label in labels[0].get_label(): container_labels['labels'][ label.get_name() ] = label.get_value() return container_labels def _match_docker_history(self) -> Dict: container_config_section = self.get_build_type_containerconfig_section() container_history: Dict[str, Dict[str, str]] = {} if container_config_section: history = container_config_section.get_history() if history: container_history['history'] = {} if history[0].get_created_by(): container_history['history']['created_by'] = history[ 0 ].get_created_by() if history[0].get_author(): container_history['history']['author'] = history[ 0 ].get_author() if history[0].get_launcher(): container_history['history']['launcher'] = history[ 0 ].get_launcher() if history[0].get_application_id(): container_history['history']['application_id'] = history[ 0 ].get_application_id() if history[0].get_package_version(): container_history['history']['package_version'] = history[ 0 ].get_package_version() container_history['history']['comment'] = history[ 0 ].get_valueOf_() return container_history def _solve_profile_dependencies( self, profile: str, available_profiles: Dict[str, Any], current_profiles: List[str], ) -> List[str]: if profile not in available_profiles: raise KiwiProfileNotFound( 'profile {0} not found for host arch {1}'.format( profile, self.host_architecture ) ) profiles_to_add = [] if profile not in current_profiles: profiles_to_add.append(profile) for required in available_profiles[profile].get_requires(): if self.requires_matches_host_architecture(required): if required.get_profile() not in current_profiles: profiles_to_add += self._solve_profile_dependencies( required.get_profile(), available_profiles, current_profiles + profiles_to_add, ) return profiles_to_add def _build_type_section(self, build_type: Optional[str] = None) -> Any: """ find type section matching build type and profiles or default """ # lookup all preferences sections for selected profiles image_type_sections = [] for preferences in self.get_preferences_sections(): image_type_sections += preferences.get_type() # lookup if build type matches provided type if build_type: for image_type in image_type_sections: if build_type == image_type.get_image(): return image_type raise KiwiTypeNotFound( 'Build type {0!r} not found for applied profiles: {1!r}'.format( build_type, self.profiles ) ) # lookup if build type matches primary type for image_type in image_type_sections: if image_type.get_primary(): return image_type # build type is first type section in XML sequence if image_type_sections: return image_type_sections[0] raise KiwiTypeNotFound( 'No build type defined with applied profiles: {0!r}'.format( self.profiles ) ) def _profiled(self, xml_abstract: List) -> List: """ return only those sections matching the instance stored profile list from the given XML abstract. Sections without a profile are wildcard sections and will be used in any case """ result = [] for section in xml_abstract: profiles = section.get_profiles() if profiles: for profile in profiles.split(','): if self.profiles and profile in self.profiles: result.append(section) break else: result.append(section) return result def _to_volume_name(self, name: str) -> str: name = name.strip() name = re.sub(r'^\/+', r'', name) name = name.replace('/', '_') return name def _to_mega_byte(self, size: str) -> Union[int, str]: value = re.search(r'(\d+)([MG]*)', format(size)) if value: number = value.group(1) unit = value.group(2) if unit == 'G': return int(number) * 1024 else: return int(number) else: return size ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7543156 kiwi-11.1.8/kiwi/xsl/convert74to75.xsl0000644000000000000000000000677615273675667014416 0ustar00 Changed attribute schemaversion to schemaversion from 7.4 to 7.5. Error: Schema version must be >= 7.4 For details how to update older schemas refer to: https://osinside.github.io/kiwi ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/kiwi/xsl/convert75to76.xsl0000644000000000000000000000345515273675667014407 0ustar00 Changed attribute schemaversion to schemaversion from 7.5 to 7.6. dnf4 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/kiwi/xsl/convert76to80.xsl0000644000000000000000000000271015273675667014374 0ustar00 Changed attribute schemaversion to schemaversion from 7.6 to 8.0. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/kiwi/xsl/convert80to81.xsl0000644000000000000000000000367315273675667014401 0ustar00 Changed attribute schemaversion to schemaversion from 8.0 to 8.1. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/kiwi/xsl/convert81to82.xsl0000644000000000000000000000353715273675667014402 0ustar00 Changed attribute schemaversion to schemaversion from 8.1 to 8.2. Delete obsolete use_for_bootstrap attribute from repository ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/kiwi/xsl/convert82to83.xsl0000644000000000000000000000372715273675667014405 0ustar00 Changed attribute schemaversion to schemaversion from 8.2 to 8.3. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/kiwi/xsl/convert83to84.xsl0000644000000000000000000000473415273675667014406 0ustar00 Changed attribute schemaversion to schemaversion from 8.3 to 8.4. ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/kiwi/xsl/convert84to85.xsl0000644000000000000000000000342715273675667014406 0ustar00 Changed attribute schemaversion to schemaversion from 8.4 to 8.5. Delete obsolete vga attribute from type ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/kiwi/xsl/include.xsl0000644000000000000000000000223215273675667013446 0ustar00 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/kiwi/xsl/master.xsl0000644000000000000000000000363015273675667013321 0ustar00 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/kiwi/xsl/pretty.xsl0000644000000000000000000000361415273675667013357 0ustar00 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/kiwi/xsl/print.xsl0000644000000000000000000000373715273675667013172 0ustar00 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7397454 kiwi-11.1.8/kiwi.yml0000644000000000000000000002274415273675667011222 0ustar00# KIWI - Build configuration file # # Below all configuration parameters available to control # KIWI's build process are listed as comments. The values shown # are representative examples. For most settings the value shown # is also the default applied by KIWI when nothing is specified, # but a few settings are context dependent (noted explicitly) # # To make any of the below effective, please uncomment the # respective section(s) and adapt the parameters according # to your needs # # Setup access to security keys #credentials: # # Specify private key(s) used for signing operations # verification_metadata_signing_key_file: /path/to/private.pem # Setup access options for the Open BuildService #obs: # # Specify the URL of the Open BuildService download server # download_url: http://download.opensuse.org/repositories # # Specify the URL of the Open BuildService API server # api_url: https://api.opensuse.org # # Specify if the BuildService download server is public or private. # # This information is used to verify if the request to populate # # the repositories via the imageinclude attribute is possible # public: true # Setup behaviour of the kiwi result bundle command #bundle: # # Specify if the bundle tarball should contain compressed results. # # Note: Already compressed result information will not be touched. # # There is no single default for this setting. The effective default # # depends on the image and its subformat: raw disk, filesystem images, # # vhdfixed and any disk subformat that does not override the generic # # base default to compressed, while vmdk, qcow2, ova, kis and enclave # # default to uncompressed. Setting this key overrides the default only for # # result formats whose bundle compression is configurable. # # The intention for result compression is to produce a smaller # # image than the original. Encrypted data generally grows when an # # attempt is made to compress it. Therefore this setting is ignored for # # filesystem images and for disk subformats derived from the generic base, # # including vhdfixed and vmdk, when a luks setup is present. For raw disks # # the override additionally requires luks_randomize. # compress: true # # Specify if the image build result and bundle should contain # # a .changes file. The .changes file contains the package changelog # # information from all packages installed into the image. # # Default: true. Automatically false when building inside the Open # # Build Service, which provides an equivalent .report file itself. # has_package_changes: true # # Specify shasum size for the bundle creation. Supported values # # are "256" (default) and "512". This value takes precedence # # over the global shasum size specified in the shasum section. # # If not specified, the global shasum size or the default is used. # shasum_size: "256" # Setup behaviour of XZ compressor #xz: # # Specify options used in any xz compression call # options: '--threads=0' # Setup behaviour of the data sync used to install the image payload #sync: # # Specify if sequences of null bytes in the source data should be # # turned into holes on the target. This adds the --sparse option to # # the rsync call. It costs sync time because the data has to be # # scanned for null sequences, and the gain depends on the payload. # # It is effective for binaries built for a 64k page size, which # # carry a zero tail per segment. # # Default: false # # # # Note: the option is skipped with a warning if it cannot be used, # # which is the case for rsync releases before 3.1.3 because they # # reject --sparse together with --inplace. # # # # Note: on filesystems that perform speculative preallocation the # # option alone does not reclaim space, because the skipped range # # becomes an allocated but unwritten extent rather than a hole. For # # those filesystems KIWI adds the mount options needed to prevent # # this to the install time mount only, so they do not appear in the # # fstab of the image. An explicit setting of the same option in the # # fsmountoptions attribute of the image description takes precedence. # # # # Note: For an encrypted image, gains on image size require that # # luks_randomize is set to false, otherwise all blocks remain # # written. Inside the image, sparse savings do manifest as more # # free space in the rsync target. # sparse: true # Setup process parameters for container image creation #container: # # Specify compression for container images # # Possible values are true, false, xz or none. # compress: true # Setup process parameters for ISO image creation #iso: # # Specify tool category which should be used to build iso images # # Possible values are: xorriso # tool_category: xorriso # # Specify media tag tool used to implant iso checksums # # Possible values are checkmedia and isomd5sum # media_tag_tool: checkmedia # Setup process parameters for OCI toolchain #oci: # # Specify OCI archive tool which should be used on creation of # # container archives for OCI compliant images, e.g docker # # Possible values are umoci and buildah # archive_tool: umoci # Setup shasum size # shasum: # # Specify shasum size, supported are "256" (default) and "512" # # Setting the size in this section globally applies to all # # shasum operations performed by KIWI. Please also see the # # bundle section for shasum size configuration specific to the # # result bundle creation. # size: "256" # Specify build constraints that applies during the image build # process. If one or more constraints are violated the build exits # with an appropriate error message. #build_constraints: # # Maximum result image size. The value can be specified in # # bytes or it can be specified with m=MB or g=GB. The constraint # # is checked prior to the result bundle creation # max_size: 700m # Setup process parameters for partition mapping #mapper: # # Specify tool to use for creating partition maps # # Possible values are: kpartx and partx # # Default: partx, except on s390 where the default is kpartx # part_mapper: partx # Setup process parameters to handle runtime checks #runtime_checks: # # Specify list of runtime checks to disable # disable: # # verify that the host has the required container tools installed # - check_container_tool_chain_installed # # verify that there are repositories configured # - check_repositories_configured # # verify that the URL for imageinclude repos is accessable # - check_image_include_repos_publicly_resolvable # # verify for legacy kiwi boot images that they exist on the host # - check_boot_description_exists # # verify if kiwi initrd_system was set if a boot attribute exists # - check_initrd_selection_required # # verify for legacy kiwi boot images that the same kernel is used # - check_consistent_kernel_in_boot_and_system_image # # check for reserved label names used in LVM setup # - check_volume_setup_defines_reserved_labels # # verify only one full size volume is specified for LVM images # - check_volume_setup_defines_multiple_fullsize_volumes # # verify no / volume setup is setup but the @root volume is used # - check_volume_setup_has_no_root_definition # # verify if volume label is really used with a volume setup # - check_volume_label_used_with_lvm # # verify that there is a xen domain setup for xen images # - check_xen_uniquely_setup_as_server_or_guest # # verify mediacheck is installed for ISO images that requests it # - check_mediacheck_installed # # verify that checkmedia/tagmedia is used with an MBR(msdos) partition table # - check_checkmedia_used_with_msdos_table # # verify dracut-kiwi-live is installed for ISO images # - check_dracut_module_for_live_iso_in_package_list # # verify dracut-kiwi-overlay is installed for overlay disk images # - check_dracut_module_for_disk_overlay_in_package_list # # verify dracut-kiwi-repart is installed for OEM disk images # - check_dracut_module_for_disk_oem_in_package_list # # verify dracut-kiwi-oem-dump is installed for OEM install images # - check_dracut_module_for_oem_install_in_package_list # # verify configured firmware is compatible with host architecture # - check_architecture_supports_iso_firmware_setup # # verify WSL naming conventions # - check_appx_naming_conventions_valid # # check kiwi dracut modules compatible with kiwi builder # - check_dracut_module_versions_compatible_to_kiwi # # check target_dir and image root on a supported filesystem # - check_target_dir_on_unsupported_filesystem # # check for unresolved include statements in the XML description # - check_include_references_unresolvable # # validate options passed to cryptsetup via luksformat element # - check_luksformat_options_valid # # check devicepersistency compatible with partition table type # - check_partuuid_persistency_type_used_with_mbr # # check efifatimagesize does not exceed the max El Torito load size # - check_efi_fat_image_has_correct_size # # check the target directory is not inside the shared cache directory # - check_target_directory_not_in_shared_cache # # check the swap partition name is only used with an LVM setup # - check_swap_name_used_with_lvm # # check the image description provides a version # - check_image_version_provided # # check no two build types with the same image attribute are selected # - check_image_type_unique # # check the bootloader environment is compatible with the loader # - check_bootloader_env_compatible_with_loader ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7554357 kiwi-11.1.8/package/python-kiwi-pkgbuild-template0000644000000000000000000000644015273675667016737 0ustar00# Maintainer: Marcus Schaefer # Maintainer: David Cassany pkgname=('python-kiwi' 'kiwi-man-pages' 'dracut-kiwi-lib' 'dracut-kiwi-oem-repart' 'dracut-kiwi-oem-dump' 'dracut-kiwi-live' 'dracut-kiwi-overlay') arch=(x86_64) pkgver=%%VERSION pkgrel=0 pkgdesc="KIWI - Appliance Builder Next Generation" url="https://github.com/SUSE/kiwi/tarball/master" license=('GPL3') makedepends=(make gcc python-build python-typer python-installer python-lxml python-poetry-core python-requests python-simplejson python-sphinx python-sphinx_rtd_theme python-wheel python-yaml shadow grep) provides=(kiwi-ng kiwi) source=("${pkgname}.tar.gz") changelog="${pkgname}.changes" md5sums=('%%MD5SUM') build() { export LANG=C.UTF-8 export LC_ALL=C.UTF-8 cd kiwi-${pkgver} make -C doc man python3 -m build --no-isolation --wheel } package_python-kiwi(){ depends=(python-typer python-simplejson python-lxml python-requests python-yaml python-cerberus python-progressbar grub qemu squashfs-tools gptfdisk pacman e2fsprogs xfsprogs btrfs-progs libisoburn lvm2 mtools parted multipath-tools rsync tar shadow screen kiwi-man-pages) optdepends=('gnupg: keyring creation for APT package manager' 'sshfs: boxbuild data sharing via sshfs' 'virtiofsd: boxbuild data sharing via virtiofs' 'podman: boxbuild in a container, stackbuild and stash') cd kiwi-${pkgver} python3 -m installer --destdir "${pkgdir}/" dist/*.whl ln -sr "${pkgdir}/usr/bin/kiwi-ng" "${pkgdir}/usr/bin/kiwi" install -Dm644 LICENSE "$pkgdir/usr/share/licenses/$pkgname/LICENSE" } package_kiwi-man-pages(){ cd kiwi-${pkgver} make buildroot="${pkgdir}/" docdir="/usr/share/doc/${pkgname}" install_package_docs } package_dracut-kiwi-lib(){ depends=(cryptsetup btrfs-progs gptfdisk coreutils e2fsprogs grep lvm2 mdadm parted util-linux xfsprogs dialog curl xz device-mapper dracut pv bc) cd kiwi-${pkgver} install -d -m 755 ${pkgdir}/usr/lib/dracut/modules.d/59kiwi-lib cp -a dracut/modules.d/59kiwi-lib ${pkgdir}/usr/lib/dracut/modules.d/ } package_dracut-kiwi-oem-repart(){ depends=(dracut-kiwi-lib=${pkgver}) cd kiwi-${pkgver} install -d -m 755 ${pkgdir}/usr/lib/dracut/modules.d/55kiwi-repart cp -a dracut/modules.d/55kiwi-repart ${pkgdir}/usr/lib/dracut/modules.d/ } package_dracut-kiwi-oem-dump(){ depends=(dracut-kiwi-lib=${pkgver} multipath-tools kexec-tools) cd kiwi-${pkgver} install -d -m 755 ${pkgdir}/usr/lib/dracut/modules.d/55kiwi-dump cp -a dracut/modules.d/55kiwi-dump ${pkgdir}/usr/lib/dracut/modules.d/ cp -a dracut/modules.d/59kiwi-dump-reboot ${pkgdir}/usr/lib/dracut/modules.d/ } package_dracut-kiwi-live(){ depends=(dracut dialog xfsprogs e2fsprogs util-linux device-mapper libisoburn parted) cd kiwi-${pkgver} install -d -m 755 ${pkgdir}/usr/lib/dracut/modules.d/55kiwi-live cp -a dracut/modules.d/55kiwi-live ${pkgdir}/usr/lib/dracut/modules.d/ } package_dracut-kiwi-overlay(){ depends=(dracut util-linux) cd kiwi-${pkgver} install -d -m 755 ${pkgdir}/usr/lib/dracut/modules.d/55kiwi-overlay cp -a dracut/modules.d/55kiwi-overlay ${pkgdir}/usr/lib/dracut/modules.d/ } package_dracut-kiwi-verity(){ depends=(dracut util-linux) cd kiwi-${pkgver} install -d -m 755 ${pkgdir}/usr/lib/dracut/modules.d/55kiwi-verity cp -a dracut/modules.d/50kiwi-verity ${pkgdir}/usr/lib/dracut/modules.d/ } ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.755758 kiwi-11.1.8/package/python-kiwi-rpmlintrc0000644000000000000000000000350115273675667015332 0ustar00# There is a kiwi manual page, kiwi-ng exists for the alternative system addFilter("no-manual-page-for-binary kiwi-ng") # don't blame on empty package, kiwi-boot-requires for obs # integration is used to provide a requires list but the package # itself comes with no content which is intentional. In addition # don't blame on lib dependency which are also an expected result # for this buildservice internal package addFilter("suse-filelist-empty .*") addFilter("explicit-lib-dependency .*") # don't check uid for tftpboot addFilter("non-standard-uid .*") # don't check for buildroot usage, kiwi's Makefile uses the same var name addFilter("rpm-buildroot-usage .*") # don't check position-independent-executable addFilter("position-independent-executable-suggested .*") # don't check for file duplicates addFilter("files-duplicate .*") addFilter("cross-directory-hard-link .*") # don't check for locale locations, they are used in the initrd only addFilter("file-not-in-%lang .*") # don't check for manual page of binaries used in initrd only addFilter("W: no-manual-page-for-binary dcounter"); addFilter("W: no-manual-page-for-binary startshell"); addFilter("W: no-manual-page-for-binary utimer"); addFilter("W: no-manual-page-for-binary driveready"); addFilter("W: no-manual-page-for-binary setctsid"); addFilter("W: no-manual-page-for-binary isconsole"); addFilter("W: no-manual-page-for-binary kiwicompat"); # kiwi master package can't be noarch if sub packages are arch specific addFilter("W: no-binary"); # if we add a provides to the obsoleted another warning that the # same package is provided and obsoleted appears. This warning is # pointless or doesn't explain what it really wants addFilter("W: obsolete-not-provided"); # providing deb packages from this spec requires the tag to be hard coded addFilter("W: hardcoded-packager-tag"); ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.755758 kiwi-11.1.8/package/python-kiwi-spec-template0000644000000000000000000007324415273675667016076 0ustar00# # spec file for package kiwi # # Copyright (c) 2023 SUSE LLC # # All modifications and additions to the file contributed by third parties # remain the property of their copyright owners, unless otherwise agreed # upon. The license for this file, and modifications and additions to the # file, is the same license as for the pristine package itself (unless the # license for the pristine package is not an Open Source License, in which # case the license is the MIT License). An "Open Source License" is a # license that conforms to the Open Source Definition (Version 1.9) # published by the Open Source Initiative. # # Please submit bugfixes or comments via: # # https://github.com/OSInside/kiwi/issues # # If they aren't provided by a system installed macro, define them %{!?_defaultdocdir: %global _defaultdocdir %{_datadir}/doc} %if 0%{?suse_version} && 0%{?suse_version} < 1600 %global __python3 /usr/bin/python3.11 %global python3_pkgversion 311 %else %{!?__python3: %global __python3 /usr/bin/python3} %{!?python3_pkgversion:%global python3_pkgversion 3} %endif %if %{undefined python3_sitelib} %if "%{_vendor}" == "debbuild" %global python3_sitelib %(%{__python3} -c "from distutils.sysconfig import get_python_lib; print(get_python_lib())") %else %global python3_sitelib %(%{__python3} -c "import sysconfig; print(sysconfig.get_path('platlib'))") %endif %endif %if %{undefined python3_version} %global python3_version %(%{__python3} -Esc "import sys; sys.stdout.write('{0.major}.{0.minor}'.format(sys.version_info))") %endif %if %{undefined python3_version_nodots} %global python3_version_nodots %(%{__python3} -Esc "import sys; sys.stdout.write('{0.major}{0.minor}'.format(sys.version_info))") %endif %if 0%{?debian} || 0%{?ubuntu} %global is_deb 1 %global pygroup python %global sysgroup admin %global develsuffix dev %else %global pygroup Development/Languages/Python %global sysgroup System/Management %global develsuffix devel %endif %if 0%{?fedora} || 0%{?rhel} || 0%{?suse_version} >= 1600 %bcond_without selinux %else %bcond_with selinux %endif Name: python-kiwi Version: %%VERSION Provides: kiwi-schema = 8.5 Release: 0 Url: https://github.com/OSInside/kiwi Summary: KIWI - Appliance Builder Next Generation License: GPL-3.0-or-later %if "%{_vendor}" == "debbuild" # Needed to set Maintainer in output debs Packager: Marcus Schaefer %endif Group: %{pygroup} Source0: %{name}.tar.gz Source1: %{name}-rpmlintrc # SUSE-specific source additions (1001+) Source1001: systemd-tmpfiles-for-suse.conf BuildRoot: %{_tmppath}/%{name}-%{version}-build %if 0%{?fedora} || 0%{?suse_version} BuildRequires: fdupes %endif %if 0%{?suse_version} BuildRequires: shadow %endif %if 0%{?debian} || 0%{?ubuntu} BuildRequires: passwd %endif # Main build requirements BuildRequires: gcc BuildRequires: make BuildRequires: python%{python3_pkgversion}-%{develsuffix} >= 3.9 BuildRequires: python%{python3_pkgversion}-build BuildRequires: python%{python3_pkgversion}-installer BuildRequires: python%{python3_pkgversion}-poetry-core >= 1.2.0 BuildRequires: python%{python3_pkgversion}-wheel # doc build requirements %if 0%{?debian} || 0%{?ubuntu} # only because of debbuild BuildRequires: python%{python3_pkgversion}-setuptools %endif BuildRequires: python%{python3_pkgversion}-typer >= 0.19.0 BuildRequires: python%{python3_pkgversion}-lxml BuildRequires: python%{python3_pkgversion}-requests BuildRequires: python%{python3_pkgversion}-simplejson %if 0%{?suse_version} BuildRequires: python%{python3_pkgversion}-Sphinx %else BuildRequires: python%{python3_pkgversion}-sphinx %endif %if 0%{?debian} || 0%{?ubuntu} BuildRequires: python%{python3_pkgversion}-sphinx-rtd-theme BuildRequires: python%{python3_pkgversion}-yaml %else BuildRequires: python%{python3_pkgversion}-sphinx_rtd_theme BuildRequires: python%{python3_pkgversion}-PyYAML %endif %description The KIWI Image System provides an operating system image builder for Linux supported hardware platforms as well as for virtualization and cloud systems like Xen, KVM, VMware, EC2 and more. %package -n kiwi-systemdeps-core Summary: KIWI - Core host system dependencies Group: %{sysgroup} Provides: kiwi-image-tbz-requires = %{version}-%{release} Obsoletes: kiwi-image-tbz-requires < %{version}-%{release} %if "%{_vendor}" != "debbuild" Provides: kiwi-image:tbz %endif %if 0%{?fedora} >= 42 Provides: kiwi-image:enclave Requires: eif_build %endif # tools conditionally used by kiwi %if 0%{?fedora} || 0%{?rhel} >= 8 Recommends: gnupg2 Recommends: apt Recommends: dpkg %endif %if 0%{?suse_version} Recommends: gpg2 %if 0%{?suse_version} >= 1650 Recommends: dnf %endif %endif # package managers required by distro %if 0%{?fedora} >= 41 || 0%{?rhel} >= 11 || 0%{?suse_version} >= 1650 Requires: dnf5 Requires: dnf5-plugins Provides: kiwi-packagemanager:dnf5 %endif %if (0%{?fedora} && 0%{?fedora} < 41) || (0%{?rhel} && 0%{?rhel} < 11) Requires: dnf4 Provides: kiwi-packagemanager:dnf Provides: kiwi-packagemanager:dnf4 Provides: kiwi-packagemanager:yum %endif %if (0%{?fedora} && 0%{?fedora} < 41) || (0%{?rhel} >= 8 && 0%{?rhel} < 11) Provides: kiwi-packagemanager:microdnf Requires: microdnf %endif %if 0%{?fedora} >= 26 || 0%{?suse_version} Requires: zypper Provides: kiwi-packagemanager:zypper %endif %if 0%{?debian} || 0%{?ubuntu} Requires: apt Requires: dpkg Requires: gnupg %endif # tools required by kiwi Requires: mtools Requires: rsync Requires: tar >= 1.2.7 Requires: cpio Requires: lsof Requires: openssl %description -n kiwi-systemdeps-core This metapackage installs the necessary system dependencies to run KIWI. %package -n kiwi-systemdeps-containers Summary: KIWI - host requirements for OCI container images Group: %{sysgroup} Provides: kiwi-image-docker-requires = %{version}-%{release} Obsoletes: kiwi-image-docker-requires < %{version}-%{release} %if "%{_vendor}" != "debbuild" Provides: kiwi-image:docker Provides: kiwi-image:oci %endif %if 0%{?suse_version} Requires: umoci %else Requires: buildah %endif Requires: skopeo %description -n kiwi-systemdeps-containers Host setup helper to pull in all packages required/useful on the build host to build OCI container images %package -n kiwi-systemdeps-containers-wsl Summary: KIWI - host requirements for WSL container images Group: %{sysgroup} Provides: kiwi-image-wsl-requires = %{version}-%{release} Obsoletes: kiwi-image-wsl-requires < %{version}-%{release} %if "%{_vendor}" != "debbuild" Provides: kiwi-image:appx Provides: kiwi-image:wsl %endif %if 0%{?suse_version} Requires: fb-util-for-appx %endif %if 0%{?fedora} || 0%{?rhel} Requires: appx-util %endif %description -n kiwi-systemdeps-containers-wsl Host setup helper to pull in all packages required/useful on the build host to build WSL container images %package -n kiwi-systemdeps-iso-media Summary: KIWI - host requirements for live and install iso images Group: %{sysgroup} Provides: kiwi-image-iso-requires = %{version}-%{release} Obsoletes: kiwi-image-iso-requires < %{version}-%{release} %if "%{_vendor}" != "debbuild" Provides: kiwi-image:iso %endif %if 0%{?suse_version} Requires: checkmedia %else Requires: isomd5sum %endif Requires: xorriso Requires: kiwi-systemdeps-core = %{version}-%{release} Requires: kiwi-systemdeps-filesystems = %{version}-%{release} Requires: kiwi-systemdeps-bootloaders = %{version}-%{release} %description -n kiwi-systemdeps-iso-media Host setup helper to pull in all packages required/useful on the build host to build live and install iso images. %package -n kiwi-systemdeps-bootloaders Summary: KIWI - host requirements for configuring bootloaders %if 0%{?suse_version} %ifarch x86_64 Requires: grub2-x86_64-efi %endif %ifarch %{ix86} x86_64 Recommends: gfxboot %endif %endif %if 0%{?fedora} || 0%{?rhel} %ifarch x86_64 Requires: grub2-efi-x64 %endif %endif %ifarch %arm aarch64 %if 0%{?fedora} || 0%{?rhel} Requires: uboot-tools %endif %if 0%{?suse_version} Requires: u-boot-tools %endif %endif %ifarch s390 s390x %if 0%{?fedora} || 0%{?rhel} Requires: s390utils %else Requires: s390-tools %if ! (0%{?debian} || 0%{?ubuntu}) Requires: grub2 %endif %endif %endif Requires: kiwi-systemdeps-core = %{version}-%{release} %description -n kiwi-systemdeps-bootloaders Host setup helper to pull in all packages required/useful on the build host for configuring bootloaders on images. %package -n kiwi-systemdeps-filesystems Summary: KIWI - host requirements for filesystems Group: %{sysgroup} Provides: kiwi-image-pxe-requires = %{version}-%{release} Obsoletes: kiwi-image-pxe-requires < %{version}-%{release} Provides: kiwi-filesystem-requires = %{version}-%{release} Obsoletes: kiwi-filesystem-requires < %{version}-%{release} %if "%{_vendor}" != "debbuild" Provides: kiwi-image:pxe Provides: kiwi-image:kis %if ! (0%{?rhel} >= 8) Provides: kiwi-filesystem:btrfs %endif Provides: kiwi-filesystem:ext2 Provides: kiwi-filesystem:ext3 Provides: kiwi-filesystem:ext4 Provides: kiwi-filesystem:squashfs Provides: kiwi-filesystem:xfs %if ! (0%{?suse_version} && 0%{?suse_version} < 1600) Provides: kiwi-filesystem:erofs Provides: kiwi-image:erofs %endif %endif Requires: dosfstools Requires: e2fsprogs Requires: xfsprogs %if ! (0%{?suse_version} && 0%{?suse_version} < 1600) Requires: erofs-utils %endif %if 0%{?suse_version} Requires: btrfsprogs %else %if ! (0%{?rhel} >= 8) Requires: btrfs-progs %endif %endif %if 0%{?suse_version} Requires: squashfs %else Requires: squashfs-tools %endif %ifnarch %{ix86} %{arm} %if "%{_vendor}" == "debbuild" Requires: qemu-utils %else %if 0%{?suse_version} Requires: qemu-tools %else Requires: qemu-img %endif %endif %endif Requires: kiwi-systemdeps-core = %{version}-%{release} %description -n kiwi-systemdeps-filesystems Host setup helper to pull in all packages required/useful on the build host to build filesystem images %package -n kiwi-systemdeps-disk-images Summary: KIWI - host requirements for disk images Group: %{sysgroup} Provides: kiwi-image-oem-requires = %{version}-%{release} Obsoletes: kiwi-image-oem-requires < %{version}-%{release} Provides: kiwi-image-vmx-requires = %{version}-%{release} Obsoletes: kiwi-image-vmx-requires < %{version}-%{release} %if "%{_vendor}" != "debbuild" Provides: kiwi-image:oem Provides: kiwi-image:vmx %endif Requires: kiwi-systemdeps-filesystems = %{version}-%{release} Requires: kiwi-systemdeps-bootloaders = %{version}-%{release} Requires: kiwi-systemdeps-iso-media = %{version}-%{release} %if 0%{?suse_version} >= 1600 Requires: binutils Requires: glibc-gconv-modules-extra %endif %if 0%{?suse_version} Requires: gptfdisk >= 1.0.9 %else Requires: gdisk >= 1.0.9 %endif Requires: lvm2 Requires: kpartx Requires: cryptsetup Requires: mdadm Requires: util-linux %if 0%{?fedora} || 0%{?rhel} || 0%{?suse_version} Requires: open-vmdk %endif # lsblk is part of util-linux-systemd on openSUSE %if 0%{?suse_version} Requires: util-linux-systemd %endif %description -n kiwi-systemdeps-disk-images Host setup helper to pull in all packages required/useful on the build host to build disk images %package -n kiwi-systemdeps-image-validation Summary: KIWI - host requirements for handling image descriptions better Group: %{sysgroup} %if 0%{?fedora} || 0%{?rhel} >= 8 || 0%{?suse_version} || 0%{?debian} || 0%{?ubuntu} Recommends: jing %endif %if 0%{?fedora} || 0%{?rhel} >= 8 || 0%{?suse_version} Requires: python%{python3_pkgversion}-solv %endif %if ! (0%{?rhel} && 0%{?rhel} < 8) Recommends: python%{python3_pkgversion}-anymarkup-core %endif %description -n kiwi-systemdeps-image-validation Host setup helper to pull in all packages required/useful on the build host to handling image descriptions better. This also includes reading of image descriptions for different markup languages %package -n kiwi-systemdeps-boxbuild Summary: KIWI - host requirements for building in a self contained box Group: %{sysgroup} %if "%{python3_pkgversion}" == "3" %if 0%{?suse_version} Provides: python%{python3_version_nodots}-kiwi_boxed_plugin = 0.2.60+1 Obsoletes: python%{python3_version_nodots}-kiwi_boxed_plugin < 0.2.60+1 %else Provides: python%{python3_version}-kiwi_boxed_plugin = 0.2.60+1 Obsoletes: python%{python3_version}-kiwi_boxed_plugin < 0.2.60+1 %endif %endif Requires: python%{python3_pkgversion}-kiwi = %{version}-%{release} %ifnarch %{ix86} %if 0%{?ubuntu} || 0%{?debian} Requires: qemu-kvm %else Requires: qemu %endif %endif Recommends: sshfs Recommends: virtiofsd >= 1.10 Recommends: podman %description -n kiwi-systemdeps-boxbuild Host setup helper to pull in all packages required/useful on the build host to build images in a self contained virtual machine or container via the kiwi-ng system boxbuild command %package -n kiwi-systemdeps-stackbuild Summary: KIWI - host requirements for building based on containers Group: %{sysgroup} %if "%{python3_pkgversion}" == "3" %if 0%{?suse_version} Provides: python%{python3_version_nodots}-kiwi_stackbuild_plugin = 1.0.14+1 Obsoletes: python%{python3_version_nodots}-kiwi_stackbuild_plugin < 1.0.14+1 %else Provides: python%{python3_version}-kiwi_stackbuild_plugin = 1.0.14+1 Obsoletes: python%{python3_version}-kiwi_stackbuild_plugin < 1.0.14+1 %endif %endif Requires: python%{python3_pkgversion}-kiwi = %{version}-%{release} Requires: kiwi-systemdeps-containers = %{version}-%{release} Requires: podman Requires: rsync %description -n kiwi-systemdeps-stackbuild Host setup helper to pull in all packages required/useful on the build host to store image root trees as containers and to build images based on containers via the kiwi-ng system stash and kiwi-ng system stackbuild commands %package -n kiwi-systemdeps Summary: KIWI - Host system dependencies Group: %{sysgroup} Requires: kiwi-systemdeps-core = %{version}-%{release} Requires: kiwi-systemdeps-bootloaders = %{version}-%{release} %if 0%{?fedora} || 0%{?rhel} || 0%{?suse_version} # None of the container build tools are available in Debian/Ubuntu Requires: kiwi-systemdeps-containers = %{version}-%{release} Requires: kiwi-systemdeps-containers-wsl = %{version}-%{release} %endif Requires: kiwi-systemdeps-filesystems = %{version}-%{release} Requires: kiwi-systemdeps-disk-images = %{version}-%{release} Requires: kiwi-systemdeps-iso-media = %{version}-%{release} %if 0%{?fedora} || 0%{?suse_version} Requires: kiwi-systemdeps-image-validation = %{version}-%{release} %endif %description -n kiwi-systemdeps Host setup helper to pull in all packages required/useful to leverage all functionality in KIWI. # python3-kiwi %package -n python%{python3_pkgversion}-kiwi Summary: KIWI - Appliance Builder Next Generation Group: %{pygroup} %if "%{python3_pkgversion}" == "3" %if 0%{?suse_version} Provides: python%{python3_version_nodots}-kiwi = %{version}-%{release} Conflicts: python%{python3_version_nodots}-kiwi_boxed_plugin < 0.2.60+1 Conflicts: python%{python3_version_nodots}-kiwi_stackbuild_plugin < 1.0.14+1 %else Provides: python%{python3_version}-kiwi = %{version}-%{release} Conflicts: python%{python3_version}-kiwi_boxed_plugin < 0.2.60+1 Conflicts: python%{python3_version}-kiwi_stackbuild_plugin < 1.0.14+1 %endif %endif Obsoletes: python2-kiwi Conflicts: python2-kiwi Conflicts: kiwi-man-pages < %{version} Requires: screen Requires: file Requires: sed Requires: bash Requires: python%{python3_pkgversion} >= 3.9 %if 0%{?ubuntu} || 0%{?debian} Requires: python%{python3_pkgversion}-yaml %else Requires: python%{python3_pkgversion}-PyYAML %endif Requires: python%{python3_pkgversion}-simplejson Requires: python%{python3_pkgversion}-typer >= 0.19.0 Requires: python%{python3_pkgversion}-lxml Requires: python%{python3_pkgversion}-requests Requires: python%{python3_pkgversion}-xmltodict Requires: python%{python3_pkgversion}-progressbar2 %if 0%{?suse_version} Requires: python%{python3_pkgversion}-Cerberus %else Requires: python%{python3_pkgversion}-cerberus %endif %if %{with selinux} Requires: (kiwi-selinux = %{version}-%{release} if selinux-policy) %endif %if ! (0%{?rhel} && 0%{?rhel} < 8) Recommends: kiwi-man-pages %endif %if "%{_vendor}" == "debbuild" # Avoid issues with not being able to use magic Provides Requires: kiwi-systemdeps = %{version}-%{release} %else # Only require core dependencies, and allow OBS to pull the rest through magic Provides Requires: kiwi-systemdeps-core = %{version}-%{release} %if ! 0%{?el7} # Retain default expectation for local installations Recommends: kiwi-systemdeps = %{version}-%{release} %endif %endif %description -n python%{python3_pkgversion}-kiwi Python 3 library of the KIWI Image System. Provides an operating system image builder for Linux supported hardware platforms as well as for virtualization and cloud systems like Xen, KVM, VMware, EC2 and more. %if "%{_vendor}" != "debbuild" %ifarch %{ix86} x86_64 %package -n kiwi-pxeboot Summary: KIWI - PXE boot structure Requires: syslinux %if 0%{?fedora} || 0%{?rhel} Requires(pre): shadow-utils %else Requires(pre): shadow %endif %if 0%{?suse_version} >= 1550 Requires(pre): user(tftp) %endif License: GPL-3.0-or-later Group: %{sysgroup} %description -n kiwi-pxeboot This package contains the basic PXE directory structure which is needed to serve kiwi built images via PXE. %endif %endif %package -n dracut-kiwi-lib Summary: KIWI - Dracut kiwi Library %if 0%{?fedora} || 0%{?rhel} || 0%{?suse_version} || 0%{?debian} # Ubuntu 16.04 OBS environments refuse to set up due to # initramfs-tools / dracut conflict and initramfs-tools is required # to set up the build environment... BuildRequires: dracut %endif Requires: bc Requires: cryptsetup %if 0%{?fedora} || 0%{?rhel} || 0%{?ubuntu} >= 1804 || 0%{?debian} >= 9 %if 0%{?rhel} && 0%{?rhel} < 8 Requires: btrfs-progs %else Recommends: btrfs-progs %endif Requires: gdisk >= 1.0.9 Requires: dracut-network %else %if 0%{?debian} || 0%{?ubuntu} Recommends: btrfs-tools Requires: gdisk >= 1.0.9 %else Requires: btrfsprogs Requires: gptfdisk >= 1.0.9 %endif %endif Requires: coreutils Requires: e2fsprogs Requires: grep Requires: lvm2 Requires: mdadm Requires: util-linux # lsblk is part of util-linux-systemd on openSUSE %if 0%{?suse_version} Requires: util-linux-systemd %endif Requires: xfsprogs Requires: dialog Requires: pv Requires: curl %if 0%{?debian} || 0%{?ubuntu} Requires: xz-utils Requires: dmsetup %else Requires: xz Requires: device-mapper %endif %ifarch s390 s390x %if 0%{?fedora} || 0%{?rhel} Requires: s390utils %else Requires: s390-tools %endif Requires: parted %endif License: GPL-3.0-or-later Group: %{sysgroup} %description -n dracut-kiwi-lib This package contains a collection of methods to provide a library for tasks done in other kiwi dracut modules %package -n dracut-kiwi-oem-repart Summary: KIWI - Dracut module for oem(repart) image type %if 0%{?fedora} || 0%{?rhel} || 0%{?suse_version} || 0%{?debian} # Ubuntu 16.04 OBS environments refuse to set up due to # initramfs-tools / dracut conflict and initramfs-tools is required # to set up the build environment... BuildRequires: dracut %endif Requires: dracut-kiwi-lib = %{version}-%{release} License: GPL-3.0-or-later Group: %{sysgroup} %description -n dracut-kiwi-oem-repart This package contains the kiwi-repart dracut module which is used to repartition the oem disk image to the current disk geometry according to the setup in the kiwi image configuration %package -n dracut-kiwi-oem-dump Summary: KIWI - Dracut module for oem(install) image type %if 0%{?fedora} || 0%{?rhel} || 0%{?suse_version} || 0%{?debian} # Ubuntu 16.04 OBS environments refuse to set up due to # initramfs-tools / dracut conflict and initramfs-tools is required # to set up the build environment... BuildRequires: dracut %endif Requires: dracut-kiwi-lib = %{version}-%{release} Requires: kexec-tools Requires: gawk Requires: kpartx License: GPL-3.0-or-later Group: %{sysgroup} %description -n dracut-kiwi-oem-dump This package contains the kiwi-dump and kiwi-dump-reboot dracut modules which is used to install an oem image onto a target disk. It implements a simple installer which allows for user selected target disk or unattended installation to target. The source of the image to install could be either from media(CD/DVD/USB) or from remote %package -n dracut-kiwi-live Summary: KIWI - Dracut module for iso(live) image type %if 0%{?fedora} || 0%{?rhel} || 0%{?suse_version} || 0%{?debian} # Ubuntu 16.04 OBS environments refuse to set up due to # initramfs-tools / dracut conflict and initramfs-tools is required # to set up the build environment... BuildRequires: dracut %endif Requires: dialog Requires: xfsprogs Requires: e2fsprogs Requires: util-linux # lsblk is part of util-linux-systemd on openSUSE %if 0%{?suse_version} Requires: util-linux-systemd %endif %if 0%{?debian} || 0%{?ubuntu} Requires: dmsetup Requires: dracut-network %endif %if 0%{?fedora} || 0%{?rhel} Requires: device-mapper Requires: dracut-network %endif %if 0%{?suse_version} Requires: device-mapper %endif Requires: dracut License: GPL-3.0-or-later Group: %{sysgroup} %description -n dracut-kiwi-live This package contains the kiwi-live dracut module which is used for booting iso(live) images built with KIWI %package -n dracut-kiwi-overlay Summary: KIWI - Dracut module for vmx(+overlay) image type %if 0%{?fedora} || 0%{?rhel} || 0%{?suse_version} || 0%{?debian} # Ubuntu 16.04 OBS environments refuse to set up due to # initramfs-tools / dracut conflict and initramfs-tools is required # to set up the build environment... BuildRequires: dracut %endif Requires: dracut-kiwi-lib = %{version}-%{release} Requires: dracut License: GPL-3.0-or-later Group: %{sysgroup} %description -n dracut-kiwi-overlay This package contains the kiwi-overlay dracut module which is used for booting vmx images built with KIWI and configured to use an overlay root filesystem %package -n dracut-kiwi-verity Summary: KIWI - Dracut module for disk with embedded verity metadata %if 0%{?fedora} || 0%{?rhel} || 0%{?suse_version} || 0%{?debian} # Ubuntu 16.04 OBS environments refuse to set up due to # initramfs-tools / dracut conflict and initramfs-tools is required # to set up the build environment... BuildRequires: dracut %endif Requires: dracut-kiwi-lib = %{version}-%{release} Requires: dracut BuildRequires: gcc License: GPL-3.0-or-later Group: %{sysgroup} %description -n dracut-kiwi-verity This package contains the kiwi-verity dracut module which is used for booting oem images built with KIWI and configured to use an embedded verity metadata block via the embed_verity_metadata type attribute %package -n kiwi-man-pages Summary: KIWI - manual pages License: GPL-3.0-or-later Group: %{sysgroup} %description -n kiwi-man-pages Provides manual pages to describe the kiwi commands %package -n kiwi-bash-completion Summary: Bash Completion for kiwi-ng Requires: bash-completion Requires: python%{python3_pkgversion}-kiwi = %{version} %if ! (0%{?debian} || 0%{?ubuntu}) Supplements: (%{name} and bash-completion) %endif BuildArch: noarch %description -n kiwi-bash-completion Bash command line completion support for python-kiwi - completion of subcommands, parameters and keywords for the kiwi-ng command. %if %{with selinux} %package -n kiwi-selinux Summary: SELinux module for kiwi-ng License: GPL-3.0-or-later BuildArch: noarch BuildRequires: selinux-policy BuildRequires: selinux-policy-devel BuildRequires: make %{?selinux_requires} %description -n kiwi-selinux This package provides the SELinux policy module to ensure kiwi-ng runs properly under an environment with SELinux enabled. %endif %prep %setup -q -n kiwi-%{version} # Drop shebang for kiwi/xml_parse.py, as we don't intend to use it # as an independent script sed -e "s|#!/usr/bin/env python||" -i kiwi/xml_parse.py # Build documentation make -C doc man %if %{with selinux} # Build SELinux module make -C selinux SHARE="%{_datadir}" TARGETS="kiwi" %endif # Build application wheel %{__python3} -m build --no-isolation --wheel %install # Install application %{__python3} -m installer --destdir %{buildroot} %{?is_deb:--no-compile-bytecode} dist/*.whl %if 0%{?is_deb} # Fix where files were installed mv %{buildroot}%{_prefix}/local/* %{buildroot}%{_prefix} mv %{buildroot}%{_prefix}/lib/python3* %{buildroot}%{_prefix}/lib/python3 %endif # Install man-pages, completion and kiwi default configuration make buildroot=%{buildroot}/ python=%{__python3} install # Install dracut modules make buildroot=%{buildroot}/ python=%{__python3} install_dracut # Install documentation README / LICENSE make buildroot=%{buildroot}/ docdir=%{_defaultdocdir}/ python=%{__python3} install_package_docs # Create symlinks for correct binaries ln -sr %{buildroot}%{_bindir}/kiwi-ng %{buildroot}%{_bindir}/kiwi ln -sr %{buildroot}%{_bindir}/kiwi-ng %{buildroot}%{_bindir}/kiwi-ng-3 %if %{with selinux} # Install SELinux module install -t %{buildroot}%{_datadir}/selinux/packages -Dpm 0644 selinux/kiwi.pp.bz2 %endif %if "%{_vendor}" != "debbuild" # kiwi pxeboot directory structure to be packed in kiwi-pxeboot %ifarch %{ix86} x86_64 %if 0%{?suse_version} >= 1600 install -D -m 755 %{SOURCE1001} %{buildroot}%{_tmpfilesdir}/kiwi-pxeboot.conf %else for i in KIWI pxelinux.cfg image upload boot; do \ mkdir -p %{buildroot}/srv/tftpboot/$i ;\ done %endif %endif %endif %if 0%{?fedora} || 0%{?suse_version} %fdupes %{buildroot}/srv/tftpboot %endif %if "%{_vendor}" != "debbuild" && 0%{?suse_version} < 1550 %ifarch %{ix86} x86_64 %pre -n kiwi-pxeboot #============================================================ # create user and group tftp if they does not exist if ! /usr/bin/getent group tftp >/dev/null; then %{_sbindir}/groupadd -r tftp fi if ! /usr/bin/getent passwd tftp >/dev/null; then %{_sbindir}/useradd -c "TFTP account" -d /srv/tftpboot -G tftp -g tftp \ -r -s /bin/false tftp fi %endif %endif %if %{with selinux} %pre -n kiwi-selinux %selinux_relabel_pre %post -n kiwi-selinux %selinux_modules_install %{_datadir}/selinux/packages/kiwi.pp.bz2 %selinux_relabel_post %posttrans -n kiwi-selinux %selinux_relabel_post %postun -n kiwi-selinux %selinux_modules_uninstall kiwi if [ $1 -eq 0 ]; then %selinux_relabel_post fi %endif %files -n kiwi-systemdeps-core # Empty metapackage %files -n kiwi-systemdeps-bootloaders # Empty metapackage %files -n kiwi-systemdeps-containers # Empty metapackage %files -n kiwi-systemdeps-containers-wsl # Empty metapackage %files -n kiwi-systemdeps-iso-media # Empty metapackage %files -n kiwi-systemdeps-filesystems # Empty metapackage %files -n kiwi-systemdeps-disk-images # Empty metapackage %files -n kiwi-systemdeps-image-validation # Empty metapackage %files -n kiwi-systemdeps-boxbuild # Empty metapackage %files -n kiwi-systemdeps-stackbuild # Empty metapackage %files -n kiwi-systemdeps # Empty metapackage %files -n python%{python3_pkgversion}-kiwi %dir %{_defaultdocdir}/python-kiwi %dir %{_usr}/share/kiwi %dir %{_usr}/share/kiwi/kiwi.yml.d %dir %_sysconfdir/kiwi.yml.d %doc %{_usr}/share/kiwi/kiwi.yml.example %{_bindir}/kiwi %{_bindir}/kiwi-ng %{_bindir}/kiwi-ng-3* %{python3_sitelib}/kiwi* %{_usr}/share/kiwi/xsl_to_v74/ %{_defaultdocdir}/python-kiwi/LICENSE %{_defaultdocdir}/python-kiwi/README %files -n kiwi-bash-completion %{_usr}/share/bash-completion/completions/kiwi-ng %files -n kiwi-man-pages %doc %{_mandir}/man8/* %files -n dracut-kiwi-lib %{_usr}/lib/dracut/modules.d/59kiwi-lib %files -n dracut-kiwi-oem-repart %{_usr}/lib/dracut/modules.d/55kiwi-repart %files -n dracut-kiwi-oem-dump %{_usr}/lib/dracut/modules.d/55kiwi-dump %{_usr}/lib/dracut/modules.d/59kiwi-dump-reboot %files -n dracut-kiwi-live %{_usr}/lib/dracut/modules.d/55kiwi-live %files -n dracut-kiwi-overlay %{_usr}/lib/dracut/modules.d/55kiwi-overlay %files -n dracut-kiwi-verity %{_usr}/lib/dracut/modules.d/50kiwi-verity %{_bindir}/kiwi-parse-verity %if "%{_vendor}" != "debbuild" %ifarch %{ix86} x86_64 %if 0%{?suse_version} >= 1600 %post -n kiwi-pxeboot %tmpfiles_create kiwi-pxeboot.conf %endif %files -n kiwi-pxeboot %if 0%{?suse_version} >= 1600 %{_tmpfilesdir}/kiwi-pxeboot.conf %ghost %dir %attr(0755,tftp,tftp) /srv/tftpboot %ghost %dir /srv/tftpboot/KIWI %ghost %dir /srv/tftpboot/pxelinux.cfg %ghost %dir /srv/tftpboot/image %ghost %dir /srv/tftpboot/upload %ghost %dir /srv/tftpboot/boot %else %if 0%{?suse_version} < 1550 %dir %attr(0755,tftp,tftp) /srv/tftpboot %endif %dir /srv/tftpboot/KIWI %dir /srv/tftpboot/pxelinux.cfg %dir /srv/tftpboot/image %dir /srv/tftpboot/upload %dir /srv/tftpboot/boot %endif %endif %endif %if %{with selinux} %files -n kiwi-selinux %doc selinux/README.md %license LICENSE %{_datadir}/selinux/packages/kiwi.pp.bz2 %endif %changelog ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7573156 kiwi-11.1.8/package/python-kiwi.changes0000644000000000000000000317573515273675667014757 0ustar00commit fcc3a74db108cc36ad0d617b05970c6243cd167c Author: Marcus Schäfer AuthorDate: Wed Mar 13 14:55:06 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 13 14:55:06 2019 +0100 Bump version: 9.17.28 → 9.17.29 commit c473cc0fdcacec039bfdbea31a94c39d5e227531 Author: Marcus Schäfer AuthorDate: Wed Mar 13 14:55:04 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 13 14:55:04 2019 +0100 Update changelog reference commit bfc2f814207e2a3fb5e158ecf27b048fe98a6004 Author: Marcus Schäfer AuthorDate: Wed Mar 13 14:53:52 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 13 14:53:52 2019 +0100 Fixed bumpversion helper Make sure the commit for the changelog reference update and the commit for the version bump have different timestamps by sleeping 2sec between the two actions commit 8aeaa874c2b14f155d0ca935fbc85e214b097ddd Author: Marcus Schäfer AuthorDate: Wed Mar 13 14:39:55 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 13 14:39:55 2019 +0100 Update API documentation In reference to Refactor OCI images packing the difference between docker and OCI images is just on packing format. Thus the extra docker container subclass is no longer present. commit abdfef8d1a71421fa38f91521fee51cb82e83a06 Author: Marcus Schäfer AuthorDate: Wed Mar 13 14:34:09 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 13 14:34:09 2019 +0100 Bump version: 9.17.27 → 9.17.28 commit c9c31abc53152bad2a0ae388c77b972c16397d76 Author: Marcus Schäfer AuthorDate: Wed Mar 13 14:34:08 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 13 14:34:08 2019 +0100 Update changelog reference commit c38cc03ef280220edf7a40b42b2479dc60a26db7 Author: Stefan Seyfried AuthorDate: Wed Mar 13 14:02:15 2019 +0100 Commit: Stefan Seyfried CommitDate: Wed Mar 13 14:02:15 2019 +0100 kiwi-dump-image: fix kiwi_oemdevicefilter for rd.debug commit 1dba376d672f3a79856b270e9d83af35f6bd51ca Author: Marcus Schäfer AuthorDate: Wed Mar 13 09:24:26 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 13 09:59:47 2019 +0100 Added bumpversion helper Script that also updates the changelog reference file before the version bump. It's optional to use this but it would be handy as the commit would show the rpm changelog differences from one tag to the other commit d701cdd3ca98da8605b5c0d1eb551ac76d4f6d04 Author: Marcus Schäfer AuthorDate: Tue Mar 12 22:38:28 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 13 09:59:47 2019 +0100 Fixed code smells on completion_generator Also update python interpreter to use for the completion and the changelog helpers commit 688d6d006425f6bda1044e23b1e15f9ef571d3ec Author: Marcus Schäfer AuthorDate: Tue Mar 12 18:01:24 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 13 09:59:47 2019 +0100 Update gitlab CI config The rpm stage needs python because the changelog script is now written in python commit 326efed73f6432e1dec9fa60f0f490820ec7ab14 Author: Marcus Schäfer AuthorDate: Mon Mar 11 08:09:02 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 13 09:26:40 2019 +0100 Update changelog file Fix changelog entries for their encoding, author name and format Also make sure commits are shown in reverse chronological order of the author date. We intentionally don't use the commit date because a commit can be older than the latest entry in the current reference file and would then not be part of the git log information commit 64bb2694f6eb7c91d65e2277623a50b305bbd2ef Author: Marcus Schäfer AuthorDate: Sun Mar 10 19:24:40 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 13 09:26:40 2019 +0100 Introduce better changelog handling The current way of creating the changelog file for the package is based on reading the entire history of the git repository and turns that information into a changelog. The downside of this approach is that any change in the code that creates this changelog information will impact older entries and could cause a conflict on the changes file of the released package. This usually leads to declined package submissions and blocks us in fixing bugs in the changelog generator. This commit changes the process in a way that only changes related to the oldest entry of a reference changelog file compared to the current branch are taken into account. This Fixes #979 commit 8e3ef494acbf0d28060a0e11d9179a766353ebd0 Author: Neal Gompa AuthorDate: Tue Mar 12 09:31:48 2019 -0400 Commit: Neal Gompa CommitDate: Tue Mar 12 09:31:48 2019 -0400 Drop duplicate EPEL7 reference in the test CentOS appliance We already request the standard, update, and extras repos and the EPEL7 repo separately. There's no reason to request the "centos" EPEL7 repo which combines standard+update and EPEL7 repos already. commit 0936db8fc1a335ee5d2efb6848fbdc9c17b5e038 Author: Dan Čermák AuthorDate: Fri Mar 1 12:23:30 2019 +0100 Commit: Dan Čermák CommitDate: Tue Mar 12 12:29:56 2019 +0100 Extend the GitLab-CI pipeline - build the documentation in the build_doc stage - run tests for all supported Python versions in tox_check - build an RPM for Fedora 29 & OpenSUSE Tumbleweed in RPM stage commit 0681fb4d7335c1b496a62663fae4b56876ffdc8e Author: Dan Čermák AuthorDate: Tue Mar 5 11:15:28 2019 +0100 Commit: Dan Čermák CommitDate: Tue Mar 12 12:29:50 2019 +0100 Add GitLab CI pipeline status to README.rst commit ef60cf0e680e46e13bc1b4679e4723ad73847eee Author: Stefan Seyfried AuthorDate: Mon Mar 11 14:36:26 2019 +0100 Commit: Stefan Seyfried CommitDate: Mon Mar 11 14:36:26 2019 +0100 centos-appliance: reorder repos to fix build EPEL has older package versions of e.g. librepo, which breaks dnf. Re-prioritize to prefer the good CentOS packages instead of bad EPEL. commit 8f1048f840c0db22ecd0b99832ad146479ec2653 Author: David Cassany AuthorDate: Tue Feb 12 16:54:41 2019 +0100 Commit: David Cassany CommitDate: Mon Mar 11 13:54:42 2019 +0100 Refactor OCI images packing This commit refactors the OCI images support: * added import_container_image and export_container_image methods to oci_tools classes. 'umoci' and 'buildah' consume different formats thus the inital skopeo call to import a container is tool dependent. * use oci-archive transport for packing the OCI images, this causes docker and oci operations to just diverge on transport type. * add_tag method no longer needed in oci_tools/base, skopeo is used for that matter. * container/docker.py class is no longer needed. The difference between docker and OCI images is just on packing format which is just a parameter in skopeo. It does not deserve a dedicated class * system/root_import/docker.py class no longer needed. The difference between OCI and Docker class was just the transport type for the skopeo call. It does not deserve a dedicated class commit fa9c865bb1f03a07340d9eea9a396de3af068977 Author: David Cassany AuthorDate: Sun Mar 10 18:20:11 2019 +0100 Commit: David Cassany CommitDate: Sun Mar 10 18:34:50 2019 +0100 Adding a derived docker image build test commit 6414a556b6562da6894f2623e958ff8e78138112 Author: Marcus Schäfer AuthorDate: Sun Mar 10 15:33:39 2019 +0100 Commit: Marcus Schäfer CommitDate: Sun Mar 10 15:33:39 2019 +0100 Bump version: 9.17.26 → 9.17.27 commit 49ed90656e42ea7c93187fb0c6bcab4de03847fa Author: Neal Gompa AuthorDate: Fri Mar 8 06:05:23 2019 -0500 Commit: Neal Gompa CommitDate: Fri Mar 8 06:07:29 2019 -0500 Use correct GRUB 2 and shim EFI packages for test CentOS 7 appliance CentOS 7 has inherited the changes from Fedora in how its EFI binaries are packaged, so we need to adapt to handle those and build the appliance properly. commit 1a682b678c5f41e66aec1990e93a839e8131cfc6 Author: Marcus Schäfer AuthorDate: Fri Mar 8 10:51:03 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 8 10:51:03 2019 +0100 Fixed evaluation of @root size setup The @root volume setup allows to specify a size for the root volume in an LVM setup. The size setting was not respected and the root volume was always resized to the rest space available. This patch fixes the read_volume_setup_all_free method on the dracut kiwi library to know if there is root volume setup and respect its contents. This Fixes #983 commit 282e6b7823eeca619952f08e4f781f4643889799 Author: Neal Gompa AuthorDate: Thu Mar 7 20:55:20 2019 -0500 Commit: Neal Gompa CommitDate: Thu Mar 7 20:55:20 2019 -0500 Update generated configuration file for DNF The dnf.conf file generated by KIWI contained some obsolete options as well as options that have been renamed. This change updates the options set so that they match what is expected by DNF and configures the appropriate behavior. commit 2a8f08191d2b93bcd037150a6ee1cd255ff2e6a0 Author: Marcus Schäfer AuthorDate: Thu Mar 7 16:36:46 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 7 16:36:46 2019 +0100 Bump version: 9.17.25 → 9.17.26 commit d11e7b48fc57068c8f5950990407d811aacf237a Author: Marcus Schäfer AuthorDate: Thu Mar 7 16:34:48 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 7 16:34:48 2019 +0100 hotfix runtime check for count of fullsize volumes The check did not respect images that do not come up with a systemdisk section. systemdisk is an optional section and the test did not respect this and failed with a stack trace commit 824d1be9c940a81c6afd880d44230152e85f855f Author: Marcus Schäfer AuthorDate: Thu Mar 7 15:56:25 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 7 15:56:25 2019 +0100 Bump version: 9.17.24 → 9.17.25 commit 94a006d8bad4323b15b7e464408c7de51c27ac84 Author: Marcus Schäfer AuthorDate: Thu Mar 7 15:54:05 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 7 15:54:05 2019 +0100 Update provider support status in vagrant docs commit 21b4bce5a6448a7e19bedbc1c0fdc9b6cf25868b Author: Marcus Schäfer AuthorDate: Thu Mar 7 15:46:24 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 7 15:46:24 2019 +0100 Rebuild schema docs Create an up to date state of the oxygen schema doc in the repo commit ad5b19a9e2b4350a517268a0caaf095d02aa0310 Author: Marcus Schäfer AuthorDate: Thu Mar 7 15:44:35 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 7 15:44:35 2019 +0100 Fixed Title underline too short warning in the doc commit 921fa17f4fe7415e4e5e21a8636c72e7d76dc1d3 Author: Marcus Schäfer AuthorDate: Thu Mar 7 15:38:13 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 7 15:38:13 2019 +0100 Fixed permanent redirect links in documentation commit ae2c9ddf3475755d8d08fe16c27064af11797fb2 Author: Marcus Schäfer AuthorDate: Thu Mar 7 15:33:09 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 7 15:33:09 2019 +0100 Bump version: 9.17.23 → 9.17.24 commit b43ac0f24f8d91a212c3ac8fbdc65250840fdceb Author: Marcus Schäfer AuthorDate: Thu Mar 7 14:02:55 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 7 14:02:55 2019 +0100 Cleanup example_dot_profile_config.xml Don't use multiple all size volumes commit e1dc183066bae78ae46c28050f3903ab072e65b4 Author: Dan Čermák AuthorDate: Thu Mar 7 12:32:01 2019 +0100 Commit: Dan Čermák CommitDate: Thu Mar 7 13:34:07 2019 +0100 Add different installation methods to the documentation commit 207e8d4034aea6ef74147b548248fc82904d17fa Author: Dan Čermák AuthorDate: Thu Feb 28 14:46:46 2019 +0100 Commit: Dan Čermák CommitDate: Thu Mar 7 13:33:55 2019 +0100 Extend documentation about using KIWI to build vagrant images commit d9b1bb3dc8e3afffc25449103e0d37623db0671e Author: Dan Čermák AuthorDate: Thu Feb 28 14:23:47 2019 +0100 Commit: Dan Čermák CommitDate: Thu Mar 7 13:33:48 2019 +0100 Extend documentation on how to build inside OBS commit fa8baea5ec147943fdfbf66fe13f88bd8e067e20 Author: Dan Čermák AuthorDate: Thu Feb 28 13:07:32 2019 +0100 Commit: Dan Čermák CommitDate: Thu Mar 7 13:33:42 2019 +0100 Bump required minimum disk space commit c3c48344b453ad4d524dbeea43371c49e0807860 Author: Dan Čermák AuthorDate: Thu Feb 28 13:06:52 2019 +0100 Commit: Dan Čermák CommitDate: Thu Mar 7 13:33:36 2019 +0100 Extend index.rst by a "advertising" section commit ad5abefc52c48aa2c9e8543c8c5c2ebdf775b79a Author: Dan Čermák AuthorDate: Thu Feb 28 13:05:27 2019 +0100 Commit: Dan Čermák CommitDate: Thu Mar 7 13:33:30 2019 +0100 Add url to PyPI & use https instead of http commit fe7c7f59bdf6d1970550a28fff479233e95b85d1 Author: Dan Čermák AuthorDate: Thu Feb 28 13:03:33 2019 +0100 Commit: Dan Čermák CommitDate: Thu Mar 7 13:33:24 2019 +0100 Extend quickstart to be more viable as a stand-alone document commit 99c73fb829cc8526ff059633ba40fa3a6697b721 Author: Dan Čermák AuthorDate: Thu Feb 28 13:02:08 2019 +0100 Commit: Dan Čermák CommitDate: Thu Mar 7 13:33:18 2019 +0100 Reorder TOCs so that the most important comes first commit 5bd5ea84e26853cd911696e8c298a3727c5bfb64 Author: Dan Čermák AuthorDate: Thu Feb 28 12:55:31 2019 +0100 Commit: Dan Čermák CommitDate: Thu Mar 7 13:33:12 2019 +0100 (whitespace-cleanup) on doc/source/overview/workflow.rst commit 1e06bc2f8d4ebdc51b67cf48c947b8ae64ffc401 Author: Dan Čermák AuthorDate: Thu Feb 28 11:15:57 2019 +0100 Commit: Dan Čermák CommitDate: Thu Mar 7 13:33:06 2019 +0100 Fix some spelling mistakes & sentence order in the docs commit 00b8213ac963de61690b98fae592f09fffeef817 Author: Marcus Schäfer AuthorDate: Thu Mar 7 11:14:38 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 7 11:28:30 2019 +0100 Check for multiple allsize volumes setup Added runtime check check_volume_setup_defines_multiple_fullsize_volumes which reads the volume setup and counts the number of volumes that define a 'all' volume. Only one is allowed commit 4899da09c64fd8b83ccc50773897fda047ca0b49 Author: Marcus Schäfer AuthorDate: Wed Mar 6 17:44:45 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 6 17:44:45 2019 +0100 Complete test coverage on iso tools testing If there is no mkisofs/genisoimage present on the system, the tests based on real example iso files are skipped. The code tested in this case is now covered in a mock style to run through the logic even without the tools in place commit 2cd080d0bb04cf42f72aeccc182df1b8b90db5a4 Author: Marcus Schäfer AuthorDate: Wed Mar 6 16:25:01 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 6 16:25:01 2019 +0100 Follow up fix for zypper compat link Move the code handling the compat setup of the rpm database to the correct method of the repository API. Call the import of the signing keys only if there are signing keys commit fde6d86923e598035a0060bd7297d6a8a8d2beb3 Author: Dan Čermák AuthorDate: Wed Mar 6 12:20:27 2019 +0100 Commit: Dan Čermák CommitDate: Wed Mar 6 14:11:51 2019 +0100 Fix suseRemoveYaST to work with set -e When the config.sh is invoked with set -e then suseRemoveYaST causes the whole script to fail when no yast packages are present. The problem is that `grep yast` returns 1 in that case. => Explicitly ignore the return value of grep Furthermore, if no YaST packages were found, we don't want to invoke rpm, as that would fail too (as it is called without any parameters). commit d70df02aa3af2c88854a39c0c31a5d153720fd1e Author: Marcus Schäfer AuthorDate: Wed Mar 6 12:09:15 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 6 12:09:15 2019 +0100 Care for update alternatives on rpmdb move In set_database_to_image_path we also have to care for the move of the alternatives path to the new rpmdb location commit d92606e46fb21f8fae4e97d50ef501609fe83048 Author: Marcus Schäfer AuthorDate: Wed Mar 6 11:45:02 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 6 11:45:02 2019 +0100 Fixup zypper/suse link to rpm database The compat code generating the /var/lib/rpm link was only effective if a signing key was specified, however it should be effective in any case commit 5112ec7121dc9a3de195655312c118f5cb9ca5dd Author: Marcus Schäfer AuthorDate: Tue Mar 5 15:54:25 2019 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 5 15:54:25 2019 +0100 Run cdrtools based unit tests on demand Only if the underlaying system provides legacy cdrtools, run the unit tests which actually reads the test data iso using those tools. commit 2b17684d2c4eea68e80aaf1c6eb55ca51e767eb6 Author: Dan Čermák AuthorDate: Mon Feb 18 20:20:50 2019 +0100 Commit: Dan Čermák CommitDate: Tue Mar 5 15:33:18 2019 +0100 Add support to build vagrant boxes with the Virtualbox provider This commits adds initial support to build Vagrant boxes with the Virtualbox provider. - The attribute 'provider' of the option now supports the option "virtualbox". - A new boolean attribute 'virtualbox_guest_additions_present' was added to . When set to true, KIWI will assume that guest additions have been installed into the base image and configure the shared folders to use vboxfs, otherwise rsync will be used. This fixes #532 (https://github.com/SUSE/kiwi/issues/532). commit acf67419af6079c76deb567306588dec94daa03d Author: Marcus Schäfer AuthorDate: Mon Mar 4 10:07:04 2019 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 4 10:07:04 2019 +0100 Improve error messages The error messages for running a build against an undefined image definition as well as the error message to explain why the imageinclude attribute can only be used with public repos has been improved by suggestions from J. Mixer commit d9ab8bce6afb3346399e72c405bb83ffb32dec34 Author: Stefan Seyfried AuthorDate: Mon Mar 4 09:46:18 2019 +0100 Commit: Stefan Seyfried CommitDate: Mon Mar 4 09:46:18 2019 +0100 pxe: use dracut's network code, drop own setup commit f0392f4b163e273579bd0475c086813901a7ff6a Author: Neal Gompa AuthorDate: Fri Mar 1 06:10:13 2019 -0500 Commit: Neal Gompa CommitDate: Fri Mar 1 08:48:44 2019 -0500 Ensure DNF is installed for kiwi itself and the test CentOS 7 appliance In e33f53aa4513c38a42736c82db3ec5e0b9da41d4, we switched to DNF when requesting YUM. This now means we need to ensure DNF is installed for images where we previously used YUM for that. commit e33f53aa4513c38a42736c82db3ec5e0b9da41d4 Author: Neal Gompa AuthorDate: Thu Feb 28 06:18:10 2019 -0500 Commit: Neal Gompa CommitDate: Thu Feb 28 15:09:21 2019 -0500 Rework package manager selection to use DNF when YUM is requested YUM v3 is no longer developed, having been superseded by DNF for several years. With DNF now available as a usable package manager in Red Hat Enterprise Linux 7 through the Extras channel and SUSE Linux Enterprise 15 through PackageHub, there is no reason for keeping support for YUM v3 around. We are keeping support for requesting YUM because in Red Hat Enterprise Linux 7, DNF is referred to as "YUM v4", and it is simply referred to as "YUM" in Red Hat Enterprise Linux 8. To avoid confusion from people, we're just going to leave it in place as an alias to the DNF package manager. As for why this is happening now, Fedora is retiring YUM v3 in Fedora 31, so we might as well get it over with and cut over now. Reference: https://fedoraproject.org/wiki/Changes/Retire_YUM_3 commit 8dcb74ecd89c3b777d32930d60bc528adb9a01ab Author: Dan Čermák AuthorDate: Thu Feb 28 15:02:11 2019 +0100 Commit: Dan Čermák CommitDate: Thu Feb 28 15:26:10 2019 +0100 Add environment for running the unit tests with Python 3.7 to tox Python 3.7 does only appear to be available on Ubuntu Xenial with sudo enabled commit 6c0dacd452ac0ca8c28b4736491129577a437ca3 Author: Marcus Schäfer AuthorDate: Thu Feb 28 11:13:32 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 28 11:13:32 2019 +0100 GitLab CI integration Run tox targets on demand. With GitLab CI selected containers are small but also limited in their scope. commit c4f0855d1f160070982b0609d2cea831751cdc47 Author: Marcus Schäfer AuthorDate: Thu Feb 28 11:11:58 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 28 11:11:58 2019 +0100 Fixed iso tools unit test Test was not environment independent and behaved differently compared to which iso tool change is installed. commit 1390b855e23db29cd4d0ab6f0b9b5de6f526c9f5 Author: Marcus Schäfer AuthorDate: Thu Feb 28 10:53:39 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 28 10:53:39 2019 +0100 GitLab CI integration Select 3.6 image to run the test commit 81e13d149bfc42a0eeca488e7676374dec2a1fd5 Author: Marcus Schäfer AuthorDate: Thu Feb 28 10:44:08 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 28 10:44:08 2019 +0100 Fixed shellcheck issue on kiwi-partitions-lib.sh Fixup SC2046: Quote this to prevent word splitting commit 626b29714d9326e30ce4b516843a10d718360f06 Author: Marcus Schäfer AuthorDate: Thu Feb 28 10:34:43 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 28 10:34:43 2019 +0100 GitLab CI integration Not so easy to get pip running there. Try standard binary name of after pip ugrade to install the rest of the chain commit 23fc87e4eb19e078efbac23d391bd6400754639d Author: Marcus Schäfer AuthorDate: Thu Feb 28 10:31:30 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 28 10:31:30 2019 +0100 GitLab CI integration No alternative naming for py3 commands commit bc275f7425e06be2826c5ce0138a802f45a5dc43 Author: Marcus Schäfer AuthorDate: Thu Feb 28 10:26:19 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 28 10:26:19 2019 +0100 GitLab CI integration Fixed install of tox on the runner commit aff9b966031d5c6543e39e956882e8c761fc138e Author: Marcus Schäfer AuthorDate: Thu Feb 28 10:23:15 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 28 10:23:15 2019 +0100 GitLab CI integration Require tox to be installed on the runner commit 0e66b7ade4eced02fe903f5e57c025ae29b639df Author: Marcus Schäfer AuthorDate: Thu Feb 28 10:19:58 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 28 10:19:58 2019 +0100 GitLab CI integration pip not installed by default on the runner commit 1c3361fa2fad6171aa9ee872ef75358450ec6f4d Author: Marcus Schäfer AuthorDate: Thu Feb 28 10:16:07 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 28 10:16:07 2019 +0100 Looks like Travis will go away Try moving CI integration to GitLab commit 3c55023c9e1ec317e2fa5df7b0829daa6d84bdaf Author: Marcus Schäfer AuthorDate: Wed Feb 27 17:33:53 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 27 17:33:53 2019 +0100 Write sha256sum --check compatible shasum format Change the output format of the bundler shasum file to be compatible with a 'sha256sum --check' call. This fixes bsc#1127173 commit 7014758de790be9e4b3527fd6783f0729fbb36f1 Author: Marcus Schäfer AuthorDate: Wed Feb 27 16:00:13 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 27 16:00:13 2019 +0100 Move azure integration test build to Factory repos commit 1aa41c6833634cdec2fc2a6f07b3b28f6b83cff3 Author: Marcus Schäfer AuthorDate: Wed Feb 27 15:52:57 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 27 15:52:57 2019 +0100 Fixed package list of azure integration test commit 0f4199df2fc7f3e99902268fcb9cf6d9c26f0a53 Author: Marcus Schäfer AuthorDate: Wed Feb 27 15:50:47 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 27 15:50:47 2019 +0100 Fixed repo setup from azure integration test commit 311efd6e028b1f75b76d7a7854354b2bda6022f1 Author: Marcus Schäfer AuthorDate: Wed Feb 27 15:05:40 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 27 15:05:40 2019 +0100 Bump version: 9.17.22 → 9.17.23 commit 541cf9c3d1ebd86924c6bbf189ddf0570837b078 Author: Marcus Schäfer AuthorDate: Mon Feb 25 15:50:52 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 27 14:24:55 2019 +0100 Fixed import of signing keys In reference to bsc#1112357 it was required to add the compat symlink /var/lib/rpm such that zypper can read the signing keys. Unfortunately zypper does not use the configured rpmdb from the rpm macro setup. commit d55eda8a56e3e5e427826c4b2809777c81c9a0bb Author: Dan Čermák AuthorDate: Tue Feb 26 17:35:24 2019 +0100 Commit: Dan Čermák CommitDate: Tue Feb 26 17:35:24 2019 +0100 Allow xdist to run the tests in parallel for the Python 2.7 env This reverts an accidental change that was introduced with 942ed7a8eea65f1c99b5f51a8587cfbeae73b484, which removed the {posargs} from tox.ini for the python 2.7 environment. commit ed6c11f7d67162242ae9706d8a2e3a233fa90abd Author: Marcus Schäfer AuthorDate: Tue Feb 26 12:24:02 2019 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 26 15:20:21 2019 +0100 Added get_description method to XMLState In preparation to access the contents of the section this pull requests adds a simple method to read the contents. commit 9ed77f1d8d28793f39fba9ba2c5acee7db319917 Author: Marcus Schäfer AuthorDate: Mon Feb 25 16:43:17 2019 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 25 16:43:17 2019 +0100 Update tools from strip list for oemboot For legacy oemboot kiwi descriptions the strip list for tools to keep in the initrd is still active. On s390 required tools for dasd_configure were missing and got added by this commit. This Fixes #963 commit 12e57bb461ba7b747f48a33aeba7009ac5214d30 Author: Stefan Seyfried AuthorDate: Mon Feb 25 14:30:22 2019 +0100 Commit: Stefan Seyfried CommitDate: Mon Feb 25 16:24:44 2019 +0100 add rd.kiwi.install.pass.bootparam boot parameter if this boolean is set, most boot parameters are passed on to the kexec kernel on OEM image deployments commit 3cccf0a1d7216b89d174bc148786c3604e3bcdfc Author: Marcus Schäfer AuthorDate: Sat Feb 23 20:40:00 2019 +0100 Commit: Marcus Schäfer CommitDate: Sat Feb 23 20:40:00 2019 +0100 Bump version: 9.17.21 → 9.17.22 commit daf90b9ed49387ea05c2252d4bd562a149ae5240 Author: Marcus Schäfer AuthorDate: Sat Feb 23 20:22:06 2019 +0100 Commit: Marcus Schäfer CommitDate: Sat Feb 23 20:22:06 2019 +0100 Followup fix for disk detection from root device No matter if one ore more devices are used in a multipath map, if the root device is managed by multipath kiwi has to use the mapped device for all operations, otherwise we run into busy or blocked state inside of the initrd operations. This is related to Issue #954 and bsc#1126283 and bsc#1126318 commit 9190f80ad75793db3921c0a2fcf8ed321163f020 Author: Marcus Schäfer AuthorDate: Sat Feb 23 16:11:30 2019 +0100 Commit: Marcus Schäfer CommitDate: Sat Feb 23 16:11:30 2019 +0100 Fixed relocation of GPT Simplify the relocation of the GPT to the end of the current disk by using sgdisk -e instead of gdisk. The possitive after effect of this is that the broken return value handling of gdisk in centos will be fixed and did not harm the kiwi deployment anymore. This Fixes #958 commit 111f284c1aaec5cfcd274c1c812c600028b5ca9c Author: Marcus Schäfer AuthorDate: Fri Feb 22 17:11:47 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 22 17:11:47 2019 +0100 Bump version: 9.17.20 → 9.17.21 commit 942ed7a8eea65f1c99b5f51a8587cfbeae73b484 Author: Marcus Schäfer AuthorDate: Fri Feb 22 17:11:00 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 22 17:11:00 2019 +0100 Speedup the make build target Activated the pytest xdist feature Dan added for the make build target to speedup package creation commit a53cce03d5b99255f4e080399c395ce857e7347c Author: Marcus Schäfer AuthorDate: Fri Feb 22 17:01:03 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 22 17:01:03 2019 +0100 Bump version: 9.17.19 → 9.17.20 commit c1534a35637bbd8e0ad6958222470633451efda8 Author: Marcus Schäfer AuthorDate: Fri Feb 22 16:01:16 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 22 16:01:16 2019 +0100 Update vagrant libvirt unit test Take extra config from DiskFormatVagrantLibVirt as base for the test and don't mock that information as it was done before in the base class commit 0e422e944745530acd17c64c08b5234849a835f6 Author: Marcus Schäfer AuthorDate: Fri Feb 22 11:30:46 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 22 11:30:46 2019 +0100 Extend the vagrant base class test Take an example for additional vagrant config settings into account commit 3f414dada835305494b6c80ed06fd62088c7a791 Author: Marcus Schäfer AuthorDate: Fri Feb 22 09:53:57 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 22 09:53:57 2019 +0100 Refactor unit tests for vagrant classes Better use of pytest capabilities, avoid mock rewrite of implementation classes commit 9cab9af8594d231f395f405c2d413b0fefde4df6 Author: Marcus Schäfer AuthorDate: Fri Feb 22 09:52:13 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 22 09:52:13 2019 +0100 Fixed DiskFormatVagrantBase docs and behavior Update class docs per review by Dan, also raise on use of methods without proper provider implementation commit b3b03363f9b21656f38fec5a8168e1560cf5fffb Author: Marcus Schäfer AuthorDate: Fri Feb 22 09:50:43 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 22 09:50:43 2019 +0100 Fixed create_box_img in DiskFormatVagrantLibVirt The call to create_box_img did not use the given tmpdir parameter but assumes an instance variable to provide this information commit 624633776d2acd9892e27f15bc6ff36bec2dcc25 Author: Stefan Seyfried AuthorDate: Thu Feb 21 17:34:13 2019 +0100 Commit: Stefan Seyfried CommitDate: Thu Feb 21 17:34:13 2019 +0100 fix network failure with "BOOTIF=" parameter If a BOOTIF= parameter (pxelinux "IPAPPEND 2" option) is present, dracut handles the network already *and* overwrites the 90-net.rules that kiwi-*-net-genrules.sh created, thus the interface is not named "lan0" and ifup is destined to fail. Work around the issue by detecting if the interface is already handled by generic dracut code and just skipping the ifup call. Fixes / improves issue #942 commit d757e824de8c4900431ed7b0c66c16190806258e Author: Marcus Schäfer AuthorDate: Thu Feb 21 14:42:27 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 21 17:12:14 2019 +0100 Fixed disk detection from root device The method lookup_disk_device_from_root assigns the disk device matching the root device uuid. However in a multipath environment multiple disk devices matches the same root device. The code to assign the multipath map in this case was missing in the dracut code base. This Fixes #954 and Fixes bsc#1126283 and bsc#1126318 commit 5e599afa1a236531802c4c6422ddb5677f3c4c1b Author: Marcus Schäfer AuthorDate: Thu Feb 21 17:03:42 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 21 17:03:42 2019 +0100 Added some style fixes to the vagrant classes Adapt doc strings to match style on lists. Change variable names not class global to be lowercase. Use 80 chars per line. Don't reach code that potentially uses undefined variables commit d70d8d85cc03fa65b39f49af8f33ef01a3107a7c Author: Marcus Schäfer AuthorDate: Wed Feb 20 18:08:57 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 21 15:49:11 2019 +0100 Fixed losetup call due to move in option names util-linux dropped losetup-Add-support-for-setting-logical-blocksize.patch because different implementations exists in the new kernel, and it has a conflicting implementation in util-linux. This caused a change in the option to specify the logical sector size. The option --logical-blocksize was replaced by --sector-size. We adapt this now in kiwi too commit a50c251f5f5131bcb0aa1e1da78e73752d48d4b7 Author: Marcus Schäfer AuthorDate: Thu Feb 21 15:48:05 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 21 15:48:05 2019 +0100 Refactor vagrant storage subformat In preparation to support other vagrant providers a base class for Vagrant operations has been created. Original Code written by DanČermák commit 0fbc2c5ff950cb1857fe7b45e66983272bf1fc4d Author: Dan Čermák AuthorDate: Wed Feb 20 14:46:14 2019 +0100 Commit: Dan Čermák CommitDate: Wed Feb 20 14:46:14 2019 +0100 Add pytest-xdist to dev-virtualenv to run the unit tests in parallel - fix CLI args not being passed to pytest by tox for unit_py3_4 and unit_py3_6 - enable parallel run on travis - document how to run the unit tests in parallel commit 5b434f5c36fc180a475458e33c06a86525ea0ba3 Author: Ruediger Oertel AuthorDate: Wed Feb 20 14:04:12 2019 +0100 Commit: Ruediger Oertel CommitDate: Wed Feb 20 14:04:12 2019 +0100 s390-test-image: add factory base project (same as on arm) commit b335f9e21a016a2370fd68569f6d8c61faf942a0 Author: Marcus Schäfer AuthorDate: Thu Feb 14 21:18:37 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 14 21:18:37 2019 +0100 Bump version: 9.17.18 → 9.17.19 commit 9725153258b33b42b8f75b5af133536d84909182 Author: Marcus Schäfer AuthorDate: Thu Feb 14 17:37:38 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 14 17:37:38 2019 +0100 Fixed isolinux fallback path In case isolinux-config failed or does not exist on the distribution a fallback path is called. That code hardlinks the files to the isolinux compiled in standard path. However due to the move of the grub unicode file for iso images the path contains a directory. Directories can't be hardlinked thus this patch uses 'cp -l' instead of the 'ln' command to create the linked target contents. commit 4d0c77ba1c58914a4eaa6e3613a587dd32c2e288 Author: Marcus Schäfer AuthorDate: Thu Feb 14 11:07:12 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 14 11:07:12 2019 +0100 Bump version: 9.17.17 → 9.17.18 commit f9aafe7f3590ad4af4078aba3bd61768097aed01 Author: Marcus Schäfer AuthorDate: Wed Feb 13 18:34:40 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 13 18:34:40 2019 +0100 Fix location of grub unicode font This is a follow up patch for #f5bac4495d34. The change of the location of the font file was not applied if an iso target, live or install image is being built. This patch completes the change and Fixes bsc#1124885 commit 81bf8241cb0d7def926f20993999f8ec773b8e1b Author: Marcus Schäfer AuthorDate: Wed Feb 13 17:08:19 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 13 17:08:19 2019 +0100 Fix handling of zypper return codes The following codes should be handled as errors: 104 - ZYPPER_EXIT_INF_CAP_NOT_FOUND 105 - ZYPPER_EXIT_ON_SIGNAL 106 - ZYPPER_EXIT_INF_REPOS_SKIPPED commit 51a9015b34e5879b9f83577cbde96d7d0fd3df79 Author: Bernhard M. Wiedemann AuthorDate: Sat Feb 9 22:02:09 2019 +0100 Commit: Bernhard M. Wiedemann CommitDate: Mon Feb 11 10:41:55 2019 +0100 Sort filesystem listings so that kiwi works in a reproducible way in spite of indeterministic filesystem readdir order and http://bugs.python.org/issue30461 See https://reproducible-builds.org/ for why this is good. commit 34c76e35a11a46cef73a9b4e9b7278511c7036cf Author: Bernhard M. Wiedemann AuthorDate: Sun Feb 10 06:51:00 2019 +0100 Commit: Bernhard M. Wiedemann CommitDate: Mon Feb 11 10:41:55 2019 +0100 tox: Allow to run a single test using tox -v -e unit_py2_7 -- -vv ./test/unit/iso_tools_cdrtools_test.py commit 84fcbc60fd6e2360e38a213a34d5db3cc70ac88c Author: Marcus Schäfer AuthorDate: Mon Feb 11 09:10:47 2019 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 11 09:18:55 2019 +0100 Sort file and dir entries in iso sortfile commit 8b3e11888052be631ff69ed9ec8b9230866f629a Author: Marcus Schäfer AuthorDate: Sat Feb 9 16:00:04 2019 +0100 Commit: Marcus Schäfer CommitDate: Sat Feb 9 16:00:04 2019 +0100 Moved azure integration test to Leap15 Factory doesn't resolve well together with Cloud:Tools. I'd like to have stable integration tests and not getting screwed with any change on Factory commit a343e9d798d3b169f84e6f72ab8eb2e5fc617659 Author: Marcus Schäfer AuthorDate: Sat Feb 9 15:53:42 2019 +0100 Commit: Marcus Schäfer CommitDate: Sat Feb 9 15:53:42 2019 +0100 Bump version: 9.17.16 → 9.17.17 commit f8265bb60766f2adfbbd65e5caf28cb671c9d344 Author: Marcus Schäfer AuthorDate: Fri Feb 8 16:56:56 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 8 16:56:56 2019 +0100 Added new preferences subsection In the preferences section the following optional subsection can be configured: true|false If set to true the default locales POSIX, C, and C.UTF-8 are applied as rpm install_lang macro. If the locale section is configured in addition the list is extended by that information too commit e8b66e5da3b4ab8eec7a53445d0f29315926e41a Author: Marcus Schäfer AuthorDate: Fri Feb 8 15:58:29 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 8 15:58:29 2019 +0100 Extend the .packages file by the license field For rpm based builds the License field from the rpm metadata is extracted into the .packages file. For Debian based build the license information is in an extra file and not taken into account for the moment. commit e88601ffbf10cc8df67ef5f3d8e4c927a38f53d9 Author: Marcus Schäfer AuthorDate: Fri Feb 8 11:58:53 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 8 11:58:53 2019 +0100 Bump version: 9.17.15 → 9.17.16 commit fad1c0f1efbdd7f261f1d8d92d25c9cd36e2fe18 Author: Marcus Schäfer AuthorDate: Thu Feb 7 10:35:09 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 7 16:05:25 2019 +0100 Added support for %_install_langs rpm macro During the image build the custom rpm macro %_install_langs is configured with the setup from the KIWI XML description. This allows to filter language specific packages on the rpm level and Fixes #771 commit 892c6332f2a9c55dc820b04bcef0b7353c85d6b5 Author: Marcus Schäfer AuthorDate: Wed Feb 6 17:13:56 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 6 17:13:56 2019 +0100 Add API for package manager returncode validation Allow to validate the return code from a package manager operation. In case of zypper the standard UNIX return code validation does not apply. Return codes from zypper which are >= 100 are not treated as an error anymore commit dd1052ac99b56859e3c280c30946cf3ab9bf4aca Author: Marcus Schäfer AuthorDate: Mon Feb 4 16:59:51 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 6 11:55:42 2019 +0100 Handle location of the rpm DB on the macro level The location of the rpm database is no longer a standard path one can trust. Some distributions put it to /var/lib others to /usr/lib. This introduces the problem of dealing with different locations between the bootstrapping (host rpm) phase and the image installation (image rpm) phase. This commit implements a solution based on an intermediate rpm database configuration. KIWI creates the macros.kiwi file inside of the image root which is read by any call of rpm in the inner and outer system. During bootstrap phase the rpm dbpath from the host system is used and later in the install phase the dbpath from the rpm package as it was installed by the target image distribution is used. In case of a dbpath difference the database is automatically moved to the new location by setting the _dbpath_rebuild macro to the correct location. At the end the custom KIWI macro is deleted. As this process allows custom macro defintions during the KIWI run it also serves as the base for a solution to Issue #771 which will be done in a follow up request to this commit. Also the workaround for bsc#1112357 which uses a static dbpath to store an optionally given signing key will be addressed with this commit. The macro setup happens before the import_trusted_keys method which makes any specification for a strict dbpath obsolete. Last the implementation deletes the obsolete dump_reload_package_database code. rpm is able to automatically do the conversion of different db versions such that the code in kiwi is obsolete. In addition that code only worked for rather old db versions. The public API has not changed though, but the method is marked obsolete and does nothing anymore. In addition to the deletion of obsolete code a new API method post_process_install_requests_bootstrap has been introduced to handle actions required after bootstrap and before installing of packages from inside the new image commit 3482be44f07e78634dc7dc27db97cba4f850cc8e Author: Marcus Schäfer AuthorDate: Wed Feb 6 11:33:54 2019 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 6 11:41:45 2019 +0100 Fix Failed to cache rpm database on zypper addrepo Occasionally zypper fails when adding the repo with the rpm error message 'Failed to cache rpm database'. I was not able to find out why this happens and I also could not find a way to reproduce it safely. However this commit adds a workaround that seems to fix the issue when it happens. If the first call of zypper addrepo fails kiwi now issues the exact same call again and only if that fails too an exception is thrown In addition the patch changes the zypper call and avoids the option --type. That option is marked legacy and ignored by zypper but causes a misleading warning message commit 72a63f0b16e19bc69830e22a0ac0bf0343c26f39 Author: David Cassany AuthorDate: Mon Feb 4 12:03:25 2019 +0100 Commit: David Cassany CommitDate: Mon Feb 4 16:38:50 2019 +0100 Add custom partitioning docs This commit adds two new documentation chapters. One covering custom partitioning scheme in KIWI. And another covering setting custom volumes in KIWI commit 132eda8027bed2e5812d064baaea089591a2008b Author: Marcus Schäfer AuthorDate: Thu Jan 31 11:09:53 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 31 11:09:53 2019 +0100 Bump version: 9.17.14 → 9.17.15 commit 0b976eea0f4eb0c35d75ec0b3f28468986547eda Author: Marcus Schäfer AuthorDate: Thu Jan 31 11:08:15 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 31 11:08:15 2019 +0100 Fixup code issues reported by new flake8 version Travis has updated the flake8 version which caused more strict issue reports on the code. This commit fixes the new issues reported by flake8 commit 9d1dea1aa12ae5ce9f5882a826f04a2ce030ad56 Author: Marcus Schäfer AuthorDate: Thu Jan 31 10:40:27 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 31 10:40:27 2019 +0100 Bump version: 9.17.13 → 9.17.14 commit dbf399a34c32cb6e54bb2cfd9a6dba297373b37f Author: Marcus Schäfer AuthorDate: Thu Jan 31 10:28:53 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 31 10:28:53 2019 +0100 Changed default value for bundler compression If no compression is configured in the kiwi config file the default was set to: False. However this lead to big trouble on the obs side for images which has fixed storage disk sizes configured, e.g Azure images which requests 30G disk size per instance. Thus the default for the bundler compression has changed to be: True commit fed5a06d5f385fd7d1c7e62741e877e9eaefc245 Author: Marcus Schäfer AuthorDate: Tue Jan 29 13:05:03 2019 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 29 13:05:03 2019 +0100 Bump version: 9.17.12 → 9.17.13 commit 9f0946e1f8f60eefedda1902579135f2bdf41db9 Author: Marcus Schäfer AuthorDate: Tue Jan 29 11:20:30 2019 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 29 12:26:09 2019 +0100 Fixed grub theme lookup If the theme was not found at the expected place an exception was thrown. However the alternative lookup code in /boot was not reached with that exception. This commit fixes this commit 35862a58fc5cccb8e6076ded70dba28480352f50 Author: Marcus Schäfer AuthorDate: Mon Jan 28 17:34:52 2019 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 28 17:34:52 2019 +0100 Bump version: 9.17.11 → 9.17.12 commit 0f4b0b34bbaeede0c320dc7b3ae39602978304fe Author: David Cassany AuthorDate: Mon Jan 28 11:17:07 2019 +0100 Commit: David Cassany CommitDate: Mon Jan 28 17:16:31 2019 +0100 Add a runtime check for preferences metadata This commit adds a runtime check for preferences metadata. More specfic verifies there is a packagemanager defined and an image version defined. Fixes #925 commit 0985e211172a6a77edbb3ad364a06bb41bc37d52 Author: Marcus Schäfer AuthorDate: Fri Jan 25 17:13:43 2019 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 28 16:27:48 2019 +0100 Support alternative EFI and grub modules paths In SUSE products EFI binaries are historically located in /usr/lib*/efi. In a recent move to package grub2 as noarch fate#326960, a collision between x86_64 and aarch64 has been identified, as both place platform-specific files in the same spot. To rectify this, a new location was devised: /usr/share/efi/$(uname -m). At the same time /usr/lib/grub2 will move to /usr/share/grub2. This Fixes #924 commit dcce7c38c5be5705b6eaf3dd51edf76abb3559c9 Author: Marcus Schäfer AuthorDate: Fri Jan 25 10:30:27 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 25 16:20:32 2019 +0100 Fixed Xen guest detection We only support Xen setup e.g in the Amazon Cloud for the x86_64 architecture. This Fixes bsc#1123186 and bsc#1123185 commit f5bac4495d34fae3c72b327f4d96138bc918c687 Author: Marcus Schäfer AuthorDate: Thu Jan 24 17:07:54 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 24 17:07:54 2019 +0100 Fixed location of grub unicode font file grub2 is expecting the unicode font below the fonts directory in the /boot/grub*/ depending on how the distribution installs grub2. This Fixes bsc#1119416 commit 71d9eda2b954cd47044d56bb3a19066ace2c2a68 Author: Marcus Schäfer AuthorDate: Thu Jan 24 15:24:00 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 24 15:24:00 2019 +0100 Fix documentation howto delete a package The documentation described an invalid XML grammar commit 3776ed9a8fec620cab8689be54b28181090b6bed Author: Marcus Schäfer AuthorDate: Thu Jan 24 11:31:49 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 24 11:31:49 2019 +0100 Bump version: 9.17.10 → 9.17.11 commit 9c0855753a3070a4592453d8a85d0055f61f0c24 Author: Marcus Schäfer AuthorDate: Thu Jan 24 11:27:48 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 24 11:27:48 2019 +0100 Fix package conflict for completion file The completion can only be provided by one package if not python version specific completion files are provided. Due to the fix in #920 the completion file must be provided by another sub-package. This commit moves it to the kiwi-man-pages package. Actually kiwi man pages provides more than just the man pages, but also the PDF documentation and I think the completion information serves the purpose of documentation to some degree too. commit b65bf309179014dff5db69ea216de38d7c5b3159 Author: Marcus Schäfer AuthorDate: Thu Jan 24 10:00:28 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 24 10:00:28 2019 +0100 Bump version: 9.17.9 → 9.17.10 commit eb4076bdafdfc37f6ee75b219cfaad4764eddd3f Author: Marcus Schäfer AuthorDate: Thu Jan 24 09:32:44 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 24 09:32:44 2019 +0100 Fixed file name of completion file The bash completion file must match one of the alternatives links. Otherwise the bash completion mechanism will not match. kiwi-ng is the unique alternative link name compared to the still present legacy kiwi version and should be used preferably commit eeba381a5aae83f1092ee8e91c334a2c358e6457 Author: David Cassany AuthorDate: Wed Jan 23 12:08:06 2019 +0100 Commit: David Cassany CommitDate: Wed Jan 23 12:08:06 2019 +0100 Add container history metadata on umoci repack call This commit makes sure that `umoci repack` call includes history metadata and skips that in `umoci config` call. Fixes #918 commit 0a4f7002c71d27919402ae141e98a04e1a82cd25 Author: Marcus Schäfer AuthorDate: Thu Jan 17 14:06:16 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 17 14:06:16 2019 +0100 Bump version: 9.17.8 → 9.17.9 commit d795dd7a6682d69b3a67c6ccc5a0d0de162c0189 Author: Marcus Schäfer AuthorDate: Thu Jan 17 11:22:01 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 17 11:22:01 2019 +0100 Update schematron rule install_continue_on_timeout is only for oem types commit ae17658c9f4733534ffa9f3c4a21ced4d8cdd393 Author: David Cassany AuthorDate: Thu Jan 17 10:13:48 2019 +0100 Commit: David Cassany CommitDate: Thu Jan 17 10:13:48 2019 +0100 Do not assume package manager is always there This commit modifies the dump_reload_package_database method for zypper to not assume rpm binary is always part of the image. An image could be bootstrapped only without zypper or rpm, in that case it does not make sense and it is not possible to dump and reload rpmdb. Fixes #915 and related to #550 commit 0af8028387ae02a1cdf1edffc38b9843367de7df Author: Marcus Schäfer AuthorDate: Thu Jan 17 10:09:40 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 17 10:09:40 2019 +0100 Allow to switch off install image boot timeout This commit adds a new attribute called: It allows to setup the boot timeout for install images build with KIWI. If not set or set to 'true' the configured boottimeout or its default applies to the install image as it was before. If set to 'false' there will be no timeout in the install image bootloader setup and the boot only continues on manual intervention. commit c8fd24a8bf69ad3d2a12d8d1b6ea5b0dc4f9115d Author: Marcus Schäfer AuthorDate: Fri Jan 11 10:57:10 2019 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 11 10:57:10 2019 +0100 Bump version: 9.17.7 → 9.17.8 commit 3346f3028fa9620728c256af53f7fedd705c24ff Author: Marcus Schäfer AuthorDate: Thu Jan 10 15:52:49 2019 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 10 16:13:02 2019 +0100 Make result compression in the bundler optional Calling kiwi result bundle will take the image build results and bundle the relevant image files according to their image type. Depending on the result configuration this could instruct the bundler to compress one or more files from the result. By default this compression is switched off in the bundler but can be activated to save storage space and speedup download of the image with the following runtime configuration: bundle: - compress: true|false If compression is activated the result image has to be uncompressed before it can be used. This Fixes #901 commit 195c92d20b819577daeb961f29383714bdf54ba1 Author: Marcus Schäfer AuthorDate: Mon Jan 7 11:17:52 2019 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 7 11:17:52 2019 +0100 Bump version: 9.17.6 → 9.17.7 commit b39f5dad97f9058107715f3f0d4c3684e91bfbe1 Author: Marcus Schäfer AuthorDate: Mon Jan 7 10:48:09 2019 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 7 10:48:09 2019 +0100 Fix use of SysConfig objects objects of that class did not provide a get method but overload the bracket [] operator. Using the get() method failed. This Fixes #910 commit e577c9fffba44f391c8811ef6adfef27598dd51a Author: Marcus Schäfer AuthorDate: Sat Jan 5 19:52:42 2019 +0100 Commit: Marcus Schäfer CommitDate: Sat Jan 5 19:52:42 2019 +0100 Use chkstat to verify and fix file permissions Call chkstat in system mode which reads /etc/sysconfig/security to determine the configured security level and applies the appropriate permission definitions from the /etc/permissions* files. It's possible to provide those files as overlay files in the image description to apply a certain permission setup when needed. Otherwise the default setup as provided on the package level applies. It's required that the image root system has chkstat installed. If not present KIWI skips this step and continuous with a warning. This Fixes #895 commit 6fa997888e0f176202be0f0457b5434e0e346103 Author: David Cassany AuthorDate: Fri Dec 21 17:22:57 2018 +0100 Commit: David Cassany CommitDate: Fri Dec 21 17:22:57 2018 +0100 Allow setting the protocol for exposed ports With this commit it is possible to set tcp or upd (e.g. "80/tcp") for exposed container ports. If no protocol is provided OCI defaults are applied. Fixes #906 commit 3156bd14d8926df9e495d3325914ba8cc561752e Author: Thomas Schraitle AuthorDate: Wed Dec 19 18:01:17 2018 +0100 Commit: Thomas Schraitle CommitDate: Thu Dec 20 08:47:43 2018 +0100 Use cls in @classmethods instead of self For consistency reasons. commit aac1c7c290bc6e9c72b0098765b8b3ec0ce40fdb Author: Marcus Schäfer AuthorDate: Wed Dec 19 09:13:48 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 19 09:13:48 2018 +0100 Bump version: 9.17.5 → 9.17.6 commit 2224fe67b2023aa89654863883ac9f7baa100510 Author: Marcus Schäfer AuthorDate: Tue Dec 18 20:03:33 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 18 20:03:33 2018 +0100 Allow setctsid to be part of custom boot images commit 9601ab669ccb2285b7267b076eb04d8abe00e051 Author: David Cassany AuthorDate: Tue Dec 18 14:33:09 2018 +0100 Commit: David Cassany CommitDate: Tue Dec 18 14:56:54 2018 +0100 Fix disk size calculation for VMX Disk size calculation must take into account the empty volumes that are to be mounted in a directory that does not exist in the root tree otherwise there is KeyError. The result of storate/setup._calculate_volume_mbytes must be a dict including all defined volumes. Fixes #904 commit f4a1f52173ef68389bffc9ef74cd080d58f52fc9 Author: Marcus Schäfer AuthorDate: Wed Dec 12 12:19:50 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 12 12:19:50 2018 +0100 Bump version: 9.17.4 → 9.17.5 commit 6d69c6f190484ef1ffeeed0b5b35747f0b6d903a Author: Marcus Schäfer AuthorDate: Wed Dec 12 11:06:20 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 12 11:06:20 2018 +0100 Make sure manual pages are part of pypi archive As consequence of the change in the travis setup to make use of the native 'pages' and 'pypi' providers from travis the environment for the sdist target has changed. Within the doc_travis tox env no manual pages was build. In combination with the 'pypi' provider setup in .travis.yml which uses skip_cleanup: true, this caused the pypi archive to miss any manual pages which lead to a runtime error on install via pip. commit 5bbadf287e3b265fb9976e5017cd659f91918195 Author: Marcus Schäfer AuthorDate: Tue Dec 11 08:18:26 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 11 08:18:26 2018 +0100 Bump version: 9.17.3 → 9.17.4 commit ece8a511d96e2f7e4ca8491290acff25de85add3 Author: Marcus Schäfer AuthorDate: Mon Dec 10 12:34:53 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 10 12:34:53 2018 +0100 Don't trust the vmlinux symlink to be present commit 164c8d24d4cbe6d1b8d9c5ee1711af084c978ebe Author: Marcus Schäfer AuthorDate: Mon Dec 10 11:15:02 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 10 11:15:02 2018 +0100 Refactor kernel version lookup Check the presence of the gzip compressed kernel binary and use it. If not present use the arbitrary kernel image format with the known limitations. commit da7984881c23096eb1093bfa8bc22420fb87e870 Author: Marcus Schäfer AuthorDate: Mon Dec 10 09:46:06 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 10 09:46:06 2018 +0100 More clarity on kernel version lookup Lookup of the kernel version is done by directly reading the kernel image via a small tool named kversion. The scope of the tool is limited and does not work for e.g kernel images which contains its own decompressor code. For the special cases we defined exceptions, one was zImage. The recently added exception for vmlinuz seemed too intrusive to me and was also not well documented. This patch tries to clarify and get us back to explicit and easy to read coding. Fixes #899 commit fc0709a3430931500e9682b5c93807697c2666ff Author: Ruediger Oertel AuthorDate: Tue Dec 4 17:22:25 2018 +0100 Commit: Ruediger Oertel CommitDate: Tue Dec 4 17:24:05 2018 +0100 testing: fix issues marked by shellcheck commit 978c37a7ce2fb3d46c681042521cf00e3d8ec4d6 Author: Ruediger Oertel AuthorDate: Thu Nov 29 17:58:48 2018 +0100 Commit: Ruediger Oertel CommitDate: Tue Dec 4 16:53:10 2018 +0100 kernel.py: also try vmlinux-version.gz in case of image-version to get the version number commit 083c28f84b14749c96faba59e39204ad00d03718 Author: David Cassany AuthorDate: Tue Nov 27 17:09:52 2018 +0100 Commit: David Cassany CommitDate: Tue Nov 27 17:09:52 2018 +0100 Add Ubuntu bionic build tests commit ee1c8a6f06857fec712717da711fee98e789acd2 Author: David Cassany AuthorDate: Tue Nov 27 15:17:49 2018 +0100 Commit: David Cassany CommitDate: Tue Nov 27 17:03:15 2018 +0100 Another round of OCI tools refactoring In order to provide buildah support some of the logic about temporary directories for OCI images creation needs to be moved to the dedicated OCI tool class. While umoci can operate in any directory and this is passed as an argument, this is not the case for buildah. In buildah workflow the storage path of work-in-progress images/containers is not customizable neither the mountpoint of the container rootfs. commit 8651fe4d292c2903eb76e51f2c1f33a34f8ad21b Author: Marcus Schäfer AuthorDate: Mon Nov 26 15:36:54 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 26 15:36:54 2018 +0100 Bump version: 9.17.2 → 9.17.3 commit 5962417063a714eab14aed1c00f8ed09569ad46c Author: Marcus Schäfer AuthorDate: Mon Nov 26 14:37:42 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 26 14:37:42 2018 +0100 Update documentation for rd.live.cowfile.mbsize commit f1cdf155a6add8028bdcf0c9d9c3ea056fc61ed4 Author: Marcus Schäfer AuthorDate: Mon Nov 26 10:07:44 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 26 11:26:35 2018 +0100 Use cow file on persistent grub live loop boot When using tools like live-grub-stick the live iso as generated by kiwi will be copied as file on the target device and a grub loopback setup is created there to boot the live system from file. In such a case the persistent write setup which tries to create an extra write partition on the target fails in almost all cases because the target has no free and unpartitioned space available. Therefore in case of such a loopback mounted system we create a cow file(live_system.cow) instead of a partition to setup persistent writing. The cow file will be created in the same directory the live iso image file was read from grub This Fixes #860 commit 1abc2000c6f4fe2f97f680d24056f8e2520043e2 Author: Marcus Schäfer AuthorDate: Fri Nov 23 14:15:38 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 23 14:15:38 2018 +0100 Bump version: 9.17.1 → 9.17.2 commit 30eb5c165ffde387a65955f675e97a48d0c914ae Author: David Cassany AuthorDate: Fri Nov 23 11:29:40 2018 +0100 Commit: David Cassany CommitDate: Fri Nov 23 12:27:00 2018 +0100 Create a custom `setup.py clean` command The default `setup.py clean` command does not clean `dist` and `*.egg-info` folders. This commit makes sure those are cleaned and also ands a `setup.py clean` command in the `clean` Makefile target commit 02049b003b9ae8c9a8ad58d0ce7106bb807c236e Author: Marcus Schäfer AuthorDate: Fri Nov 23 11:11:53 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 23 11:27:24 2018 +0100 Better exception handling in oem installer If an error condition applies in the kiwi dump dracut code the reaction was to stop the process with a dracut die() call. If the option 'rd.debug' was set on boot, this lead to a debugging shell which is good, but in a standard process this lead to a lock of the machine which is an unfortunate situation. This patch changes the behavior to always print the error message as a dialog message box on the primary console and reboot the system after keypress or timeout. In case of the debug switch configured the system die()'s as before. This Fixes #884 commit daab92ae05fbbee5167945d3087a6fb1c06c3546 Author: David Cassany AuthorDate: Mon Nov 19 11:19:36 2018 +0100 Commit: David Cassany CommitDate: Mon Nov 19 11:19:36 2018 +0100 Add parted dependency for dracut-kiwi-live package dracut-kiwi-live requires `partprobe` tool and this is provided by parted package. Persistent overlay setup fails if parted is not installed in the image. commit 5de35d17333a5a15283a31c305fc9c88952e914c Author: David Cassany AuthorDate: Tue Nov 13 17:06:30 2018 +0100 Commit: David Cassany CommitDate: Thu Nov 15 17:07:33 2018 +0100 Fix spec to better support Debian and Ubuntu builds This commit fixes the spec to properly build for Debian and Ubuntu. More specific: * update-alternatives path has been adapted * python3-kiwi are now enabled for Debian 9 and Ubuntu 18.04 commit aaeffeae47c6a116a451ced82cc68aa617bcd954 Author: Marcus Schäfer AuthorDate: Thu Nov 15 09:40:46 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 15 09:40:46 2018 +0100 Added unit test for syslinux lookup paths commit 510d2b25c1e2cb7b86cd273c874e980afb12d276 Author: David Cassany AuthorDate: Thu Nov 15 08:50:29 2018 +0100 Commit: David Cassany CommitDate: Thu Nov 15 08:50:29 2018 +0100 Include the isolinux ubuntu paths This commit adds the ubuntu installation paths the places to look for isolinux binaries. commit 733012c5a1591c1385c97573fbb1849eb9b65a61 Author: Marcus Schäfer AuthorDate: Mon Nov 12 11:37:35 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 12 11:37:35 2018 +0100 Make gfxboot a recommended package gfxboot is needed on the host for certain boot graphics operations. It's used if the boot theme provides a gfxboot.cfg In this case the tool is also required. The setup of the boot themes is differently implemented in each of the distributions we support. In addition on suse distributions gfxboot is no longer in the core system. Given that we are not able to find a common base on requirement of the package we changed gfxboot from a required to a recommended package and deleted the requirement on debian based distros commit 41eb4e2df6a040afe0f097df8ee82b8d0731d561 Author: David Cassany AuthorDate: Fri Nov 9 13:28:14 2018 +0100 Commit: David Cassany CommitDate: Mon Nov 12 09:19:17 2018 +0100 Add support for --no-history umoci's flag Using this flag kiwi appends only a single history entry for OCI containers. commit 396ac822039467ff8bcc60dae78b5ac30a830ca0 Author: David Cassany AuthorDate: Fri Nov 9 15:54:31 2018 +0100 Commit: David Cassany CommitDate: Fri Nov 9 15:54:31 2018 +0100 Adding OEM and ISO image types for Fedora tests commit 4780f444e535b129820d38977f44ea1f20ac4d71 Author: Stefan Seyfried AuthorDate: Fri Nov 9 14:53:54 2018 +0100 Commit: Stefan Seyfried CommitDate: Fri Nov 9 14:53:54 2018 +0100 kiwi-dump-image: improve dialog usage Dialog's "--radiolist" feature requires to navigate to the item, press "space" to select the item and then "enter" to execute. With "--menu", it is enough to just navigate to the item and press "enter" to execute, which is much more intuitive for most users. commit 2dc46b77344fc795b73e098f5e4096f6278fd097 Author: Marcus Schäfer AuthorDate: Fri Nov 9 11:23:16 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 9 11:23:16 2018 +0100 Bump version: 9.17.0 → 9.17.1 commit 1d8c8af4d674c63494d3c0022a6af9d27c35eb7d Author: David Cassany AuthorDate: Fri Nov 9 11:05:22 2018 +0100 Commit: David Cassany CommitDate: Fri Nov 9 11:05:22 2018 +0100 Little code styling fix commit aa02325ea2dda4b3de80dd192fac2790dd4c5a82 Author: Marcus Schäfer AuthorDate: Fri Nov 9 09:56:33 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 9 10:09:21 2018 +0100 Fixed oem installer In the implementation of the ramdisk installer from SUSE/ramdisk_deployment(4fdeee3faa3) an error for the standard case was introduced such that the lsblk call was invalid. This lead to no devices being present for the installation. This patch Fixes #877 commit 58333cd9a65b789bb8b42fb792cb06bd6a82e7f8 Author: David Cassany AuthorDate: Thu Nov 8 16:34:35 2018 +0100 Commit: David Cassany CommitDate: Fri Nov 9 08:48:13 2018 +0100 Fix rsync call for filesystem images For filesystem images the rsync call was missing a finale slash for the source path causing the sync also the containing directory. With this change the filesystem image does not include the rootfs in any subdirectory. Fixes #875 commit f0612486ddef32b82e43153daec79f13039e3920 Author: David Cassany AuthorDate: Tue Nov 6 16:31:37 2018 +0100 Commit: David Cassany CommitDate: Thu Nov 8 15:33:04 2018 +0100 Add history metadata for container builds This commit adds the history section in contianerconfig. With it 'author', 'created_by' and 'comment' can be customized. In addition 'created' is always included with the image creation date time. 'created_by' entry is set to 'KIWI __version__' by default if nothing is provided. Fixes #852 commit 441358a3120035965c4a78b59e5c77ab58880dd5 Author: Marcus Schäfer AuthorDate: Tue Nov 6 15:20:59 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 6 15:20:59 2018 +0100 Bump version: 9.16.36 → 9.17.0 commit 18ba277113cecd2aa790bbd20bfe84f7223a727b Author: Marcus Schäfer AuthorDate: Tue Nov 6 11:58:03 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 6 12:16:36 2018 +0100 Change bundling of image formats By default none of the image formats were stored as compressed file. The reason behind this was the assumption that some formats automatically makes use of compression, which is true but only in their processing and not in their data blocks at creation time. Storage and handling of the image file itself becomes cumbersome and therefore we change the default bundle setup for image formats to be compressed. This means the image as it gets packed by KIWI needs to be uncompressed before use. The following image formats are affected by the change in a call of the result bundler: kiwi result bundle ... * qcow2 (.qcow2.xz) * vdi (.vdi.xz) * vhd (.vhd.xz) * vhdx (.vhdx.xz) * vmdk (.vmdk.xz) All other image formats already defined a custom bundling setup including compression and are not affected by this change. This Fixes #650 commit d56b1447073f9d8035ceb10fb82a5c2df05d1682 Author: Marcus Schäfer AuthorDate: Tue Nov 6 11:00:18 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 6 11:00:18 2018 +0100 Fixed firmware strip and lookup for kiwi initrd In a kiwi initrd the function baseStripFirmware can be used to strip down the firmware to the actually used kernel drivers in that initrd. The code to do this was broken due to the changes in #64cb5b003140a. This patch done by Ruediger Oertel fixes the method to work correctly again. commit dd1668ad278753fbe48cde2b61896c9cf86a6da2 Author: Stefan Seyfried AuthorDate: Tue Nov 6 10:39:21 2018 +0100 Commit: Stefan Seyfried CommitDate: Tue Nov 6 10:39:21 2018 +0100 kiwi-partitions-lib: wait for udev before lsblk A LVM-enabled oem image spuriously did not resize its PV / LVs. Tracking this down, I discovered that lsblk was sometimes racing with udev and the disk was just not available during get_partition_node_name(). Call udev_pending() before all lsblk calls to avoid that. (lsblk man page also advocates this to synchronize with udev) commit 2fa147dfb98ee7ae65fc5a90984006010262d780 Author: Marcus Schäfer AuthorDate: Tue Nov 6 10:11:08 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 6 10:11:08 2018 +0100 Bump version: 9.16.35 → 9.16.36 commit 26e4121e401b75bd033ef8e054fdede4e8ec40c8 Author: Marcus Schäfer AuthorDate: Tue Nov 6 10:09:44 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 6 10:09:44 2018 +0100 Bypass Jekyll processing for github pages sphinx uses directories that start with underscores which Jekyll considers these to be special resources and does not copy them to the final site. commit f0068106614ef42765cc1ea060e35cdfd325ca8a Author: Marcus Schäfer AuthorDate: Mon Nov 5 22:21:25 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 22:21:25 2018 +0100 Bump version: 9.16.34 → 9.16.35 commit b8e7e2bea6af89e604baa6d798bd57e54e2dca02 Author: Marcus Schäfer AuthorDate: Mon Nov 5 22:20:11 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 22:20:11 2018 +0100 Revert last travis.yml change This reverts commit 7fb7e8c39fa861b6226d54e04483be8e96a5f8be. commit 206ecdf183f1198a90dcbf3e868c440d94ace290 Author: Marcus Schäfer AuthorDate: Mon Nov 5 22:14:37 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 22:14:37 2018 +0100 Bump version: 9.16.33 → 9.16.34 commit 7fb7e8c39fa861b6226d54e04483be8e96a5f8be Author: Marcus Schäfer AuthorDate: Mon Nov 5 22:13:38 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 22:13:38 2018 +0100 Next try to fixup pypi deployment Reset to encrypted password hash which worked before commit 991ba67d14103b4be727a1f7d5e1ae62d0002afb Author: Marcus Schäfer AuthorDate: Mon Nov 5 16:30:28 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 16:30:28 2018 +0100 Bump version: 9.16.32 → 9.16.33 commit fa70a8263055cb3863adc95c8bbac4050ad10c4d Author: Marcus Schäfer AuthorDate: Mon Nov 5 16:29:58 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 16:29:58 2018 +0100 Move pypi secret to secure variable on travis commit eb4e121eadd1d5b388bb54ef2ddaf55195d520c4 Author: Marcus Schäfer AuthorDate: Mon Nov 5 16:25:44 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 16:25:44 2018 +0100 Bump version: 9.16.31 → 9.16.32 commit 0896872bae29189ff1b60a1c8591f4f58de0d1d6 Author: Marcus Schäfer AuthorDate: Mon Nov 5 16:24:35 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 16:24:35 2018 +0100 Use travis-sphinx to generate github pages doc The output from the sphinx build does not render css and java script correctly on github pages, thus switch back to travis-sphinx to generate that data commit c2b99c6d89a98c784bc0242d09b0ba47cd2efd88 Author: Marcus Schäfer AuthorDate: Mon Nov 5 15:30:17 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 15:30:17 2018 +0100 Bump version: 9.16.30 → 9.16.31 commit d0240cd657a4363ca92fa48f9f6afd4d1c1f6c36 Author: Marcus Schäfer AuthorDate: Mon Nov 5 15:29:42 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 15:29:42 2018 +0100 Move github token to secure variable on travis commit 3a879e8da2ea641cd53f7e9b91a0f682f00a7176 Author: Marcus Schäfer AuthorDate: Mon Nov 5 14:58:04 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 14:58:04 2018 +0100 Bump version: 9.16.29 → 9.16.30 commit d1aafdedef3cb207eed6dbe8a1b1fe9ae567072e Author: Marcus Schäfer AuthorDate: Mon Nov 5 14:56:57 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 14:56:57 2018 +0100 Run pages deployment before pypi In addition update the pypi secret commit a9d2cb8b5f08ed1e077a684c989ab69873415ae2 Author: Marcus Schäfer AuthorDate: Mon Nov 5 14:08:04 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 14:08:04 2018 +0100 Move travis references to .com domain commit 7561059875a7ebe48849a76a632ff59e36494a77 Author: Marcus Schäfer AuthorDate: Mon Nov 5 14:03:45 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 14:03:45 2018 +0100 Bump version: 9.16.28 → 9.16.29 commit 958180f71cb97813c5161c750355b3396dab54cf Author: David Cassany AuthorDate: Mon Nov 5 12:34:51 2018 +0100 Commit: David Cassany CommitDate: Mon Nov 5 13:15:32 2018 +0100 Arrange command test arguments to match py2 and py3 order Apparently dictionary keys are not sorted equaly in py2 and py3. While the code does not relay on command flags order the test command validation does. This commit ensures the umoci command is the same for both, py2 and py3, with all the flags in the same order. commit c5ee03ac0a3884b5676f7a59e5ec35206c593d76 Author: David Cassany AuthorDate: Mon Nov 5 10:56:26 2018 +0100 Commit: David Cassany CommitDate: Mon Nov 5 12:13:29 2018 +0100 Make process config arguments method static commit b3fd4caeacef0953085152f481245881013ab23d Author: Marcus Schäfer AuthorDate: Mon Nov 5 10:30:46 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 12:03:36 2018 +0100 Use the travis pages provider for doc deployment In the past we used the travis-sphinx script to deploy the documentation to gh-pages via the travis CI. However with the change to the travis github App we need to change this deployment into a real deployment stage of the travis setup commit a3765fd448ccc94d7f5b5b5d5bbb4152c4552372 Author: Marcus Schäfer AuthorDate: Mon Nov 5 10:22:21 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 12:03:36 2018 +0100 Fixed azurectl redirect in documentation commit e735494a085472c90ed172610f836788c892eeae Author: Marcus Schäfer AuthorDate: Mon Nov 5 10:38:41 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 10:38:41 2018 +0100 Added oci_tools to package MANIFEST commit 643d617bbac98edef29996f8480bbbf9da859e69 Author: David Cassany AuthorDate: Wed Oct 31 17:42:23 2018 +0100 Commit: David Cassany CommitDate: Mon Nov 5 10:36:04 2018 +0100 Refactor containerconfig xml evaluation This commit refactors the extracted data from containerconfig section to be tool agnostic. Related to #863 commit dc19c74455eae00c4e0bcf7b50050e78e5d65212 Author: Marcus Schäfer AuthorDate: Mon Nov 5 09:13:12 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 5 09:13:12 2018 +0100 Bump version: 9.16.27 → 9.16.28 commit 9e6a2698ae516f407b92f15c83819c29ac280067 Author: Marcus Schäfer AuthorDate: Sun Nov 4 17:17:06 2018 +0100 Commit: Marcus Schäfer CommitDate: Sun Nov 4 17:17:06 2018 +0100 Added Deploy and Run System in a RamDisk docu commit 8a0ef0461c331321d0f338187bd2354b141800ce Author: Marcus Schäfer AuthorDate: Tue Oct 30 19:57:29 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Oct 31 10:26:38 2018 +0100 Support ramdisk deployment in OEM images Using the rd.kiwi.ramdisk boot option enables the deployment into a ramdisk. If this option is enabled only ramdisk devices as provided by the brd kernel driver will be available for deployment commit 645542c33aa95b62ea54593d1c88257d254887c8 Author: David Cassany AuthorDate: Mon Oct 29 16:29:34 2018 +0100 Commit: David Cassany CommitDate: Tue Oct 30 14:53:42 2018 +0100 Distinguish install and image dracut config This commit distinguishes the files that should be installed inside the image dracut only than the ones installed in both, in install initrd and image initrd. Fixes #858 commit eff434c2562f5966933eb40491767330aaf6cddd Author: Marcus Schäfer AuthorDate: Mon Oct 29 17:48:17 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Oct 30 09:36:14 2018 +0100 Apply OCI interface for container and root_import Instead of directly calling the container archiving tool, in this case umoci, the code has been changed to use the new OCI interface class. This Fixes #859 commit e51b91cb388bceb1cd1c2460a50d78a86a1b2e6b Author: Marcus Schäfer AuthorDate: Mon Oct 29 09:33:21 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Oct 30 09:35:58 2018 +0100 Added OCI tooling interface class An initiative to formulate industry standards around container formats and runtime is available at https://www.opencontainers.org Different tools to implement the specifications had been created. The purpose of this class and its sub-classes is to provide a common interface in kiwi to allow using all tools such that the container support in kiwi covers every linux distribution no matter what tooling was preferred. Related to Issue #859 commit 3a066551c97891dde6a050f8ef2b7b188d94b9ba Author: Marcus Schäfer AuthorDate: Fri Oct 26 15:17:59 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 26 15:17:59 2018 +0200 Warn on Modifications to intermediate config files Some files are taken from the host and managed as intermediate config files during the build of the image. Changes to those files during the build run by e.g a script will not become effective because the file gets restored. With this patch we detect the modification condition and throw a warning message such that the author of the image can adapt the description as suggested in the message. This Fixes #817 commit 7cee86cf18766d490468835f5d140f36e8f2ac76 Author: Marcus Schäfer AuthorDate: Thu Oct 25 11:22:34 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 25 15:52:17 2018 +0200 Cleanup code to make flake8 happy The new version of flake8 is more strict on code checking and complained at several places. This commit fixes the code smells such that flake8 is happy again commit 7343787f871305eaf378ccffc1e9028600eca928 Author: Marcus Schäfer AuthorDate: Fri Oct 19 14:26:39 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 19 14:26:39 2018 +0200 Bump version: 9.16.26 → 9.16.27 commit a1be96220048479860f930926021a9bd713f4b0c Author: Marcus Schäfer AuthorDate: Fri Oct 19 08:51:47 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 19 08:51:47 2018 +0200 Use %{ix86} rather than %ix86 in spec template Clear macro annotation prevents clarity issues commit 65c7d71c0748e0327c72686444ed3794efbf30ad Author: Marcus Schäfer AuthorDate: Thu Oct 18 17:55:53 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 18 17:58:36 2018 +0200 Fixed spec file for gfxboot requires Require gfxboot but only for the x86 architecture commit d1ef6cbce9532f5cf58e128f899c840387fed96e Author: Marcus Schäfer AuthorDate: Thu Oct 18 16:33:26 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 18 16:33:26 2018 +0200 Bump version: 9.16.25 → 9.16.26 commit 7f675e98b6e60d21cf43e49fe7c53a800af1ef23 Author: David Cassany AuthorDate: Thu Oct 18 16:30:15 2018 +0200 Commit: David Cassany CommitDate: Thu Oct 18 16:30:15 2018 +0200 Move the default rpm database path into Defaults class commit 0a351a319562c611c070a1c3c8fbfaa5b109db1d Author: Marcus Schäfer AuthorDate: Thu Oct 18 16:08:29 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 18 16:08:29 2018 +0200 Handle default uri mime type in Defaults class commit 3bf6e01a8a617d509180a74e23af8c250ef7bdb0 Author: David Cassany AuthorDate: Thu Oct 18 15:27:07 2018 +0200 Commit: David Cassany CommitDate: Thu Oct 18 15:27:07 2018 +0200 Add a hardcoded rpm database path to import trusted keys This commits adds a hardcoded rpm database location to make sure the imported keys are in the expected location for zypper. Fixes #855 commit 4f8eb6d4197d5bf9f689bc20cc92fd800de2fb08 Author: Marcus Schäfer AuthorDate: Thu Oct 18 13:57:11 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 18 13:57:11 2018 +0200 Allow simple path source in Uri class This patch is needed as follow up fix for the setup of the package cache in local repositories. The is_remote method from the Uri class is used to identify if a repostory source is remote or local. At that point the initial repository source was already translated into its components. In case of a local repository the Uri instance now receives a simple path and the is_remote method raised with a style error. This patch allows the Uri class to be more friendly and initializes a local path as file:/ typed source. Related to Issue #847 commit 55c3c875f392f0ea658c9a562ae9726d87f11a08 Author: Marcus Schäfer AuthorDate: Thu Oct 18 10:35:50 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 18 10:35:50 2018 +0200 Bump version: 9.16.24 → 9.16.25 commit 1a70dd6440e6b4083061995d6aec1c8278e5f27b Author: Marcus Schäfer AuthorDate: Thu Oct 18 10:18:53 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 18 10:18:53 2018 +0200 Add timestamp to logfile entries On the console output we use a log format with timestamps This is useful for the logfile contents too commit 46c95b966899fd07953fd1605e5bc1597f8bf6f2 Author: Stefan Seyfried AuthorDate: Wed Oct 17 16:15:22 2018 +0200 Commit: Stefan Seyfried CommitDate: Wed Oct 17 16:15:22 2018 +0200 sort package list which accompanies the image This makes it much easier to diff the lists of two images to find out the differences in package versions. commit b97dcf6ce54ac62313064cac514d92da0dbffdf5 Author: Marcus Schäfer AuthorDate: Wed Oct 17 14:34:24 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 17 14:34:24 2018 +0200 Don't cache packages from local repos for zypper Access to packages from local repositories is as fast as reading them from a cache location. The additional package copy and cache update is superfluous and should be avoided. This Fixes #847 commit 857c87dbd8ca052f3a0429464730b8b2e59391c4 Author: Marcus Schäfer AuthorDate: Tue Oct 16 16:56:45 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 16 16:56:45 2018 +0200 Bump version: 9.16.23 → 9.16.24 commit e54874b554690bfb6393e5e44fe43998c65e2897 Author: David Cassany AuthorDate: Tue Oct 16 11:58:23 2018 +0200 Commit: David Cassany CommitDate: Tue Oct 16 15:35:06 2018 +0200 Update /etc/machine-id management docs Updates the information about how /etc/machine-id is treated in KIWI and provides some hints for old systems where /var/lib/dbus/machine-id is not a symlink to /etc/machine-id Related to #843 commit f61326bd3bf4f548c7efea0d7900e1344d10bb01 Author: Marcus Schäfer AuthorDate: Tue Oct 16 10:32:15 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 16 10:32:15 2018 +0200 Unpack root.tar.gz file for LVM integration test commit 0e413ed89d368b797b9099a0badbd01d16215967 Author: Marcus Schäfer AuthorDate: Tue Oct 16 10:28:44 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 16 10:28:44 2018 +0200 Added LVM integration test build commit f75dbb16438fcc40f71a5b6df2dbca1a49ba4f3e Author: Marcus Schäfer AuthorDate: Mon Oct 15 09:53:10 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 15 09:53:10 2018 +0200 Bump version: 9.16.22 → 9.16.23 commit 68d492978860e33008490c1eaac0c50ade7efbeb Author: Marcus Schäfer AuthorDate: Mon Oct 15 09:33:25 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 15 09:33:25 2018 +0200 Added machine id setup in dracut preparation In case of a dracut booted image we empty out the systemd machine-id configuration file to trigger the rebuild of that information by the dracut boot code at boot time. This allows for unique systemd identifiers if the same image gets deployed on different machines. This also makes the script implementations people put in in config.sh or images.sh to solve this problem obsolete. This Fixes #843 commit 8ecafc7b6b7463a5a1dfb7cd4c563c6ac2f8a274 Author: Marcus Schäfer AuthorDate: Fri Oct 12 21:42:28 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 12 21:42:28 2018 +0200 Fix use of uri type in debootstrap call Referencing a file in a debootstrap call is done using the file:/ source type. However when using file:// debootstrap does something different and failed to find the file. The additional / had a bad impact to the call. commit 734a5ba528462bb911a2c3d3b7edfc4312f104aa Author: Marcus Schäfer AuthorDate: Thu Oct 11 17:37:37 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 11 17:37:37 2018 +0200 Bump version: 9.16.21 → 9.16.22 commit 8220b6f5828d152d8466970a49ed10d9f921396d Author: Marcus Schäfer AuthorDate: Thu Oct 11 17:35:54 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 11 17:35:54 2018 +0200 Delete obsolete rhel/fedora doc move With the fix to use the rpm macro consistently it is no longer required to move around the docs commit c9e5ed6e44aec6c8a8ddff7dee93448d5ffef564 Author: Marcus Schäfer AuthorDate: Thu Oct 11 17:13:34 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 11 17:13:34 2018 +0200 Bump version: 9.16.20 → 9.16.21 commit f1042730cb2e598fab1f24e8fb51e63d329aaac0 Author: Marcus Schäfer AuthorDate: Thu Oct 11 16:02:01 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 11 16:03:32 2018 +0200 Fixed package specs for dracut modules on fedora dracut-network is a separate package on Fedora/RHEL too commit dd3009bd401f0c800539dd9fe72e1bfd1b21fffb Author: Marcus Schäfer AuthorDate: Thu Oct 11 15:48:34 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 11 15:48:34 2018 +0200 Add alternative search path for syslinux binaries On debian/ubuntu systems /usr/lib/ISOLINUX is a valid search path for syslinux binaries like isolinux.bin. This Fixes #839 commit e64ccbe74c65d9122c80e11fdb8269dbc1fbf8cf Author: Marcus Schäfer AuthorDate: Thu Oct 11 15:29:20 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 11 15:29:20 2018 +0200 Fixed package doc install target The spec file uses the %{_defaultdocdir} macro but the corresponding Makefile target used a hardcoded path which lead to inconsistencies on debian/ubuntu based systems. This Fixes #838 commit 9eaebb15c3c99441ca618c4fc636e5290a609f8a Author: Marcus Schäfer AuthorDate: Thu Oct 11 15:04:48 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 11 15:04:48 2018 +0200 Fixed package specs for dracut modules on debian btrfs tools are provided by btrfs-tools package and not by btrfs-progs. In addition dracut-network is a separate package on debian/ubuntu based distributions. This Fixes #837 commit 9df816c0649a35e4745c8ff391655e3e1628d97f Author: Marcus Schäfer AuthorDate: Tue Oct 9 12:28:46 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 9 12:28:46 2018 +0200 Don't require gfxboot on rhel/fedora commit 72b0173208381db8a8fb3aa605117480c97f92b8 Author: Marcus Schäfer AuthorDate: Tue Oct 9 10:32:26 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 9 12:15:02 2018 +0200 Added gfxboot to required packages in spec kiwi calls gfxboot as tool when building live iso images. Thus this tool provided by the gfxboot package should be a requirement for kiwi commit 6f607df5166a3a84f4e24791adfb148b58342bef Author: Marcus Schäfer AuthorDate: Tue Oct 9 10:44:03 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 9 10:44:03 2018 +0200 Fixup zypper calls in documentation The way the documentation describes the zypper call to add a repository was wrong in several places. commit 539cdd7172cc6a35a7438f9158261aff1315c5b7 Author: Marcus Schäfer AuthorDate: Tue Oct 9 09:17:25 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 9 09:17:25 2018 +0200 Bump version: 9.16.19 → 9.16.20 commit fda157296e8bbe52c1d3ee210f50b37eeefe75a9 Author: David Cassany AuthorDate: Fri Oct 5 11:39:41 2018 +0200 Commit: David Cassany CommitDate: Mon Oct 8 15:48:51 2018 +0200 Add Codec utils for bytes literals decoding In case of a literal decoding failure it tries to decode the result in utf-8. This is handy in python2 environments where python and the host might be using different charset configurations. In python3 this issue seams to be solved. Fixes #829 and bsc#1110871 commit 2ea7fbd13f13487e49c23e4a0e0b21fc3c85bc09 Author: Marcus Schäfer AuthorDate: Mon Oct 8 15:47:53 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 8 15:47:53 2018 +0200 rebuild auto generated code with stable generateDS For some reason the xml_parse code generated by generateDS v2.29.24 caused warnings on simple type XSD patterns. Therefore I rebuild the code with the stable build version v2.29.14 which fixed that issue commit 7b51f525c1870612c4443af7edbaeecea9ab33b1 Author: Marcus Schäfer AuthorDate: Mon Oct 8 09:56:14 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 8 09:56:14 2018 +0200 Fixup README travis and codacy status badges commit 81201b5cf0c43144d201a0ca9086c547d841826c Author: Marcus Schäfer AuthorDate: Mon Oct 8 09:13:56 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 8 09:13:56 2018 +0200 Adding bugfix trace for bsc#1110869 bsc#1108508 ticket was fixed with request #831 from SUSE/fix_uri_handler commit 0a6998dfc33c5f86e0050dda849b87721b0566c4 Author: Marcus Schäfer AuthorDate: Sun Oct 7 20:49:44 2018 +0200 Commit: Marcus Schäfer CommitDate: Sun Oct 7 20:52:39 2018 +0200 Include livenet module with dmsquash-live support The upstream dracut dmsquash-live module supports network mode with the livenet module. But that module must be explicitly included and is not fetched automatically. This Fixes #827 commit d7f68860555a0097a3a740695b41c0abade4ac4c Author: Marcus Schäfer AuthorDate: Fri Oct 5 17:12:14 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 5 17:12:14 2018 +0200 Bump version: 9.16.18 → 9.16.19 commit 480f0a0cde291b8907b5b628ae8e8f9eccc3234f Author: Marcus Schäfer AuthorDate: Fri Oct 5 16:37:14 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 5 16:37:14 2018 +0200 Rename private method to be more expressive commit 337d11d5c2f4121b172e2128f938831dda07b4c4 Author: Marcus Schäfer AuthorDate: Fri Oct 5 11:27:49 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 5 11:27:49 2018 +0200 Fixed URI handling with token query option So far only the query format ?credentials=... was supported. In case of ?random_token_data the returned uri was truncated and also the format check on the query caused a python trace. This Fixes #830 and Fixes #828 commit 164be0fc546d299a438694f3e34a840a69952d22 Author: David Cassany AuthorDate: Fri Oct 5 11:08:02 2018 +0200 Commit: David Cassany CommitDate: Fri Oct 5 11:08:02 2018 +0200 Make use of the quiet flag of mountpoint command This commit sets the use of -q flag of mountpoint. Kiwi only checks the return code, thus any stdout is useless in this case. Fixes #829 commit e73a7c0b5af62d2d7d2397ee3d788cb9c803cf40 Author: Fergal Mc Carthy AuthorDate: Tue Oct 2 05:51:40 2018 -0400 Commit: Fergal Mc Carthy CommitDate: Tue Oct 2 06:11:49 2018 -0400 Eliminate redundant code Create a helper method, _create_volume_no_zero, which calls the lvreate command with appropriate options and calls the vgscan command immeditately afterwards to create any missing /dev nodes. commit 00f136b7d7673975e06033cb5a78702172a061e5 Author: Fergal Mc Carthy AuthorDate: Thu Sep 27 15:27:36 2018 -0400 Commit: Fergal Mc Carthy CommitDate: Tue Oct 2 06:11:49 2018 -0400 Fixes LVM based image creation in OBS While attempting to create LVM based images under the Open Build Service I recently ran into some issues related to the fact that there is no udev running in the chroot environment used to build kiwi based images. Two workarounds have been implemented in this patch: (1) When calling lvcreate, include the `-Zn` option to disable the automatic zeroing of the header of the newly created LV device; doing so requires that the LV device's /dev entry exists immediately after it has been created, but in a chroot'd environment udev isn't going to be running to automatically populate /dev// or /dev/mapper/-. This should be safe to do since the LV is being created within a loopback device based partition, which is backed by a zero filled file, created by qemu-img. (2) After creating an LV we need to run `vgscan --mknodes` to create the required device nodes under /dev, which won't be automatically created since udev isn't running in the chroot'd environment. Unit tests updated to account for additional `-Zn` arguments that are being passed to `lvcreate` and for additional call that is being made to `vgscan --mknodes`. This fixes #824. commit b702873e37d31be8dd0fe3e0450c11e9b39f5691 Author: Marcus Schäfer AuthorDate: Sat Sep 29 21:37:46 2018 +0200 Commit: Marcus Schäfer CommitDate: Sat Sep 29 21:37:46 2018 +0200 Fixed broken link to ec2uploadimg tool commit 7d6fe44cba8c468b95237bdcc00a69f8c6ef97d9 Author: Marcus Schäfer AuthorDate: Sat Sep 29 21:14:38 2018 +0200 Commit: Marcus Schäfer CommitDate: Sat Sep 29 21:26:27 2018 +0200 Update contact information We moved from IRC to Matrix as chat platform. Thus the documentation needs to be updated accordingly commit 2f68057404f39a673eb09bedcb765fae6339d28e Author: Marcus Schäfer AuthorDate: Wed Sep 26 17:00:15 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 26 17:00:15 2018 +0200 Bump version: 9.16.17 → 9.16.18 commit 1c9700236744ca96d72aa850a3b474a57eddca6c Author: David Cassany AuthorDate: Wed Sep 26 15:57:05 2018 +0200 Commit: David Cassany CommitDate: Wed Sep 26 16:42:13 2018 +0200 Create parent qgroup when snapper is present This commit creates a new parent quota group (1/0) of level 1 when btrfs_quota_groups is enabled and snapper present into the image root tree. Related to bsc#1093518 and #812 commit d84c01334a28b7c69cefd9f121338a58d1e0899a Author: Marcus Schäfer AuthorDate: Wed Sep 26 13:39:20 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 26 13:39:20 2018 +0200 Bump version: 9.16.16 → 9.16.17 commit 929e08cd124341d2754edf0798a5a8a0931b92cb Author: Marcus Schäfer AuthorDate: Wed Sep 26 13:38:07 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 26 13:38:07 2018 +0200 Fixup make build target Don't include auto generated schema docs into the source tarball. Also cleanup MANIFEST.in from files no longer present in the repository commit 84a83c2cfc18b0aaec6973b3a7c782c1889684f4 Author: Marcus Schäfer AuthorDate: Wed Sep 26 12:28:00 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 26 12:28:00 2018 +0200 Bump version: 9.16.15 → 9.16.16 commit d425b0c1a7562b1612b09bb30368935b02cf0b6d Author: Marcus Schäfer AuthorDate: Wed Sep 26 12:26:30 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 26 12:26:30 2018 +0200 Disable warnings report from pytest By default pytest now generates warnings for all modules used in the tox environment. This information is nice but taints the test output of the code of this project and is therefore unwanted. commit 09f1c195766a873a13435f28ea3048dceeb23a3a Author: Marcus Schäfer AuthorDate: Wed Sep 26 12:19:22 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 26 12:19:22 2018 +0200 Bump version: 9.16.14 → 9.16.15 commit f28aced0e07d81ec83b5467994c5181068ddb2d2 Author: David Cassany AuthorDate: Tue Sep 25 11:05:20 2018 +0200 Commit: David Cassany CommitDate: Wed Sep 26 11:57:01 2018 +0200 Make volume id customizable for installation ISOs This commit makes volid attribute also available for OEM images. The installation media makes use of the volid value. Only posix safe names are allowed, up to 32 characters. Fixes #811 commit dd4de571c3daa32199c0c99beb456d5d61a6b68a Author: Marcus Schäfer AuthorDate: Wed Sep 26 10:58:12 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 26 10:58:12 2018 +0200 Customize latex output for look and feel commit cba8f96792be2bc9ab1891aa21791d464d35609b Author: Marcus Schäfer AuthorDate: Wed Sep 26 10:35:52 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 26 10:40:14 2018 +0200 Update development doc chapter per review by Tom commit e7987be802ba106597409b9dcd76c6dcf8e533d9 Author: Marcus Schäfer AuthorDate: Mon Sep 24 12:39:29 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 24 17:31:07 2018 +0200 Include PDF build of documentation to the package Bundle a PDF version of the online documentation with the rpm package build. Due to the complexity of getting a latex build environment into the travis CI which does not take forever to install, the bundling of a built PDF into the pypi archive has been skipped. Users installing from pypi would need to install a latex env on their machine and run make latexpdf from the installed bundle. This Fixes #819 commit d521f476b7b91aecc6b4b6a13b7bbf9db0ef29a9 Author: Marcus Schäfer AuthorDate: Mon Sep 24 11:43:10 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 24 11:43:10 2018 +0200 Update docs for setting up development environment Reference py3.6 when showing example tox call. Also delete a py version reference where it was not needed commit a9492904a0958ad5d8e5eee9d734242870516f76 Author: Marcus Schäfer AuthorDate: Fri Sep 21 16:45:19 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 21 16:45:19 2018 +0200 Update kiwi tools README Delete obsolete entries for tools no longer present commit 4ba8d9541b4decd1e671223bd6b5903d9c01d4d4 Author: David Cassany AuthorDate: Thu Sep 20 17:46:42 2018 +0200 Commit: David Cassany CommitDate: Thu Sep 20 17:46:42 2018 +0200 Adding bugfix trace for bsc#1108508 bsc#1108508 ticket was fixed with bf556a96 and 77517cff commits. Just adding the ticket reference here. commit 2aba8d981f5ebf064c63efadbf86f7023021ad57 Author: Marcus Schäfer AuthorDate: Wed Sep 19 16:01:11 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 19 16:01:11 2018 +0200 Fixed disk detection for live iso in loopback grub If the live iso is used as a disk on e.g USB sticks and is configured to setup a persistent write space via the initrd option rd.live.overlay.persistent, it's required to find the disk device to create a write partition on it. This detection worked if the live iso is binary dumped on the disk and bootet due to the hybrid support each iso built by kiwi provides. However if the live ISO deployment should not destroy existing data on the disk there is an alternative setup which uses grub's loopback support and puts the iso as a file on some partition of the disk. In this mode the kiwi-live dracut module failed to find the disk device and could not setup a persistent write partition. commit 0094f1bf148c9b3567b6986ec52b4565317a9c58 Author: Marcus Schäfer AuthorDate: Fri Sep 14 11:39:24 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 14 11:39:24 2018 +0200 Bump version: 9.16.13 → 9.16.14 commit 711d2ee2c36d5f2c88072494c90a49176462afa9 Author: Marcus Schäfer AuthorDate: Fri Sep 14 11:38:21 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 14 11:38:21 2018 +0200 Fixed spec template Directory delimiter missing in call for install_dracut target commit 02b961b8c8a992e8ab12a5f3db4117d69fd222e6 Author: Marcus Schäfer AuthorDate: Fri Sep 14 11:21:46 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 14 11:21:46 2018 +0200 Bump version: 9.16.12 → 9.16.13 commit 79352768076e7a625c6d213ce59e81d280d4dcab Author: David Cassany AuthorDate: Thu Sep 13 17:54:58 2018 +0200 Commit: David Cassany CommitDate: Thu Sep 13 17:54:58 2018 +0200 Make use of kiwi/utils/sysconfig This commit makes use the sysconfig kiwi utility in order to read and eventually update the /etc/sysconfig/snapper file. commit 33bf71fad98cd03e27cf69a390fb0a6d1ab585f5 Author: David Cassany AuthorDate: Thu Sep 13 11:35:53 2018 +0200 Commit: David Cassany CommitDate: Thu Sep 13 11:48:56 2018 +0200 Snapper configuration for btrfs quota support refactored This commit refactors the snapper configuration for btrfs quota support when btrfs_root_is_snapshot is enabled. The sysconfig file /etc/sysconfig/snapper is now taken into consideration. Fixes bsc#1093518 commit 6b9e321048602945214fb570f2ee991a14cd9054 Author: Marcus Schäfer AuthorDate: Wed Sep 12 17:27:28 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 12 17:27:28 2018 +0200 Fixed overlay of intermediate config files Some config files e.g etc/hosts needs to be temporary copied from the buildsystem host to the image root system. This is done by a custom copy with the .kiwi extension and a symlink to that file. During the installation process the package manager either overwrites the file or creates a .rpmnew variant. In case a .rpmnew variant exists there is code in kiwi which restores that .rpmnew variant to become the real file. However that _restore_intermediate_config_rpmnew_variants() method runs after overlay files has been applied to the system because it's part of the final cleanup step. In order to preserve an eventual overlay version of the file the .rpmnew variant gets only restored if the real file does not exist. This Fixes #807 commit 3b30a2edc96e754ea3beba82704be0d876c770a2 Author: Marcus Schäfer AuthorDate: Wed Sep 12 09:55:18 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 12 09:55:18 2018 +0200 Fixed dice documentation The chapter: Building in a Self-Contained Environment holds a fixed ruby version in the package install which was outdated. It also still referenced the container as tar.xz but we have changed to uncompressed containers by default a while back commit 6a6ff06b406d3db42d348e11f86e8107be802c1a Author: Marcus Schäfer AuthorDate: Tue Sep 11 18:11:16 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 11 18:11:16 2018 +0200 Fixed filesystem builder use of exclude list kiwi defines a global Defaults.get_exclude_list_for_root_data_sync method but it was not used in the scope of the filesystem builder. Thus this builder was missing the exclusion of the .buildenv file. This references Issue #422 and Fixes #814 commit a891fbac60ef2cfc9fdf142817dc2b42608954bc Author: Marcus Schäfer AuthorDate: Sat Aug 25 20:52:07 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 7 10:13:58 2018 +0200 Separate dracut module install by Makefile target The dracut modules like kiwi provides it should not be part of the default install target. If kiwi gets installed from source or via pip all dracut code gets installed on that system which is unwanted and in the worst case leads to boot trouble next time this system rebuilds its initrd via dracut. Therefore an extra Makefile target which is used in the spec of an rpm but not in the install target of setup.py is provided in this commit. As a consequence the installation from pip will not install any dracut modules on that system which is intentional. Installing from source requires to run make install_dracut which if called assumes the caller knows what he/she does :) commit c5bccf8e8c2dfc80dc7950731f9a0d0b220b4a76 Author: David Cassany AuthorDate: Wed Sep 5 14:35:16 2018 +0200 Commit: David Cassany CommitDate: Wed Sep 5 14:35:16 2018 +0200 Enhance /etc/snapper/configs/root file parser commit 5652ac06749787f1b0800c75bb640317c73e47d2 Author: David Cassany AuthorDate: Tue Sep 4 16:51:28 2018 +0200 Commit: David Cassany CommitDate: Tue Sep 4 18:29:44 2018 +0200 Fix quota groups management when snapper is present * Fixes the config file path if root is snapshot * Uses the correct QGROUP="" syntax * Do not overwrite the config file if already present Fixes bsc#1093518 commit 2887d1af8a1f2e07e7a549f49aee16bfa5333d42 Author: Marcus Schäfer AuthorDate: Mon Aug 20 22:42:46 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 20 22:42:46 2018 +0200 Bump version: 9.16.11 → 9.16.12 commit 68980b3cf06f47e08043bb3ebb45fbcb04b10169 Author: Marcus Schäfer AuthorDate: Mon Aug 20 22:35:37 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 20 22:36:11 2018 +0200 Follow up fix for skip_cleanup use make sure doc_travis tox target has created the manual pages such that the environment contains this data commit 038bc48ca96878eb20829e0bf636c0b745d08bb7 Author: Marcus Schäfer AuthorDate: Mon Aug 20 22:09:18 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 20 22:09:18 2018 +0200 Bump version: 9.16.10 → 9.16.11 commit 67a33bae4c81c0606b0969a739d3708d645eb617 Author: Marcus Schäfer AuthorDate: Mon Aug 20 22:08:04 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 20 22:08:04 2018 +0200 Use skip_cleanup for deploy stage in travis We need the tox build environment to run the deployment commit 8b7b728139f6351ea0919d3727be72f33820711c Author: Marcus Schäfer AuthorDate: Mon Aug 20 19:18:38 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 20 19:18:38 2018 +0200 Bump version: 9.16.9 → 9.16.10 commit ac1e6261110a680b78cc6a116fbea29aab7b6092 Author: Marcus Schäfer AuthorDate: Mon Aug 20 17:37:11 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 20 19:15:12 2018 +0200 Follow up fix for deploy target Integration of man pages must be done as part of the sdist setup because the travis pypi deployment only uses the sdist target to bundle the sources commit 7a44d051a6e7348f79b2f6caf76d3d13212a43a8 Author: Marcus Schäfer AuthorDate: Mon Aug 20 17:02:58 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 20 17:02:58 2018 +0200 Bump version: 9.16.8 → 9.16.9 commit 52002870cd94a70d8baa90103e1d0dcaf6f025c0 Author: Marcus Schäfer AuthorDate: Mon Aug 20 12:04:09 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 20 12:04:09 2018 +0200 Fixed deploy target As part of the deploy process in travis a bundle to pypi is uploaded. The bundle is missing the compiled manual pages because the doc_travis stage did not create them. commit 542074cb733dac8040c4a4b4210f0220a3952ce3 Author: Marcus Schäfer AuthorDate: Wed Aug 8 21:32:23 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 8 21:32:23 2018 +0200 Bump version: 9.16.7 → 9.16.8 commit f278e8fe57838ac8e52bbdc7b398265bb553ec1e Author: Marcus Schäfer AuthorDate: Wed Aug 8 17:56:24 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 8 18:13:00 2018 +0200 Added support for system wide config file If there is no user specific config file we are also looking for a system wide /etc/kiwi.yml file commit 0baeedc8c3cd6e712fbf3be4dd7b7c01b2f0fc29 Author: Marcus Schäfer AuthorDate: Wed Aug 8 18:02:59 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 8 18:02:59 2018 +0200 Update pxe server setup documentation Delete the suggested modifications to /etc/sysconfig/atftpd and trust the defaults provided by the package commit bf556a96adbf02de50c1b9cd124b924fc5e25b23 Author: David Cassany AuthorDate: Wed Aug 8 09:46:22 2018 +0200 Commit: David Cassany CommitDate: Wed Aug 8 09:46:22 2018 +0200 use more meaningful variable names commit dbb46178d3f28577e9fb0de24e6e9e5074b2bf55 Author: Marcus Schäfer AuthorDate: Tue Aug 7 11:43:13 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 8 09:41:23 2018 +0200 Added doc chapter for remote live boot commit 77517cffdeb1d6ff27c6fea5abaaaf75c08367c6 Author: David Cassany AuthorDate: Tue Aug 7 16:10:11 2018 +0200 Commit: David Cassany CommitDate: Tue Aug 7 16:35:19 2018 +0200 Fix baseStripUnusedLibs config method This commit arguments handling of the baseStripUnusedLibs that was not prepared to handle quoted variable containing a list. Fixes #798 commit 8ddab94511a2d58403170c35e344c4c5e4e51d04 Author: Marcus Schäfer AuthorDate: Mon Aug 6 18:28:30 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Aug 7 11:43:36 2018 +0200 Added support for pxe live boot via AOE The live ISO should support a network reference. We are using the Ata Over Ethernet protocol to achieve this. In combination with pxe boot of the kernel/initrd a live iso can boot from the network using the following parameter example: root=live:AOEINTERFACE:e0.1 rd.kiwi.live.pxe Export of the live iso file via AOE can be achieved using the vblade toolkit which needs to be available on the exporting system and compatible with the live operating system. This Fixes #796 commit 6608c7f57522d889418d38f3dcab1af05ec56efe Author: Marcus Schäfer AuthorDate: Mon Aug 6 12:21:24 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 6 12:23:53 2018 +0200 Run schema validation/update per XSL stylesheets commit 30c11dc82d359dd35e8dfa472b4cc48fca39f58b Author: Marcus Schäfer AuthorDate: Mon Aug 6 12:16:53 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 6 12:23:53 2018 +0200 Added XSL stylesheet to auto update schema Drop oem-ataraid-scan from oemconfig if specified commit efc0d63c8815033e9b83f223fe2f99b160b201c2 Author: Marcus Schäfer AuthorDate: Mon Aug 6 11:39:03 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 6 12:23:53 2018 +0200 Drop oem-ataraid-scan from schema Along with the change we pin generateDS version to 2.29.14 because the newer version (2.29.19) creates broken python syntax for elements with a value list for their content like it's the case for the packagemanager element. The tool uses the name k.packagemanager.content as class name which is invalid for python. commit d30cd0e9027a5229b253a591cb452488c1700f7e Author: Marcus Schäfer AuthorDate: Mon Aug 6 11:31:07 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 6 12:23:53 2018 +0200 Delete dmraid aka: softraid soft/fakeraid support In fate#323743 the decision was made to drop dmraid from the distribution. Along with the low business case for those controllers and the support for linux softraid via mdadm we also drop the support in kiwi for oem-ataraid-scan commit 6028e406b2762e7d615792222ecc7de909367e8f Author: Marcus Schäfer AuthorDate: Mon Aug 6 11:45:15 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 6 12:23:52 2018 +0200 Update vagrant doc chapter redirect links commit 410e1c9e2cb3b80ec7bcf126e110e7c3fd0bf04a Author: Marcus Schäfer AuthorDate: Mon Aug 6 11:21:22 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 6 11:21:22 2018 +0200 Fixed unresolvables in EC2 integration build For some reason libyui-ncurses-pkg8 is gone now commit d8dbbcb76e42c173df9ea37d0f473751f6e89b06 Author: Marcus Schäfer AuthorDate: Mon Aug 6 11:15:16 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 6 11:15:16 2018 +0200 Fixed unresolvables in integration builds For some reason libyui-ncurses-pkg8 is gone now commit 57f879d8a0e42ffd18e22bf7bc407dcf1a5aba1a Author: Marcus Schäfer AuthorDate: Wed Aug 1 14:24:25 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 1 14:24:25 2018 +0200 Bump version: 9.16.6 → 9.16.7 commit 64f3654872af103c8de451e52aad82bdeb8c8b90 Author: Marcus Schäfer AuthorDate: Wed Aug 1 13:18:37 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 1 13:18:37 2018 +0200 update vagrant doc chapter per review by Tom commit 4a9d5437afa76cd07414db43253678d36a95b5d8 Author: Marcus Schäfer AuthorDate: Wed Aug 1 09:03:19 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 1 09:03:19 2018 +0200 Added vagrant setup chapter in the docs Document steps to create a vagrant box for the libvirt provider. Also provide information on provider support This Fixes #792 commit 7bcccbe1f387c73208390c2f4e94d763ac5e03b1 Author: Marcus Schäfer AuthorDate: Tue Jul 31 09:45:35 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 31 09:45:35 2018 +0200 Use xattr 0.9.3 Latest xattr is broken on pip commit 2104c02e8f7e2793d7879b68538ca184c6ed95f3 Author: Marcus Schäfer AuthorDate: Tue Jul 31 08:58:18 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 31 09:00:28 2018 +0200 Fixed make obs_test_status The helper script .obs_test_status looks up the build results from the integration tests. With the introduction of multibuild integration tests the script has to apply some modifications to get the correct results This is related to Issue #791 commit 1587fe9213c798b845b4935f82103852dc9f4ceb Author: Marcus Schäfer AuthorDate: Mon Jul 30 13:21:16 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 30 13:21:16 2018 +0200 Bump version: 9.16.5 → 9.16.6 commit 12b1e9c2c8298ddbca07bcb474c910c3383d85bd Author: David Cassany AuthorDate: Mon Jul 30 11:53:23 2018 +0200 Commit: David Cassany CommitDate: Mon Jul 30 11:53:23 2018 +0200 Fix result bundle command This commits fixes a regression introduced in 98c9c77a commit 5ba2efd3f5e52be0eb1c63c7c874f22157468260 Author: Marcus Schäfer AuthorDate: Mon Jul 30 09:47:39 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 30 09:47:39 2018 +0200 Bump version: 9.16.4 → 9.16.5 commit 7514969510249b2c78e4710170809312f941c6d6 Author: Marcus Schäfer AuthorDate: Mon Jul 30 08:44:12 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 30 08:44:12 2018 +0200 Fixup validation of boottimeout attribute If boottimeout is set to zero it is evaluated as "not set" and the default applies. However it's a fairly well approach to set a zero second boot timeout. This Fixes #789 commit a05cc79d5174dc649d5a953036c6a8af9a27ab29 Author: David Cassany AuthorDate: Fri Jul 27 14:31:59 2018 +0200 Commit: David Cassany CommitDate: Fri Jul 27 14:39:45 2018 +0200 Add build tests for CentOS commit 98c9c77a72cc65508638a3d4711e6786a623d72b Author: David Cassany AuthorDate: Fri Jul 27 12:27:18 2018 +0200 Commit: David Cassany CommitDate: Fri Jul 27 13:30:37 2018 +0200 Do not replace version from the image name This commit makes sure that replacing version to version plus the build id on resulting files happens only on version suffixes. Before that if image name was including the version string it, this part was also replaced. Fixes #787 (bsc#1102868) commit 2cffd331fcc7bf5cb2893c048be79dd6d8877c66 Author: David Cassany AuthorDate: Fri Jul 27 12:25:23 2018 +0200 Commit: David Cassany CommitDate: Fri Jul 27 12:25:23 2018 +0200 Extending result bundle task tests to better cover corner cases This commit adds some tests to better cover a couple of cases: * image name contains the version of the image * the file in result does not include the version commit 48d552200eb6a9d24bc67e9be28f4993f1026cd0 Author: Marcus Schäfer AuthorDate: Wed Jul 25 16:35:26 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 25 16:37:33 2018 +0200 Cleanup misleading error message In root_bind if the cleanup failed to remove a directory hierarchy the error message was just displaying the path as it would be on the host root and not based on the root of the image root tree. commit 2f22cad3f86685faf8e20fd70fce6bdbdd7f24d3 Author: David Cassany AuthorDate: Tue Jul 24 17:39:38 2018 +0200 Commit: David Cassany CommitDate: Wed Jul 25 08:40:36 2018 +0200 Modify python-yaml dependency for CentOS and RHEL 7 This commit fixes #785 commit dc3bc6acca8841f45eb031df65061a476376b074 Author: David Cassany AuthorDate: Fri Jul 20 12:37:41 2018 +0200 Commit: David Cassany CommitDate: Fri Jul 20 12:37:41 2018 +0200 Do not run Codacy analysis on tests commit afe9067021354e1c0adb6b1a86196ba324f2e23e Author: Marcus Schäfer AuthorDate: Thu Jul 19 17:05:03 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 19 17:05:03 2018 +0200 Fixup DiskFormatOva implementation The inheritance and super call concept used in this class destroys the OO design concept of loosely coupled code and also leads to a broken build because it bypasses the post_init constructor called by the base class commit e3bcd508e8e7ea671359a46e518c4c6785cb6778 Author: David Cassany AuthorDate: Mon Jul 16 17:47:40 2018 +0200 Commit: David Cassany CommitDate: Mon Jul 16 17:47:40 2018 +0200 Exclude tests in codacy analysis commit b0bdb3dfbbc885d22dbe6618f7d5f84a33c730b8 Author: Marcus Schäfer AuthorDate: Mon Jul 16 17:22:58 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 17:22:58 2018 +0200 Bump version: 9.16.3 → 9.16.4 commit 9546c91dc4039ef8c5abce08eb77d85cc8453f8d Author: Marcus Schäfer AuthorDate: Mon Jul 16 17:13:21 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 17:13:21 2018 +0200 Added grub2 module packages for GCE test build commit fc78bc9ce04e0e62f18b78b00fd8e3dc021e0e80 Author: Marcus Schäfer AuthorDate: Mon Jul 16 17:03:46 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 17:03:46 2018 +0200 Fixup timezone and keytable setup for GCE build commit 9b59297044bf026a6f1873a98d55b42180795659 Author: Marcus Schäfer AuthorDate: Mon Jul 16 16:56:29 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 16:56:29 2018 +0200 Second round of package fixes for GCE test build commit 0a2c946984a2acc62118aeec63ed7edc26b7ca18 Author: Marcus Schäfer AuthorDate: Mon Jul 16 16:50:41 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 16:50:41 2018 +0200 Update schema for GCE build test to latest version commit d4d0975792969a9f2ca0ebca973b906e52976cb4 Author: Marcus Schäfer AuthorDate: Mon Jul 16 16:09:28 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 16:09:28 2018 +0200 Fixup package list for GCE test build commit d789f602a153f2e9b5376fd112e68c4ad3db1dc7 Author: Marcus Schäfer AuthorDate: Mon Jul 16 16:06:31 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 16:06:31 2018 +0200 Added Google Compute Engine build test commit 6b045821f13c7d578d6fd6f0e754f9e2949fb780 Author: Marcus Schäfer AuthorDate: Mon Jul 16 13:07:38 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 13:07:38 2018 +0200 Deleted obsolete landscape setup Code quality is checked via codacy now commit 08b6dd35b51062a72db5ade5c0a9e3cc29152357 Author: Marcus Schäfer AuthorDate: Mon Jul 16 13:07:21 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 13:07:21 2018 +0200 Rebuild schema documentation commit 68543f90643df3a688f0f3d5eca794036f97215b Author: Marcus Schäfer AuthorDate: Mon Jul 16 12:46:31 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 12:46:31 2018 +0200 Fixed building VMware images with pvscsi adapter Qemu does not natively support the pvscsi adapter type. However there is a VMware suggested procedure which allows to change the lsilogic setup to pvscsi inside of the DDB of a formerly created lsilogic configured image format. This patch implementes that procedure and Fixes bsc#1099569 commit 8e866d6b1f44da689bbc843aa5679838dd7ad7ec Author: Marcus Schäfer AuthorDate: Mon Jul 16 11:04:05 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 11:04:05 2018 +0200 Rebuild schema documentation commit 310c35a750d6d74db838db43f851592e3f18966e Author: Marcus Schäfer AuthorDate: Mon Jul 16 10:33:53 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 16 10:33:53 2018 +0200 Bump version: 9.16.2 → 9.16.3 commit 0ccbf61b7bc775f374c3484bc96342275c7b2e19 Author: Marcus Schäfer AuthorDate: Fri Jul 13 15:56:33 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 13 15:56:33 2018 +0200 Fixed name of checksum file for pxe type The pxe image build generates among others a checksum file with the suffix '.md5' This file is read by the legacy netboot code and is expected to have the same basename as the image file itself. However if the compressed attribute is set the image file name is set to 'image.xz' and the checksum is named 'image.xz.md5' which is wrong because 'image.md5' is expected. This patch makes sure the checksum file is always set to 'image.md5' no matter if the compressed flag is configured or not commit 753606ed11ff07846c230d5e47df1228a60dbb85 Author: Marcus Schäfer AuthorDate: Fri Jul 13 15:47:21 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 13 15:47:21 2018 +0200 Fixed custom_args argument assignment in BootImage custom_args has been deleted from BootImageKiwi class but was still passed in the Factory commit 2983ef026546667887d71982db2b2c312b7640ba Author: Marcus Schäfer AuthorDate: Fri Jul 13 10:29:30 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 13 10:29:30 2018 +0200 Added runtime check for label use Added check_volume_label_used_with_lvm to check if custom volume labels are used in the scope of LVM commit 1942674efccd8764fdd3ec125fe5955efe90d2de Author: Marcus Schäfer AuthorDate: Fri Jul 13 09:13:13 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 13 09:13:13 2018 +0200 Fixed GCE image file name In former times Google requires the image name to follow their naming conventions. However that seems to have changed and it is no longer required to match a certain pattern. Thus this patch changes the output name of the GCE tar file to use the same naming schema as KIWI applies to its output files commit 197e06c486079640063941a086abec7ad54129b1 Author: David Cassany AuthorDate: Thu Jul 12 10:43:13 2018 +0200 Commit: David Cassany CommitDate: Thu Jul 12 10:43:13 2018 +0200 Add codacy.yml config file commit a6ee8ab9e2902eca716e052a9ec97391fbc3c56e Author: David Cassany AuthorDate: Wed Jul 11 17:14:21 2018 +0200 Commit: David Cassany CommitDate: Wed Jul 11 17:19:21 2018 +0200 Move from landscape.io to codacy.com commit c4082e268e999b8e732b24d1a5f0c319b732e3ae Author: David Cassany AuthorDate: Wed Jul 11 16:52:35 2018 +0200 Commit: David Cassany CommitDate: Wed Jul 11 16:52:35 2018 +0200 Updated Travis check icon to forked project commit c32121704dea2173741c82e8712c9807ada74d2a Author: Marcus Schäfer AuthorDate: Wed Jul 11 12:18:55 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 11 13:07:31 2018 +0200 Support label attribute in volumes The optional label attribute in a volume section allows to specify a filesystem label for the selected volume. The label setup will have no effect on filesystems which implements their own volume management like it's the case for btrfs. This Fixes #738 commit 926d9b3bb998ead07875259ae1af90c808cb30d0 Author: Marcus Schäfer AuthorDate: Wed Jul 11 11:29:22 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 11 11:29:22 2018 +0200 Update schema tron rules for btrfs type attributes The btrfs_* attributes only applies for vmx and oem types commit 9f77411162c85c455d920615d77c9808855fc097 Author: Marcus Schäfer AuthorDate: Fri Jul 6 16:44:00 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 11 11:01:05 2018 +0200 Add support for activation of btrfs quota groups If the new type attribute btrfs_quota_groups is set to true this will enable the quota group system for btrfs based systems. This Fixes #772 and bsc#1093518 commit afcbe93826d0ac179e04b85cc6af02f9245dab35 Author: Marcus Schäfer AuthorDate: Tue Jul 10 11:55:21 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 11 10:31:04 2018 +0200 Fixed some code smells * Use of unused variables, and dangerous defaults * Update of design patterns on pylint and landscape commit e483e7c5da52e6c0a9767a416b5570f9e6df7e4a Author: David Cassany AuthorDate: Fri Jul 6 15:03:48 2018 +0200 Commit: David Cassany CommitDate: Fri Jul 6 15:04:30 2018 +0200 Improve coding style, tests and label format validation commit dd21e6c8d78eecb29d2969788df19d8664f11d4d Author: David Cassany AuthorDate: Fri Jul 6 12:05:14 2018 +0200 Commit: David Cassany CommitDate: Fri Jul 6 14:11:00 2018 +0200 Add '--add-container-label' flag This commits adds a command line flag to add a label for container image types. The flag can be used multiple times. Fixes #770 commit bed956c0be3c63e23673246cad3f30aa8e365ed5 Author: Marcus Schäfer AuthorDate: Wed Jul 4 11:44:14 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 4 11:44:14 2018 +0200 Added system cleanup methods Some files in the system gets created by services like systemd or zypper and are meant to be created once on the target system. However in the image they might be unwanted. Thus this commit adds convenience methods to delete files which gets automatically re-created by the services on startup. Whether or not the methods are used is in the responsibility of the author of the image descripion. This Fixes bsc#1098535 commit e0e7669a010b2853b76b4557ec6b09c37208d3ca Author: Adrian Schröter AuthorDate: Fri Jun 29 09:39:59 2018 +0200 Commit: Adrian Schröter CommitDate: Fri Jun 29 09:39:59 2018 +0200 avoid double quoting of disturl in label (...="'obs://...'"). avoid always printed warning of missing disturl make use of disturl variable commit ad53480f975c53e4ac23f6508470920fabaa9067 Author: Marcus Schäfer AuthorDate: Wed Jun 20 15:24:31 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 20 15:24:31 2018 +0200 Bump version: 9.16.1 → 9.16.2 commit 23aaaea512bcfb56381defb3a073cda1bd7164ea Author: Marcus Schäfer AuthorDate: Wed Jun 20 11:56:21 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 20 11:56:21 2018 +0200 Simplify configfile loading prefix and root variables are correctly set, thus calling the "normal" command has the same effect than the explicit call for "configfile" commit dc06f9a7207d8b8a4978523ae1f5244eaffa98bd Author: Marcus Schäfer AuthorDate: Tue Jun 19 13:21:30 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 19 13:21:30 2018 +0200 Prevent building custom efi image If the distribution provides a prebuilt efi image kiwi should use it instead of building its own image. commit 24a1be449a4321607324818bcbda41f6ad517d24 Author: Marcus Schäfer AuthorDate: Wed Jun 13 14:42:12 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 13 14:42:12 2018 +0200 Bump version: 9.16.0 → 9.16.1 commit 1d5b35498c2bf518bcbc015e3dbadedd8e7d2869 Author: Marcus Schäfer AuthorDate: Wed Jun 13 11:08:09 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 13 11:08:09 2018 +0200 Avoid module loading in grub config template This patch is two fold. First part replaces the import of dedicated video modules in the grub image by the all_video module. Second part avoids runtime module insertion which requires access to the boot filesystem which is not guaranteed on sophisticated rootfs structures like btrfs plus readonly snapshots and what not. Thus we make sure all boot code is embedded into the grub image(s) and no extra loading of modules at runtime will be needed. This Fixes bsc#1096937 commit deaf2eabff21df93b87e23558189da48824dc3ec Author: David Cassany AuthorDate: Tue Jun 12 18:05:22 2018 +0200 Commit: David Cassany CommitDate: Tue Jun 12 18:05:22 2018 +0200 Fix for bsc#1094788 This is just an empty commit to include the bugfix reference in the repository history. The bugfix for bsc#1094788 was actually commited in: commit 835cebfe5c488515dfbcdf33dab6262613ca5508 Author: Marcus Schäfer Date: Tue May 29 16:42:55 2018 +0200 commit 1d5886fe35233d42d4d91f17f173067460135990 Author: Marcus Schäfer AuthorDate: Tue Jun 12 17:25:12 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 12 17:25:12 2018 +0200 Complete GUID change from signed to unsigned Follow up fix to complete the binary packing of the GUID format to use unsigned types. Missed to move short source from signed to unsigned. This Fixes bsc#1095267 commit 233e6e2835a4b61961beeb06e3a604c89c614381 Author: Neal Gompa AuthorDate: Wed Jun 6 08:28:14 2018 -0400 Commit: Neal Gompa CommitDate: Wed Jun 6 08:45:52 2018 -0400 Use the versioned Python interpreter path to run build helper scripts The kiwi build process mostly does the right thing in terms of executing with the correct Python interpreter throughout the build process, with the exception of the Makefile not correctly locating the versioned Python interpreter executable path, and the bash completion generator being executed using '/usr/bin/python' without regard for what the target environment was. This is a problem when a build environment complying with PEP 394 as it stands today does not have Python 2 installed, such as when kiwi is being built as a Python 3-only package in Fedora. Thus, the Makefile has been adjusted to not only correctly locate the versioned Python interpreter, but to also execute 'completion_helper' with the correct interpreter. Additionally, a trivial change to the shebang to 'completion_helper' was made to be consistent with other Python-based build helper scripts. This is part of the overall effort to eliminate the dependencies on Python 2 in Fedora. Reference: https://fedoraproject.org/wiki/FinalizingFedoraSwitchtoPython3 commit c6a01a59614bb21172e33d773fe5950adcae305a Author: Marcus Schäfer AuthorDate: Wed Jun 6 13:32:11 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 6 13:32:11 2018 +0200 Bump version: 9.15.4 → 9.16.0 commit 0bbbeb05c501ba52a094b85c8bd4508225d329f2 Author: Marcus Schäfer AuthorDate: Wed Jun 6 13:16:22 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 6 13:16:22 2018 +0200 Move fedora integration test build to fc28 distro commit e1b5b40a9742a4d481864ddc67fd956440769025 Author: Marcus Schäfer AuthorDate: Tue Jun 5 15:00:32 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 5 15:00:32 2018 +0200 Bump version: 9.15.3 → 9.15.4 commit d60926f6b7215ba50909174e13f6b6116f84fcd3 Author: Marcus Schäfer AuthorDate: Tue Jun 5 12:22:38 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 5 12:22:38 2018 +0200 Fixup move_to_root method move_to_root is called to check each element of a given list and changes any path specification to a valid path if the given root path would be it's root(/). This tranformation implied the creation of paths containing double slashes like //foo which was considered harmless. However it has turned out that the dnf package manager makes a difference here which requires to fix the resulting paths. This Fixes #761 commit 2418d58dbe9e14903e231a786e89264e1bffaca7 Author: David Cassany AuthorDate: Mon Jun 4 17:16:12 2018 +0200 Commit: David Cassany CommitDate: Mon Jun 4 17:16:12 2018 +0200 Adding license tag under description tag in schema This license tag does not effect the resulting image in any way. The tag is just included to state the license of the kiwi image sources in case they are distributed. Fixes #728 commit 37c8851d12353c1ea81bff464323c9ad77b1ecb8 Author: Marcus Schäfer AuthorDate: Mon Jun 4 11:00:55 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 4 11:18:13 2018 +0200 Make sure profile env is included in live images For all images which boots via dracut the .profile file is included except for live iso's because no information is needed from that file to boot or customize the boot. However the .profile contains the kiwi_revision information which is useful for any image type. This Fixes #755 commit cf9ceb34536bac11ede97fcb8c6a75ba7393af25 Author: Marcus Schäfer AuthorDate: Mon Jun 4 10:46:49 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 4 10:46:49 2018 +0200 Add config-cdroot to description import list During the prepare step the image description and mandatory files needed in the create step are copied into the image root system below the image/ directory. In case of the optional config-cdroot archive this copy action was missing which lead to the problem that the archive was not present if the kiwi system create command is sequence is used. This Fixes #756 commit b34c93dbf4e9ae0f9ba766e1ab93739b488a26e7 Author: Marcus Schäfer AuthorDate: Mon Jun 4 10:20:24 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 4 10:20:24 2018 +0200 Added true module to grub image list When kiwi creates a grub image a list of modules are embedded. For the purpose of snapshot boot the true module seems to be used but was not included at build time when kiwi created the grub image. This Fixes bsc#1093917 commit cf0773c8b028eb55cb4d8fd611e37fe0854416db Author: Marcus Schäfer AuthorDate: Mon Jun 4 09:59:35 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 4 09:59:35 2018 +0200 Changed GUID format from signed to unsigned With reference to Microsoft Guid constructors it seems unsigned values are allowed which could exceed the value range of the binary unpack used in kiwi. This Fixes bsc#1095267 commit 9023d2cceedbb034a17df86ee05044d4fff4418b Author: David Cassany AuthorDate: Fri Jun 1 16:13:07 2018 +0200 Commit: David Cassany CommitDate: Fri Jun 1 16:13:07 2018 +0200 Fix SC2164 complain of shellcheck commit de4b6a91d44c0fbaf9c03db8c04f008a56c496db Author: David Cassany AuthorDate: Thu May 31 09:33:01 2018 +0200 Commit: David Cassany CommitDate: Thu May 31 09:33:01 2018 +0200 Updating shellcheck call from tox Recent shellcheck versions are more strict and complain about backslashes "\" used in literals claiming it is preferred to use double backslashes "\\". As is just a styling advise and we use backslashes in multiple commands (echo, sed, etc) I believe this can be ignored. commit 3f12281fcb85aab773f33167075555f4250c54f0 Author: David Cassany AuthorDate: Wed May 30 17:55:05 2018 +0200 Commit: David Cassany CommitDate: Wed May 30 17:55:05 2018 +0200 Relax runtime check for ISO images using dmsquash This commit relaxes the dracut-kiwi-live module requirement if dmsquash dracut module is selected in flags attribute. commit 835cebfe5c488515dfbcdf33dab6262613ca5508 Author: Marcus Schäfer AuthorDate: Tue May 29 16:42:55 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue May 29 16:42:55 2018 +0200 omit multipath module in live iso initrd The multipath module creates device maps which puts the device in a busy state and prevents the creation of a persistent write partition. As multipath seems never useful for the root of a live iso image we generally omit this module from being included commit 28c6f82e84c84cc68b9addb7fc253e6672476dd4 Author: Marcus Schäfer AuthorDate: Tue May 29 10:26:03 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue May 29 10:26:03 2018 +0200 Fixup LOADER_LOCATION in sysconfig/bootloader By default we always set LOADER_LOCATION=mbr which is wrong if EFI is in use. This patch updates the value to be correct. It also seems that this variable is only consumed by the yast2 bootloader module from past days. Thus we consider it obsolete and on the to be droped list in future releases. This Fixes #746 commit 3163089a39641bb0bd317db5d132e248112c5f23 Author: Marcus Schäfer AuthorDate: Tue May 29 09:14:28 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue May 29 09:14:28 2018 +0200 Bump version: 9.15.2 → 9.15.3 commit 384392360ee38f092b742f471a7e59d25062deed Author: Marcus Schäfer AuthorDate: Mon May 28 17:46:49 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon May 28 17:46:49 2018 +0200 Fix setup of LOADER_TYPE in sysconfig/bootloader LOADER_TYPE value for the grub2 bootloader depends on the use of EFI. This Fixes bsc#1094883 commit 708b708878e171a5465c73a6e2c55b659f4b47be Author: Marcus Schäfer AuthorDate: Mon May 28 17:34:34 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon May 28 17:34:34 2018 +0200 Added documentation for config-cdroot archive commit fcda2c4f9a0a48fede86d718168e8e85850d462a Author: Marcus Schäfer AuthorDate: Mon May 28 17:17:00 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon May 28 17:25:05 2018 +0200 Added support for config-cdroot archive The image description now allows an optional file named: config-cdroot.tar[.compression_postfix]. The file gets unpacked as user data for live and install ISO images. This allows users to add e.g license files or reference documentation to the ISO image. This Fixes #737 commit 8916aea373d2f47b5ddd4e543bc2e844d1d34acf Author: David Cassany AuthorDate: Mon May 28 15:37:09 2018 +0200 Commit: David Cassany CommitDate: Mon May 28 15:37:09 2018 +0200 Verify file does not exist before creating symlink commit 2f8added7d0bdbfb317318e62cf817fed3f75a7c Author: David Cassany AuthorDate: Mon May 28 11:17:53 2018 +0200 Commit: David Cassany CommitDate: Mon May 28 11:20:35 2018 +0200 Add service dependencies in generators Correctly adding the initrd-root-fs.target service dependency to auto generated sysroot.mount for kiwi-live and kiwi-overlay dracut modules. Fixes #741 commit 9602f61a92bb4e539906078fbf3d3e3799f75cc5 Author: Marcus Schäfer AuthorDate: Mon May 28 10:20:57 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon May 28 10:27:49 2018 +0200 Do not create static dev nodes in root init For compatibility reasons kiwi created a set of static device nodes when initializing a new image root system. With the presence of devtmpfs this should no longer be needed. In addition the static dev node setup now also causes problems on filesystems like btrfs which was the reason to delete this code now. This Fixes bsc#1087104 commit 8c69e5a5c774dd27868b7141a76f9a92f8b0d01b Author: David Cassany AuthorDate: Thu May 24 10:53:11 2018 +0200 Commit: David Cassany CommitDate: Thu May 24 10:53:11 2018 +0200 Do not delete uncompressed base docker images Fixes #739 commit bb28768b39596e969a2b226145e33cebfb8160a0 Author: Marcus Schäfer AuthorDate: Wed May 16 11:48:00 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed May 16 11:48:00 2018 +0200 Bump version: 9.15.1 → 9.15.2 commit bfa8e83f3d9ad7013f71936bc30caa034f979ee5 Author: David Cassany AuthorDate: Wed May 16 11:31:40 2018 +0200 Commit: David Cassany CommitDate: Wed May 16 11:31:40 2018 +0200 Fix zypper add lock operations This commit fixes the arguments passed to zypper in add lock operations. commit 4e778db916bc67b87e02788cfc500105515d6194 Author: David Cassany AuthorDate: Tue May 15 15:48:24 2018 +0200 Commit: David Cassany CommitDate: Tue May 15 19:07:35 2018 +0200 Add correct GPL-3.0-or-later license Add the correct license reference in the spec License field Fixes #732 commit e97629ba47647751422fac3a09c72c2afb8904b4 Author: Marcus Schäfer AuthorDate: Tue May 15 11:18:22 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue May 15 11:18:22 2018 +0200 Make container compression a configuration option Change the ContainerBuilder class to evaluate on the configuration options to decide if the container archive should be compressed or not. By default the archive will be compressed, thus there is no change to the former behavior but can be setup in ~/.config/kiwi/config.yml as follows: container: - compress: none|xz This Fixes #725 commit 426221ce34a961603655b8825e04ae3f8fffbe39 Author: Marcus Schäfer AuthorDate: Tue May 15 10:36:57 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue May 15 10:36:57 2018 +0200 Return file name after archive or compression call Extend the ArchiveTar and Compress classes such that their archiving and compression methods returns the result file name after the operation commit 78d0baedf05048e6a5a0ed703325866b06e633a5 Author: Marcus Schäfer AuthorDate: Tue May 15 10:02:52 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue May 15 10:02:52 2018 +0200 Allow docker root import from uncompressed file Check the given file name for its compression format and only uncompress if a supported format could be detected. This Fixes #730 commit 87769a32017cb74720ff2f0fa1442f14dacc155d Author: David Cassany AuthorDate: Mon May 14 14:57:33 2018 +0200 Commit: David Cassany CommitDate: Mon May 14 17:04:07 2018 +0200 Add additionaltags containerconfig attribute This commit adds `additionaltags` attribute, so multiple tags to a container image can be defined in a comma separated value. Fixes #713 commit 2a6ef0fe5217b3fa52c5c8212c080e9d2aebad4b Author: Marcus Schäfer AuthorDate: Wed May 9 14:53:02 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed May 9 14:53:02 2018 +0200 Bump version: 9.15.0 → 9.15.1 commit cf4ca1c85aad3869a2d142bbcd280d654204ce83 Author: David Cassany Viladomat AuthorDate: Wed May 9 12:52:59 2018 +0200 Commit: GitHub CommitDate: Wed May 9 12:52:59 2018 +0200 Add a chapter for uninstall package requests in docs (#726) Add a chapter for uninstall package requests in docs commit b446cdef24a87359b9b020c8a82b7fa8ba787f75 Author: Marcus Schäfer AuthorDate: Tue May 8 16:31:57 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue May 8 16:31:57 2018 +0200 Update arm integration test Existing panda build was outdated and non functional. Move the test to a more popular target and write the image description to use technology matching the suse arm development effort. Target is now Rpi(64bit) commit ff08c21259f1a63208e34fefcb0a1306dd7e78f9 Author: Marcus Schäfer AuthorDate: Tue May 8 11:18:21 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue May 8 11:18:21 2018 +0200 Use latest version of sphinx Formerly sphinx==1.6.7 was used because travis-sphinx failed with latest sphinx. Now travis-sphinx fails with 1.6.7 and I hope using latest sphinx will fix that commit 6d87ff52d00837531789a30750191db742cf288e Author: Marcus Schäfer AuthorDate: Tue May 8 08:42:24 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue May 8 08:42:24 2018 +0200 Bump version: 9.14.7 → 9.15.0 commit dcdec6afb754aee7d875e4350b17860bad9797b1 Author: David Cassany AuthorDate: Mon May 7 15:49:51 2018 +0200 Commit: David Cassany CommitDate: Mon May 7 16:21:16 2018 +0200 Add comment in pinch_system calls commit cd7cede258bd796f3c47c27c3de2322fc52b06a3 Author: David Cassany AuthorDate: Mon May 7 15:10:47 2018 +0200 Commit: David Cassany CommitDate: Mon May 7 15:13:40 2018 +0200 Refining the uninstall type implementation commit f055ac12961a9d6ae03f8f6dd4e48c4647df2b72 Author: David Cassany AuthorDate: Fri May 4 15:00:31 2018 +0200 Commit: David Cassany CommitDate: Fri May 4 15:00:31 2018 +0200 Add uninstall pacakges type This commit adds a new `uninstall` type for packages. Packages listed with this type will be removed by the package manager cleaning also any unneeded dependency. The removal is executed after running `config.sh`. Also in this commit `delete` type for packages is now executed after `uninstall` packages, meaing it also happens after `config.sh`. Fixes #625 commit 348c0193245fd637c3ab841ef1ec34bd6ae5b56c Author: Marcus Schäfer AuthorDate: Fri May 4 10:52:28 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri May 4 10:52:28 2018 +0200 Bump version: 9.14.6 → 9.14.7 commit f442551cb6fe26cdd883d9c4b8f49daef91307ef Author: David Cassany AuthorDate: Fri May 4 10:40:13 2018 +0200 Commit: David Cassany CommitDate: Fri May 4 10:40:13 2018 +0200 Some simple code cleaning commit 02753e4301d90c18b7d183a93d9808a0d8ab2918 Author: Marcus Schäfer AuthorDate: Fri May 4 10:23:12 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri May 4 10:23:12 2018 +0200 Fixed check for volume group in use The former implementation evaluates the output of the vgs command and set the volume group as in use if one of the listed volume groups on the host contains the group name set by the image description. This would also match if the group name set in the image description is e.g 'System' and the a volume group on the host with name 'SystemVG' exists. However a conflict only exists on exact match of the name. The proposed fix is to use the --select feature from vgs and let it show information on exact match of the vg_name field. The code in kiwi then just evaluates if the selection by vgs has a value or not. This Fixes #721 commit 6f39d3f36b92d1a0e561723a987416ee38f43680 Author: Marcus Schäfer AuthorDate: Fri May 4 09:07:04 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri May 4 09:07:04 2018 +0200 Fix setup of kiwi_lvm profile variable kiwi_lvm was always set to true if a volume management system is in use. However it should only be set to true if the selected volume management system is lvm. The same applies to the kiwi_lvmgroup variable which also only makes sense if the lvm volume management system is used. This Fixes bsc#1090427 commit a1423ee76bfc99643592cc2f432d72459d5405af Author: Marcus Schäfer AuthorDate: Mon Apr 30 16:12:52 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 30 16:12:52 2018 +0200 Bump version: 9.14.5 → 9.14.6 commit 3ec88d60580145639cb93b8dbf6d42f6dc5dbb0e Author: Marcus Schäfer AuthorDate: Thu Apr 26 15:40:01 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 26 15:40:01 2018 +0200 Extend test-image-azure integration test Use xfs as filesystem and set a tag to also test image tags commit dd09d4c2412eb9e9a07b5696f7904d456435a3e7 Author: Marcus Schäfer AuthorDate: Thu Apr 26 10:48:29 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 26 10:52:17 2018 +0200 Use /dev/zero to really write a zero byte The cleanup of the 512 byte block for the vhdfixed tag was based on reading from /dev/null which does effectively nothing. As the block should be filled with zero bytes this patch changes the source from /dev/null to /dev/zero This was found by tests to reproduce the issue reported in bsc#1090953 but is not causing it commit 1ed7dc57f5ae6c3f3d176fc48303ec5a68e2b8d5 Author: David Cassany AuthorDate: Tue Apr 24 15:33:18 2018 +0200 Commit: David Cassany CommitDate: Tue Apr 24 15:33:18 2018 +0200 Add test for the utils class StringToSize This commit adds a couple of unit tests for the StringToSize class. commit 586f9dc758ca9ab32695a017363d45cfc4fbca21 Author: Marcus Schäfer AuthorDate: Tue Apr 24 11:23:43 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 11:23:43 2018 +0200 Bump version: 9.14.4 → 9.14.5 commit 09ada89434b2b9596e0791d7464c115e3995d3a7 Author: Marcus Schäfer AuthorDate: Tue Apr 24 11:23:08 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 11:23:08 2018 +0200 Run doc target in travis test stage commit 78836af0d4a2ce99afa6a9bc3292fb9c744580d6 Author: Marcus Schäfer AuthorDate: Tue Apr 24 11:21:15 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 11:21:15 2018 +0200 Fixup doc conf.py Do not load kiwi logging which is unneeded and causes many superfluous messages on the console when sphinx build runs commit c6643a53fd788187e4c68a78fd38763084e8696b Author: Marcus Schäfer AuthorDate: Tue Apr 24 11:20:46 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 11:20:46 2018 +0200 Fixup docstring warning from sphinx build commit 0a9dbd32c261d39eabb8f197e424724dc053ff54 Author: Marcus Schäfer AuthorDate: Tue Apr 24 10:57:31 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 10:57:31 2018 +0200 Fixup travis unit test stages Build docs in deployment stage only commit 424539a4af066d6403ebc72ff33d99a279e4ee9d Author: Marcus Schäfer AuthorDate: Tue Apr 24 10:52:12 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 10:52:12 2018 +0200 Include doc_travis_deploy in travis deploy stage commit 35f92f7d48e002780075111d8b5f3a273582bfc2 Author: Marcus Schäfer AuthorDate: Tue Apr 24 10:33:24 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 10:33:24 2018 +0200 Fixed syntax errors shown by travis lint commit ce0ccaf2e8d3a7a0a4bdae0a79855642698971f9 Author: Marcus Schäfer AuthorDate: Tue Apr 24 10:29:53 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 10:29:53 2018 +0200 Revert "Fixup travis.yml" This reverts commit 79ccbdff394e2aba4f1e8fb6390a9a8e0d1925e2. commit b8f8906f0372b2246bb521133f2b529c7aa93060 Author: Marcus Schäfer AuthorDate: Tue Apr 24 10:29:29 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 10:29:29 2018 +0200 Revert "Yet another try to get travis stages correct" This reverts commit aca057c3554795b79c651f63a58967138d00f3c8. commit aca057c3554795b79c651f63a58967138d00f3c8 Author: Marcus Schäfer AuthorDate: Tue Apr 24 10:24:11 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 10:24:11 2018 +0200 Yet another try to get travis stages correct commit 79ccbdff394e2aba4f1e8fb6390a9a8e0d1925e2 Author: Marcus Schäfer AuthorDate: Tue Apr 24 10:11:51 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 10:11:51 2018 +0200 Fixup travis.yml Looks like empty lines are not allowed commit 07b3f71f22e08c5737432ce19c8b1ed8c9bca7c7 Author: Marcus Schäfer AuthorDate: Tue Apr 24 10:05:00 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 10:05:00 2018 +0200 Revert "Clearly separate unittest stage from deployment" This reverts commit 5fd27924c931b6b60903b0015d0a8cf31cf499f7. commit 2fb8439e53ad476eabc884b8311cb31c7af6a7ce Author: Marcus Schäfer AuthorDate: Tue Apr 24 09:59:56 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 24 09:59:56 2018 +0200 Bump version: 9.14.3 → 9.14.4 commit 9dcf00e4d116c30a2756d05ef12875038d569aeb Author: David Cassany AuthorDate: Mon Apr 23 15:45:38 2018 +0200 Commit: David Cassany CommitDate: Mon Apr 23 15:45:38 2018 +0200 Some improvements on size calculation This commit simplifies the unpartitioned area size calculation. Fixes #709 and it is related to fate#323874 commit 5fd27924c931b6b60903b0015d0a8cf31cf499f7 Author: Marcus Schäfer AuthorDate: Mon Apr 23 12:22:10 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 23 12:22:10 2018 +0200 Clearly separate unittest stage from deployment commit 74aa8a5c142039d284be07bdb5926cd09cef5dc9 Author: David Cassany AuthorDate: Fri Apr 20 15:32:29 2018 +0200 Commit: David Cassany CommitDate: Fri Apr 20 17:04:33 2018 +0200 Adding unpartitioned size attribute This commit adds the possibility of setting some unpartitioned area after the systemdisl partition into the image. Fixes #709 commit b2d1ea11db90061765f7106596b7103d1582139c Author: Marcus Schäfer AuthorDate: Fri Apr 20 16:39:33 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 20 16:39:33 2018 +0200 Use travis stages feature for pypi deployment Problem ist that the deploy section is called for every item in the former matrix: setup. This means the pypi upload was triggered twice for the same archive which means one target always fails. In order to deploy only once travis provides a stages feature which is used in this commit commit 87c7c423eb0af23be009e956a75f832140152993 Author: Marcus Schäfer AuthorDate: Fri Apr 20 15:47:39 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 20 15:47:39 2018 +0200 Bump version: 9.14.2 → 9.14.3 commit ebbc4942b7fc35dbbaa676dd8bb9582df7bca152 Author: Marcus Schäfer AuthorDate: Fri Apr 20 10:42:36 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 20 10:42:36 2018 +0200 Fixed creation of machine settings file If no vmnic setup is present a request to iterator over a NoneType object is attempted and failed. This Fixes #710 commit 2e37255923713e34591a9a1780431e2557a04b9a Author: David Cassany AuthorDate: Thu Apr 19 17:06:42 2018 +0200 Commit: David Cassany CommitDate: Thu Apr 19 17:06:42 2018 +0200 volume_manager API docs cleanup commit 5493a175a294271c01f42032a93deb1f56f9cc06 Author: David Cassany AuthorDate: Thu Apr 19 16:28:24 2018 +0200 Commit: David Cassany CommitDate: Thu Apr 19 16:28:24 2018 +0200 repository API docs cleanup commit 294e25f411dfd9f1933d15ca3ec9da9c2022473a Author: David Cassany AuthorDate: Thu Apr 19 12:02:12 2018 +0200 Commit: David Cassany CommitDate: Thu Apr 19 12:02:12 2018 +0200 system API docs cleanup commit 3a4af5e6ed77b90396db78d958774ded26157b0c Author: David Cassany AuthorDate: Wed Apr 18 14:40:54 2018 +0200 Commit: David Cassany CommitDate: Wed Apr 18 17:04:13 2018 +0200 package_manager API docs cleanup commit eb7a6cbe8021a74a4f3ea1a041e8b7ddda6a007e Author: David Cassany AuthorDate: Wed Apr 18 11:54:45 2018 +0200 Commit: David Cassany CommitDate: Wed Apr 18 11:54:45 2018 +0200 build API docs cleanup commit 75b1e2d6c78f641951aa2351316268cfa75e98f5 Author: Marcus Schäfer AuthorDate: Wed Apr 18 10:33:15 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 18 10:33:15 2018 +0200 Fixed docstring :rtype: values In Python the string type name is str not string commit 1fca29cee843e13432cea8b446dbf25b84929a03 Author: David Cassany AuthorDate: Tue Apr 17 18:36:40 2018 +0200 Commit: David Cassany CommitDate: Wed Apr 18 10:03:26 2018 +0200 Cleanup of the iso_tools API docs commit 9eab3eebf9c80964563391095a59d6731018e5ed Author: David Cassany AuthorDate: Tue Apr 17 18:05:09 2018 +0200 Commit: David Cassany CommitDate: Tue Apr 17 18:05:09 2018 +0200 Cleanup of the utils API docs commit f8c73e2ca3a159c1658893260e61683e1666d290 Author: Marcus Schäfer AuthorDate: Tue Apr 17 17:56:13 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 17 17:56:13 2018 +0200 Cleanup api doc strings This cleans up and fixes the api documentation for the public interface of the projects boot source code files and Fixes #700 commit 2097c4a6d2743fb0d77270522b1421550ce8339f Author: David Cassany AuthorDate: Tue Apr 17 15:09:58 2018 +0200 Commit: David Cassany CommitDate: Tue Apr 17 15:43:33 2018 +0200 Cleanup of the solver API docs commit f7c64d4443c0efae6b3fbd37bd46451b99c732a5 Author: Marcus Schäfer AuthorDate: Tue Apr 17 12:03:20 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 17 12:03:20 2018 +0200 Fixup docstring typos per review commit 8668fbbc2409d4b149468a07385e2e767f46f296 Author: Marcus Schäfer AuthorDate: Tue Apr 17 08:42:23 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 17 10:29:42 2018 +0200 Cleanup api doc strings This cleans up and fixes the api documentation for the public interface of the projects storage source code files and Fixes #698 commit 199fdf004423786b2d72ac81695436335d7d633e Author: Marcus Schäfer AuthorDate: Mon Apr 16 16:17:21 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 16 16:17:21 2018 +0200 Fixup download url in setup.py Better point to installable packages. This Fixes #702 commit 41970d3dd40f1274b2480014b1fab4a76586f441 Author: Marcus Schäfer AuthorDate: Wed Apr 11 16:20:47 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 16 16:10:04 2018 +0200 Cleanup api doc strings This cleans up and fixes the api documentation for the public interface of the projects toplevel source code files and Fixes #697 commit 009a218ea537d790fe39cc575fb158ea47af86b3 Author: Marcus Schäfer AuthorDate: Tue Apr 10 17:41:23 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 10 19:50:59 2018 +0200 Fixup creation of vmware settings file The kiwi schema allows for multiple vmnic sections but kiwi only took the primary one into account. This patch uses all configured vmnic sections. This Fixes #688 commit 2b8b0f23951849143da6d21ae3d483ec42bb1085 Author: Marcus Schäfer AuthorDate: Tue Apr 10 11:52:10 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 10 11:52:10 2018 +0200 Support lookup for fstab.append on fstab creation At the time kiwi creates the fstab with all required fields to boot the system it now also looks for an optional fstab.append file and appends its contents to the fstab file. This allows to setup custom fstab entries for filesystem mounts which are established outside of the kiwi image building process by e.g a service at first boot commit 9ae95ee1d13eea295dbbb350224843d4d989f8ee Author: Marcus Schäfer AuthorDate: Tue Apr 10 10:20:20 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 10 10:23:50 2018 +0200 Add auto release to pypi on release tags This will automatically release kiwi on pypi if a new tag in master is set. This happens when bumpversion is called followed by a push and push --tags. Only if the tag is pushed the travis deployment gets triggered. This Fixes #678 commit 8767a48434cb79b8b52588c0291e7d72d2d9458d Author: Marcus Schäfer AuthorDate: Mon Apr 9 11:31:21 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 9 11:31:21 2018 +0200 Change variable quoting for Rm/Rpm shell helpers The two methods exists to overlay their call with a logging facility. Thus it is ok and expected that the caller can pass arguments for the program e.g (Rm -rf foo) which resulted in (rm '-rf foo') leading to a runtime error. commit 2ce56fb8219a60aca7c87e0b214da96481f37939 Author: Marcus Schäfer AuthorDate: Mon Apr 9 10:56:37 2018 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 9 10:56:37 2018 +0200 Bump version: 9.14.1 → 9.14.2 commit d3baa9d102af17f15a59360ff7fc875fc8f5fb36 Author: David Cassany AuthorDate: Fri Apr 6 16:01:51 2018 +0200 Commit: David Cassany CommitDate: Fri Apr 6 16:08:24 2018 +0200 Fix default initrd_system values This commit fixes the default initrd_system value for some image types. Since this value is included in profile and potentially taken into account for some of the config script functions, it is important to have consistent values even when the image type has no initrd choice or it doesn't have initrd at all. Related to #689 commit 89c9127bc5d4fc287b404c00ad7523f6252c3b8a Author: Marcus Schäfer AuthorDate: Fri Apr 6 10:51:36 2018 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 6 10:51:36 2018 +0200 Check partition table after cow part creation Proceed with the persistent write partition setup only if the cow partition could have been created successfully commit 229464523d61efa79851f160b3c66339ad240db1 Author: Marcus Schäfer AuthorDate: Thu Apr 5 14:47:23 2018 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 5 14:47:23 2018 +0200 Fixed detection of disk node in live iso images If the live iso is booted as disk the initrd code needs to find the correct disk node pointing to the iso image. This was formerly done by checking if the populated disk devices contains an iso header with an application id. The information was obtained using the isoinfo tool. isoinfo is a tool provided by the obsolete and xorriso replaced cdrtools kit. In addition the lookup was unsafe because any iso with an application id would have been valid. Thus this patch changes the detection mechanism to use the volume id as it is used in the root assignment on the cmdline. The volume id is populated as device label for the assigned block device and can therefore be used as a unique id. The volume id itself is a configuration option in the image XML description. If not set the default is 'CDROM'. The information can be obtained via blkid and therefore also eliminates the isoinfo requirement commit bbb0721a606dc220db86ba482de310709d6b6df0 Author: Marcus Schäfer AuthorDate: Wed Apr 4 17:26:40 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 4 17:26:40 2018 +0200 Fixup test-image-docker unresolvable state genisoimage seems no longer present in the distro commit 8c916dec912196b391995f32781507d819ad07b1 Author: Marcus Schäfer AuthorDate: Wed Apr 4 12:08:39 2018 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 4 12:08:39 2018 +0200 Update etc/default/grub setup kiwi writes optional grub boot parameters to the GRUB_CMDLINE_LINUX variable in default/grub. This information is then picked up by grub2-mkconfig and written to grub.cfg However there is also another variable named GRUB_CMDLINE_LINUX_DEFAULT which according to the documentation should be used preferably. While it does not seem to matter for grub it matters for yast. Thus this patch changes the configuration variable and fixes bsc#1084117 commit f86b6f273038d2123a8a64d80f939421e21cc03c Author: Marcus Schäfer AuthorDate: Tue Apr 3 12:17:33 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 3 12:17:33 2018 +0200 Bump version: 9.14.0 → 9.14.1 commit 3e7f788157a2d60a824361967c582bce5a2a494c Author: Marcus Schäfer AuthorDate: Tue Apr 3 11:51:26 2018 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 3 11:51:26 2018 +0200 Fixed truncation of image when writing vhd tag When writing the vhd tag into a vhdfixed formatted image the image was opened with the wrong open bits 'wb' and thus was truncated at the 64k offset. This patch fixes the open bits to allow in-place tag writing. This Fixes bsc#1077096 commit 90669d84afe1c655fed68d435313053971bf3ff7 Author: David Cassany AuthorDate: Tue Apr 3 09:45:51 2018 +0200 Commit: David Cassany CommitDate: Tue Apr 3 10:45:25 2018 +0200 Make use of autoremove in Yum and Dnf to clean dependencies commit cae19113a135d003555ff10f6a5439861ee3be77 Author: David Cassany AuthorDate: Wed Mar 28 17:13:48 2018 +0200 Commit: David Cassany CommitDate: Thu Mar 29 12:35:05 2018 +0200 Enable no forced deletion for dnf, yum and apt package managers This commit makes apt, yum and dnf support equivalent to zypper in terms of being capable to delete packages using the package manger tools (implies dependencies deletion is handled by the package manager) or deleting explicitly only listed packages using packager tools even if this implies breaking dependencies. commit e5b34ae4f9f9044e65c7e1b6c1a765ff1adcefd3 Author: Guilherme AuthorDate: Tue Mar 27 08:57:54 2018 +0100 Commit: Guilherme CommitDate: Tue Mar 27 08:57:54 2018 +0100 fix vmx fileName parameter, bsc#1084157 commit d46326d0a8064650e4a1e1eff1751406e3b243d2 Author: Marcus Schäfer AuthorDate: Fri Mar 23 15:05:12 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 23 15:05:12 2018 +0100 Update schema version in free schema doc generator commit 1ad29571c1cc6ed1f2a74c79949c5de23b46d33e Author: Marcus Schäfer AuthorDate: Fri Mar 23 10:44:32 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 23 10:44:32 2018 +0100 Update schema version in headline of doc chapter commit 72ab2b64e6c5a83842ea80efe6517b1891c2cf0f Author: Marcus Schäfer AuthorDate: Fri Mar 23 10:34:37 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 23 10:34:37 2018 +0100 Bump version: 9.13.9 → 9.14.0 commit 7d8df73a319fcb53c6471339830e0db0dcecd045 Author: Marcus Schäfer AuthorDate: Fri Mar 23 10:33:08 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 23 10:33:08 2018 +0100 Rebuild online schema documentation commit 4fc38a2b09113cac9f66dbe19945c02a319a1295 Author: Marcus Schäfer AuthorDate: Fri Mar 23 09:29:43 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 23 09:42:24 2018 +0100 XSL Auto update descriptions due to schema change commit 86a8cc9da76de1315cce892d3c62f05425b248e2 Author: Marcus Schäfer AuthorDate: Fri Mar 23 09:19:11 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 23 09:42:23 2018 +0100 Delete obsolete hybrid attribute from type Any iso image we create will be a hybrid image. That was already the default for any install iso image and was a configuration option for live images. The optional selection only existed for systems which do not provide tools to make an iso hybrid. All distributions kiwi supports provides this capabilities and there is no good reason why a live or install iso should not be hybrid and bootable as iso and as disk. Also the boot in disk mode became the preferred boot method for the majority of our users which requires to provide a hybrid iso commit fba3ff74bada66353a2c1620bd26e0b00bff3c36 Author: David Cassany AuthorDate: Thu Mar 22 18:36:53 2018 +0100 Commit: David Cassany CommitDate: Thu Mar 22 18:36:53 2018 +0100 Add efiparttable type attribute This commit allows to choose the partition table type for efi firmwares using the efiparttable type attribute. Fixes #638 commit d0bd6a27e95f2eae68d03f8be74c66bc679a3854 Author: Marcus Schäfer AuthorDate: Thu Mar 22 17:40:54 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 22 17:40:54 2018 +0100 Update spec file to require xorriso commit fd58ae39ed7406de1f65f25f44d306ad5e16321d Author: Marcus Schäfer AuthorDate: Thu Mar 22 16:54:05 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 22 17:25:53 2018 +0100 Cleanup hybrid call and use of iso tool options The extra isohybrid call is only needed if the mkisofs tool category is used. Thus it should be only visible at the place where the isofs is created and not as an extra step in the builder tasks. Additionally the handling of extra options was mkisofs specific and should be better done as a common meta_data record. The tool specific options should only appear in the tool specific class implementations commit 73fb3977177678cc142368aa35d71dfc53f4c4af Author: Marcus Schäfer AuthorDate: Thu Mar 22 10:33:01 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 22 11:18:54 2018 +0100 Allow to configure iso tool category Switch to xorriso by default but allow to setup cdrtools in the runtime configuration file commit ca661dda5fd8f3e0f763802aced0340c4978f0b8 Author: Marcus Schäfer AuthorDate: Mon Mar 19 14:22:40 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 22 11:18:54 2018 +0100 Added IsoToolsXorrIso class As an alternative to mkisofs/genisoimage there is now the IsoToolsXorrIso class which implements the IsoTools interface by using xorriso. This Fixes #635 commit 89fe579ffed7db0cac0b206364e0ea8f3a70f0d6 Author: David Cassany AuthorDate: Wed Mar 21 15:54:25 2018 +0100 Commit: David Cassany CommitDate: Wed Mar 21 15:54:25 2018 +0100 Remove xml_parse.py shebang in spec It removes the shebang from the autogenerated file and also removes the exception in rpmlint to ignore non-executable-script warning. Fixes #666 commit 30f335460023b9a60a5ef745add6d2937eaa7e99 Author: David Cassany AuthorDate: Mon Mar 19 16:34:15 2018 +0100 Commit: David Cassany CommitDate: Tue Mar 20 11:59:38 2018 +0100 Remove unneeded shebangs from dracut modules Fixes #668 commit f9eb6b4b90aa718a74bc997e56cbab6e3ce21bc3 Author: Marcus Schäfer AuthorDate: Mon Mar 19 10:07:19 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 19 10:07:19 2018 +0100 Update package MANIFEST.in Include new iso_tools directory commit 678866f9e66a20b8b401c3eb03fdaebc3b44b1e1 Author: Marcus Schäfer AuthorDate: Fri Mar 16 21:03:30 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 16 21:23:26 2018 +0100 Added iso_tools api documentation commit 2af5c4c06fa5344b9e8e855b4b081d84adf85407 Author: Marcus Schäfer AuthorDate: Fri Mar 16 20:55:57 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 16 21:23:26 2018 +0100 Add list_iso method to iso_tools api commit 8cfa17c63e4c5f743abb73fdb8c45489f09aa124 Author: Marcus Schäfer AuthorDate: Fri Mar 16 11:02:35 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 16 21:23:26 2018 +0100 Add create_iso method to iso_tools api commit c948bb47d035a56932e23b544c0f8535df042094 Author: Marcus Schäfer AuthorDate: Thu Mar 15 17:27:51 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 16 21:23:26 2018 +0100 Seperate iso tool handling into its own namespace The Iso class only provides generic helper methods around the creation of ISO filesystems. For the creation of the filesystem itself we encapsulate the tool parameter handling into its own class. For the option compatible mkisofs/genisoimage tools the IsoToolsCdrTools class exists. This allows to create e.g IsoToolsXorrIso class as a future implementation commit 079130942ca9a3526fd7c0d1e8c7f3e9974c606a Author: Marcus Schäfer AuthorDate: Thu Mar 15 10:32:25 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 16 21:23:26 2018 +0100 Refactor iso helper tools There are several tools available to build iso images. genisoimage, mkisofs and also xorriso. The history of the tools shows them to be used in the range of available Linux distributions. Thus kiwi contains an abstraction layer to support them but assumed they are option compatible. With the xorriso implementation this is no longer correct and therefore a refactoring of the iso tools api is required before support for xorriso can be added. This references Issue #635 commit bfb4bfa7096a1552278f8468c2e7e13bdbbd447a Author: David Cassany AuthorDate: Fri Mar 16 15:26:29 2018 +0100 Commit: David Cassany CommitDate: Fri Mar 16 15:26:29 2018 +0100 Update FSF address The address has been taken from the header example published here https://www.gnu.org/licenses/old-licenses/gpl-2.0.html Fixes #667 commit 4f106c5e45f7c449b93bdbc63fcc074cee2199af Author: David Cassany AuthorDate: Wed Mar 14 17:12:59 2018 +0100 Commit: David Cassany CommitDate: Wed Mar 14 18:01:13 2018 +0100 kiwi_inode_size value is no longer hardcoded in more than one place commit 703747c7180ccec620ec520476eaf84a8e7fc60c Author: David Cassany AuthorDate: Wed Mar 14 17:59:23 2018 +0100 Commit: David Cassany CommitDate: Wed Mar 14 17:59:23 2018 +0100 Make build type mandatory in XMLState commit 11e5e21f70ad79a4051512de5b75398551735026 Author: David Cassany AuthorDate: Wed Mar 14 16:34:39 2018 +0100 Commit: David Cassany CommitDate: Wed Mar 14 16:34:39 2018 +0100 Add warning message for dasd commit 3628ad102d9eb50c1176abd434ae3ef3de2da1ad Author: David Cassany AuthorDate: Wed Mar 14 15:13:09 2018 +0100 Commit: David Cassany CommitDate: Wed Mar 14 15:26:16 2018 +0100 Rearrange defaults and some comments commit 52f5b6f46c9624a9d7ffc9b635d69bda0a2ad8cc Author: David Cassany AuthorDate: Wed Mar 14 14:38:22 2018 +0100 Commit: David Cassany CommitDate: Wed Mar 14 14:38:22 2018 +0100 Rearrange variable start_sector attribute to be a Partitioner attribute commit 22db94ab7e2f54da38fca8a8a5b55e86e92b2768 Author: David Cassany AuthorDate: Tue Mar 13 18:31:40 2018 +0100 Commit: David Cassany CommitDate: Tue Mar 13 18:31:40 2018 +0100 Add disk_start_sector type attribute This commit adds the disk start sector attribute to configure the first disk sector for the first partition of the disk. Fixes #575 commit ef31f2b05f4328c5d7be4c0e926640f4664f5e4d Author: Marcus Schäfer AuthorDate: Tue Mar 13 15:36:29 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 13 15:36:29 2018 +0100 Rebuild online schema documentation commit 3f63dfeb46aa920978d4d0e433b7cd088c4dd96c Author: Marcus Schäfer AuthorDate: Tue Mar 13 10:27:30 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 13 10:27:30 2018 +0100 Bump version: 9.13.8 → 9.13.9 commit c5707392a3340aa8962f84a0418c6b6094e53bcc Author: Marcus Schäfer AuthorDate: Tue Mar 13 10:05:06 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 13 10:05:06 2018 +0100 Bump version: 9.13.7 → 9.13.8 commit e76e23bc443fd9e15aedaddf6d52361e8331be26 Author: Marcus Schäfer AuthorDate: Tue Mar 13 10:02:16 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 13 10:02:16 2018 +0100 Fixed base package requires kpartx is used by kiwi but was not required in spec commit 731d1a68a68bf34dc61138d70d3b3dce193c4e64 Author: Marcus Schäfer AuthorDate: Tue Mar 13 10:00:01 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 13 10:00:01 2018 +0100 Update gitignore Do not manage changes in .pytest_cache commit 1e05c2a2db13173b07a2d35b05c7aec665f0d639 Author: Marcus Schäfer AuthorDate: Tue Mar 13 09:56:32 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 13 09:56:32 2018 +0100 Tell plymouth to quit only if a dialog is called In case of a dialog kiwi uses the dialog program which conflicts with the plymouth splash system. Thus we tell plymouth to stop This patch changes the request to be send to plymouth prior to a dialog call and not in general commit 02794a9e5bd51b9886bf845a545097ceb1c567ab Author: Marcus Schäfer AuthorDate: Mon Mar 12 15:41:07 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 12 15:41:07 2018 +0100 Bump version: 9.13.6 → 9.13.7 commit ee6eb203139b513cf995d9817656aa2728bc12ea Author: Marcus Schäfer AuthorDate: Mon Mar 12 11:48:51 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 12 11:48:51 2018 +0100 Update bootloader console for oem test image Set bootloader_console="serial" for the oem test image to allow testing in the Kanku CI commit 967bde83852cb2a63852e2993117ccea67ce5127 Author: David Cassany AuthorDate: Mon Mar 12 09:13:51 2018 +0100 Commit: David Cassany CommitDate: Mon Mar 12 09:18:54 2018 +0100 Add profile dependencies With this commit the profile can include other profiles as a dependency. This way it is possible build an image defined by multiple profiles by just calling a single composed profile from the command line. Fixes #658 commit f0b240248f418610bb2f4d6b584637bccce8d476 Author: Marcus Schäfer AuthorDate: Mon Mar 12 08:28:52 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 12 08:28:52 2018 +0100 Bump version: 9.13.5 → 9.13.6 commit b006718d265828887c901652d3d3656b8e35c51e Author: Marcus Schäfer AuthorDate: Fri Mar 9 14:08:53 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 9 14:08:53 2018 +0100 Disable multipath from oem build test commit 62fc4c159fd929a193f590d1eea95d584e23a41a Author: Marcus Schäfer AuthorDate: Fri Mar 9 14:03:23 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 9 14:03:23 2018 +0100 Fixup setup of root_filesystem_is_multipath The variable is set to a boolean value or None. If set to False due to a configuration of oem-multipath-scan this will cause the dracut multipath module to be omitted. In any other case the presence of the multipath module decides whether it will be included into the dracut generated initrd or not. commit 2d61c91e8e0479acd7949e1fad9d94e2e241cbc7 Author: Marcus Schäfer AuthorDate: Fri Mar 9 11:26:38 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 9 11:26:38 2018 +0100 Fixup python-kiwi base package requires There is no need for the base package to require multipath. Those tools are only needed for dracut modules commit 4fdf4b646ad26ff8cead9992b3519dcada66dc85 Author: Marcus Schäfer AuthorDate: Thu Mar 8 15:58:38 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 8 15:58:38 2018 +0100 Use dracut modules based on feature use As the kiwi build dracut initrd is a generic one which includes all installed dracut modules we missed a way to exclude modules from beeing incorporated even if we know it would not be needed. One example is the multipath module which would only be useful if the oem multipath scan is configured in the image description commit cfc6ffc86e62b90252f0900a51dc20a0124acaff Author: Marcus Schäfer AuthorDate: Wed Mar 7 11:48:48 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 7 11:48:48 2018 +0100 Update test-image-oem build Create hostonly dracut initrd on first boot and replace kiwi's grub config by the result of grub2-mkconfig commit 69da1afee8fcbb402c5ce85061e63339dd5cf094 Author: Marcus Schäfer AuthorDate: Wed Mar 7 11:36:34 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 7 11:36:34 2018 +0100 Delete invalid motd file from build tests commit e6e3ce2180c7130f6f0fe1a483617cf1210955d9 Author: Marcus Schäfer AuthorDate: Wed Mar 7 10:28:28 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 7 10:28:28 2018 +0100 Prepare test-image-oem build test for Kanku Activate unattended mode and preselect the installation target Also specify a fixed swapsize value to be independent of the host main memory which is used to calculate swap if no size is specified commit 272af8560d4884b675f3c6489a0ada57d519ce42 Author: Marcus Schäfer AuthorDate: Tue Mar 6 17:01:58 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 6 17:01:58 2018 +0100 Bump version: 9.13.4 → 9.13.5 commit 19a84e54eccd7a4a41e7afe4f823a1215fbe7d64 Author: Marcus Schäfer AuthorDate: Tue Mar 6 16:43:35 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 6 16:43:35 2018 +0100 Fixed btrfs search path in earlyboot script If kiwi generates its own efi image for the boot process it does not setup the btrfs relative path setup in the earlyboot script embedded into the generated efi image. This has a bad impact on the file search because the btrfs setup done in kiwi puts root below the @ volume which we then need to specify of the relative lookup is not activated. Fixes bsc#1082155 commit 8d5a9b0ba631147fb5bc4d0454a8dca8b4138c7e Author: Marcus Schäfer AuthorDate: Tue Mar 6 15:51:52 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 6 15:51:52 2018 +0100 Bump version: 9.13.3 → 9.13.4 commit a4e582eb6d4dbea1b1ffa3dd4c9596bff3db4f76 Author: Marcus Schäfer AuthorDate: Fri Mar 2 16:31:14 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 6 11:24:25 2018 +0100 Resize partition table after image resize The command 'kiwi image resize' allows to resize the size of a disk image. Depending on the partition table type it is also required to resize the partition table inside of the image to let the file size change become effective This Fixes #534 commit 9f70b6c9060aef0a7f0260628f2d4d5df1d6eef9 Author: David Cassany AuthorDate: Mon Mar 5 18:00:26 2018 +0100 Commit: David Cassany CommitDate: Mon Mar 5 18:00:26 2018 +0100 Use LABEL for the swap partition If multipath and device maps are active the fstab entry should use the LABEL reference. Systemd calls swapon and it only works properly with multipath devices when LABEL reference is used or calling directly on the /dev/dm-* device file. commit 34685e39636911e2cce7a442be74a6369c45c5c1 Author: Marcus Schäfer AuthorDate: Sat Mar 3 18:29:01 2018 +0100 Commit: Marcus Schäfer CommitDate: Sat Mar 3 18:29:01 2018 +0100 Bump version: 9.13.2 → 9.13.3 commit 843832e282946a8cc3ad5ac06f6a84b0510a7973 Author: Marcus Schäfer AuthorDate: Fri Mar 2 16:39:44 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 2 16:39:44 2018 +0100 The order of the options for mkisofs matters Setting -eltorito-platform after -b causes mkisofs to fail commit 9997894a932f8c3008e88c8b3e8138df7963f4c9 Author: Michal Marek AuthorDate: Fri Mar 2 16:18:13 2018 +0100 Commit: Michal Marek CommitDate: Fri Mar 2 16:18:13 2018 +0100 APT: Support patternType in the bootstrap phase With patternType="onlyRequired" (the default), run debootstrap with --variant=minbase to install only essential packages. With patternType="plusRecommended", let debootstrap also install important packages. This is not exactly what the patternType keyword means with other targets, but it allows to choose between an absolutely minimal image and a small but usable system. commit d74ce6a9c0261354481315d46599a093cbb0cf92 Author: Marcus Schäfer AuthorDate: Fri Mar 2 14:56:28 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 2 14:56:28 2018 +0100 Bump version: 9.13.1 → 9.13.2 commit 418a35704590a97ad46e172e3e9abfc5e153e2f8 Author: David Cassany AuthorDate: Fri Mar 2 10:56:11 2018 +0100 Commit: David Cassany CommitDate: Fri Mar 2 10:56:11 2018 +0100 Reactivate device mappings after repart. Fixes #645 This commit recreates removed device maps and triggers again systemd generators in order to adapt again device units to the new context. Fixes #645 commit 1553be4ea5f0eec3b5d1fa68c9c1a9a68ef1b2a4 Author: Marcus Schäfer AuthorDate: Fri Mar 2 10:05:48 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 2 10:05:48 2018 +0100 Refactor ovftool check The way this was done mask errors from the call with the check if the tool exists on the host. This patch refactors this and makes clear where we check for the tool to be installed and where we actually call it commit 135fdcf4da32d1bd285c93dbf913f98c42f2c50d Author: Marcus Schäfer AuthorDate: Fri Mar 2 10:04:13 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 2 10:04:13 2018 +0100 Extend has_option_in_help to also check error data commit 0d377e1714f40c2875f1826c9b46e3d6de61450a Author: Marcus Schäfer AuthorDate: Thu Mar 1 14:58:38 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 1 14:58:38 2018 +0100 Check if isotool supports eltorito-platform option Along with the change there is a small refactoring to populate the iso tool search to the public api of the Iso class commit 37934d5ad7447c849dce78ccff3d359d9ce230e7 Author: Marcus Schäfer AuthorDate: Thu Mar 1 10:23:52 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 1 10:26:28 2018 +0100 Set eltorito-platform for efi The default eltorito platform is set to "x86_64 PC", however in an alternative bootloader spec for efi this would be the wrong platform spec. This patch adds the correct platform to the alt-boot setup for efi. References #643 commit f8ca681309538f465baceceb60b75d45cd194c8a Author: Marcus Schäfer AuthorDate: Wed Feb 28 15:41:58 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 28 15:41:58 2018 +0100 Fixup obs test status helper Use osc results output to get better status information commit 6dc70731014f1ff3da0525e8cdadbdf9a88ee23a Author: Marcus Schäfer AuthorDate: Wed Feb 28 10:47:29 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 28 10:47:29 2018 +0100 Fixed get_free_disk_bytes in dracut kiwi-lib The method used any device from the lsblk output, but it can happen that some device nodes with different name point to the same physical device. The method would then calculate the free space wrong. This patch takes the PARTUUID value into account to make sure any partition device size is used only once. This Fixes #648 commit 6c3f8efa642ee105e471a8bfe9c910f05ad4f3de Author: Thomas Schraitle AuthorDate: Tue Feb 27 12:34:52 2018 +0100 Commit: Thomas Schraitle CommitDate: Tue Feb 27 12:39:52 2018 +0100 Use pytest instead of py.test From pytest 3.0, it is recommended to use "pytest" as the main command. The use of "py.test" is deprecated and is potentially removed in the future. commit 2034baf63f6613fa8112ea5a846a8d0e747a3e66 Author: Marcus Schäfer AuthorDate: Tue Feb 27 11:04:15 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 27 11:21:23 2018 +0100 Update tox setup Add python 3.6 target and activate it for the travis and the local make targets Use major python version for the check(flake) and doc targets where the interpreter minor version is not primarily important This references #641 commit 25bf25379e4f6d9209a074a33eecdc5a441353fe Author: Marcus Schäfer AuthorDate: Tue Feb 27 10:52:39 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 27 10:52:39 2018 +0100 Update yast setup documentation Incorporate changes per review by Tom commit 7d62e36548a4ed0d8010eaf98a9a0e3fa673312d Author: Marcus Schäfer AuthorDate: Mon Feb 26 18:03:38 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 26 18:03:38 2018 +0100 Fixed oem build test bind-utils explicitly required for obs to be able to resolve the package dependencies commit c0bd6ed9d860b4e993cc922a83a90894b2a2c476 Author: Marcus Schäfer AuthorDate: Mon Feb 26 17:46:55 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 26 17:46:55 2018 +0100 Bump version: 9.13.0 → 9.13.1 commit ccbbb48a36598c332bbd6b54daebdecb98fd5a4f Author: Marcus Schäfer AuthorDate: Mon Feb 26 17:30:15 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 26 17:30:15 2018 +0100 Only delete sub path if not empty commit 02203c68325d1d3ebcf3028a2210ec0b7f9976f7 Author: Marcus Schäfer AuthorDate: Mon Feb 26 17:29:30 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 26 17:29:30 2018 +0100 Fixed package lists for azure and ec2 build tests commit 90346fb4f90bdf6e266e1a96345c385bb9c725d7 Author: Marcus Schäfer AuthorDate: Mon Feb 26 16:34:45 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 26 16:34:45 2018 +0100 Reference commit for bugzilla With regards to the changes done in Issue #637 this commit just creates a reference to a related bug bsc#1082163 commit 64cb5b003140a3733f635e25b5b667f13f1ce4a1 Author: Marcus Schäfer AuthorDate: Fri Feb 23 16:00:06 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 26 11:27:38 2018 +0100 Cleanup config functions shell coding commit 57ad4acfd1ef947d91821d3c995939d311f9a55d Author: Adam Majer AuthorDate: Fri Feb 23 12:20:52 2018 +0000 Commit: Adam Majer CommitDate: Fri Feb 23 13:38:37 2018 +0100 Use mkisofs instead of wodim commit 11b3a2bb3255e0c0d8385ea52ec6070740dee2b0 Author: Marcus Schäfer AuthorDate: Fri Feb 23 11:37:58 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 23 11:37:58 2018 +0100 Delete obsolete/unused methods commit 814258ecf3ef0f3d53742c15572da25ca24998ef Author: Marcus Schäfer AuthorDate: Fri Feb 23 11:37:43 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 23 11:37:43 2018 +0100 Add functions.sh to shellcheck commit 94e279514e5db87b3007596209bfa876aa402d32 Author: Marcus Schäfer AuthorDate: Fri Feb 23 10:09:11 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 23 10:09:11 2018 +0100 Added doc page how to setup yast on firstboot commit a70d7bdccc01085987d4e32d66d9cd88795f98e0 Author: Marcus Schäfer AuthorDate: Thu Feb 22 14:42:30 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 22 15:10:10 2018 +0100 Allow arch attribute for profiles specification A profile could be relevant for only a specific architecture. There was no way to express that in the XML description. With the change in this commit a specification like the following is possible: Profile A is only usable on the aarch64 architecture, whereas profile B would be usable on all architectures. * Selecting an arch specific profile from the commandline via the --profile option on a system which is not of that architecture will result in an error message. * Using the import="true" attribute in the definition for an arch specific profile will cause the import of that profile only on that architecture and silently ignore the import on any other architecture This Fixes #637 commit 025850bde1ef327eee1ede598a63d9cef6896d96 Author: Marcus Schäfer AuthorDate: Thu Feb 22 09:54:04 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 22 09:54:04 2018 +0100 Update build-test descriptions for Kanku As part of the buildservice there is now also a CI system called Kanku which allows for image boot/run tests. The only requirement on the image level which is missing in our build test descriptions is the setup of the serial console. This patch updates those image descriptions which could be tested by kanku to provide a serial console at boot time. The plan is that our build-test images automatically gets boot tested by the Kanku CI. This should include boot, console-login, reboot, console login, shutdown. The required job description to do this needs to be worked out together with the Kanku team commit 9aea8452f257e69df66f0c8049e58a8ee05bd86c Author: Marcus Schäfer AuthorDate: Tue Feb 20 14:56:11 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 21 12:54:07 2018 +0100 Fixed yum vs. yum-deprecated binary lookup When using the yum package manager it could be either provided as yum or yum-deprecated binary. Because of this the search method to find the binary needs to know the context from which the call is performed. This could be either the host system or the created image root. This Fixes #624 commit 2928bba2760dfb7012778564ca16d60155178bcb Author: David Cassany AuthorDate: Tue Feb 20 17:57:18 2018 +0100 Commit: David Cassany CommitDate: Tue Feb 20 17:57:18 2018 +0100 Adding publisher attribute for ISOs This commit adds the 'publisher' attribute in type only for ISO image type. It sets the publisher name of the resulting ISO. Fixes #630 commit 71bb27722a9db47ec1c9d7d67b91b73b410243fd Author: Michal Marek AuthorDate: Tue Feb 20 13:41:36 2018 +0100 Commit: Michal Marek CommitDate: Tue Feb 20 13:41:36 2018 +0100 APT: Run debootstrap with --variant=minbase This selects only packages with Priority: required, which is more in line with what the other package managers are doing. A patch for kiwi-descriptions has been submitted to adapt to this new behavior. commit 39b2b703a20d95111b1ebf670f07b1b6ec70d6b9 Author: Marcus Schäfer AuthorDate: Fri Feb 16 11:58:16 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 16 11:58:16 2018 +0100 Bump version: 9.12.9 → 9.13.0 commit 9ee21e61636e407f4fb2f0093e1ca4dc42da1fdc Author: Alexander Graf AuthorDate: Fri Feb 16 11:24:41 2018 +0100 Commit: Alexander Graf CommitDate: Fri Feb 16 11:24:43 2018 +0100 Do not emit linuxefi/initrdefi on non-x86 platforms Grub wants to have linuxefi/initrdefi commands to execute Linux via the UEFI calling convention on x86. However, all other platforms simply use the normal linux/initrd commands, because there grub assumes that an EFI grub wants to run an EFI payload. Reflect this architecture difference in the generated grub configuration. Signed-off-by: Alexander Graf commit 4c901d506d0ca6543215936e1a994be774f139b5 Author: Marcus Schäfer AuthorDate: Thu Feb 15 14:46:21 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 15 15:03:45 2018 +0100 Fixup grub2 theme setup The presence of a background file was mandatory for kiwi to use the theme. But the background information is optional commit 655393626597f411ba70daf2aa5fdaf536859d1c Author: Marcus Schäfer AuthorDate: Wed Feb 14 11:49:19 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 14 18:42:49 2018 +0100 Deleted obsolete boot descriptions The custom kiwi boot descriptions has been moved into the kiwi-descriptions github repo and builds the compat package kiwi-boot-descriptions from there. The build of the boot image(initrd) is done by dracut and the dracut module packages provided by kiwi. The classic custom boot descriptions can still be used as alternative method if the above package is installed. Related to Issue #576 commit 0a50b72da377777a5e16707403d165103cc02f42 Author: Marcus Schäfer AuthorDate: Tue Feb 13 13:00:36 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 13 13:00:36 2018 +0100 Create compatible boot options The boot option root=install:CDLABEL= is mandatory for install images which uses the dracut initrd system. But for the custom kiwi oemboot descriptions this is causing a problem when detecting the install device. Thus the above boot option is only applied for the initrd system which actually makes use of it commit a27562d8c45b550b61d3749e07f049983fa073f4 Author: Marcus Schäfer AuthorDate: Tue Feb 13 12:27:15 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 13 12:27:15 2018 +0100 Update boot description search path With the move of the boot descriptions in its own package the kiwi search path needs to be adapted to look for boot descriptions in /usr/share/kiwi/custom_boot. In addition a runtime check to exit early if the boot description could not be found or is not specified will be provided. Related to Issue #576 commit 1db0a1a1c2c6b4cd07a9bb0f28567a0dae0f12aa Author: David Cassany AuthorDate: Tue Feb 13 10:37:16 2018 +0100 Commit: David Cassany CommitDate: Tue Feb 13 10:47:27 2018 +0100 Update the docs to the current example present in kiwi-descriptions commit acfa69617c4e169ded7c0d1036e80261e044a86b Author: Marcus Schäfer AuthorDate: Mon Feb 12 16:48:17 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 12 16:48:17 2018 +0100 Bump version: 9.12.8 → 9.12.9 commit d29ba29276f824a08985be60e0fd40a786c0cf18 Author: Marcus Schäfer AuthorDate: Mon Feb 12 14:51:17 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 12 15:56:49 2018 +0100 Add restrictions to Path.remove_hierarchy When an iso file is used as repo, this iso will be loop mounted on the host and bind mounted into the image root as long as the image builds. When the mount is released a recursive cleanup of the complete path happens. This is done by calling Path.remove_hierarchy. However if a sub path of the mount path contains a system root directory which is mandatory for the Linux root system it is not allowed to be deleted even if it is empty at the time of the mount cleanup. Thus this patch adds a lookup for protected directory names and only runs the recursive deletion as long as no protected member is part of the path. This fixes bsc#1080301 commit 02ce24dda56f89a43675eb7ee4bd1d6318ebe8df Author: Marcus Schäfer AuthorDate: Mon Feb 12 15:55:46 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 12 15:56:26 2018 +0100 Update .virtualenv.dev-requirements.txt sphinx 1.7.0 is not compatible with travis-sphinx thus we stick with 1.6.7 until travis-sphinx followed the sphinx changes commit 12a9dfb0fa1b2323bb051079eae9af39c917fe6c Author: Neal Gompa AuthorDate: Sat Feb 10 22:49:25 2018 -0500 Commit: Neal Gompa CommitDate: Sun Feb 11 16:10:23 2018 -0500 Initial support for building Debian/Ubuntu packages in spec This adds support for producing the main kiwi package as well as the packages for the dracut modules to be used when building Debian-based distribution images with KIWI. The Debian/Ubuntu package is built using debbuild: https://github.com/ascherer/debbuild commit 987b3c6d27317696cea00dfc7ba0c800b80c1e91 Author: Marcus Schäfer AuthorDate: Fri Feb 9 15:38:16 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 9 15:38:16 2018 +0100 Fixed build_pxe_root_filesystem documentation The article still used filename references from v7 code stream This patch updates the docs to match the sources it refers to commit 3270e4aeea444b9ba7843a903e02cef0cc325353 Author: Marcus Schäfer AuthorDate: Wed Feb 7 14:38:47 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 7 14:38:47 2018 +0100 Update dropped features documentation The information on the partition based install method was unclear and misleading. This patch clarifies the documentation in this regard commit c05f784f110fbed077c98af3808684990b90a943 Author: Marcus Schäfer AuthorDate: Wed Feb 7 14:22:58 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 7 14:22:58 2018 +0100 Delete obsolete ovf format value Support for ova has been added which makes the ovf format value obsolete and redundant commit 805bb68fff01099b2d7554e9a97c0d94910f01c2 Author: Michal Marek AuthorDate: Tue Feb 6 15:55:55 2018 +0100 Commit: Michal Marek CommitDate: Tue Feb 6 15:55:55 2018 +0100 OVA: Print a user-friendly message if ovftool is not available commit b281de970b9ac0525ad40fc1fa44f8c9a8ecd0e2 Author: Michal Marek AuthorDate: Tue Feb 6 15:55:29 2018 +0100 Commit: Michal Marek CommitDate: Tue Feb 6 15:55:29 2018 +0100 OVA: Require ovftype="vmware" commit d6a67460cbe484d89ef93e14c94a99722707fc9f Author: Robert Schweikert AuthorDate: Mon Feb 5 18:33:10 2018 -0500 Commit: Robert Schweikert CommitDate: Mon Feb 5 18:33:10 2018 -0500 - Expand consistency check for grub efi package to cover debian based and RH distros commit aa27a37a6430bdc3d9d1267dde1ede59065dc2f5 Author: Marcus Schäfer AuthorDate: Mon Feb 5 17:02:19 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 5 17:02:19 2018 +0100 Bump version: 9.12.7 → 9.12.8 commit ba6d4326f54eef9291d117605d0b61deece94615 Author: Marcus Schäfer AuthorDate: Mon Feb 5 15:56:26 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 5 16:22:45 2018 +0100 Exclude install source device from target list commit a887c7fe9b0f06fce4f6d44170608457a56c5197 Author: Robert Schweikert AuthorDate: Mon Feb 5 10:13:14 2018 -0500 Commit: Robert Schweikert CommitDate: Mon Feb 5 10:13:14 2018 -0500 - Fix style error commit f44ce191c2bc429f14dc21ac0e842a427cf3cde9 Author: Marcus Schäfer AuthorDate: Mon Feb 5 15:29:25 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 5 15:38:24 2018 +0100 Fixed kiwi-dump timing issue The install code needs to wait in the pre-udev phase for the device containing the installation data to become ready before proceeding with the actual installation code. commit 7cff2e93b916756fdd2b39f833d5ae7c2a6164a6 Author: Robert Schweikert AuthorDate: Mon Feb 5 09:29:07 2018 -0500 Commit: Robert Schweikert CommitDate: Mon Feb 5 09:29:07 2018 -0500 - Early exit if firmware is efi or uefi but the expected grub module is not part of the package list commit e09579e11100dd4a5e1da25b961fdbd84e7f5825 Author: Marcus Schäfer AuthorDate: Mon Feb 5 15:28:12 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 5 15:28:12 2018 +0100 Fixed dialog size of install confirmation dialog The size was too small to show device names which causes a line break to be displayed in the next line commit d8bc0e3dcda49ec74468da94288eefc905f44f8c Author: Marcus Schäfer AuthorDate: Sun Feb 4 20:19:45 2018 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 4 20:19:45 2018 +0100 Cleanup misleading method name commit bc4e225aec59ba5e50a7c1a98e585faaa17819cb Author: Marcus Schäfer AuthorDate: Sun Feb 4 15:52:06 2018 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 4 18:46:57 2018 +0100 Fixed target path name for gce format get_target_name_for_format in case of the gce format does not return a path spec which leads to an incomplete result information for a later bundle command. This patch fixes this. In a follow up pull request we will also update the method name from the misleading get_target_name_for_format function name to get_target_path_name_for_format commit 422d91ada6329159b9056e2665e7ec2c07f27665 Author: Marcus Schäfer AuthorDate: Sun Feb 4 18:46:09 2018 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 4 18:46:09 2018 +0100 Fixed coverage report setup Latest version of the coverage module requires a report setup commit 91270176ffdf716b85a7775308f3ede4e161591a Author: cyberorg AuthorDate: Sat Feb 3 13:12:48 2018 +0530 Commit: cyberorg CommitDate: Sat Feb 3 13:12:48 2018 +0530 Use live-grub-stick commit d1fced5e9986dea113d8bdce7403d95b0e1484dc Author: David Cassany AuthorDate: Fri Feb 2 18:16:28 2018 +0100 Commit: David Cassany CommitDate: Fri Feb 2 18:16:28 2018 +0100 Fix packages file generation This commit checks the %_dbpath value of the image rpm tool. This is needed since recent rpm versions switched the default database path, thus running rpm queries to different roots might lead to errors. Fixes #605 commit df22ab6c446d2e20590f8977e517ff3124476fdf Author: Marcus Schäfer AuthorDate: Thu Feb 1 14:31:31 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 1 14:31:31 2018 +0100 Bump version: 9.12.6 → 9.12.7 commit e81866c337e117b42a821180655a53bbf1dc8ca4 Author: Marcus Schäfer AuthorDate: Thu Feb 1 10:29:30 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 1 10:29:30 2018 +0100 Update per review by Tom commit c2cb10001b6479e7d6510464e175bd5a5cea7adf Author: Marcus Schäfer AuthorDate: Thu Feb 1 09:55:08 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 1 09:55:08 2018 +0100 Update per review by David commit 84790e74ad16e06de3dcb7a8fc8efa1581c6d6df Author: Marcus Schäfer AuthorDate: Wed Jan 31 15:43:07 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 31 15:43:07 2018 +0100 Update per review by Tom commit 5c8ab7c744e3a986a9d2117aba447c1ccef15315 Author: Marcus Schäfer AuthorDate: Tue Jan 30 15:37:21 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 30 15:37:21 2018 +0100 Added chapter for live-fat-stick deployment With the support for the iso-scan feature in KIWI live ISO image, also the ability to deploy file based on FAT32 usb sticks via the live-fat-stick tool exists. This chapter describes how to do it and Fixes #521 commit c5ca89682b0d878728db37165f89167c445aff9e Author: Marcus Schäfer AuthorDate: Tue Jan 30 14:35:06 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 30 14:35:06 2018 +0100 Update pre review by Tom commit 71b77c9be352db7a9045bf2ae1173c3866b56445 Author: Marcus Schäfer AuthorDate: Tue Jan 30 14:29:43 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 30 14:29:43 2018 +0100 Update per review by Tom commit d4ebf1684820a8c1e8e415acecc52e1586adebe3 Author: Marcus Schäfer AuthorDate: Tue Jan 30 14:25:08 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 30 14:25:08 2018 +0100 Update per review by Tom commit de47635af36f28cf9ad017df105dc67aa74610be Author: David Cassany AuthorDate: Tue Jan 30 14:20:45 2018 +0100 Commit: David Cassany CommitDate: Tue Jan 30 14:20:45 2018 +0100 Remove vmdk metadata update procedure This commit removes the method _update_vmdk_descriptor from DiskFormatVmdk class. The code part causes vmdk format issues in current up to date hipervisors such as VMWarePlayer 14 or Virtualbox 5.2. Removing this code does not produce any failure, at most can only imply loosing some features provided by open-vm-tools package. Fixes #591 commit a2fd4b3ce206aaeffa78617f6ae3b1c185d76d36 Author: Marcus Schäfer AuthorDate: Tue Jan 30 11:38:16 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 30 11:38:16 2018 +0100 Fixed use of profile variables in kiwi-dump module The profile environment was not imported in the dracut kiwi-dump module. Thus custom settings like oem-unattended did not had an effect commit d69dc24992cc82e851e1c4d6ac34443969037fbe Author: Marcus Schäfer AuthorDate: Tue Jan 30 10:37:03 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 30 10:37:41 2018 +0100 Fixup docstrings in xml_state commit aaf563d93993fbe646ba78613cfc08a792cca49d Author: Marcus Schäfer AuthorDate: Tue Jan 30 10:22:42 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 30 10:37:41 2018 +0100 Allow only one dracut variable for kiwi debugging commit 427a1c28b370659f7d6aa88c1cee0d662aebbae1 Author: Marcus Schäfer AuthorDate: Fri Jan 26 11:38:29 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 30 10:37:41 2018 +0100 Update documentation Update the documentation with regards to the move from the plain kiwi initrd to the dracut initrd system. This is related to Issue #576 commit 36e3cd52ee1a860e23ae1383c3f161ba4105b468 Author: Marcus Schäfer AuthorDate: Mon Jan 29 12:16:55 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 29 12:16:55 2018 +0100 Bump version: 9.12.5 → 9.12.6 commit bcd170a04dfbe5c4bb50c4ae245b3f6a8fede39d Author: Marcus Schäfer AuthorDate: Sat Jan 27 11:14:48 2018 +0100 Commit: Marcus Schäfer CommitDate: Sat Jan 27 11:14:48 2018 +0100 Fixed kiwi dracut config for the final system Once the image has been deployed on the target and the system is up and running some of the kiwi dracut modules used for deployment are no longer needed and should not be taken into account when another dracut call happens on the system. commit 7b7afa815bbc5b2b3b5d3f47e0384b403dabdcf8 Author: Michal Marek AuthorDate: Fri Jan 26 12:19:18 2018 +0100 Commit: Michal Marek CommitDate: Fri Jan 26 12:19:18 2018 +0100 Add support for building OVA images Implement support for format="ova" using VMware's ovftool. We use the vmdk format as a basis and then just call ovftool to convert *.vmdk + *.vmx to an OVA. commit a1d30ca4db3ec44a8c80c0b71084c14282036725 Author: Michal Marek AuthorDate: Fri Jan 26 11:02:39 2018 +0100 Commit: Michal Marek CommitDate: Fri Jan 26 11:02:39 2018 +0100 flake8: Use a more conservative max-complexity setting Set the default threshold to 12 and annotate the outliers with "noqa: C901". Most of the cases are due to lack of switch statement in python, but there are some worth titying up. Now we can grep for them :). commit 2de55d1f415dfefca367d946f9bed5156a2d1e80 Author: Marcus Schäfer AuthorDate: Fri Jan 26 10:28:53 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 26 10:28:53 2018 +0100 Bump version: 9.12.4 → 9.12.5 commit b7b6d1a553ef26d9000360ad8078940f225ed582 Author: Marcus Schäfer AuthorDate: Fri Jan 26 10:18:58 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 26 10:18:58 2018 +0100 Make sure there are no busy devices on reboot If the dracut kiwi-repart module skips the repartition step because the disk was already repartitioned it leaves devices in busy state which leads to a rescue shell at the system mount stage commit a4cc859530ba60057cd72157f35ea69fc7984667 Author: David Cassany AuthorDate: Thu Jan 25 16:48:30 2018 +0100 Commit: David Cassany CommitDate: Thu Jan 25 16:48:30 2018 +0100 uboot-setup-panda.tgz was readded by mistake as boot hooks are no longer needed commit 695ab000d0ed31f23697346049d3491449baae20 Author: David Cassany AuthorDate: Thu Jan 25 15:32:53 2018 +0100 Commit: David Cassany CommitDate: Thu Jan 25 15:32:53 2018 +0100 Adding opensuse ports repository commit d5422306721d0b40af83d450369af1667ff9394c Author: Marcus Schäfer AuthorDate: Thu Jan 25 14:04:36 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 25 14:04:36 2018 +0100 Bump version: 9.12.3 → 9.12.4 commit cc152d0a57254ae84bfc05af50d3247707549b65 Author: Marcus Schäfer AuthorDate: Thu Jan 25 14:02:31 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 25 14:02:31 2018 +0100 Don't lookup zImage symlink Due to the workaround to lookup the gzip compressed variant of a zImage to find its version, it's required to find the full name of the zImage in order to rematch the gzip variant. Looking at the zImage link will make this to fail because there is no vmlinux link commit 318794ce68fda20c5ede7c4d5513132aa815244d Author: Marcus Schäfer AuthorDate: Thu Jan 25 13:54:03 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 25 13:54:03 2018 +0100 Bump version: 9.12.2 → 9.12.3 commit 7a94685217f1a48e9e0d22308621cc6696b3004e Author: Marcus Schäfer AuthorDate: Thu Jan 25 11:59:36 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 25 11:59:36 2018 +0100 Fixed kernel version check for zImage kernels build as zImage contains the decompressor code as part of the kernel image and could be therefore compressed by any possible compression algorithm. In this case we assume/hope that there is also a standard gz compressed vmlinux version of the kernel available and check this one instead of the zImage variant. Fixes #587 commit 407b69a3edcf926b9d128d1cabf4fe80aa83adff Author: Marcus Schäfer AuthorDate: Thu Jan 25 11:34:58 2018 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 25 11:34:58 2018 +0100 Bump version: 9.12.1 → 9.12.2 commit 2fc430be2bc188e6c7f0fe7ee797e55e1df47521 Author: Robert Schweikert AuthorDate: Wed Jan 24 15:00:06 2018 -0500 Commit: Robert Schweikert CommitDate: Wed Jan 24 15:00:06 2018 -0500 - Image name generation for GCE images + Fix the name generation for GCE images. The implementation assumed that GCE images are of a type that use a kiwi generated initrd, looking for image name components based on the boot attribute in the type element. This assumption is not correct, use the name provided in the XML to compose the image name. commit 1e8550332268916cce2e82041117850fda7ec408 Author: David Cassany AuthorDate: Wed Jan 24 19:40:50 2018 +0100 Commit: David Cassany CommitDate: Wed Jan 24 19:40:50 2018 +0100 Update the man pages commit f9c38557d5e57b83f2e91f7dca43caf793ac38c8 Author: Marcus Schäfer AuthorDate: Wed Jan 24 17:18:51 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 24 17:18:51 2018 +0100 Fixed installation image builder Use get_boot_names from BootImage instance to ask for the name of the initrd instead of constructing this information from static values. The name of the initrd is different per distro and toolkit commit 2ffcb26f1511274211287bb9ffb2cefe033cf4ca Author: Marcus Schäfer AuthorDate: Wed Jan 24 16:57:27 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 24 16:57:27 2018 +0100 Provide a get_boot_names method in boot classes The naming schema for an initrd file name depends on the boot image type as well as on the underlaying initrd creation toolkit. In order to encapsulate that in a clear interface the code to know about the correct names has been moved into the classes which are responsible for it and out of the builder/disk class commit da2c41894b0260b143785422ec44289ac56ddb28 Author: Marcus Schäfer AuthorDate: Wed Jan 24 12:07:06 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 24 12:07:06 2018 +0100 Bump version: 9.12.0 → 9.12.1 commit 8cc0138eaa4e182be8cbd03a295a27ca18d2c349 Author: Marcus Schäfer AuthorDate: Wed Jan 24 12:05:53 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 24 12:05:53 2018 +0100 Fixed dracut-kiwi-oem-dump requires setup on rhel/fedora multipath is provided by device-mapper-multipath commit d334a89d84dd499ca23cc7f25988791ac07c0473 Author: David Cassany AuthorDate: Tue Jan 23 19:03:27 2018 +0100 Commit: David Cassany CommitDate: Tue Jan 23 19:03:27 2018 +0100 Adding package_gpgcheck flag as an option for set-repo and add-repo Fixes #565 commit 62318c4888ad2f64ce72c7246faea23a1f0a58c2 Author: David Cassany AuthorDate: Tue Jan 23 11:37:52 2018 +0100 Commit: David Cassany CommitDate: Tue Jan 23 11:37:52 2018 +0100 Adding uboot-setup kiwi hooks For some reason the uboot-setup-panda.tgz file did not get into master branch, probably was not properly pushed in the former include_build_tests_arm branch. commit efbb47f999256c60fce34ff8b119060da6793ebb Author: David Cassany Viladomat AuthorDate: Tue Jan 23 11:22:42 2018 +0100 Commit: GitHub CommitDate: Tue Jan 23 11:22:42 2018 +0100 Fix build tests to match new locale setting strategy (#586) commit 72fc10639f2eccb3cadcef2ddc171c4f07190368 Author: Marcus Schäfer AuthorDate: Mon Jan 22 19:08:27 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 22 19:08:27 2018 +0100 Added timezone package to build tests With the latest update on how kiwi handles the locales with systemd-firstboot, only locales defined in timezone package can be set, thus Europe/Berlin is not possible if timezone is not installed commit 34d58087d244f377daeaeddb4b0e82d6f574f138 Author: Marcus Schäfer AuthorDate: Mon Jan 22 18:03:29 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 22 18:03:29 2018 +0100 Fixed build tests for azure and ec2 Packages yast2-storage and recode no longer provided commit 04a28f77bdc6ffa95e4620fe081a8b0ea890a45e Author: Marcus Schäfer AuthorDate: Mon Jan 22 17:49:24 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 22 17:49:24 2018 +0100 Bump version: 9.11.30 → 9.12.0 commit 383187157a8b3f82d26dab58e02f13f6bb36dd9d Author: Marcus Schäfer AuthorDate: Mon Jan 22 17:44:10 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 22 17:44:10 2018 +0100 Update build test image descriptions Update to latest schema by auto conversion and delete use of oemboot kiwi code by switching to dracut commit 2d68cbbbd8fd8d4acf7974026be7cf1f580a95e6 Author: Marcus Schäfer AuthorDate: Mon Jan 22 14:23:59 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 22 14:23:59 2018 +0100 Fixed reading device node path lsblk should be called with -p because it's a mistake to assume any device lives below /dev. There could also be subtree devices in /dev/mapper or /dev/disk/.. We leave it up to lsblk to provide us the correct information commit 5ed743febfe5c328e396987319637b753eab9815 Author: Marcus Schäfer AuthorDate: Mon Jan 22 10:38:28 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 22 10:38:28 2018 +0100 No need to actively stop the dialog service commit 8dbd012078dfe4f8aaa997ea9854b56316a61651 Author: Marcus Schäfer AuthorDate: Mon Jan 22 09:47:36 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 22 09:47:36 2018 +0100 Added required packages for dmraid and multipath commit 645d600c8921715ad1a644eed129394746215e94 Author: Marcus Schäfer AuthorDate: Sat Jan 20 17:42:41 2018 +0100 Commit: Marcus Schäfer CommitDate: Sat Jan 20 17:42:41 2018 +0100 Added handling for dmraid and multipath devices commit eaff4a84f5d80850f3991b56a34b92bcdf0df48e Author: David Cassany AuthorDate: Fri Jan 19 18:20:29 2018 +0100 Commit: David Cassany CommitDate: Fri Jan 19 18:20:29 2018 +0100 Adding iso-scan feature to kiwi-live dracut module This commit adds the iso-scan scripts to kiwi-live module_setup if the former files are found in the system inside the dmsquash-live dracut module directory. Fixes #574 and is related to #521 commit 2439659340a266463fe71ebc5903c877e39d1d86 Author: Marcus Schäfer AuthorDate: Fri Jan 19 15:37:34 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 19 15:37:34 2018 +0100 Fixed Arrays implicitly concatenate by shellcheck commit 1f348e843626991419cf52e985a018a7bea15c79 Author: Marcus Schäfer AuthorDate: Thu Jan 18 18:05:35 2018 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 19 14:27:52 2018 +0100 Add support for net install in dracut kiwi-dump This implementes one of the tasks from Issue #576 commit f704c3c7b2e6a4263b2388768e2503b5ee32efe0 Author: Marcus Schäfer AuthorDate: Wed Jan 17 14:59:59 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 17 14:59:59 2018 +0100 Added runtime check for dracut-kiwi-oem-dump The installation of the above mentioned dracut module package is required for oem images which uses dracut as initrd system and have the creation of an installation image requested. This is related to Issue #576 commit 2b582a333995c3e19161a90e5e6b662a7d66b9eb Author: Marcus Schäfer AuthorDate: Wed Jan 17 10:22:34 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 17 10:22:34 2018 +0100 Update schema version in documentation commit f304802c538bdd624aa3b68b5855f3a7ee6c94f0 Author: Marcus Schäfer AuthorDate: Wed Jan 17 10:18:54 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 17 10:19:37 2018 +0100 Auto update all schema descriptions to v6.8 commit 1c5d969b4a82062252ce697f6a9ab48e31b04b18 Author: Marcus Schäfer AuthorDate: Wed Jan 17 10:17:39 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 17 10:19:37 2018 +0100 Delete hwclock from profile and system setup commit a64161df65da4eaeb6de305b72aa6b198c50b93d Author: Marcus Schäfer AuthorDate: Wed Jan 17 10:07:56 2018 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 17 10:19:37 2018 +0100 Delete hwclock section from schema Deletes hwclock section from schema and provides xslt style sheet for schema auto conversion from schema version 6.7 to 6.8 commit 300dd9332d95d028367024b38204f942be8d0a97 Author: David Cassany AuthorDate: Tue Jan 16 17:16:04 2018 +0100 Commit: David Cassany CommitDate: Tue Jan 16 17:16:04 2018 +0100 Deprecate suseConfig method and remove hardware config method This in this commit: - the contents of the suseConfig method from kiwi/config/functions.sh are replaced by a deprecated message. - the setup_hardware_clock method from SystemSetup is removed as it is not used anywere in the code. commit afbf2687c8db45480f5de4e89c966d22d476e2a6 Author: David Cassany AuthorDate: Tue Jan 16 16:53:59 2018 +0100 Commit: David Cassany CommitDate: Tue Jan 16 16:53:59 2018 +0100 Extend CommandCapabilities to also check version commit 6784ea8eeb18930185135cfb832a4c55dff2f02d Author: Marcus Schäfer AuthorDate: Tue Jan 16 15:48:03 2018 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 16 16:24:58 2018 +0100 Added dracut-kiwi-oem-dump subpackage to spec commit d582dc90bdc68a4d84f4f74965d97c4d445a4f77 Author: Marcus Schäfer AuthorDate: Thu Nov 23 11:56:55 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 16 16:24:58 2018 +0100 Implementation of dracut kiwi-dump module Provide the capabilities of the oem install code as dracut module. The implementation covers the result of the installiso="true" configuration. Installation from remote sources still needs to be done and will follow in an extra pull request. This addresses Issue #576 commit 02dc8e32e1b619fc521ef9c0886d26079bcd3741 Author: David Cassany Viladomat AuthorDate: Tue Jan 16 14:10:31 2018 +0100 Commit: GitHub CommitDate: Tue Jan 16 14:10:31 2018 +0100 Update locale settings (#579) * Use systemd-firstboot in order config basic settings This commit updates locale and keyboard settings in order to make use of the systemd tools, as this will be the only valid method starting from SLE15. Fixes #577 * Added CommandCapabilities utils class commit 6942c6f7009bf82094809c21576485ad8593c4a5 Author: Marcus Schäfer AuthorDate: Mon Jan 8 11:37:20 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 8 11:37:20 2018 +0100 Bump version: 9.11.29 → 9.11.30 commit 54499ab14374549dead21b38ce569ff899ea0275 Author: Marcus Schäfer AuthorDate: Mon Jan 8 11:35:25 2018 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 8 11:35:25 2018 +0100 Deleted syslinux from ppc/oemboot/suse-SLES15 syslinux is not provided for ppc. This Fixes bsc#1073310 commit 3c552d4a2f263c357296bebceaea41b5d371031f Author: Martin Mohring AuthorDate: Fri Dec 29 00:12:19 2017 +0100 Commit: Martin Mohring CommitDate: Fri Dec 29 00:12:19 2017 +0100 [boot] fix double quote in grub menu which makes kernel updates for CentOS / RHEL / Fedora break grub.cfg commit 81ac89e1a897ffb03ee4b657e0abe344aae54380 Author: David Cassany AuthorDate: Tue Dec 19 17:53:28 2017 +0100 Commit: David Cassany CommitDate: Tue Dec 19 17:53:28 2017 +0100 Omit kiwi-repart dracut module in oemboot initrd KIWI's oemboot initrd with initrd_system="dracut" together with installiso="true" requires to have dracut-kiwi-oem-repart package installed in the system, thus it ends up also being included in the recreated dracut initrd after booting the oemboot initrd from the installation iso. This kiwi-repart module causes a boot failure in that case since no .profile file is present, moreover, it has no sense to run it at that stage, since the disk is already reparted by the oemboot code. This commit allows installiso="true" and initrd_system="dracut" to play well together. commit adcdd6b46396c83e5e59faf369bb2b04a5cba5b8 Author: David Cassany AuthorDate: Fri Dec 15 10:32:26 2017 +0100 Commit: David Cassany CommitDate: Fri Dec 15 10:44:56 2017 +0100 Improve locale pattern in schema Now the locale pattern in the schema also supports POSIX. Note that POSIX will be only accepted if listed in the first place of the comma separated list. This commit fixes #570 commit 6aa385d2237849bf99db13cf3cddbf43cd0ad311 Author: Marcus Schäfer AuthorDate: Thu Dec 14 16:45:20 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 14 16:45:20 2017 +0100 Bump version: 9.11.28 → 9.11.29 commit cbccb7629422b23bac49fe0b1b043475360757d2 Author: Marcus Schäfer AuthorDate: Wed Dec 13 09:53:21 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 13 09:53:21 2017 +0100 Allow to choose dracut live module There is the standard dracut dmsquash-live module based on the device mapper technology and the kiwi-live module based on the overlayfs technology. The setup of the live iso structure in kiwi is compatible to both modules. Thus it makes sense to allow to choose the technology via the flags attribute Please note both modules supports a different set of live features. This Fixes #568 commit 0dab9cad3bc03bda2498873bf4c7d2919f065ec5 Author: Marcus Schäfer AuthorDate: Tue Dec 12 11:52:30 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 12 11:52:30 2017 +0100 Bump version: 9.11.27 → 9.11.28 commit 066cb0be23de238ad6988f9367a7ca8a2200a4c8 Author: Adrian Schröter AuthorDate: Fri Dec 1 15:56:37 2017 +0100 Commit: Adrian Schröter CommitDate: Mon Dec 11 18:04:55 2017 +0100 add missing deps for docker builds. Moving kiwi-image:* provides to -requires package commit 3f0b298ba2919ef68faefcb5d4e7639d10ab9004 Author: Marcus Schäfer AuthorDate: Thu Dec 7 15:21:23 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 7 15:21:23 2017 +0100 Fixed ec2 and azure test builds cryptconfig is no longer provided commit 046f946b13005b78fd271bc426ddfa82954351fe Author: Marcus Schäfer AuthorDate: Wed Dec 6 16:26:21 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 6 16:26:21 2017 +0100 Bump version: 9.11.26 → 9.11.27 commit e91ace3f165f6570da0273b574963a3bad45370e Author: Marcus Schäfer AuthorDate: Wed Dec 6 16:25:12 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 6 16:25:12 2017 +0100 Apply target permissions only if target dir exists commit 8555e011656c6ee4e4194439548ef76c469a07db Author: Marcus Schäfer AuthorDate: Wed Dec 6 16:03:57 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 6 16:03:57 2017 +0100 Bump version: 9.11.25 → 9.11.26 commit d1fb751b60dd7bf35b09cc13c8e92382650a25dd Author: Marcus Schäfer AuthorDate: Wed Dec 6 15:59:14 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 6 15:59:14 2017 +0100 Fixed use of stat result in os.chmod oct method returns a string representation which was mistakenly used in a subsequent os.chmod call. This Fixes #564 commit 912e3f7171b7c9f135d6228516744505057f9495 Author: Marcus Schäfer AuthorDate: Wed Dec 6 12:51:06 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 6 12:51:06 2017 +0100 Fixed tox doc target Correctly include schema pictures after travis-sphinx build commit b38bf2e4845be8e7bbdcf1fd9ca28f43a8dfa5f9 Author: Marcus Schäfer AuthorDate: Wed Dec 6 12:08:00 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 6 12:08:00 2017 +0100 Bump version: 9.11.24 → 9.11.25 commit 0fb2b38649c4a332cd2b2a669d1b33617e5f0a2e Author: Marcus Schäfer AuthorDate: Tue Dec 5 14:52:56 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 5 14:52:56 2017 +0100 Update failsafe kernel option list Delete obsolete parameters and make sure a failsafe boot does boot into runlevel 3. This Fixes #554 commit 02431db6fef81abfe23540b2e2a2ef8128b42baa Author: Marcus Schäfer AuthorDate: Tue Dec 5 14:26:06 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 5 14:31:50 2017 +0100 Apply xslt validation on boot images commit d0ff0e284ae90a32d30e3a319bff3e6caad8f072 Author: Michal Marek AuthorDate: Tue Dec 5 10:59:29 2017 +0100 Commit: Michal Marek CommitDate: Tue Dec 5 10:59:29 2017 +0100 Do not match comments and PIs in XSLT templates I wanted to add a simple vim modeline to my XML description: This made kiwi consume insane amounts of memory during the XSLT transform step. While this may be a bug in my version of lxml, we do not transform comments on processing instructions in the conversion templates, so the easiest solution is not to match them. Signed-off-by: Michal Marek commit f17b6e41f0b52606736aa40562b0d04213be3176 Author: Marcus Schäfer AuthorDate: Mon Dec 4 17:17:35 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 4 17:17:35 2017 +0100 Make sure toplevel target dir keeps permissions When syncing data via rsync we make sure the toplevel target directory the data gets synced to does not change it's origin permissions. This Fixes #557 commit a39f527e108000c192b17cdbd2dd53d19e87ffab Author: Marcus Schäfer AuthorDate: Mon Dec 4 12:33:29 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 4 12:33:29 2017 +0100 Rebuild schema documentation commit 5b06180b72977edea3245554297ebb89ec110a22 Author: Marcus Schäfer AuthorDate: Mon Dec 4 11:55:43 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 4 12:00:38 2017 +0100 Fixed dependencies for dracut-kiwi-lib Adapt package names for gdisk/gptfdisk and btrfs-progs/btrfsprogs Install and require fdasd only on s390 architecture Delete fbiterm requirement since the project seems unmaintained and the use of the framebuffer terminal is an option in the code but not mandatory. This Fixes #559 commit 9e9693ca8c0bf95a135e06d9520ddae48a52c4e1 Author: Marcus Schäfer AuthorDate: Wed Nov 29 17:37:10 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 29 17:37:10 2017 +0100 Update text per review commit 030806f08448af99f2318665964cce504cbe0a84 Author: Marcus Schäfer AuthorDate: Wed Nov 29 17:30:24 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 29 17:30:24 2017 +0100 Fix and cleanup tox setup Along with the cleanup of the tox setup also the workaround using an older version of the py module has been fixed commit 74efa869f3ff3e613d9b90cd09f429b2a9e34ecf Author: Marcus Schäfer AuthorDate: Wed Nov 29 16:22:29 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 29 16:22:29 2017 +0100 Fixed travis-sphinx call syntax commit ec9df7daaacb3a50c54d7bb2ef52239c80facbdb Author: Marcus Schäfer AuthorDate: Wed Nov 29 12:21:29 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 29 12:21:29 2017 +0100 Update dropped feature list Legacy kiwi's oem recovery feature will not be ported due to technologes like ReaR, snapper, btrfs and due to the container, cloud and public cloud orientation of OS images commit 023c65a133f2e1767355711c8fea2a5892ddc34a Author: Marcus Schäfer AuthorDate: Thu Nov 23 11:07:05 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 23 11:07:05 2017 +0100 Bump version: 9.11.23 → 9.11.24 commit b077d6006c098260f0c23b55276588a8798c8611 Author: Marcus Schäfer AuthorDate: Thu Nov 23 10:58:24 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 23 10:58:24 2017 +0100 Fixed URL to semver.org in development guide commit b6a7c83f40697b740f0b3b0847724ae49176b3b0 Author: Marcus Schäfer AuthorDate: Thu Nov 23 10:48:58 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 23 10:48:58 2017 +0100 Bump version: 9.11.22 → 9.11.23 commit 570d911eb10bee0a10c2bce6083a575367ac0d6f Author: Marcus Schäfer AuthorDate: Thu Nov 23 10:34:02 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 23 10:34:02 2017 +0100 Fixed module setup for dracut-kiwi-lib lsblk tool used in code but missing in dependencies commit 1a302112fb8358cbc7e30551c4b72f96d9a5ee7b Author: Marcus Schäfer AuthorDate: Thu Nov 23 10:18:40 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 23 10:18:40 2017 +0100 Fixed test-image-azure build test azurectl does not resolve because of missing AppScheduler but for the integration test image we also don't need azurectl Thus it was just deleted from the list commit 797cea896b988675f25aa1c50b934dd20e502eda Author: Marcus Schäfer AuthorDate: Thu Nov 23 10:06:41 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 23 10:06:41 2017 +0100 Fixed test-image-azure build test pam-modules package doesn't exist anymore commit 8cfa0108fba24146b218d6d0616d64dc2b967fd6 Author: Marcus Schäfer AuthorDate: Wed Nov 22 10:23:37 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 22 10:23:37 2017 +0100 Bump version: 9.11.21 → 9.11.22 commit 6b7532d53bbf6a02587559193162e1343a31b109 Author: Marcus Schäfer AuthorDate: Wed Nov 22 10:20:47 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 22 10:20:47 2017 +0100 Fixed typo in spec file The use of the suse_version macro from the last change introduced a syntax error which caused the package build to fail in obs commit a0c5f8c1c4f2789b293054279aedace2d84da4b0 Author: Marcus Schäfer AuthorDate: Wed Nov 22 09:06:59 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 22 09:06:59 2017 +0100 Bump version: 9.11.20 → 9.11.21 commit d0fa1ec47131f1eb8dfdd3f17e34ee4589345939 Author: Dominique Leuenberger AuthorDate: Tue Nov 21 11:37:32 2017 +0100 Commit: Dominique Leuenberger CommitDate: Tue Nov 21 11:37:32 2017 +0100 package: Prepare for Tumbleweed moving to suse_version 1550 commit 4461fecd6afe7041643804f6e7cceccb215a1430 Author: Marcus Schäfer AuthorDate: Tue Nov 21 11:16:35 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 21 11:16:35 2017 +0100 Bump version: 9.11.19 → 9.11.20 commit fce043d6eb3cae5ababf3d5ef884fae0a7399b6f Author: Marcus Schäfer AuthorDate: Tue Nov 21 10:57:36 2017 +0100 Commit: David Cassany Viladomat CommitDate: Tue Nov 21 10:57:36 2017 +0100 Only add package manager on image package requests (#550) If an image description only contains package requests from a bootstrap section but no image packages, it's not required to install a package manager package into the system commit a6ce3cfdcabcc3bc9777a20352aacef0051b23f3 Author: David Cassany AuthorDate: Mon Nov 20 18:24:15 2017 +0100 Commit: David Cassany CommitDate: Tue Nov 21 10:20:34 2017 +0100 Post build constraint validation refactored commit 6b66e069ef14fff9653e63da3f2de6f7765c3c90 Author: Marcus Schäfer AuthorDate: Tue Nov 21 08:11:20 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 21 08:11:20 2017 +0100 Add device-mapper requirement for dracut-kiwi-live commit fc0dfeae89bcc52a8ccacbb159e81cd332e2f3b5 Author: Marcus Schäfer AuthorDate: Mon Nov 20 15:54:04 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 20 15:54:04 2017 +0100 Bump version: 9.11.18 → 9.11.19 commit d3e39b8397d793a2a1eef494b341a61baf849de5 Author: Marcus Schäfer AuthorDate: Mon Nov 20 11:57:11 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 20 11:57:11 2017 +0100 Update gfxboot.cfg for iso images Don't move down one menu entry the first time a F-key is used This Fixes bsc#1068790 commit e107c2381e1687090b2d9b2ca9887e3badd9c467 Author: David Cassany AuthorDate: Fri Nov 17 15:30:26 2017 +0100 Commit: David Cassany CommitDate: Fri Nov 17 15:30:26 2017 +0100 Adding quotes to ensure '%_dbpath' is treated as string commit de2b32cbed92f09cb96f4768d8ee7f06abd5b91b Author: David Cassany AuthorDate: Fri Nov 17 12:27:05 2017 +0100 Commit: David Cassany CommitDate: Fri Nov 17 12:48:52 2017 +0100 Add max size post build command This commit includes a post build constraint validation into the Result class. With this commit any file included to the result tuple is verified not to exceed the maximum size configured into the runtime configuration file config.yml. Fixes #468 commit 81ee0aa4530ee6d60448ca6b55ad585cbacb1876 Author: Marcus Schäfer AuthorDate: Fri Nov 17 11:01:05 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 17 11:01:05 2017 +0100 Fixed ec2 integration test requirements for unneeded crash package broken commit 746d673fec1c725231784cd282d5205ffac358da Author: Marcus Schäfer AuthorDate: Fri Nov 17 08:17:52 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 17 08:17:52 2017 +0100 Fixed ec2 integration test nothing provides pam-modules commit 8af3eb3a43bdd9d03a353e085d09c1f75bef578a Author: David Cassany AuthorDate: Thu Nov 16 14:19:24 2017 +0100 Commit: David Cassany CommitDate: Thu Nov 16 14:19:24 2017 +0100 Removes the hardcoded path of the rpm database With this commit the rpmdb path is evaluated from the %_dbpath macro instead of being hardcoded. Fixes #537 commit aad2380267640d99ba3f7403b9e01e782ed702b2 Author: Marcus Schäfer AuthorDate: Thu Nov 16 09:56:10 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 16 09:56:10 2017 +0100 Bump version: 9.11.17 → 9.11.18 commit 6f39ddde913c7b5a5412e91e8bcfa1ddbbd85ffa Author: Marcus Schäfer AuthorDate: Wed Nov 15 12:41:27 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 15 12:41:27 2017 +0100 Added runtime check for dracut-kiwi-oem-repart OEM images if configured to use dracut as initrd system requires the KIWI provided dracut-kiwi-oem-repart module commit d7af683c661b2a6b0c32e2947a1426bfe0d8f6ee Author: Marcus Schäfer AuthorDate: Wed Nov 15 12:02:01 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 15 12:02:01 2017 +0100 Fixup py vs. pytest-cov version incompatibility commit 065b277ff15ce406aa2ab93c2c1debab067056ef Author: Marcus Schäfer AuthorDate: Tue Sep 19 08:12:24 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Nov 15 11:23:01 2017 +0100 Added dracut kiwi oem module and library A new dracut module kiwi-repart used to be the successor of the custom kiwi oemboot code to repartition the disk has been added. Along with the module a dracut library kiwi-lib will also be delivered. commit e0348ae1d77b964456a5c5d77243dc8d38646933 Author: Marcus Schäfer AuthorDate: Wed Nov 8 10:16:00 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 8 10:16:00 2017 +0100 Bump version: 9.11.16 → 9.11.17 commit fda40731125849d8fa463a762ebcfb7d9aeed220 Author: Marcus Schäfer AuthorDate: Wed Nov 8 10:12:45 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 8 10:12:45 2017 +0100 Delete atftp from SLE15 boot descriptions atftp will not be part of SLE15 per fate#323633. This Fixes #543 commit 0368311f695299fa86af2e57b695753eac0a25fe Author: Marcus Schäfer AuthorDate: Tue Nov 7 17:31:11 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 7 17:39:15 2017 +0100 Fixed blocksize setup in losetup The -L option was used to set the blocksize value for losetup However there is an option name clash between suse util-linux and upstream which now leads to the problem that option -L has changed its meaning and actually means --nooverlap which completely breaks the call in kiwi. This patch changes the call to use the long form --logical-blocksize. This Fixes bsc#1066873 commit d75d7cf7fdce49235c43bfe835e9319829b52b13 Author: David Cassany AuthorDate: Tue Nov 7 17:18:30 2017 +0100 Commit: David Cassany CommitDate: Tue Nov 7 17:18:30 2017 +0100 Code cleaning and enhancing variables names commit 63faa2a2ff984afbe70f42d74ba6fbcd2ac0d71b Author: David Cassany AuthorDate: Tue Nov 7 16:53:28 2017 +0100 Commit: David Cassany CommitDate: Tue Nov 7 16:58:22 2017 +0100 Use usr/lib/rpm if present instead of var/lib/rpm With this commit OEM recovery tries to backup usr/lib/rpm if present, if the directory is not present it tries to backup the old default configuration, var/lib/rpm. commit 38a47cc579bb02e7f1b5483490253e342d30b48c Author: David Cassany AuthorDate: Mon Nov 6 16:31:23 2017 +0100 Commit: David Cassany CommitDate: Mon Nov 6 17:10:44 2017 +0100 Remove hardcoded any /var/lib/rpm path This commit changes any /var/lib/rpm reference to the call 'rpm -E %_dbpath' which returns the path of the rpmdb which has been recently updated to a different location in recent rpm versions. Now the rpmdb path is determined dynamically. Fixes #537 commit 054a7e072b016fc211a9ef217ad7ff60840de7a3 Author: Marcus Schäfer AuthorDate: Mon Nov 6 16:32:28 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 6 16:32:28 2017 +0100 Extend checkmedia runtime check In addition to the correct architecture the check also includes the lookup of the required tagmedia tool to be present on the building host. This Fixes #538 commit dd44c4a151f164813f0388560f5b34a21f14bd5d Author: David Cassany AuthorDate: Fri Nov 3 18:15:02 2017 +0100 Commit: David Cassany CommitDate: Fri Nov 3 18:15:02 2017 +0100 Adding a s390 oem test image commit c2941554d34aee214264711a86dad0f7071676c5 Author: David Cassany AuthorDate: Fri Nov 3 17:48:56 2017 +0100 Commit: David Cassany CommitDate: Fri Nov 3 17:48:56 2017 +0100 kiwi-hooks should be packed in tar Remote OBS source service is no capable of packaing a folder into a tar. commit fb4eec6bed47649d3dd11477906f4328415eabdc Author: David Cassany AuthorDate: Fri Nov 3 17:10:39 2017 +0100 Commit: David Cassany CommitDate: Fri Nov 3 17:10:39 2017 +0100 Include arm build test commit c1a16b9329860d8b4ddeb4b38ccaf22bf8900a42 Author: David Cassany Viladomat AuthorDate: Fri Nov 3 14:54:29 2017 +0100 Commit: GitHub CommitDate: Fri Nov 3 14:54:29 2017 +0100 Adding test image descriptions This commit adds the image descriptions used to test KIWI within the Open Build Service. commit 4f2dc424a7615d1dc76385dd78a68700dad1cab5 Author: Marcus Schäfer AuthorDate: Thu Nov 2 12:18:18 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 2 12:34:14 2017 +0100 Add support for apt repository priorities Apt handles repository priorities in a preferences file per repository and calls that pin-priorities. The implementation here sets the configured priority for all packages of the given repository commit ee17fd06fb2708e0262e38321eca8c6130b49a6a Author: Jellyfrog AuthorDate: Tue Oct 31 16:37:27 2017 +0100 Commit: Jellyfrog CommitDate: Tue Oct 31 16:37:27 2017 +0100 Add missing hooks to the other architectures commit cc58a5ca0a9c1a1342dcea7443c74f4abc435665 Author: Jellyfrog AuthorDate: Tue Oct 31 16:37:09 2017 +0100 Commit: Jellyfrog CommitDate: Tue Oct 31 16:37:09 2017 +0100 Add pre/post mount hook for oem commit 713b02d37dae5bebe1e93bdfffd00fa857753f64 Author: Jellyfrog AuthorDate: Tue Oct 31 13:24:15 2017 +0100 Commit: Jellyfrog CommitDate: Tue Oct 31 13:24:15 2017 +0100 Clarify how strip works commit 48e255038b943351979e169ba397920cbf0059d9 Author: Jellyfrog AuthorDate: Mon Oct 30 11:12:04 2017 +0100 Commit: Jellyfrog CommitDate: Mon Oct 30 11:12:04 2017 +0100 Add more OEM hooks commit 8e6bf0ae0a7f1c2511428e564b8d59198fd7d517 Author: Ryan Desfosses AuthorDate: Wed Oct 25 22:56:48 2017 -0400 Commit: Ryan Desfosses CommitDate: Wed Oct 25 22:56:48 2017 -0400 updated contributing link commit c3e520d2ab89c644134630b0070a390faba3fe89 Author: Ryan Desfosses AuthorDate: Wed Oct 25 22:03:12 2017 -0400 Commit: Ryan Desfosses CommitDate: Wed Oct 25 22:03:12 2017 -0400 s/42.1/42.3/ commit 6232cd9c7e610fc87a66d390a06dab659e13a30c Author: Marcus Schäfer AuthorDate: Wed Oct 25 16:32:35 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 25 16:32:35 2017 +0200 Bump version: 9.11.15 → 9.11.16 commit dee934b6a392d15271a229503b1c5966190e095f Author: Marcus Schäfer AuthorDate: Wed Oct 25 13:06:44 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 25 13:06:44 2017 +0200 Fixed validation of isohybrid warnings The list of warning messages is evaluated line by line and those not matching the ignore warnings list are treated as errors. However if an empty line exists it did not match the ignore warnings list but is also not an error. This patch makes sure only non empty warning information has an effect commit 583b9f970d531a6693b13c063cf1a63691ec967d Author: Marcus Schäfer AuthorDate: Wed Oct 25 12:35:16 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 25 12:35:16 2017 +0200 Bump version: 9.11.14 → 9.11.15 commit 1a7a5e1fcfcdb6b05eb7405d651fc6613c382c42 Author: Marcus Schäfer AuthorDate: Wed Oct 25 12:16:56 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 25 12:16:56 2017 +0200 Do not require cracklib-dict-full in boot images commit 6eb18af6d7db1d5c287c1f10442b9a05d281a69e Author: Marcus Schäfer AuthorDate: Tue Oct 24 18:12:21 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 24 18:12:21 2017 +0200 Bump version: 9.11.13 → 9.11.14 commit 892bb6fa4491881bc2b2c7dcc892ce8b88520031 Author: Marcus Schäfer AuthorDate: Tue Oct 24 18:12:07 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 24 18:12:07 2017 +0200 Cleanup SLE12 boot image descriptions commit 78aeb7859dbba4045097add0a680e44a61f499fc Author: Marcus Schäfer AuthorDate: Tue Oct 24 17:39:13 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 24 17:39:13 2017 +0200 Bump version: 9.11.12 → 9.11.13 commit 10b68a070699863c05e1629a754bdfbf7699b056 Author: Marcus Schäfer AuthorDate: Tue Oct 24 12:34:59 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 24 12:34:59 2017 +0200 Cleanup SLE boot image descriptions Don't use packages which does not exist on SLE, Fixes #523 commit 2ecb282f13b57b2690e957ebbb4e4d51c9da62d2 Author: David Cassany AuthorDate: Mon Oct 23 14:39:36 2017 +0200 Commit: David Cassany CommitDate: Mon Oct 23 14:39:36 2017 +0200 Improve coding style to make flake8 happy This commit includes the exact Exception class that the 'except' statement catches. According to the new flake8 3.5.0 version it should be explicit rather than implicit. commit a94b7af96255fda7f811cfa08127f1787088da66 Author: David Cassany AuthorDate: Mon Oct 23 14:18:51 2017 +0200 Commit: David Cassany CommitDate: Mon Oct 23 14:18:51 2017 +0200 Add OCI reference in skopeo copy call and umoci config call Skopeo, since v1.24, does no longer assume 'latest' as the default tag/reference and requires explicit tag or reference in skopeo call. In KIWI the default was only used to import the base rootfs, with this commit the imported container is tagged as 'base_layer'. The current patch works for all skopeo versions. commit 76312160e286cf9c32003f5d8f79fb4ab325aab6 Author: Jellyfrog AuthorDate: Thu Oct 19 12:56:06 2017 +0200 Commit: GitHub CommitDate: Thu Oct 19 12:56:06 2017 +0200 Update hooks documentation commit 67baa3a4d86bc69da77fcfefd41e71b94a8beb2f Author: Marcus Schäfer AuthorDate: Thu Oct 19 12:12:08 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 19 12:12:08 2017 +0200 Bump version: 9.11.11 → 9.11.12 commit 44e819b73180769a262da118ca7896675b8dd776 Author: Jellyfrog AuthorDate: Thu Oct 19 10:54:07 2017 +0200 Commit: GitHub CommitDate: Thu Oct 19 10:54:07 2017 +0200 Add more hooks for oemboot This follows netboot behavior commit 1499df3ea0f57ebf5a547536e65dbb06e6c9d98d Author: David Cassany AuthorDate: Wed Oct 18 15:54:14 2017 +0200 Commit: David Cassany CommitDate: Wed Oct 18 16:46:53 2017 +0200 Fix vmdk descriptor file This commit fixes the descriptor file of the vmdk images. Before this commit the descriptior file was appended at the end of the image instead of overwritting the current one at the very beginning. Fixes bsc#1050665 commit 8cf4f62b5eecbf0cc9adb668c51abb40957dfa4a Author: Marcus Schäfer AuthorDate: Wed Oct 18 11:16:09 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 18 11:16:09 2017 +0200 Bump version: 9.11.10 → 9.11.11 commit ee0f0e00fcd5b8c83aef179e829013a558941ef6 Author: Marcus Schäfer AuthorDate: Wed Oct 18 10:40:51 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 18 10:47:50 2017 +0200 Follow up fix for isohybrid error handling Allow to handle multiple messages from isohybrid as warnings. Only if the list of messages still contains information after all non error conditions had been checked out, an exception is thrown commit 68d7b1ef934518e49341264bbcc8cdbcc98101dd Author: Marcus Schäfer AuthorDate: Mon Oct 16 12:10:22 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 16 12:10:22 2017 +0200 Bump version: 9.11.9 → 9.11.10 commit 2a1b1e516d67312da79115195c65424001083edc Author: Marcus Schäfer AuthorDate: Mon Oct 16 12:06:06 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 16 12:06:06 2017 +0200 Cleanup boot descriptions The still existing kiwi boot descriptions contained wrong information about no longer existing packages and many other obsolete information. commit 3afffbbd1f75eca8f5632e52994dd6786b361837 Author: Marcus Schäfer AuthorDate: Fri Oct 13 15:50:32 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 13 15:50:32 2017 +0200 Bump version: 9.11.8 → 9.11.9 commit 9500232ba1e81523c9bcc763eabf8c6025407609 Author: Marcus Schäfer AuthorDate: Fri Oct 13 15:35:54 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 13 15:35:54 2017 +0200 Prefer image packages section for bootincludes If a package is marked bootinclude prefer section in the target XML as primary target and only if no such section exists put the package in the section commit cc80d98a04c3f17383d8366e63badc444ea381d4 Author: Marcus Schäfer AuthorDate: Fri Oct 13 09:04:31 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 13 09:04:31 2017 +0200 Keep NVMe drivers in the initrd Support systems with the root filesystem on a NVMe device commit 8376e97fa86d45315def36842a1bfd0f572c5650 Author: Marcus Schäfer AuthorDate: Fri Sep 29 15:04:59 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 29 15:04:59 2017 +0200 Bump version: 9.11.7 → 9.11.8 commit ed2844d4f0b5bf03a65cd2058263d21b423b6453 Author: Dominique Leuenberger AuthorDate: Fri Sep 29 10:24:05 2017 +0200 Commit: Dominique Leuenberger CommitDate: Fri Sep 29 10:24:05 2017 +0200 Changed permissions of /srv/tftpboot to be readable (bsc#940608) commit 84f47d7c5165141bc5b04f0418c3f9db35cf05a9 Author: Marcus Schäfer AuthorDate: Thu Sep 28 15:41:24 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 28 15:41:24 2017 +0200 Bump version: 9.11.6 → 9.11.7 commit c5846592ff44ac63ffbf4dab896872df6fc1166c Author: Marcus Schäfer AuthorDate: Thu Sep 28 14:41:16 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 28 14:41:16 2017 +0200 Also handle multiple error conditions commit 511c87ad0fb4a2274fb11b171b65a25cad1250f8 Author: Marcus Schäfer AuthorDate: Thu Sep 28 11:50:43 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 28 11:50:43 2017 +0200 Allow to ignore certain isohybrid warnings kiwi treates warning from isohybrid as fatal errors becuase in most cases they are fatal. However some of them are kind of historical and should be ignored like the one described here: http://www.syslinux.org/archives/2015-March/023306.html commit e8b8e548103694ceef41b6d2faba2c12ee48cbfb Author: Marcus Schäfer AuthorDate: Wed Sep 27 14:52:07 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 27 14:52:07 2017 +0200 Bump version: 9.11.5 → 9.11.6 commit 8acdd8cb44403eaaa132e6be10f22a66cb48a43e Author: Marcus Schäfer AuthorDate: Wed Sep 27 12:06:04 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 27 12:06:04 2017 +0200 Make sure xz options are used with pxe tarball The tar command used in the pxe builder did not utilize threading and/or the xz options provided by an optional kiwi config file. This Fixes #507 commit 9d1e289f1c4d90427a342a7b085bebc6cd6cc5fd Author: Marcus Schäfer AuthorDate: Wed Sep 27 11:18:29 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 27 11:18:29 2017 +0200 Move depmod into baseUpdateModuleDependencies Kernel module dependencies should be resolved after kiwi has called all the stripping functions and not as part of the baseCreateCommonKernelFile which runs before. This Fixes #508 commit eab9dbabcc02e8078f8ee3cf278013d944f418cf Author: Marcus Schäfer AuthorDate: Tue Sep 26 16:21:49 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 26 16:21:49 2017 +0200 Fixed order of volume mount list re-order mount_list by mountpoint hierarchy. This is needed because the handling of the fullsize volume and all other volumes is outside of the canonical order. If the fullsize volume forms a nested structure together with another volume the volume mount list must be re-ordered to avoid mounting the volumes in the wrong order commit 6196e65393a012991ae49fb6545b2656d5b9b6cb Author: Jellyfrog AuthorDate: Mon Sep 25 16:53:27 2017 +0200 Commit: GitHub CommitDate: Mon Sep 25 16:53:27 2017 +0200 Update issue template commit 1b0e3605d37e03fd45010ce48e94550f659dc1c5 Author: Marcus Schäfer AuthorDate: Fri Sep 22 15:55:28 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 22 15:55:28 2017 +0200 Bump version: 9.11.4 → 9.11.5 commit 7250655ac2b3f626f488eb1e51129d2adc0bb78e Author: Marcus Schäfer AuthorDate: Fri Sep 22 15:53:43 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 22 15:53:43 2017 +0200 Rebuild schema documentation commit 7c3daf4c80d78ea823047226f1ed8e88e7572139 Author: Marcus Schäfer AuthorDate: Thu Sep 21 12:34:55 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 21 12:34:55 2017 +0200 Show results in a dialog commit c71675cb3f76493c99f938b82f8254fd89b2f367 Author: Marcus Schäfer AuthorDate: Wed Sep 20 15:18:09 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 20 15:18:09 2017 +0200 Improve display of runMediaCheck results The splash screen should be switched off in order to let the user see the mediacheck results as well as a delay timeout before the boot continues or stops is useful commit f6f316cc94819639abef16969444177334bf8ed2 Author: Marcus Schäfer AuthorDate: Wed Sep 20 15:15:45 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 20 15:15:45 2017 +0200 Call plymouth default theme setup in build command Make sure plymouth-set-default-theme is called as part of the system build command and not only as part of the system prepare command commit 383c0fa4b8abbdb4716b62065fa2b428c563b1c2 Author: Marcus Schäfer AuthorDate: Tue Sep 19 16:09:18 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 19 16:09:18 2017 +0200 Fixed package requires for dracut-kiwi-live On Fedora/RHEL cdrkit is only a source package building other packages. The package dracut-kiwi-live really needs is genisoimage commit 9beb38629a0c3fba8d4a99eed6fa489b9da39337 Author: Marcus Schäfer AuthorDate: Mon Sep 18 14:35:23 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 18 14:35:23 2017 +0200 Fix trailing pipe character in .packages file In addition make sure the field layout is consistent across the .packages files no matter which package manager was used to create the information. This Fixes #501 commit f28f4040a82e77586e8c7845264c2935409b67fc Author: Marcus Schäfer AuthorDate: Fri Sep 15 10:02:49 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 15 10:02:49 2017 +0200 Bump version: 9.11.3 → 9.11.4 commit bd081da3145d0e392d68e3ae5615e557c183d8b1 Author: Marcus Schäfer AuthorDate: Fri Sep 15 10:00:36 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 15 10:00:36 2017 +0200 Update documentation Link to the obs overview page to show build test results commit aeb3ccfa0688b17c06758bfa864f67fbc954c48b Author: Marcus Schäfer AuthorDate: Fri Sep 15 09:56:27 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 15 09:56:27 2017 +0200 Added Fedora integration test build to obs status commit 04f23ee6cd1f2d3be11331891771d4dece3a0939 Author: David Cassany AuthorDate: Fri Sep 15 09:00:29 2017 +0200 Commit: David Cassany CommitDate: Fri Sep 15 09:05:12 2017 +0200 Limit the characters set for volid attribute This commit fixes #493 commit 05fb854b45725e800c7d5faf14d395313371efda Author: Marcus Schäfer AuthorDate: Thu Sep 14 19:35:08 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 14 19:35:08 2017 +0200 Revert "Fixed package requires" This reverts commit a8d50a593911725965e09b0e8c2f3b9bc742202b. commit a8d50a593911725965e09b0e8c2f3b9bc742202b Author: Marcus Schäfer AuthorDate: Thu Sep 14 18:28:06 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 14 18:28:06 2017 +0200 Fixed package requires On Fedora xattr is provided by python[3]-pyxattr commit 5c6d3cca129adab4412431ac4d8ba23438707609 Author: Marcus Schäfer AuthorDate: Thu Sep 14 18:10:52 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 14 18:10:52 2017 +0200 kiwi-boot-requires only required for suse(obs) commit cf85ad66a6114ab4f49872518bd74dfa3baad27f Author: Marcus Schäfer AuthorDate: Thu Sep 14 10:27:20 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 14 10:27:20 2017 +0200 Update project intro page commit 28fe4e3ad68aa26b67d13efb361eb72f6abb3950 Author: Marcus Schäfer AuthorDate: Thu Sep 14 10:16:40 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 14 10:16:40 2017 +0200 Update project intro layout commit ec671a712f208fc41cc8b5f4327ab3a3bae7b1e5 Author: Marcus Schäfer AuthorDate: Thu Sep 14 10:14:24 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 14 10:14:24 2017 +0200 Update project intro page commit 09b5a001a054f871916c0a92a8c9311e61451892 Author: Marcus Schäfer AuthorDate: Wed Sep 13 09:27:51 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 13 09:27:51 2017 +0200 Bump version: 9.11.2 → 9.11.3 commit 6e8ef1f0224bb542543f70bec279f066a74ac0bf Author: Marcus Schäfer AuthorDate: Tue Sep 12 15:30:49 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 12 15:30:49 2017 +0200 Added disk format="vhdx" support Support dynamic VHDX (gen2) image format for Hyper-V. This Fixes #490 commit c1668bcfc59263b0577e5fea87d73b87b067d7cb Author: Marcus Schäfer AuthorDate: Tue Sep 12 12:24:31 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 12 12:39:49 2017 +0200 Added additional required attr schematron rule The new rule allows to check for required attributes for a specific image type and is used for the filesystem attribute which is required for the image type oem, vmx and pxe. This Fixes #476 commit f83c3f74ac92a9a61ed16a95c92c34be5b789248 Author: Marcus Schäfer AuthorDate: Mon Sep 11 17:03:55 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 11 17:03:55 2017 +0200 Bump version: 9.11.1 → 9.11.2 commit c44ffc70b51ef6fb6677da481cc11370202d8b3f Author: Marcus Schäfer AuthorDate: Mon Sep 11 17:03:29 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 11 17:03:29 2017 +0200 Rebuild online schema documentation commit 2bdb26b5c675851570088a1d8437607cd0cdb6f2 Author: Marcus Schäfer AuthorDate: Mon Sep 11 16:51:28 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 11 16:51:28 2017 +0200 Bump version: 9.11.0 → 9.11.1 commit b97ba1d96cea676d162b9fd96db3a7791828a553 Author: Marcus Schäfer AuthorDate: Mon Sep 11 16:31:24 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 11 16:31:24 2017 +0200 Fixed kernelList function The kernelList function searches for the installed kernels and applies the corresponding initrd name. The information the method provides is used in case of a custom initrd which should be used instead of the result of dracut. When requesting the use of the kiwi firsboot initrd also in the system via the element, the information from the list is used to correctly link the kiwi initrd named initrd.vmx to the expected name of the system as dracut would create it. The creation of the list was broken which lead to an empty list and the after effect that the system was not able to reboot. This Fixes #483 commit 37682e8308bf88a869bc4195bb0e4acb5faa353a Author: Marcus Schäfer AuthorDate: Mon Sep 11 16:22:09 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 11 16:28:01 2017 +0200 Update oemboot/rhel-07.0 due to isolinux changes With the move of the isolinux setup operation into the python code and the deletion of the old code from the images.sh scripts it's required to keep syslinux in the boot image otherwise the builder can't find it when explicitly deleted before the isolinux setup commit 240f03b52c512682c374622e85ab45100e6bb77c Author: Marcus Schäfer AuthorDate: Mon Sep 11 11:01:06 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 11 11:01:06 2017 +0200 Update device node names for devmapper nodes Partition devices created by the device mapper could use the _part or the -part naming schema. This patch allows for both variants and Fixes #480 commit d0552b6559d6482197e806eb887226e6d7a736eb Author: Marcus Schäfer AuthorDate: Mon Sep 11 10:29:59 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 11 10:29:59 2017 +0200 Added e2fsprogs to s390/netboot During bootup of a diskful netclient when it comes to e2 filesystem operations the tools were missing. Fixes #479 commit 21203bb4ef047d85a8408d74ac56fccafa4967a5 Author: Marcus Schäfer AuthorDate: Fri Sep 8 12:05:45 2017 +0200 Commit: Marcus Schäfer CommitDate: Sat Sep 9 19:48:47 2017 +0200 Add mediacheck handler for live iso This fixes bsc#1049304 commit 053e6940826849a81651e7d9defab190da10898f Author: David Cassany AuthorDate: Fri Sep 8 16:48:22 2017 +0200 Commit: David Cassany CommitDate: Fri Sep 8 16:48:22 2017 +0200 Rename source label This commit renames the source label to a more explicit name. This commit also relates to bsc#1055542 and fixes #473 commit c93d3d9947a4bcd368d046b3766ba0a7ae01a6d8 Author: Marcus Schäfer AuthorDate: Thu Sep 7 16:53:19 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 7 16:53:19 2017 +0200 Added live iso integration test build to obs status commit 71313a006667ef0cbbd9425a12384cb9e62291ef Author: Marcus Schäfer AuthorDate: Thu Sep 7 16:27:25 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 7 16:27:25 2017 +0200 Bump version: 9.10.6 → 9.11.0 commit 67255da245fd2c1d2a3daede0cd2dfd6321db3ea Author: Marcus Schäfer AuthorDate: Thu Sep 7 16:01:58 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 7 16:01:58 2017 +0200 Delete atftp from boot descriptions In SLE15 / Leap15 atftp has been dropped. This Fixes bsc#1056951 commit 0d760de2a2ab65e5178d682e3530e604a06ef6e2 Author: Marcus Schäfer AuthorDate: Thu Sep 7 15:28:34 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 7 15:36:12 2017 +0200 Deleted Leap 42.1 JeOS Leap 42.3 has been released commit 01df7fa0fe821dfa2e399b2004185fa618dbb3a6 Author: Marcus Schäfer AuthorDate: Thu Sep 7 14:58:29 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 7 15:36:12 2017 +0200 Fixed list of gfxboot modules Bad bug, missing comma caused the list to be interpreted differently by python which screwed up some list items commit bd156ad8b10faddd055dfdd89028f8dfcc498c29 Author: Marcus Schäfer AuthorDate: Thu Sep 7 14:40:31 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 7 14:40:31 2017 +0200 Delete obsolete suseGFXBoot kiwi boot code The code has been moved into the python source at bootloader/config/isolinux.py commit 6379846a2211332e0dc5a10acb3da425826fbba5 Author: Marcus Schäfer AuthorDate: Wed Sep 6 18:07:22 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 18:07:22 2017 +0200 Delete vmxboot descriptions vmx boot is now fully integrated with dracut commit 77fa8de510cfff52094f44e9445c3f2ab52c3b43 Author: Marcus Schäfer AuthorDate: Wed Sep 6 18:01:37 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 18:01:37 2017 +0200 Make get_initrd_system a state method Make sure the default initrd_system is set to dracut for the vmx image type and to kiwi if no initrd_system is specified. This allows to simplify other code parts as we can trust there is a value set commit 01e6842db9f9ce237143cb34339b8f0b09b142c6 Author: Marcus Schäfer AuthorDate: Wed Sep 6 17:12:05 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 17:12:05 2017 +0200 Update schematron rules for boot and initrd_system The boot and initrd_system attributes are no longer used by the vmx image type and are therefore not allowed anymore. commit f7f8ee0057138b8ad73f0d5145a47c05df68d6f7 Author: Marcus Schäfer AuthorDate: Wed Sep 6 11:09:59 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 17:08:10 2017 +0200 Added runtime checks for overlay disk images Checking if the dracut-kiwi-overlay package will be installed as part of the build and also for the supported EFI setup since the EFI secure boot setup would try to perform changes on the filesystem which is a readonly squashfs, this is not supported commit 50ab40c8e173241a52bc2a27579f6dc31aab5092 Author: Marcus Schäfer AuthorDate: Tue Sep 5 16:35:20 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 17:08:10 2017 +0200 Support overlay disk images via dracut Using the kiwi-overlay module to boot up systems configured with the overlayroot="true" attribute in the system image XML configuration. Fixes #65 commit b411934194184dcf742d86fe2ce3d35a5dd46d15 Author: Marcus Schäfer AuthorDate: Tue Sep 5 16:33:24 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 17:08:05 2017 +0200 Added kiwi-overlay dracut module and package Package dracut-kiwi-overlay providing kiwi-overlay dracut module commit 447ef92536c54d949ef5eae0106800cf62557893 Author: Marcus Schäfer AuthorDate: Sun Sep 3 20:53:38 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 09:53:19 2017 +0200 Delete isoboot descriptions Live ISO boot is now fully integrated with dracut commit b0074c21326aeebdfe460107251ea083648e3904 Author: Marcus Schäfer AuthorDate: Sun Sep 3 15:10:36 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 09:53:18 2017 +0200 Added runtime check for dracut module on live iso Live ISO images uses a dracut initrd to boot and requires the KIWI provided kiwi-live dracut module to be installed at the time dracut is called. Thus this runtime check examines if the required package is part of the package list in the image description commit f939de53bea57e9d3b74c1da3a7b73901176aa58 Author: Marcus Schäfer AuthorDate: Fri Aug 25 17:15:12 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 09:53:18 2017 +0200 Added kiwi-live dracut module and package Package dracut-kiwi-live providing kiwi-live dracut module commit cc2790b5030c037a66149e073a3921f131e941a5 Author: Marcus Schäfer AuthorDate: Wed Aug 23 17:02:13 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 09:53:18 2017 +0200 Update schematron rule for boot attribute The boot attribute is no longer used by the iso image type and is therefore not allowed anymore commit 7fa7688d0c798af2bdc21cd80d2b4569dc00f644 Author: Marcus Schäfer AuthorDate: Wed Aug 23 16:32:16 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 09:53:18 2017 +0200 Update allowed values for iso image attribute With the move to dracut only the options implemented for the kiwi-live dracut module are available commit e82c5e18c6bf4428a07f3b45cecb65f4f89ccd0f Author: Marcus Schäfer AuthorDate: Tue Aug 22 18:55:46 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 6 09:53:15 2017 +0200 Move to dracut for live ISO images Instead of the kiwi isoboot layout the live layout has been changed to follow the rules of the live system support offered by dracut. The initrd used to boot up the system is now a dracut generated initrd and can be customized via the 'flags' attribute in the kiwi XML description. In order to meet the kiwi live requirements a custom dracut module called kiwi-live is provided along with the changes in kiwi. This Fixes #470 commit fdc33a7ede9ee480784cb924b7ee1daa8d5308c9 Author: Marcus Schäfer AuthorDate: Tue Sep 5 21:42:02 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 5 22:00:32 2017 +0200 Fix isohybrid call isohybrid errors printed on stderr were not treated as fatal but should be treated as such. In addition isohybrid should distinguish for efi setup according to the efi setup of the image itself commit ade6d7f49aa284c49870e0d509754d53dfe0d2a4 Author: David Cassany AuthorDate: Tue Sep 5 16:55:39 2017 +0200 Commit: David Cassany CommitDate: Tue Sep 5 16:55:39 2017 +0200 Refactor _get_source and _get_source_label methods commit fea849e7f0592126acceb6f940ba223c61849937 Author: Marcus Schäfer AuthorDate: Mon Sep 4 15:21:59 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 4 15:21:59 2017 +0200 update README Use normal style dash character commit 54399c512e4a70ee515ba8545319288615fb9b3e Author: Marcus Schäfer AuthorDate: Mon Sep 4 15:21:19 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 4 15:21:19 2017 +0200 update README commit 96cb67b558f76da50e10d497166a5da7456831ad Author: David Cassany AuthorDate: Fri Sep 1 11:20:33 2017 +0200 Commit: David Cassany CommitDate: Fri Sep 1 16:03:23 2017 +0200 Include the source label in container images This commit fixes bsc#1055542, it includes the DISTURL parameter as a label into the container metadata when the build happens inside the buildservice. The new label included is named: * org.opencontainers.image.source in line with the current OCI annotations schema. commit becc012db4293796fab92252755a4bac721d3f1f Author: Marcus Schäfer AuthorDate: Tue Aug 22 10:03:25 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Aug 22 10:03:25 2017 +0200 Bump version: 9.10.5 → 9.10.6 commit 58d9c8b88f84ea7719bfde10598668be79868648 Author: Marcus Schäfer AuthorDate: Mon Aug 21 10:56:05 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 21 10:56:05 2017 +0200 Added boot descriptions for SLE15 on ppc commit 2969d470860dfa4448ff1b755db12d860d9911be Author: Marcus Schäfer AuthorDate: Mon Aug 21 10:55:46 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 21 10:55:46 2017 +0200 Added boot descriptions for SLE15 on s390 commit cfd5467bf80de7c7f002193588bd915bd2bd070f Author: Marcus Schäfer AuthorDate: Mon Aug 21 10:23:25 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 21 10:23:25 2017 +0200 Bump version: 9.10.4 → 9.10.5 commit e59270c09b475b99510a7ed0980b916c553dc9b0 Author: Marcus Schäfer AuthorDate: Fri Aug 11 15:46:40 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Aug 11 15:46:40 2017 +0200 Added handling of formatoptions attribute Custom disk format options passed in the formatoptions attribute were not handled. In addition options with a value passed to qemu were handled in the wrong way. This commit addresses both problems and Fixes #463 commit a5abd2c15a204002e24f1edfe651c5ce7b24b10e Author: Ludwig Nussel AuthorDate: Fri Aug 11 15:15:25 2017 +0200 Commit: Ludwig Nussel CommitDate: Fri Aug 11 15:15:41 2017 +0200 s/sles/openSUSE/ commit 1b6240218fa31af35ec2ce6ed2d3a6c86a603552 Author: Ludwig Nussel AuthorDate: Fri Aug 11 15:12:35 2017 +0200 Commit: Ludwig Nussel CommitDate: Fri Aug 11 15:12:35 2017 +0200 copy SLE15 files for Leap 15 commit 285847be3d8798cc4758041013da0a8b4d8de7ce Author: Ludwig Nussel AuthorDate: Fri Aug 11 15:01:16 2017 +0200 Commit: Ludwig Nussel CommitDate: Fri Aug 11 15:01:16 2017 +0200 add Leap 15 macros commit db8f09cbc822d7bdb1e8f743350757d314659bed Author: Ludwig Nussel AuthorDate: Fri Aug 11 15:01:09 2017 +0200 Commit: Ludwig Nussel CommitDate: Fri Aug 11 15:01:09 2017 +0200 leap_version is deprecated. use sle_version+is_openuse instead commit fc72effc2a05c4927e93910d7a1eb5d7788ee473 Author: Marcus Schäfer AuthorDate: Thu Aug 10 17:18:59 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 10 17:18:59 2017 +0200 Added azure integration test build to obs status commit 5caa64e2852e143f9fcea02f48f1175e6f803c65 Author: Marcus Schäfer AuthorDate: Wed Aug 9 23:14:44 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 9 23:14:44 2017 +0200 Bump version: 9.10.3 → 9.10.4 commit 6c29c03a1bf7104ce4d08b6a3d179b8a6756963f Author: Marcus Schäfer AuthorDate: Wed Aug 9 22:45:38 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 9 22:45:38 2017 +0200 Fixed resize if all free volume in oemboot/repart commit c3a5178a33388696eedb468f89a061d21605bd32 Author: Marcus Schäfer AuthorDate: Wed Aug 9 13:10:29 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 9 22:36:34 2017 +0200 Fix space calculation for lvm volumes It is required to take the other configured volumes into account in order to solve the problem of nested volumes. The size of e.g the root volume must be reduced by the size other volumes inside of the root volume needs. This is especially required if the root volume is not the fullsize volume commit 6e543b537926396b0b33fdb74abffa0f606fcb6f Author: Marcus Schäfer AuthorDate: Tue Aug 8 17:20:34 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Aug 8 17:20:34 2017 +0200 Fixed setup.py requirements record PyYAML is required by KIWI commit 513243c159b9324eb098e545a2c10eed3a53b03a Author: Marcus Schäfer AuthorDate: Fri Aug 4 10:05:43 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Aug 4 10:05:43 2017 +0200 Add description of Overlay Files to Terminology commit 5553e6cf6fa585677d9bec2a87f4cc22e20338e4 Author: Marcus Schäfer AuthorDate: Thu Aug 3 11:00:57 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 3 11:00:57 2017 +0200 Bump version: 9.10.2 → 9.10.3 commit 5c78697d33462175be3b89f4628fb8935a083965 Author: David Cassany AuthorDate: Wed Aug 2 15:19:02 2017 +0200 Commit: David Cassany CommitDate: Wed Aug 2 17:30:35 2017 +0200 Export *.verified also for images based on apt-get This commit includes support in system/setup.py to run a package verification also for images based in apt-get package-manger Related to #457 commit 4777431c93f55f0bbfa810045d8f8c87ed5e23ec Author: David Cassany AuthorDate: Wed Aug 2 15:06:19 2017 +0200 Commit: David Cassany CommitDate: Wed Aug 2 15:06:19 2017 +0200 Include .packages file for apt-get based images This commit renames export_rpm_packages_list method to export_packages_list and it includes support for listing debian packages if apt-get package manager is used. Fixes #457 commit 747206b2bf7b0050c4fef7e4cce2248d4638e8de Author: Marcus Schäfer AuthorDate: Wed Aug 2 11:57:21 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 2 11:57:21 2017 +0200 Fix calculation of needed disk space for oem types The calculation did not include the minimum volume requirements if a volume setup exists commit 40b99736117588a512a75a4a73adad1cc3d402c7 Author: Marcus Schäfer AuthorDate: Tue Aug 1 15:33:42 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Aug 1 15:33:42 2017 +0200 Update expected compatible major version every version of umoci/skopeo <= major v1.x.x is expected to work with the implementation used in kiwi commit 2e0bb07665188131171733495de23246574771b9 Author: Marcus Schäfer AuthorDate: Tue Aug 1 10:24:17 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Aug 1 10:24:17 2017 +0200 Extend scope of check_docker_tool_chain_installed The runtime check only checks for the presence of the docker tools umoci and skopeo but as we are expecting incompatible api changes in the next major version release the check has been extended to look at the major versions of the installed tools as well. Fixes #454 commit 170bb9c2fa37395fe11b02b85c2afe46282a1a66 Author: Marcus Schäfer AuthorDate: Fri Jul 28 14:07:21 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 28 14:07:21 2017 +0200 Fixup schema version in chapter topic commit 922774714a374647e6dc72b33ec1692c674f793a Author: Marcus Schäfer AuthorDate: Fri Jul 28 13:53:59 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 28 13:53:59 2017 +0200 Bump version: 9.10.1 → 9.10.2 commit e17684ee51d002e66d7471e6eecc96128f99523b Author: Marcus Schäfer AuthorDate: Thu Jul 27 17:19:32 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 27 17:19:32 2017 +0200 Fixup XSL stylesheet v6.7 Apply templates matching all processing instructions in order to match
text
commit ecea0ee1b8be40ecee73feda0c50f1c4f131b7fc Author: Marcus Schäfer AuthorDate: Thu Jul 27 16:54:08 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 27 16:54:08 2017 +0200 Rebuild schema documentation commit fae3c427287728c5705e3d0169ad79ac66d13d69 Author: David Cassany AuthorDate: Thu Jul 27 15:33:43 2017 +0200 Commit: David Cassany CommitDate: Thu Jul 27 15:44:37 2017 +0200 Remove xml_state.get_build_type_mediacheck method The method was not needed since a direct call to xml_state.build_type.get_mediacheck was already producing an equivalent output (True, False or None), where 'None' can be easily treated in the same way as False. commit 642b514a59c212416fa17b92762f067c8e6938b4 Author: David Cassany AuthorDate: Thu Jul 27 14:09:29 2017 +0200 Commit: David Cassany CommitDate: Thu Jul 27 15:44:37 2017 +0200 Add runtimecheck for mediacheck attribute on non x86 hosts This commit rearranges some method and variable names and includes a new runtimecheck to ensure the mediacheck attribute is not set when building non x86 images. Patch related to bsc#1049304 commit 8d696cd20b16f1256fb8d0498e39ce0b900af3af Author: David Cassany AuthorDate: Wed Jul 26 15:42:41 2017 +0200 Commit: David Cassany CommitDate: Thu Jul 27 15:43:21 2017 +0200 Adding mediacheck menu entry for liveCDs This commit adds the checkiso attribute in type tag, only available for iso image types. Checkiso is boolean that determines the presence of0 a Mediacheck menu entry or not in the bootloader. This patch is related to bsc#1049304 commit 821f20291dc8f9aed2806b37c701397b6ba9acf8 Author: Marcus Schäfer AuthorDate: Thu Jul 27 09:19:22 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 27 14:46:47 2017 +0200 Auto update image descriptions to schema v6.7 commit b0b605f065f8be188119282271ad3e6009e89d88 Author: Marcus Schäfer AuthorDate: Thu Jul 27 09:10:13 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 27 14:46:11 2017 +0200 Update schema to version v6.7 Cleanup of the schema, delete obsolete and unused attributes and sections. Details of the change can be found in the conversion stylesheet convert66to67.xsl commit 3c056aa671018569262c287ebcb81cf8569a15ed Author: Marcus Schäfer AuthorDate: Thu Jul 27 08:58:36 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 27 14:46:11 2017 +0200 Add XSL stylesheet to convert from v6.6 to v6.7 Delete the following obsolete and unhandled attributes and sections * * * * * * * * * * * commit ff764f7dd97174f8dc9e0de647f8660d0194da92 Author: Marcus Schäfer AuthorDate: Tue Jul 25 16:58:29 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 25 16:58:29 2017 +0200 Fixup encoding handling for profile file If an element like displayname or oem-boot-title contains characters outside of the ascii table this causes trouble when kiwi writes out the profile file and the code is called through python2. The reason here is that the default encoding on write() (and other methods) is set to ascii in python2 and when it receives unicode characters outside of the ascii spec a UnicodeEncodeError is thrown. Now all of kiwi is using Unicode which means this does not produce a problem when calling the code through python3 because the default encoding is utf-8 there. This patch introduces a method which allows to change python's default encoding and calls it at the code point where we write the profile because we got unicode and we want to write unicode in any case. This fixes at least one situation for python2-kiwi to allow the use of non ascii characters in the XML setup. If other places will be found the same approach should allow to fix it for python2 commit 0183aca7237de14e7938a4eafb0e2e8b319fae93 Author: Jellyfrog AuthorDate: Tue Jul 25 14:02:21 2017 +0200 Commit: GitHub CommitDate: Tue Jul 25 14:02:21 2017 +0200 Fix RHEL spec check commit 3dfabfa72d71e872de7b6df2e8abd413598b316a Author: Marcus Schäfer AuthorDate: Tue Jul 25 12:16:05 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 25 12:16:05 2017 +0200 Bump version: 9.10.0 → 9.10.1 commit 5fe34c00f84919837f09915ecab9f6a3199ba776 Author: Marcus Schäfer AuthorDate: Tue Jul 25 11:34:01 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 25 11:34:01 2017 +0200 Add LVM overhead for lvm based images LVM itself requires metadata stored in the metadata block kiwi did not take a size value for this data into account commit b22d09d4da39424be71db6f0c7bbfad02106c92e Author: Marcus Schäfer AuthorDate: Tue Jul 25 11:32:28 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 25 11:32:28 2017 +0200 Use dmsetup to cleanup device maps Instead of the broken kpartx -d we use dmsetup remove directly on the maps kiwi has created commit 4190eaf2c73f2499b09b88f7271823bbbf8c6c68 Author: Marcus Schäfer AuthorDate: Mon Jul 24 17:29:51 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 24 17:29:51 2017 +0200 Evaluate file strip before kernel strip Information from the optional section was handled as part of the suseStripInitrd method which is called after suseStripKernel. However if a request to delete a driver file is part of the above mentioned strip section the checks for the driver dependency and also for potential superfluous firmware is not applied. Thus the evaluation of the section happens earlier in the suseStripKernel method. Fixes #442 commit f77154c67c4bdeb1b9e45908c0240ae12dd9ac9b Author: Marcus Schäfer AuthorDate: Mon Jul 24 16:36:19 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 24 16:36:19 2017 +0200 Added ec2 integration test build to obs status commit d13f1cca29c30c8fa995f811797fa35297f5b8c7 Author: Marcus Schäfer AuthorDate: Mon Jul 24 16:30:34 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 24 16:30:34 2017 +0200 Added Xen setup runtime validation Added check_xen_uniquely_setup_as_server_or_guest runtime check to check for a unique dom0 or domU guest setup Fixes #429 commit f2df1ae3c4dcf174c5afbc21a5dd9bc7d1d94d2b Author: Marcus Schäfer AuthorDate: Mon Jul 24 12:33:08 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 24 12:33:08 2017 +0200 Rebuild schema documentation commit 983a74b4f010379c62318343e69636ce4068ccec Author: Marcus Schäfer AuthorDate: Mon Jul 24 12:05:02 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 24 12:05:02 2017 +0200 Make vmdisk optional for the machine setup The guest machine information might not require information about the disk. Issue #429 commit 0f7a6ececcc521f583b2a74f7a034aad9ac05d7c Author: Jellyfrog AuthorDate: Fri Jul 21 14:25:35 2017 +0200 Commit: GitHub CommitDate: Fri Jul 21 14:25:35 2017 +0200 Fix some spelling commit bb07a2122fde2e326f1cd0950aac8d773362a34f Author: Jellyfrog AuthorDate: Fri Jul 21 14:19:03 2017 +0200 Commit: GitHub CommitDate: Fri Jul 21 14:19:03 2017 +0200 Fix some spelling commit 8de60dc7a5a0d39ab30b35a52d646e6f69793d1c Author: Marcus Schäfer AuthorDate: Fri Jul 21 10:04:45 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 21 10:04:45 2017 +0200 Use the same option type (long form) for clarity commit 0a7c023b5bb10b5df50680f5feb42989c54fb6f1 Author: Marcus Schäfer AuthorDate: Thu Jul 20 16:21:59 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 20 16:24:24 2017 +0200 Use kernel compatible XZ options for kiwi initrd The kernel requires specific XZ options for the initrd in order to read the compressed data. This values should not be configurable by the user and are set to the same options as used by dracut now. Fixes #435 commit f39c0aed5e1672551033a4c5cd50e76a6fbe7e2d Author: Marcus Schäfer AuthorDate: Thu Jul 20 16:20:08 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 20 16:24:19 2017 +0200 Change default XZ compression options Use all cpu cores by default. Fixes #433 commit 7b35577baf22eb729551808ba2aa6e0ef4ecc8be Author: Marcus Schäfer AuthorDate: Thu Jul 20 15:34:09 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 20 15:34:09 2017 +0200 Update spec file provides for schema version commit adbe48e64630d02093c7c43b45eb53be75380d6f Author: Marcus Schäfer AuthorDate: Thu Jul 20 14:34:23 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 20 14:34:23 2017 +0200 Bump version: 9.9.5 → 9.10.0 commit 52a361c11ac993f09239382569aacb215c0346d2 Author: Martin Mohring AuthorDate: Thu Jul 20 14:27:57 2017 +0200 Commit: Martin Mohring CommitDate: Thu Jul 20 14:27:57 2017 +0200 fixed: fdupes is also available on Fedora commit f578bbc19e6eb79044266c8268393460e755eab0 Author: Martin Mohring AuthorDate: Thu Jul 20 13:16:27 2017 +0200 Commit: Martin Mohring CommitDate: Thu Jul 20 13:16:27 2017 +0200 changed: simplify diff to orig spec file template commit 88f26d85c009d1e2dffe4ec7a2ce72d1726e7d94 Author: Martin Mohring AuthorDate: Thu Jul 20 13:01:03 2017 +0200 Commit: Martin Mohring CommitDate: Thu Jul 20 13:01:03 2017 +0200 added: support for Fedora 25 / 26, fixed support for CentOS 7 in the spec file commit bc1089b2579a4f4bd6a2c9c3e307fa921fa0a1d9 Author: Marcus Schäfer AuthorDate: Thu Jul 20 10:27:00 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 20 10:42:49 2017 +0200 Refactor code which deals with Xen Provide two methods is_xen_guest and is_xen_server which are used instead of the former machine domain and firmware processing. Issue #429 commit 95e17c5011df189191a9f918d43967b523e752e9 Author: David Cassany AuthorDate: Thu Jul 20 10:39:46 2017 +0200 Commit: David Cassany CommitDate: Thu Jul 20 10:39:46 2017 +0200 Include default container name This commit includes a default container name for KIWI container images. This makes possible to create OCI and Docker containers without forcing the user to include a section in the description file. commit d7d631c8a7e15466d7727f057dfa3011a02e9fe9 Author: Marcus Schäfer AuthorDate: Thu Jul 20 10:26:19 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 20 10:34:37 2017 +0200 Apply schema v6.6 stylesheet to XML descriptions Updates all XML descriptions to latest schema version and also includes adaptions to the test XML descriptions for testing the new Xen guest and server setup commit 24585c2f88cf48decaea095a52ae64e6ddd04570 Author: Marcus Schäfer AuthorDate: Wed Jul 19 16:35:12 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 19 16:35:12 2017 +0200 Fixup shell test condition Variables used in shell conditions should be quoted commit 9fb81db16d1ee0fd911da6c3a1eb2bcbe4bba2b7 Author: Marcus Schäfer AuthorDate: Wed Jul 19 16:33:07 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 19 16:33:07 2017 +0200 Update schema to version 6.6 * Deleted domain attribute from machine section * Added xen_server attribute to specify a type to be a Xen dom0 * Added xen_loader attribute in machine section to specify the target guest loader this image is expected to become loaded with commit 724df8302e902f5bddbb3fecabfbddceb551afe5 Author: Marcus Schäfer AuthorDate: Wed Jul 19 14:37:02 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 19 14:37:02 2017 +0200 Added schema 6.5 to 6.6 conversion Delete the Xen domain attribute from the machine section and introduce a new xen_server attribute which is set to true for any machine section with a Xen dom0 configuration commit feb4f7a58b01663aa9e4b5f21670735ad9366f69 Author: Marcus Schäfer AuthorDate: Tue Jul 18 16:48:44 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 18 16:53:55 2017 +0200 Added Makefile target obs_test_status Call make obs_test_status and get an overview about the current integration test builds and their status commit bae0acff1e4dbc42929dd3143ceae671fb711041 Author: Marcus Schäfer AuthorDate: Tue Jul 18 10:27:21 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 18 10:27:21 2017 +0200 Bump version: 9.9.4 → 9.9.5 commit 359391ec33f287c7db023c6c85e3463f12b4da85 Author: Marcus Schäfer AuthorDate: Tue Jul 18 10:26:54 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 18 10:26:54 2017 +0200 Added s390 tumbleweed boot descriptions commit 3c57f443c32a61849cfc1407bade830bcbcec8a9 Author: Marcus Schäfer AuthorDate: Mon Jul 17 15:35:55 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 17 15:35:55 2017 +0200 Bump version: 9.9.3 → 9.9.4 commit be910bdc74a7d4c06f20a360d47bf409cac5a844 Author: David Cassany AuthorDate: Mon Jul 17 12:26:27 2017 +0200 Commit: David Cassany CommitDate: Mon Jul 17 12:26:27 2017 +0200 This commit fixed root_init when running inside the buildservice This commit fixes regression bug introduced in #422 commit ee8482d0a22c25b84d435bcf8e69349f1cd6938d Author: David Cassany AuthorDate: Mon Jul 17 11:15:27 2017 +0200 Commit: David Cassany CommitDate: Mon Jul 17 11:37:11 2017 +0200 Exclude kiwi files from images This commit from one hand includes a get_exclude_list_for_root_data_sync method in Defaults which returns a list of the files used by KIWI that should not be part of the resulting image. From the other hand makes use of the exclusion default list in live, archive and container images, it fixes #423. commit 06a3f57d8b2fe92ed252caf3d18cc14300b5568a Author: Marcus Schäfer AuthorDate: Mon Jul 17 10:58:47 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 17 10:58:47 2017 +0200 Bump version: 9.9.2 → 9.9.3 commit 3efbdba4c7ae0e2dd73c6bee219dd70d6fd08bcb Author: David Cassany AuthorDate: Mon Jul 17 10:36:39 2017 +0200 Commit: David Cassany CommitDate: Mon Jul 17 10:36:39 2017 +0200 Revert "Include .buildenv file inside the buildroot" This reverts commit d30bf4a19ff11f7132c9a31528ddfa103e01b299. This also includes the get_buildservice_env_name method in Defaults to centralize '.buildenv' occurrences. commit 070ec3cd830464daefc9556c1e58e3d91c7de3e5 Author: Marcus Schäfer AuthorDate: Mon Jul 17 10:20:51 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 17 10:20:51 2017 +0200 Fixup helper/kiwi-boot-packages Make sure the code also works in python2 commit 80ba6e15c69625f913737c9e1d14e16500169546 Author: Marcus Schäfer AuthorDate: Mon Jul 17 09:59:11 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 17 10:02:42 2017 +0200 Search for python interpreter in path Allow more flexible path spec to find python interpreter commit 06d1a07373db8e913b6368e505db1a64c9c1181f Author: Marcus Schäfer AuthorDate: Fri Jul 14 15:26:16 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 14 16:18:53 2017 +0200 More comfort in calling with compat arguments In addition to the 'kiwi --compat -- ...' style we also support calling the kiwi compat mode as a service via 'kiwi compat ...' The preferred way of calling kiwi with legacy options is via the new compat service. Thus the documentation also changed to no longer mention the --compat option but it still exists for compatibility reasons. Fixes #407 commit 6fe8a2a9d62b612f8d0d16e8beba45aa2f34bc35 Author: Marcus Schäfer AuthorDate: Fri Jul 14 11:55:32 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 14 11:55:32 2017 +0200 Allow use of more fine grain ignore repos options The meaning of the --ignore-repos option has changed back to ignore all configured repositories. A new option named --ignore-repos-used-for-build has been added which allows to ignore all except imageonly repositories. The command manual pages has been changed to document the options. This Fixes #410 commit e3c5868c1cbfb7b650749c29f3c6d56263cf4f5f Author: Marcus Schäfer AuthorDate: Fri Jul 14 11:25:23 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 14 11:25:23 2017 +0200 Cleanup use of python interpreter invocation Prevent strict call of a specific version of the python interpreter. All code has been written to work with py2 and py3 thus the venv environment setup should decide what version a call of python is. Fixes #424 commit a13ac7559d9e1d233014ee00469287d0e124f83f Author: David Cassany AuthorDate: Thu Jul 13 16:19:46 2017 +0200 Commit: David Cassany CommitDate: Thu Jul 13 16:19:46 2017 +0200 Make sure the KIWI buildroot has the /.buildenv file This commit makes sure the that the KIWI build root will always contain the /.buildenv file. Fixes #421 commit d30bf4a19ff11f7132c9a31528ddfa103e01b299 Author: David Cassany AuthorDate: Thu Jul 13 11:45:34 2017 +0200 Commit: David Cassany CommitDate: Thu Jul 13 11:45:34 2017 +0200 Include .buildenv file inside the buildroot With this patch if KIWI is running inside the buildservice the /.buildenv file is copied from the build environment to the build root of KIWI. At installation time some packages test the existance of this file in order to know if they are being installed inside the buildservice or not. Fixes #421 commit 3f87b2e2db343f355c86743620d14239293afba2 Author: David Cassany Viladomat AuthorDate: Tue Jul 11 14:58:18 2017 +0200 Commit: GitHub CommitDate: Tue Jul 11 14:58:18 2017 +0200 Fix url validation in buildservice (#420) This patch changes the remote URL validation strategy when running inside the build service. By design, inside the build service build environment connections to the outside world are not allowed, thus any validation attempting to do that will fail. With this patch, when running inside the build service, KIWI will not try to test if any download URL is reachable. Fixes #418 commit 938cdd62cc92fa7bea462811731140d2949e1b7d Author: Marcus Schäfer AuthorDate: Mon Jul 10 12:33:58 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 10 12:33:58 2017 +0200 Bump version: 9.9.1 → 9.9.2 commit e117547d88785d25f9b47acbb1f941228bba85d8 Author: Marcus Schäfer AuthorDate: Mon Jul 10 12:22:03 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 10 12:22:03 2017 +0200 Refactor Uri is_public method Don't call a nested is_remote from is_public, instead the method was rewritten to explicitly cover the responsibility to check under which conditions we treat an uri as publicly available or not commit 683d31e710867f78eb3b8e3abb93788904f7f7f8 Author: Marcus Schäfer AuthorDate: Sun Jul 9 22:36:04 2017 +0200 Commit: Marcus Schäfer CommitDate: Sun Jul 9 22:42:05 2017 +0200 Fixed Uri is_remote method If called inside of the buildservice the obs uri type is not a remote uri because the translation ends in a local path commit ed6dda50038a7d336f368b71dfd67eed5895eba6 Author: Marcus Schäfer AuthorDate: Fri Jul 7 15:39:27 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 7 15:39:27 2017 +0200 Bump version: 9.9.0 → 9.9.1 commit 06e15373f541d8dcecc8d14f1ffb355735cbeeb8 Author: Marcus Schäfer AuthorDate: Fri Jul 7 15:38:40 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 7 15:38:40 2017 +0200 Fixup setup and package requirements python requests is needed due to latest changes commit 95a7427c828ce5acdbabd6ca83696a097d9ed720 Author: Marcus Schäfer AuthorDate: Fri Jul 7 10:23:54 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 7 10:23:54 2017 +0200 Bump version: 9.8.1 → 9.9.0 commit 48f4e6761b2195766678f22aaf02c745ce314218 Author: Marcus Schäfer AuthorDate: Fri Jul 7 10:14:24 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 7 10:14:24 2017 +0200 Update doc string for Uri::translate method The method was missing doc info about the check_build_environment parameter and the return type of the method commit f9f4f0b5e0b584592efb999977bf5454699bfa9a Author: Marcus Schäfer AuthorDate: Fri Jul 7 10:05:28 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 7 10:05:28 2017 +0200 Delete obsolete --obs-repo-internal switch commit b51a8e3ded61641148d088c9f9b8e9a298b74140 Author: Marcus Schäfer AuthorDate: Fri Jul 7 09:18:47 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 7 09:18:47 2017 +0200 Create obs project download link like obs does it In reference to _download_repository_link.html.erb from https://github.com/openSUSE/open-build-service, we use the same mechanism to create the download link from an obs:// project definition commit d5f480654f0e6e3312d2d6237772239291469ca9 Author: Marcus Schäfer AuthorDate: Thu Jul 6 10:34:35 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 6 10:34:35 2017 +0200 Fixup unit test for help command commit 1eabaa2b759c06da365ecdc26da6614a1f9404d5 Author: Marcus Schäfer AuthorDate: Thu Jul 6 10:33:18 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 6 10:33:18 2017 +0200 Follow up fix for man page move make sure kiwi calls the man page from the now changed section level 8 commit c6858d9162904007cdb3c5e36b73ce4fc342e005 Author: Neal Gompa AuthorDate: Wed Jul 5 11:19:23 2017 -0400 Commit: Neal Gompa CommitDate: Wed Jul 5 16:35:04 2017 -0400 Move man pages to correct section The man pages were incorrectly written to section 2, which is for syscalls. Since KIWI is an administrator's tool, it has been moved to section 8. commit dee0a5af7feb62ca2ca709313c9e875123a27f9b Author: Marcus Schäfer AuthorDate: Tue Jul 4 18:26:49 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 5 16:07:29 2017 +0200 Refactor handling of obs repositories * Delete kiwi internal ibs: and suse: types * Delete handling for --obs-repo-internal and provide a compatibility message to the user * Buildservice download server url and scope can be configured via ~/.config/kiwi/config.yml * Translate obs urls to http in import_repositories_marked_as_imageinclude * Use new Uri.is_public method in renamed runtime check check_image_include_repos_publicly_resolvable commit ab491354e763d3cef277f8d2ae7877b3401f8131 Author: David Cassany AuthorDate: Wed Jul 5 10:04:44 2017 +0200 Commit: David Cassany CommitDate: Wed Jul 5 10:08:56 2017 +0200 Make sure system image strip sections are applied in boot image This commit calls copy_strip_sections from the system image xml to the boot image xml. This is needed to make sure strip sections are applied into the boot image. Fixes #414 commit 80710ba7ccad3163cf3e526ab16fe1c412d56bf8 Author: David Cassany AuthorDate: Tue Jul 4 16:10:48 2017 +0200 Commit: David Cassany CommitDate: Tue Jul 4 16:10:48 2017 +0200 Fix a code block in workflow.rst Fixes #412 commit edfd755df1491ed60ca67c826dfebfe376dfde10 Author: David Cassany AuthorDate: Tue Jul 4 09:31:12 2017 +0200 Commit: David Cassany CommitDate: Tue Jul 4 09:31:12 2017 +0200 Fix xml_state test commit a8dfa4a5a5b9dee0998153f5603632d162cf99d4 Author: David Cassany AuthorDate: Mon Jul 3 18:17:29 2017 +0200 Commit: David Cassany CommitDate: Mon Jul 3 18:17:29 2017 +0200 Accept an empty string as a repo priority xml_parse code is autogenerated, thus no changes there should be considered. When adding a repository from the command line it can happen that the repository priority is mapped to an empty instead to a None valuei, when the priority is not specifically set. xml_parse will only support a parseable string to int or a None value as the default option, so, if an empty string is used, it throws an exception. With the current patch anything that cannot be casted to an int, will be considered as None. Fixes #408 commit 7d0ea0a1f074f5e0aa48b394a6334b4fe08fd8d5 Author: Marcus Schäfer AuthorDate: Mon Jul 3 16:00:19 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 3 16:00:19 2017 +0200 Move check_image_include_repos_http_resolvable Call the check_image_include_repos_http_resolvable runtime check after the check and setup for the obs runtime environment. In case of obs uri types and a kiwi build outside of the buildservice those source locations could be translated into a public url and thus allow for use with the imageinclude attribute. However building inside of the buildservice maps those to a local path which is private to the used worked instance. In such a case the obs uri type is translated into a suse uri type and running the check_image_include_repos_http_resolvable after that translation will run from the translated and thus correct source uri information commit 4ad200361d4609f5d3fc46802cc12ff17611c4d8 Author: Marcus Schäfer AuthorDate: Mon Jul 3 10:48:36 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 3 10:48:36 2017 +0200 Bump version: 9.8.0 → 9.8.1 commit 370b6449b3c5ded68a339f4d158c933ea0e13eb1 Author: Marcus Schäfer AuthorDate: Fri Jun 30 16:36:14 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 30 18:25:51 2017 +0200 Add unit tests for compat mode commit 04f4683664d18e83a47cec7b5968e998a6995885 Author: Marcus Schäfer AuthorDate: Fri Jun 30 15:51:37 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 30 18:25:50 2017 +0200 Fixed compat setup for upgrade command Value for --root option was added after other options commit 4ac282b2cf9232bd2777ff49809ebf87534a9027 Author: David Cassany AuthorDate: Fri Jun 30 16:07:20 2017 +0200 Commit: David Cassany CommitDate: Fri Jun 30 16:07:20 2017 +0200 Do not translate obs scheme to suse scheme for imageonly repos Fixes #404 commit 3ad92a147702e7d3187463e4aec5e977a688640d Author: David Cassany AuthorDate: Fri Jun 30 11:50:26 2017 +0200 Commit: David Cassany CommitDate: Fri Jun 30 12:16:58 2017 +0200 Translate obs to suse derived from image uris This commit performs a translation from obs scheme to suse scheme for derived from image uris when kiwi is running in a buildservice worker. Fixes #399 commit 1b4425ad5ff449b51477fa35e3bdaf17b464a8d8 Author: Marcus Schäfer AuthorDate: Fri Jun 30 10:20:44 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 30 10:20:44 2017 +0200 Bump version: 9.7.4 → 9.8.0 commit 9857a07ae6c32c3b98860cf45380547df6584121 Author: Marcus Schäfer AuthorDate: Fri Jun 30 09:50:19 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 30 09:50:19 2017 +0200 Fix content layout of zypper credentials file Missing line break for entries in zypper credentials file commit 4a736cee621010ea492c44ef5be91656e8ae697e Author: David Cassany AuthorDate: Thu Jun 29 18:11:47 2017 +0200 Commit: David Cassany CommitDate: Thu Jun 29 18:11:47 2017 +0200 Allow imageinclude repositories inside the build service Fixes #397 commit f56b57322876476ee0f2dd2990bccd2e28b70491 Author: Marcus Schäfer AuthorDate: Thu Jun 29 16:52:11 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 29 16:52:11 2017 +0200 Fixed doc_travis tox target using shell syntax requires calling a shell process commit c544dd178b1004b566df87334722a4e8cf9151be Author: Marcus Schäfer AuthorDate: Thu Jun 29 16:44:09 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 29 16:44:09 2017 +0200 Allow imageinclude in add|set-repo commandline The --set-repo and --add-repo commandline options now allows additionally to specify a true|false value to indicate if the repository should be part of the system image repository setup or not. This Fixes #398 commit 0451e4a82ecb678e447b8a16d9ca87f344b3e632 Author: Marcus Schäfer AuthorDate: Thu Jun 29 14:41:32 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 29 14:41:32 2017 +0200 Fixed travis whitelist_externals test command is used in target commit 919647241747e1ffb0b9476180347825dc065a04 Author: Marcus Schäfer AuthorDate: Thu Jun 29 13:53:42 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 29 13:53:42 2017 +0200 Fixed travis whitelist_externals commands cp and/or true are used in target commit 8bd832d63d4204ece56ab1fffc29b252be1c063d Author: Marcus Schäfer AuthorDate: Thu Jun 29 11:44:51 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 29 11:44:51 2017 +0200 Fixup travis doc deployment Custom diagram images needs to be deployed manually commit 5ed0ea74865c86f038a5a1731f91bd5c1aed5f2e Author: Marcus Schäfer AuthorDate: Thu Jun 29 11:08:13 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 29 11:08:13 2017 +0200 Update schema documentation commit de4214986827f4a6398805ed360bb1ce91bddbbb Author: Marcus Schäfer AuthorDate: Thu Jun 29 11:06:41 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 29 11:06:41 2017 +0200 Delete unused data from schema docs processing commit 1d9ac070e8cb55b84758dee03fae5fbd5329a608 Author: Marcus Schäfer AuthorDate: Fri Jun 23 21:12:03 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 29 10:38:45 2017 +0200 Build schema documentation with Oxygen Given there is a valid Oxygen license owned by the company as described in https://www.oxygenxml.com/oxygen_scripting.html the schema documentation can be created using Oxygen. This commit allows building the schema docs with alternative doc builders and in case of Oxygen would change the way the schema docs are generated in the following way: 1. Install Oxygen and setup the license to activate the tool 2. Setup the KIWI development shell environment to export the schema_tool variable to point to the schemaDocumentation.sh script provided by the Oxygen installation export oxygen_tool=/path/to/Oxygen/schemaDocumentation.sh 3. In any case of a schema change manually call: tox -e schema This step was done before as part of the tox doc target but can't be done automatically because it would require a correctly licensed Oxygen installation in the travis environment. Thus the result data has to be part of the pull request 4. Build the documentation and review the result tox -e doc 5. Create the pull request commit 4f18d2da22bc6773cb6cc8b9cb1f6a152975a693 Author: David Cassany AuthorDate: Tue Jun 27 10:02:42 2017 +0200 Commit: David Cassany CommitDate: Tue Jun 27 10:02:42 2017 +0200 Flag --ignore-repos do not ignore imageonly repos This commit fixes #395, with it, using --ignore-repos, does not delete imageonly repositories from the description file. This way imageonly is prepared to be used in the buildservice even when using the 'obsrepositories:/' reference style. commit d9160d49260ada46e555e06e8ef991b2b280ffee Author: Marcus Schäfer AuthorDate: Wed Jun 21 14:57:43 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 21 14:57:43 2017 +0200 Update schema docstring for oem-systemsize commit fb15cb559b257a9b6947e44e7b0555b241878727 Author: Marcus Schäfer AuthorDate: Tue Jun 20 18:33:21 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 20 18:33:21 2017 +0200 Bump version: 9.7.3 → 9.7.4 commit 431afc847e0082f5c8a5927e2b581cdcd5fc6a02 Author: Marcus Schäfer AuthorDate: Tue Jun 20 18:31:07 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 20 18:31:07 2017 +0200 Fixed setup_plymouth_splash The schema generated get_bootsplash_theme() method returns a list because it's section content. The return value of the method was used as a string which caused a runtime error commit 591963bb95b170b6ad98bab035f314ebea65c9b7 Author: Marcus Schäfer AuthorDate: Tue Jun 20 18:22:25 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 20 18:22:25 2017 +0200 Added creation of zsync control file in bundler If a --zsync_source url is provided to the bundler call a zsync control file is created for the compressed parts of the bundle. This Fixes #364 commit d006edb4bdb7fc6f59bf7699b36174e7c56bb91e Author: David Cassany AuthorDate: Tue Jun 20 15:18:53 2017 +0200 Commit: David Cassany CommitDate: Tue Jun 20 15:18:53 2017 +0200 Add package manager in image info task solving process This commit includes the package manager package in the packages list to be solved in image info task. commit 343c017e58442b345055d7df93a621b099215066 Author: Marcus Schäfer AuthorDate: Tue Jun 20 14:26:26 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 20 14:26:26 2017 +0200 Bump version: 9.7.2 → 9.7.3 commit f15cadf361122b1e2c214b9c1b56682bb0fa0624 Author: Marcus Schäfer AuthorDate: Tue Jun 20 11:09:41 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 20 11:09:41 2017 +0200 Fixed gce disk format The order of the files in the tarball is important. The first entry must be the manifest.json followed by disk.raw commit cf85e577e7a5421268de72cf1a15941792651c1c Author: Marcus Schäfer AuthorDate: Wed Jun 14 13:09:54 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 20 09:24:56 2017 +0200 Implement custom argument handling for xz_options Evaluate and hand over custom_args processing for the xz_options argument to all classes which performs xz compression tasks. This Fixes #373 commit 8c5d5e82bc300eeeda4337cfe5dfb4002e41fc69 Author: Marcus Schäfer AuthorDate: Wed Jun 14 13:06:38 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 20 08:31:32 2017 +0200 Read xz options from runtime config Read xz options from the kiwi runtime configuration file and pass along the information to the commands which performs compression tasks commit 011996cd5b1efd1b434714eaa1a5186ec4cba120 Author: Marcus Schäfer AuthorDate: Mon Jun 19 18:00:56 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 19 18:00:56 2017 +0200 Make sure CliTask instance reads the config file Any instance of a CliTask has to read the runtime config file if present commit 9eb98b8a170a0b2726e0e58f7257eec2d6b7efcb Author: Marcus Schäfer AuthorDate: Mon Jun 19 16:25:24 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 19 16:25:24 2017 +0200 Add generic access for attributes The layout of the yaml runtime config is based on an element topic containing a list of attributes. For now only the xz topic with its options attribute is in use but for the future more elements might be supported which can use the same access method commit 219312ec61456f61884220b877b5cc0088375972 Author: Marcus Schäfer AuthorDate: Mon Jun 19 16:03:31 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 19 16:13:38 2017 +0200 Setup plymouth splash in the image prepare process In case the plymouth-set-default-theme tool can be found in the image root system and a bootsplash theme is configured in the XML description, the tool is used to setup the theme configuration This Fixes #366 commit 71a99fdd66aa35b991d419f0d6d2a1bc41f587f4 Author: David Cassany AuthorDate: Mon Jun 19 15:03:53 2017 +0200 Commit: David Cassany CommitDate: Mon Jun 19 15:03:53 2017 +0200 Include patternType information to resolv packages in image info task This commit includes ingore_recommended flag in the Sat.solve method. This way if the description file states to include only required packages (without recommendations) it is respected and taken into account to resolv the packages list. Fixes #381 commit 66f5ed855507eeafcca29fb110907383e6af9954 Author: Marcus Schäfer AuthorDate: Mon Jun 19 11:06:01 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 19 11:12:09 2017 +0200 Added custom xz option handling for ArchiveTar Allow to pass custom xz options for create_xz_compressed method. Issue #373 commit 2179798948f7ebb035d25725b59a167d8d9c6b5c Author: Marcus Schäfer AuthorDate: Mon Jun 19 10:25:47 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 19 11:11:37 2017 +0200 Added custom xz option handling for Compress Allow to pass custom options for xz method. Issue #373 commit 403f034620c998a471bc228b897f6385fc54d355 Author: Marcus Schäfer AuthorDate: Mon Jun 19 10:31:06 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 19 10:31:06 2017 +0200 Make sure options are returned as list commit 49dbc2f2cc79a67780d1413bf82e16b91404a9a8 Author: Marcus Schäfer AuthorDate: Mon Jun 19 08:47:06 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 19 09:45:00 2017 +0200 Activate reading of runtime config in tasks Implement reading of runtime configuration file in base commandline class. Issue #373 commit de8a75adc598de9e15cfa1c007be1b411aa718c3 Author: Marcus Schäfer AuthorDate: Mon Jun 19 08:37:42 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 19 08:37:42 2017 +0200 Cleanup doc string of base task class commit 22e171165fb025347415db4659b576f0c54a0269 Author: Marcus Schäfer AuthorDate: Sun Jun 18 09:17:00 2017 +0200 Commit: Marcus Schäfer CommitDate: Sun Jun 18 09:17:00 2017 +0200 Add runtime config man page section Describe the contents of the KIWI runtime config file commit 6517d3b56844ee36c24b1a9cf018735933b7fd32 Author: Marcus Schäfer AuthorDate: Wed Jun 14 18:11:32 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 14 18:13:50 2017 +0200 Added RuntimeConfig class An instance of RuntimeConfig reads in ~/.config/kiwi/config.yml if present and provides access methods to the expected information of the config file commit 22afd9deba5d6716306e9f8a355c365a62f48655 Author: Marcus Schäfer AuthorDate: Wed Jun 14 18:10:37 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 14 18:10:37 2017 +0200 Added PyYAML requirement to package and venv The KIWI config file is yaml based and thus we need support for reading the file in KIWI commit 0d4d95ae61c0de1817cb0ea87d4fcd34d18ab2bc Author: Marcus Schäfer AuthorDate: Wed Jun 14 12:56:06 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 14 12:56:06 2017 +0200 Fixed alpha order of options in build command commit c5d93fb9ee2bcad3a7610847b4da678b0e435f89 Author: Marcus Schäfer AuthorDate: Wed Jun 14 11:55:15 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 14 11:55:15 2017 +0200 Update custom_args doc for DiskBuilder class commit 58716ac0cf64d5a7f4d717b46ed46e10fe23939e Author: Marcus Schäfer AuthorDate: Wed Jun 14 10:54:27 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 14 10:54:27 2017 +0200 Fixup class docstrings The attribute list should provide information about the construction of an object of this class. Some fields were missing or superfluous commit cf7cb0cf331131b9c071cecc295fc80bf59588e2 Author: David Cassany AuthorDate: Wed Jun 14 10:25:35 2017 +0200 Commit: David Cassany CommitDate: Wed Jun 14 10:25:35 2017 +0200 Consider only repositories used for build in image info This commit makes sure that the repositories marked with imageonly flag are not included in the packages solve procedure. This is related to #362 commit 21dd3e73db13692205ede37d35efa6238fd40f63 Author: David Cassany AuthorDate: Wed Jun 14 09:41:47 2017 +0200 Commit: David Cassany CommitDate: Wed Jun 14 09:41:47 2017 +0200 Removing has_repositories_marked_as_imageinclude method With the current repository management this method is not required anymore, since the setup repositories method does not modify the image if no repositories are present. It is related to #305 and #191 commit ef6a49a7264c13735ea1f1e88ff17e7092482172 Author: Marcus Schäfer AuthorDate: Tue Jun 13 15:40:49 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 13 15:40:49 2017 +0200 Fixed typo in isoboot/fedora-25.0 It does not really matter because the package manager setup is inherited from the system image XML configuration to the boot image, but for consistency it should be correct in the isoboot description too commit da6dd8347157cf8c817f4aebe4d97bd869f299aa Author: Marcus Schäfer AuthorDate: Tue Jun 13 13:06:23 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 13 13:07:48 2017 +0200 Added isoboot/fedora-25.0 boot description commit 84a09c78d11a07acd26ff1803377cfb16d19d4ca Author: Marcus Schäfer AuthorDate: Mon Jun 12 16:29:47 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 13 12:41:08 2017 +0200 Cleanup use of suseGFXBoot regarding grub The shell method suseGFXBoot from the config/functions contains code which should be better moved to the python code base dealing with the bootloader configuration. In this commit all grub parts of it has been moved to the BootLoaderConfigGrub2 class commit 4e11ba3b28c1a292c4433ce9adc15416b0add376 Author: Marcus Schäfer AuthorDate: Mon Jun 12 15:07:04 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 13 12:41:08 2017 +0200 Cleanup isoboot descriptions There is no need to install bootloader packages to the initrd, all information regarding the bootloader setup is taken from the system root directory commit fcfd257e2d58c2f82bbac2ef8a7bef23fe7a239a Author: David Cassany AuthorDate: Tue Jun 13 10:55:26 2017 +0200 Commit: David Cassany CommitDate: Tue Jun 13 10:55:26 2017 +0200 Change to more explicit method names commit 62a5cf1b6b22c01589297d367bda1ff6784405e6 Author: Marcus Schäfer AuthorDate: Mon Jun 12 15:05:35 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 12 23:14:21 2017 +0200 Fixup iso image builder(s) lookup path Don't lookup bootloader required files in the boot image root directory. Those needs to be looked up in the system image root directory commit 07356eba38aac9479a599abf04533bb5e4cd9544 Author: Marcus Schäfer AuthorDate: Mon Jun 12 15:01:33 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 12 23:14:21 2017 +0200 Refactor boot image factory Make sure the root directory of the base image is always accessible by any boot image type for consistency. In addition introduce a post_init method which explicitly setup the boot image root directory as needed for the selected boot image type and document it as such commit 26e15929ab98435cabb21f71897d2a14bf1a3bb3 Author: David Cassany AuthorDate: Mon Jun 12 12:27:11 2017 +0200 Commit: David Cassany CommitDate: Mon Jun 12 16:46:52 2017 +0200 Include imageonly attribute for repositories This commit adds imageonly attribute support for the repository element. imageonly is a boolean attribute that if true indicates that the repository is no used for the build but needs to be configured for the resulting image. Fixes #362 commit 6b5b837b27acc08fd6a93e32b565de599c615278 Author: Marcus Schäfer AuthorDate: Fri Jun 9 16:43:06 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 9 16:43:06 2017 +0200 Fixup use of syslinux v6 modules There is support for library loading in syslinux modules which requires to provide the lib modules when available. This Fixes #351 commit 0fd3f6c79377a12228d3356f8e78d849d3e6e593 Author: Marcus Schäfer AuthorDate: Fri Jun 9 14:12:57 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 9 14:12:57 2017 +0200 Bump version: 9.7.1 → 9.7.2 commit 367cf6070db3d2e1b48a0e0e834530cb08daba6a Author: Marcus Schäfer AuthorDate: Thu Jun 8 16:01:05 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 9 14:08:40 2017 +0200 Update PXE building chapter Redesign PXE building chapter to follow style guide. Thanks to Thomas Schraitle for review and additional contributions to this topic. This Fixes #323 commit 753c840e4435a93c6e4438c2afb8fccab4607409 Author: David Cassany AuthorDate: Fri Jun 9 12:33:03 2017 +0200 Commit: David Cassany CommitDate: Fri Jun 9 12:33:03 2017 +0200 Update rpm-check-signatures documentation commit 9949ecfef8a94295bb151777bb40a368cc24ff63 Author: David Cassany AuthorDate: Fri Jun 9 11:51:35 2017 +0200 Commit: David Cassany CommitDate: Fri Jun 9 11:51:35 2017 +0200 Fix default location repository config file for apt This commit fixes the apt config file management for default locations. The template subsitution always needs to be executed providing all the substitution parameters, as it does not make any kind of default assumption when parameters are missing. Fixes #370 commit a60ae7acc8d4b0d56d6e01dd1538847f7aa643bd Author: Marcus Schäfer AuthorDate: Fri Jun 9 11:14:45 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 9 11:14:45 2017 +0200 Revert "Refactor detection code for grub directory name" The former detection of the grub directory name in boot was correct whereas the new code introduced a problem. This reverts commit b3e4b871d52da2b5ab579d592ccc7ae39de75339. This Fixes #371 commit 02a1b89086e165dbf3711567b7c2ad7b22adb1ce Author: David Cassany AuthorDate: Thu Jun 8 16:54:50 2017 +0200 Commit: David Cassany CommitDate: Thu Jun 8 17:01:16 2017 +0200 Include repository_gpgcheck and package_gpgcheck documentation commit 62095aeaf351b96dc07c748e8f6b99798ac137a0 Author: David Cassany AuthorDate: Thu Jun 8 16:25:30 2017 +0200 Commit: David Cassany CommitDate: Thu Jun 8 16:40:20 2017 +0200 Improve package/repository signature checking setup This commit adds repository_gpgcheck and package_gpgcheck attributes to the repository tag in schema. With this change each repository can be configured individualy to enable repository signatures check and/or enable signature package check. The configuration is done at repository level, thus it is not conflicting with the wide package manager configuration flag . Fixes #358 commit 5b4fe0b8e528d3c2e9e2197229eafdc458961529 Author: Marcus Schäfer AuthorDate: Thu Jun 8 14:46:39 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 8 14:46:39 2017 +0200 Update chapter due to review commit 86d94233af284f31d626ec96051c692a38a45e40 Author: Marcus Schäfer AuthorDate: Thu Jun 8 14:25:52 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 8 14:25:52 2017 +0200 Update OEM building chapter Redesign building chapter to follow style guide. Issue #323 commit cd8629bfea4324037506c5fceba8cacb16c72887 Author: Marcus Schäfer AuthorDate: Thu Jun 8 10:56:29 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 8 10:56:29 2017 +0200 Bump version: 9.7.0 → 9.7.1 commit b3e4b871d52da2b5ab579d592ccc7ae39de75339 Author: Marcus Schäfer AuthorDate: Thu Jun 8 10:05:12 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 8 10:05:12 2017 +0200 Refactor detection code for grub directory name The method get_grub_boot_directory_name was based on checking for the name of the grub2 install tool, but this is not always reliable because the name of the grub2 install tool has no direct connection to the grub2 path. The method changes in a way that it checks for the presence of the grub2 installation directory which is /usr/lib/grub or /usr/lib/grub2. Depending on the result the location in boot is /boot/grub or /boot/grub2 which seems to be a more reliable check commit d4674e30c58463f2a63320cab74b9586ad6c90bb Author: Marcus Schäfer AuthorDate: Wed Jun 7 22:37:07 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 7 23:40:36 2017 +0200 Fixup detection of grub directory name In order to put grub data to boot/grub2 or boot/grub a check for the grub2-tool vs. grub-tool name is performed. This requires access to the image root directory on a file basis which is not always applicable. When setting up the grub bootloader for e.g EFI boot on an iso image the rootfs can't be directly accessed because the iso image contains the rootfs in a compressed format. This commit refactors the check to be generic for all image types commit 47ff8f9b61e52558dd5ad808fca5fcab49e35791 Author: Marcus Schäfer AuthorDate: Wed Jun 7 18:36:19 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 7 23:40:36 2017 +0200 Fixup EFI setup for iso images The embedded efi fat image on the iso filesystem must follow the same rules compared to the setup on a disk commit 60b207271fe797444dc4ea1b33b734b11aa10073 Author: Marcus Schäfer AuthorDate: Wed May 31 16:36:17 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 7 23:10:01 2017 +0200 Allow vendor specific grub config file location On e.g Fedora systems the EFI grub config file for secure boot systems is expected to be located in the vendor specific efi boot directory from where the shim loader gets loaded by the firmware commit c562a294ac0cbe74005b2e72c69e4af6c49be3ee Author: Marcus Schäfer AuthorDate: Mon May 29 12:33:51 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 7 23:10:01 2017 +0200 Use glob pattern to match shim modules commit 2524d19729a64dde7e45c9922a969e15cbdf0c2b Author: Marcus Schäfer AuthorDate: Wed May 24 17:51:08 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 7 23:10:01 2017 +0200 Added fallback setup for grub secure boot The current implementation is based on the presence of the shim-install tool. This tool does not exist on all distributions. In case shim-install is not present a kiwi fallback solution applies. Fixes #337 commit 58bdca2b6258c8fc192c747ae304bc613137e320 Author: Thomas Schraitle AuthorDate: Wed Jun 7 09:06:41 2017 +0200 Commit: Thomas Schraitle CommitDate: Wed Jun 7 09:06:41 2017 +0200 Fix docstring and apply ReST markup Avoids the the following warning: Definition list ends without a blank line; unexpected unindent. Docstring contains ReST markup from http://www.sphinx-doc.org/en/stable/domains.html#cross-referencing-python-objects commit 8b2682faea2d7d88b6bcf3c3cbdcaed418bd67de Author: David Cassany AuthorDate: Tue Jun 6 16:57:02 2017 +0200 Commit: David Cassany CommitDate: Tue Jun 6 16:57:02 2017 +0200 Some corrections for Building Docker image docs commit 24f56cb287946f5f99b720ad91e8d110740bdd5d Author: David Cassany AuthorDate: Tue Jun 6 11:01:47 2017 +0200 Commit: David Cassany CommitDate: Tue Jun 6 11:11:38 2017 +0200 Rearrange Docker docs This commit rearranges the Docker image builds documentation in order to match the criteria exposed in #323 commit 854b62d7f094848dbdbf5a2ba328fc36358dd824 Author: Marcus Schäfer AuthorDate: Fri Jun 2 10:38:12 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 2 10:38:12 2017 +0200 Bump version: 9.6.2 → 9.7.0 commit d4b8a030d6980e90457a96c93d9204f896fe9ecb Author: Marcus Schäfer AuthorDate: Thu Jun 1 15:54:16 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 1 15:54:16 2017 +0200 Make sure all required yum repo options are set enabled and gpgcheck parameters has to be set for any configured yum repository commit 9ccf0798854ee69daef9a8c44df37737daefa61d Author: Marcus Schäfer AuthorDate: Thu Jun 1 15:40:26 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 1 15:40:26 2017 +0200 Fixup repository setup for yum Yum cannot handle spaces between the key and the value. This patch provides a method to tell ConfigParser to use no spaces for the '=' delimiter and thus Fixes #357 commit 719adac66946e8eae2fd9b2750d354899da41492 Author: Marcus Schäfer AuthorDate: Thu Jun 1 14:08:37 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 1 14:08:37 2017 +0200 Reactivate warnings report in pytest commit a790591b05e128a7322afc3166225b41997a7984 Author: Marcus Schäfer AuthorDate: Thu Jun 1 13:58:27 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 1 13:58:27 2017 +0200 Fixup kernel name lookup If multiple abi compatible kernel module packages are installed the kernel version of the boot kernel could be different from the kernel module versions. In order to find the boot kernel all kernel versions found must be checked. Fixes #355 commit afebd3897eb1faa9ade8d1259b0221eb8e1a81a3 Author: Marcus Schäfer AuthorDate: Thu Jun 1 10:41:45 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 1 11:37:35 2017 +0200 Fix/workaround invalid xsd pattern translation The data structures are auto generated by the generateDS tool which works nicely except for the arch-name xsd pattern used in the RelaxNG schema. For some reason the used regular expression is translated by generateDS into a python expression not matching the original expression from the schema. The result is an invalid python warning message after the schema has successfully validated the arch string. The problem has been reported to the generateDS developer. As long as their is no fix available in generateDS the following workaround in kiwi applies: The original xs:token pattern validation will be disabled on the generateDS level and applies only to the schema. This Fixes #347 commit 376e9daa58ad7b2749186f82dd80d615fb9af2b5 Author: David Cassany AuthorDate: Wed May 31 14:54:40 2017 +0200 Commit: David Cassany CommitDate: Wed May 31 15:41:11 2017 +0200 Some fine tune updates * Updated the docs for system_create command * Reverted dracut image initialization * Updated yum comment about repo_gpgcheck option * Updated variable name in disk builder * Typo correction commit 617859b3a4c9df1b64e9c280b36b558c47042ebf Author: David Cassany AuthorDate: Wed May 31 10:04:06 2017 +0200 Commit: David Cassany CommitDate: Wed May 31 10:04:06 2017 +0200 Include signing-key feature for boot images This commit extends the behavior of --signing-key options in order to import the provided key file into the boot image, in addition to the regular image root tree. Related to #342 commit d316584f9fa9f9fd4e23d55e733f6779eb60d2fe Author: Marcus Schäfer AuthorDate: Tue May 30 17:43:35 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed May 31 09:32:54 2017 +0200 Fix use of pre requires in spec file commit 2498ff6ba4d99a8e23adfb3d9c958ce7c677117b Author: Marcus Schäfer AuthorDate: Tue May 30 17:03:09 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue May 30 17:03:09 2017 +0200 Fixup working dir for editboot scripts editbootconfig and editbootinstall scripts needs to be called from within the correct directory to allow access to the written bootloader config files. For live images the working directory was set to the wrong place. This Fixes #353 commit dd6dfe0f7b1d64d9e05efdbb688008639e6513a8 Author: Marcus Schäfer AuthorDate: Mon May 29 21:33:20 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon May 29 21:33:20 2017 +0200 remove duplicated code from dhclient setup IPADDR is assigned within dhclientImportInfo original patch by Dinar Valeev commit 3ec8cc1cff0efddd2aadb0dec8a8c1b788482016 Author: Dominique Leuenberger AuthorDate: Mon May 29 20:50:35 2017 +0200 Commit: Dominique Leuenberger CommitDate: Mon May 29 20:50:35 2017 +0200 Fix spelling of 'processor' https://bugzilla.opensuse.org/show_bug.cgi?id=957927 commit 722584f4865f72605fadd57c2ef26ab4166fce77 Author: Marcus Schäfer AuthorDate: Sun May 28 21:37:25 2017 +0200 Commit: Marcus Schäfer CommitDate: Sun May 28 21:37:25 2017 +0200 Fixed pre-req for kiwi-pxeboot subpackage the binaries groupadd and useradd used in the preinstall scriptlet and provided by the shadow package needs a pre requirement on shadow to make sure they exist when the package gets installed. Fixes (bsc#1040256) commit 3355f93aad80f58d73853b96f2b7b1aa6e241056 Author: David Cassany AuthorDate: Fri May 26 14:42:11 2017 +0200 Commit: David Cassany CommitDate: Fri May 26 14:48:05 2017 +0200 Fix existing root check, fixes #349 This commit fixes the validation of an existing root directory for the command 'system build'. System build used to create the root directory before performing the root existance check, thus the check was always failing in any case. The root directory is created inside the RootInit class within the 'create' method. Fixes #349 commit 435ab2651a922efe6012036d0202c51db5a627b7 Author: David Cassany AuthorDate: Wed May 24 13:18:43 2017 +0200 Commit: David Cassany CommitDate: Wed May 24 13:30:25 2017 +0200 Extend --signing-key to Apt package manager This commit extends support for --siging-key to the Apt package manager. However it has only been included for the chrooted operations, as current implementation of the bootstrap procedure does not provide signature check capabilities. Related to #342 commit 844640d93a808864459d830d1bc7f8060767710c Author: David Cassany AuthorDate: Wed May 24 13:15:19 2017 +0200 Commit: David Cassany CommitDate: Wed May 24 13:15:19 2017 +0200 Extend --signing-key option to Yum and Dnf This commit extends the --signing-key options support to Yum and Dnf package managers. In addition, signature check for repositories had to be disabled for Yum and Dnf, as kiwi unrelated issues were found while testing. Nevertheless, package signature checks are fully functional. Related to #342 commit 26995dbe9c869b0940cb60d6b2aed0279dab4e81 Author: David Cassany AuthorDate: Wed May 24 13:11:15 2017 +0200 Commit: David Cassany CommitDate: Wed May 24 13:11:15 2017 +0200 Add --signing-key option This commit adds --signing-key option which sets a key file to import into the package manager trusted keys database. This commit adds this flag support only for zypper. Fixes #342 commit 3c0029c10fe6e398597c5d68bd1300e38b201630 Author: Marcus Schäfer AuthorDate: Tue May 23 16:55:45 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue May 23 16:55:45 2017 +0200 Don't print warning report The auto generated xml_parse.py uses the python warnings module The unit tests uses the coverage module in py.test to create a report. The latest py.test update now also creates a warnings report which is unwanted because some of the unit tests intentionally causes the creation of a warning as the expected result but we don't want to see that in a py.test warnings report. Therfore this patch switches off the creation of that warnings report commit 4c4274d1edc2261773c7918bb01fdfbd05e436ab Author: Marcus Schäfer AuthorDate: Tue May 23 16:35:06 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue May 23 16:35:06 2017 +0200 Update manual page of build command Add information for --allow-existing-root option commit dba6aaecc044f9c782d35621db97d5223f357ba2 Author: Marcus Schäfer AuthorDate: Tue May 23 16:29:53 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue May 23 16:32:41 2017 +0200 Fixup default behavior of build command The build command automatically used an existing root tree from a former build attempt. However this could cause an inconsistent image if the former build root was not based on the same image type setup. Thus it is better to allow this only if the --allow-existing-root option is specified along with the build command call commit 6faee70731b91f734162673f91ae400a87921e44 Author: Marcus Schäfer AuthorDate: Tue May 23 16:29:11 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue May 23 16:29:11 2017 +0200 Fixed alpha sorting of options commit 4461f6c4981427542008901afd5d7898217fbbef Author: Marcus Schäfer AuthorDate: Tue May 23 11:04:50 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue May 23 11:04:50 2017 +0200 Complete zypper cache cleanup also the raw and solv cache needs to be deleted commit 542cf1783681cb78be37bda7a1a27a4601e00986 Author: Marcus Schäfer AuthorDate: Mon May 22 17:59:58 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon May 22 17:59:58 2017 +0200 Update manual pages Add information and use case for --clear-cache option commit c368c2731c69ba1f84ad56cab7c444797192fa99 Author: Marcus Schäfer AuthorDate: Mon May 22 17:57:57 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon May 22 17:57:57 2017 +0200 Added --clear-cache option The system prepare and build commands now provides the option --clear-cache which deletes all cache data associated with the repositories to build the image. This Fixes #341 commit 402ff5ec43d8b5e08a118a37544d691ca6251baa Author: Marcus Schäfer AuthorDate: Mon May 22 11:59:24 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon May 22 11:59:24 2017 +0200 Let dracut create a compressed initrd dracut was called in a way to create an uncompressed initrd archive and kiwi later runs the xz compression on it. That way the default compression parameters used by dracut get lost. Fixes #335 commit 9cb7390af0127e8131705c7d3cbcf0212a1d3c3d Author: Marcus Schäfer AuthorDate: Fri May 19 15:49:54 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri May 19 17:12:57 2017 +0200 Fixup boot-load-size for efi loader in iso Pass the real boot-load-size of the used loader as number of 512byte blocks to the iso creation call. Related to (bsc#939456) commit 2b40351550e43cd1396348a0701c91fc8d6da981 Author: David Cassany AuthorDate: Fri May 19 16:52:28 2017 +0200 Commit: David Cassany CommitDate: Fri May 19 17:04:59 2017 +0200 Improve rpm-check-signatures support This commit ensures the signatures are checked for both: the repository and the rpm package. It applies for zypper, dnf and yum package managers. commit 4a9ed6c766fa9314981d7439fb34a0c82b6d8156 Author: Marcus Schäfer AuthorDate: Fri May 19 10:48:10 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri May 19 10:49:29 2017 +0200 Update documentation to meet review results commit 4a41806a3d80f0ea831e10845e90899e00413010 Author: Marcus Schäfer AuthorDate: Thu May 18 16:36:49 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu May 18 16:37:56 2017 +0200 Added GCE image primary setup information commit 41a2ebbe8ee9dfc9d6ffa8f63d9c7b611a3644b4 Author: Marcus Schäfer AuthorDate: Thu May 18 16:13:22 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu May 18 16:37:56 2017 +0200 Added Azure image primary setup information commit 60e3347162f1555f8c3471305039917a730e59b2 Author: Marcus Schäfer AuthorDate: Thu May 18 15:31:19 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu May 18 16:37:56 2017 +0200 Added EC2 image primary setup information commit f216ba022a6fc4cda028fc0e1970e6613006dc66 Author: Marcus Schäfer AuthorDate: Thu May 18 09:22:25 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu May 18 16:37:30 2017 +0200 rework building virtual disk image chapter Adapt to style as used in the live iso chapter and add references to low level topics regarding the setup of the image to work in the public cloud. Related to #323 commit 0c4ebf657e60ecfc28dc5fd4fdc20dba16d4193e Author: Marcus Schäfer AuthorDate: Thu May 18 14:42:14 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu May 18 14:42:14 2017 +0200 Map partition ID's from sgdisk to lowercase commit 070f88d26ddddb4a1200462c9abb01a6ece2f035 Author: David Cassany AuthorDate: Wed May 17 17:44:51 2017 +0200 Commit: David Cassany CommitDate: Wed May 17 17:44:51 2017 +0200 Get the first two characters of the gdisk partition code output According to the gdisk documentation the gdisk maps the partitions IDs to the MBR codes, but they are multiplied by 0x0100 in hexa. Meaning 0x8300 code is equivalent to 0x83 in MBR. This commit only considers the first two characters of the sgdisk partition code output. With this change the partition types are comparable, regardless of using MBR or GPT. commit 54d9bb9279b662d0930743727cd32d58f4ca1299 Author: David Cassany AuthorDate: Wed May 17 15:15:12 2017 +0200 Commit: David Cassany CommitDate: Wed May 17 15:15:12 2017 +0200 Fixes OEM deployments on a free partition, bnc#1039469 This commit updates the boot code for oem images. In case oem-partition-install flag was set, the boot code was not capable to find an appropriate partition due to not attaching properly the raw image as a loopback device. KIWI was calling 'losetup' command with wrong arguments. Fixes bnc#1039469 commit de48b23caaab9042acae08d411e311611b9662d9 Author: Marcus Schäfer AuthorDate: Wed May 17 10:52:18 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed May 17 10:52:18 2017 +0200 Bump version: 9.6.1 → 9.6.2 commit 7191e644c8471ef11775fcdc3400499d100853ee Author: Neal Gompa AuthorDate: Tue May 16 10:37:52 2017 -0400 Commit: Neal Gompa CommitDate: Tue May 16 13:09:48 2017 -0400 Use 'yum-deprecated' if it exists when using Yum On Fedora and Mageia systems, the Yum package manager binary is named 'yum-deprecated', and 'yum' redirects to DNF. This is a problem for being able to build images of Linux systems that use Yum as its package manager, like RHEL/CentOS 7. So, in order to ensure we use the right package manager, we check for the 'yum-deprecated' binary and use it if it exists. commit 366ffd424aeec00df9fb4fb9efdcee9641dacbec Author: Marcus Schäfer AuthorDate: Tue May 16 09:47:52 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue May 16 09:47:52 2017 +0200 Restructure low level topic (iso_to_usb) The low level topic references information from the base topic. In this case the name of the previously built image. I think we should provide information on each low level topic which references information from a base topic. commit 475a5ab526613f9703fd1696152c66c8b1d317dd Author: David Cassany AuthorDate: Mon May 15 19:38:53 2017 +0200 Commit: David Cassany CommitDate: Mon May 15 19:38:53 2017 +0200 Handle rpm-check-signatures flag for each package manager This commit adds support for the rpm-check-signatures flag, which sets the package manager to verify or not each package signature. By default KIWI assumes no gpg checks are done. commit 03cafdc1130705cf28654621978246cbccc48cd8 Author: Thomas Schraitle AuthorDate: Mon May 15 16:02:45 2017 +0200 Commit: Thomas Schraitle CommitDate: Mon May 15 16:14:01 2017 +0200 Separate low-level topics (dumping) * Separate the high-level (building) from the low-level part (dumping) * Introduce a subsection ("Working with Images"); not sure, if this is useful under "Building Images" * Enhance with some (general) advise about booting from USB commit 2d294e8a3195ea132553cdf0ba64909a70e31e00 Author: Thomas Schraitle AuthorDate: Mon May 15 13:42:26 2017 +0200 Commit: Thomas Schraitle CommitDate: Mon May 15 13:44:36 2017 +0200 Provide missing _hybrid_iso label commit 51c2b42a5de54e2f5f1ef061159c526a9de96390 Author: Marcus Schäfer AuthorDate: Mon May 15 11:27:02 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon May 15 11:27:02 2017 +0200 Fixup check_target_directory_not_in_shared_cache The runtime check compared the given target path if it starts with the cache directory /var/cache/kiwi. This however also matches for e.g /var/cache/kiwi-foo which would be a valid target directory. This patch changes the matcher in a way to really check if the target directory points to the same cache directory structure. commit f3522456e58a1da2c76998b09106bd16b96adce8 Author: Marcus Schäfer AuthorDate: Fri May 12 15:29:50 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri May 12 15:29:50 2017 +0200 Set default dracut output format to match upstream commit 49aa4097feb64e5b783e0fa67f01415eebfc0563 Author: Marcus Schäfer AuthorDate: Fri May 12 12:53:19 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri May 12 12:53:19 2017 +0200 Added dracut output file format detection Unfortunately the dracut initrd output file format varies between the different Linux distributions. Tools like lsinitrd, and also grub2 rely on the initrd output file to be in that format. Thus when kiwi uses dracut the same file format should be used all over the place in order to stay compatible with what the distribution does. Fixes #325 commit 9cf9952db5bf1baf092f34b339f6bd2345ea3268 Author: Thomas Schraitle AuthorDate: Fri May 12 11:42:55 2017 +0200 Commit: Thomas Schraitle CommitDate: Fri May 12 11:42:55 2017 +0200 Revised example for issue #323 * Add abstract (use `.. sidebar`, not sure if we should use it) * Collect all concept oriented text in the beginning * Introduce procedure and create steps * Remove lonely subsection and combine it with the procedure TODO: * Review * Decide, if `.. sidebar` is ok (or should we better use `.. topic`?) * Add additional, related information? commit f2e4456d553f4b68606b6ed760f9a1347d1dd5ed Author: Marcus Schäfer AuthorDate: Thu May 11 15:58:52 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu May 11 15:58:52 2017 +0200 Bump version: 9.6.0 → 9.6.1 commit 7e47e549b9534746c3b3e70be518a0609fa4c4f3 Author: David Cassany AuthorDate: Thu May 11 12:51:55 2017 +0200 Commit: David Cassany CommitDate: Thu May 11 12:51:55 2017 +0200 Update build docker images documentation This commit includes steps to install umoci and skopeo, descriptions for the configurable metadata in KIWI and some simple style fixes. commit 1257d2e439da6c2878975f2c9ee77cfe2b121823 Author: Marcus Schäfer AuthorDate: Tue May 9 17:34:01 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed May 10 16:32:23 2017 +0200 Fixed tox.ini doc target location of schema docs has changed, and we better disable the spell check as long as not all unknown technical terms are added to the wordlist.txt commit 2046220c07948d890495dd4c1b2dd0d430b3cd76 Author: Marcus Schäfer AuthorDate: Sun May 7 20:27:16 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed May 10 16:32:23 2017 +0200 Refactor documentation layout and structure The current design of the documentation does not allow for continous improvement and development. It's missing a basic structure and concept for documenting step-by-step workflows and generic explanations. commit cde129de2c48cb928081f4c8073f3500d2096b02 Author: Jellyfrog AuthorDate: Mon May 8 14:20:17 2017 +0200 Commit: GitHub CommitDate: Mon May 8 14:20:17 2017 +0200 Use correct service name variable commit dffc2618e1e52da7ca5a9d561cb2b48abf676c68 Author: Neal Gompa AuthorDate: Fri May 5 19:12:34 2017 -0400 Commit: Neal Gompa CommitDate: Fri May 5 19:12:34 2017 -0400 Remove erroneous statement in request_package_exclusion() for Yum+DNF commit be4aa08a4ea97ae182df3541fdaf78c5b6251485 Author: Marcus Schäfer AuthorDate: Fri May 5 09:04:42 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri May 5 09:04:42 2017 +0200 Fixed markup in contributing chapter The headline of a subsection wrongly indicates a toplevel entry commit 7fad743ecc5c5b8d5d5aac76ccd3b9ae53ddf426 Author: David Cassany AuthorDate: Fri Apr 28 12:33:12 2017 +0200 Commit: David Cassany CommitDate: Fri Apr 28 12:33:12 2017 +0200 Evaluate UNIONFS_CONFIG filesystem This commit makes sure the filesystem is parsed from the UNIONFS_CONFIG configuration variable when the PXE image is loaded to a block device. This commit fixes #316 commit 156b4bb80301fb6017ce2af35a12aa3fd803115e Author: Marcus Schäfer AuthorDate: Fri Apr 28 12:13:30 2017 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 28 12:13:30 2017 +0200 Fixed GPL license text to match headers and spec source headers and spec file is pointing to GPL v3 but the license file was still at version 2 commit 808a92ffe1f1c87941a1c6aa81a429abb019213b Author: Neal Gompa AuthorDate: Thu Apr 27 17:21:26 2017 -0400 Commit: Neal Gompa CommitDate: Thu Apr 27 17:32:22 2017 -0400 Add support for excluding packages when using DNF commit e2d66426373eaf0bfbbddb2880b4c6b5e595c625 Author: Neal Gompa AuthorDate: Thu Apr 27 17:19:13 2017 -0400 Commit: Neal Gompa CommitDate: Thu Apr 27 17:32:03 2017 -0400 Add support for excluding packages when using Yum commit 372c14ed483cf43ca4981c0ca129a7b0e6fa3372 Author: Neal Gompa AuthorDate: Thu Apr 27 16:21:46 2017 -0400 Commit: Neal Gompa CommitDate: Thu Apr 27 16:21:46 2017 -0400 Fix comment about Zypper locks to reflect reality commit e3a7d9a598265934b55b960e57a07338f6a33bcb Author: Marcus Schäfer AuthorDate: Wed Apr 26 17:29:31 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 26 17:29:31 2017 +0200 Bump version: 9.5.0 → 9.6.0 commit cec1512ba11a84cf8a45b6ae5a3f5cee354fa68c Author: Marcus Schäfer AuthorDate: Wed Apr 26 14:12:33 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 26 16:47:15 2017 +0200 Additional container commandline options Added --set-container-derived-from and --set-container-tag commandline options which allows to overwrite the data set in the XML configuration commit 9487a189ed3a7a1cd8b91abd7daed18a8e78b0bc Author: Marcus Schäfer AuthorDate: Tue Apr 25 17:41:01 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 25 17:48:16 2017 +0200 Implement obsrepositories source on derived_from The following reference to a derived container: obsrepositories:/container#latest Will be translated into the following buildservice local path: /usr/src/packages/SOURCES/containers/_obsrepositories/container#latest commit f58d96ea6c3260d9b6334ef8151030ab786300cc Author: Marcus Schäfer AuthorDate: Tue Apr 25 15:28:38 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 25 17:48:16 2017 +0200 Implement obs source on derived_from The following reference to a derived container: obs:/project/repo/container#tag Will be translated into the following buildservice local path: /usr/src/packages/SOURCES/containers/project/repo/container#tag commit cd8ec243ad8edb3b572e622c54363826c51500b0 Author: Marcus Schäfer AuthorDate: Tue Apr 25 15:25:04 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 25 15:25:04 2017 +0200 Use urlparse to detect uri scheme The source location postfix can contain several different formats e.g :/, or :// or even just :, python's urlparse is able to cope with all that which allows to work with the url scheme base name and thus makes handling this code more robust commit bdc0afaa026efece1f741bb56edab4b2c6c3b531 Author: Marcus Schäfer AuthorDate: Mon Apr 24 13:22:03 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 24 13:22:03 2017 +0200 Bump version: 9.4.11 → 9.5.0 commit 38dbd7e76d4f050c28fbe8bca07f769dd85430a6 Author: David Cassany AuthorDate: Mon Apr 24 12:29:44 2017 +0200 Commit: David Cassany CommitDate: Mon Apr 24 12:29:44 2017 +0200 Include '--delete' in OCI images DataSync This commit includes #310 patch for OCI images. It also corrects the end of line format for kiwi/container/docker.py and test/unit/container_image_docker_test.py, so flake tests are all green. commit b26969d53c1b8d3fc0df2a024129a82e93479009 Author: David Cassany AuthorDate: Wed Apr 12 14:46:52 2017 +0200 Commit: David Cassany CommitDate: Mon Apr 24 11:59:45 2017 +0200 Add clear attribute for entrypoint and subcommand sections This commit adds the possibility of clearing asny subcommand or entrypoint. This is relevant for docker derived images, as they inherit the configuration and it might lead to some bad behavior. commit 5d79d1580f89e982a3e6911512176e8d055e96e0 Author: David Cassany AuthorDate: Thu Apr 20 12:55:24 2017 +0200 Commit: David Cassany CommitDate: Thu Apr 20 12:55:24 2017 +0200 Include --delete flag in DataSync for docker images This commit includes the --delete flag in order to synchronize the docker images. This is relevant for derived images where the new layer might not only add files, but also remove something from the base image. Fixes #309 commit c35f9f3b236abdb829655f8432c2dbfbcf184f7b Author: David Cassany AuthorDate: Thu Apr 13 13:35:33 2017 +0200 Commit: David Cassany CommitDate: Wed Apr 19 16:44:33 2017 +0200 Add support for OCI images This commit adds support for OCI images. Most of the docker related code is reused for OCI classes and Docker classes have been refactored so now they are a splecialization of the OCI classes. It is done this way since KIWI internally only uses OCI format to operate with containers, therefore docker images just differ from OCI images by the way they are packaged or unpackaged. commit 47b799b26188b897ff890436e9db044b9fc33eb6 Author: Neal Gompa AuthorDate: Thu Apr 13 21:59:36 2017 -0400 Commit: Neal Gompa CommitDate: Thu Apr 13 22:12:41 2017 -0400 Do not purge the repositories before inserting them There are no good reasons to be purging the repo directories, especially when it is common for some distributions (Red Hat/CentOS/Fedora, for example) to ship repository configuration as packages. Deleting them puts the package manager in the system into a weird state, so we want to avoid this. commit eed6d36761d08796826ecef3edffca46c1df54cb Author: Neal Gompa AuthorDate: Thu Apr 13 22:05:46 2017 -0400 Commit: Neal Gompa CommitDate: Thu Apr 13 22:05:46 2017 -0400 Define correct default locations for sources-dir and preferences-dir In order to ensure that the defined repositories in the KIWI configuration are set to the correct places for installing into the image, the sources-dir and preferences-dir need to be redefined to point to the in-image location, as it is done for the other package managers. commit 5af69818154aef76de86a0496d030053779ede5e Author: Neal Gompa AuthorDate: Thu Apr 13 18:18:20 2017 -0400 Commit: Neal Gompa CommitDate: Thu Apr 13 18:18:20 2017 -0400 Fix default reposdir path for Yum commit d521f8af5437d6dba87033eda1dd42d5471b717f Author: David Cassany AuthorDate: Wed Apr 12 12:06:43 2017 +0200 Commit: David Cassany CommitDate: Wed Apr 12 16:42:28 2017 +0200 Add require/recommend installation support for yum This commit adds support to install required only or required plus recommended packages using yum as the package manager. commit 6eeced10104f4bd46bdd2e3ad90415774d920e88 Author: David Cassany AuthorDate: Wed Apr 12 10:04:36 2017 +0200 Commit: David Cassany CommitDate: Wed Apr 12 16:42:15 2017 +0200 Add support for required/recommended packages This commit enables support to install only required packages or install required plus recommended packages. commit 0d0fd33a42f00c4cace5f748c41cc3f9e55467b7 Author: David Cassany AuthorDate: Tue Apr 11 17:45:39 2017 +0200 Commit: David Cassany CommitDate: Wed Apr 12 16:42:05 2017 +0200 Include 'plusRecommended' management for dnf Add support to enable/disable installation of recommended packages for dnf package manager. With this commit 'plusRecommended' patternType triggers on installation of recommended packages, which is turned off by default. commit 234b8ac5b32537008fca36dfa0b9c91833d901f9 Author: Marcus Schäfer AuthorDate: Wed Apr 12 14:09:43 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 12 14:09:43 2017 +0200 Bump version: 9.4.10 → 9.4.11 commit d4681841e7dcd51ce58eab9aff859d52704439cc Author: David Cassany AuthorDate: Tue Apr 11 16:12:11 2017 +0200 Commit: David Cassany CommitDate: Tue Apr 11 16:12:11 2017 +0200 Make sure debian repositories database is populated before install This commit includes an 'apt-get update' call before any 'apt-get install' command. This way the packages database is always ready, even if no bootstrap procedure has been executed. commit cc5da88c73abecedf002dcc6294ba477d359dc04 Author: David Cassany AuthorDate: Wed Apr 5 14:31:49 2017 +0200 Commit: David Cassany CommitDate: Tue Apr 11 16:02:27 2017 +0200 Bypass bootstrap procedure if no bootstrap packages section This commit updates kiwi to bypass bootstrap procedure in case there is no bootstrap packages section. It also adds extra validation in root_bind. commit d79ee9217e93fe7ffb014b2296ed70ed4af341ce Author: Marcus Schäfer AuthorDate: Mon Apr 10 19:16:57 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 10 19:16:57 2017 +0200 Bump version: 9.4.9 → 9.4.10 commit 19bf90073a3751cff556cf35954328aefa7d133a Author: David Cassany AuthorDate: Mon Apr 10 17:21:00 2017 +0200 Commit: David Cassany CommitDate: Mon Apr 10 18:12:52 2017 +0200 Add warning logs for unkown base image URIs commit d1498a82a899b6258d818539e0538a753c6241ad Author: David Cassany AuthorDate: Mon Apr 10 16:05:53 2017 +0200 Commit: David Cassany CommitDate: Mon Apr 10 16:05:53 2017 +0200 Update spec template for SLE13->SLE15 commit 40dae55bc3ce8662248edd350fe81a1ad8cdf6aa Author: David Cassany AuthorDate: Mon Apr 10 15:46:05 2017 +0200 Commit: David Cassany CommitDate: Mon Apr 10 15:46:05 2017 +0200 Rename SLE13 to SLE15 commit 1f05b212b32d996d8cd895ffb966d5c60be2e404 Author: David Cassany AuthorDate: Mon Apr 10 14:33:25 2017 +0200 Commit: David Cassany CommitDate: Mon Apr 10 15:28:10 2017 +0200 Add method to setup installation of recommended packages With this commit package manager are always set to include only required packages or set to include required and recommended packages. This commit fixes #285 commit de7ee77b84bc35375bdd0d93baa6a54ac6a968be Author: Marcus Schäfer AuthorDate: Mon Apr 10 15:04:33 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 10 15:04:33 2017 +0200 Follow up fix for grub2 setup in live builder The live iso builder still used a fixed boot/grub2 path but due to the refactoring this path is now distro dependant and should be obtained dynamically commit a66c5141a60b3852e019214d4fb32d8a8bd82b72 Author: Marcus Schäfer AuthorDate: Mon Apr 10 15:03:04 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 10 15:03:04 2017 +0200 Cleanup use of bootloader path in boot code Instead of repeating the bootloader path only specify it once per setup path commit 14e0b46c1d87e69769013d5c35f49211220def01 Author: Marcus Schäfer AuthorDate: Thu Apr 6 15:51:32 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 6 15:51:32 2017 +0200 Bump version: 9.4.8 → 9.4.9 commit a7a290c048b33b06e9d0addf72e6fab8c3e465c9 Author: Marcus Schäfer AuthorDate: Thu Apr 6 15:16:31 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 6 15:16:31 2017 +0200 Update development and contribution chapter Fix some minor inconsistencies due to latest code changes with regards to py2 and py3 compatibility and also change the style of the chapter to be more straight forward for people who would like to contribute from scratch commit db680d1e81d43a6f52ca4880eda4d1601d689436 Author: Marcus Schäfer AuthorDate: Wed Apr 5 11:34:40 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 5 11:34:40 2017 +0200 Bump version: 9.4.7 → 9.4.8 commit 638f94b551b71a3df53def065b293b06c5995c37 Author: Marcus Schäfer AuthorDate: Wed Apr 5 11:33:26 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 5 11:33:26 2017 +0200 Fixup grub2 template parameters The boot_directory_name parameters was missing for live and install image builds commit 58d94151120bad57853a4f2c69dfd02fdfcf181f Author: Marcus Schäfer AuthorDate: Wed Apr 5 11:21:59 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 5 11:21:59 2017 +0200 Bump version: 9.4.6 → 9.4.7 commit 883aaf3bf4a4c39cc9ce8806386668a361102528 Author: Marcus Schäfer AuthorDate: Wed Apr 5 11:21:06 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 5 11:21:06 2017 +0200 Fixup grub2 bios module setup Only copy grub2 bios modules if the architecture supports it commit 89997b7f33417c90c1cda8630868a4fbbea446f6 Author: Marcus Schäfer AuthorDate: Wed Apr 5 10:22:53 2017 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 5 10:22:53 2017 +0200 Bump version: 9.4.5 → 9.4.6 commit 295a7faaf3c485d4bd9e49638b9b113a41050cde Author: Marcus Schäfer AuthorDate: Tue Apr 4 16:52:03 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 4 16:54:49 2017 +0200 Avoid GRUB_DISTRIBUTOR setup in etc/default/grub The GRUB_DISTRIBUTOR information can't be provided in a generic way for all distributions. The information should be either placed by a package post script (as done by most of the distributions) or by a custom kiwi config.sh or images.sh script. Fixes #286 Fixes (bsc#1032119) commit 20d12a18c2ec4fa8bf411a22b76c35a9ed741743 Author: Marcus Schäfer AuthorDate: Mon Apr 3 18:54:54 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 4 16:17:31 2017 +0200 Fixup grub2 setup and tool calls Depending on the distribution the grub tools are either named grub2-tool or grub-tool. Additionally the grub configuration data is expected to live in boot/grub2 or boot/grub. This commit handles the tool calls and also the grub boot directory setup in a generic way commit 0438183ae28da54a5cba1550ce116e05d5376c34 Author: David Cassany AuthorDate: Tue Apr 4 16:08:43 2017 +0200 Commit: David Cassany CommitDate: Tue Apr 4 16:08:43 2017 +0200 Added support for unknown uri types for base image references This commits bypasses any URI check if the uri schema is unknown in RootImport class. This way the URI is bypassed to skopeo if it couldn't be translated to any known type. That enables referencing images with any URI supported by skopeo, i.e. DockerHub images. commit 0fda4f84b34f1074d12a3b2b6c17ab3c8cee8ff5 Author: David Cassany AuthorDate: Tue Apr 4 12:43:18 2017 +0200 Commit: David Cassany CommitDate: Tue Apr 4 15:34:10 2017 +0200 Keep imported image in OCI format instead of docker Kiwi always uses OCI format for container manipulations, so it is easier to assume the image kept between prepare and create step is also in OCI format, this way less format convertions are needed. commit d85e0899e39697ddbc96b95fd60abc22cff82709 Author: Marcus Schäfer AuthorDate: Tue Apr 4 11:18:01 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 4 12:01:05 2017 +0200 Fixup bootloader menu title setup If the menu title is setup via the displayname attribute in the XML configuration, kiwi should not change this text by a prefix or any other style adaptions. Fixes #287 Fixes (bsc#1032118) commit 128e48734ede3c449e055b661c67364a1aca03b5 Author: Marcus Schäfer AuthorDate: Tue Apr 4 11:00:27 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 4 11:00:27 2017 +0200 Fixup copy of array in boot code The filtered nic interface names are stored in an array and copied back into the original array. The copy of the array was semantically wrong commit b6cd573c50ccc493c72481b91bfb4f56161b0b9b Author: David Cassany AuthorDate: Thu Mar 30 16:10:46 2017 +0200 Commit: David Cassany CommitDate: Fri Mar 31 11:25:49 2017 +0200 Include SLE13 boot descriptions for x86_64 and arm This commit includes boot descriptions for SLE13, the descriptions are based on leap 42.3. commit 692c911435829262c29725d527b03dcc802ab35a Author: Marcus Schäfer AuthorDate: Thu Mar 30 11:17:19 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Mar 30 11:17:19 2017 +0200 Delete obsolete ec2 disk format The ec2 value in the format attribute is deprecated and no longer supported It remained in the schema for a while and has now reached EOL commit e9def2be6f4232aba31da14f9dc1f5937cb2b4bb Author: Marcus Schäfer AuthorDate: Thu Mar 30 10:30:35 2017 +0200 Commit: Marcus Schäfer CommitDate: Thu Mar 30 10:30:35 2017 +0200 Bump version: 9.4.4 → 9.4.5 commit afe9d42d2e7f63c7a2130003a678b190c1d79092 Author: Marcus Schäfer AuthorDate: Tue Mar 28 14:23:05 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Mar 28 14:23:05 2017 +0200 Fixup theme setup in boot Make sure grub theme data is populated in the boot directory. Checking only for the presence of the theme directory is not enough. If the theme directory in boot does not contain the requested theme it must be provided including a warning if the theme data could not be found in the system commit 249871eaea8c7cf98c3b803f73ed9470aed4e15b Author: Marcus Schäfer AuthorDate: Mon Mar 27 14:22:27 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Mar 28 11:26:03 2017 +0200 Added element Allow network interface names to be filtered by the given regular expression. The expression is handled by the bash regexp operator. Interface names matching the rule will be filtered out, all others stay. It is also possible to pass the variable kiwi_oemnicfilter as kernel command line in a PXE deployment. Fixes #245 commit 4a0d1e9adde0db4b052053c319af49c75419f24a Author: Marcus Schäfer AuthorDate: Tue Mar 28 10:41:52 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Mar 28 11:19:28 2017 +0200 Do not change the API in an incompatible way commit 9d2878a132ee8010d7f1fde1a645e41a14155dc0 Author: Marcus Schäfer AuthorDate: Tue Mar 28 10:29:31 2017 +0200 Commit: Marcus Schäfer CommitDate: Tue Mar 28 11:19:28 2017 +0200 Use request_package_exclusion method in prepare commit 44d38c99972db1fc9eacfbe536c7c98965f3ffb3 Author: Marcus Schäfer AuthorDate: Mon Mar 27 15:19:14 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Mar 27 15:19:14 2017 +0200 Refactor method name of package manager interface The request_package_lock was renamed into request_package_exclusion because that is the goal, to actually exclude(skip) a package. From an implementation point of view this is done to set a lock in the zypper case. However other package managers might do it differently. The interface should stay consistent with regards to the user goal and not with the package manager specific implementation. This Fixes #248 commit b1cd3be6938f8b7dc73f262c2c356cfbe8e99e08 Author: Marcus Schäfer AuthorDate: Mon Mar 27 10:34:27 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Mar 27 10:34:27 2017 +0200 Bump version: 9.4.3 → 9.4.4 commit 28e0656345f7576fa4f73eed5600e76835bdba36 Author: Marcus Schäfer AuthorDate: Mon Mar 27 10:28:12 2017 +0200 Commit: Marcus Schäfer CommitDate: Mon Mar 27 10:28:12 2017 +0200 Delete no longer needed btrfs bootpath setup The adaption of the bootpath in the grub.cfg file with regards to the btrfs toplevel volume named '@' was the wrong solution. The fixes in the btrfs filesystem setup and the config files etc/default/grub and sysconfig/bootloader caused the grub toolchain to work properly. This Fixes (bsc#1030038) commit b3932de0a079dbdf82bcb2ce3179de38ea06afda Author: David Cassany AuthorDate: Fri Mar 24 16:27:38 2017 +0100 Commit: David Cassany CommitDate: Fri Mar 24 17:24:13 2017 +0100 Convert user input to absolute paths This commit converts the paths provided by the user with the command line to absolute paths. The effected arguments are: * --root * --target-dir * --bundle-dir This supersedes and fixes #271 commit e16dc8702b8ea7eb2a4ba2c5c3667418a8917cc8 Author: Marcus Schäfer AuthorDate: Fri Mar 24 11:09:54 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 24 11:09:54 2017 +0100 Support editbootconfig also for the iso type This Fixes #274 commit c8304d0fb689e2fecb1aafdf449b54a8e8a57e6d Author: Marcus Schäfer AuthorDate: Thu Mar 23 18:16:07 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 23 18:16:07 2017 +0100 ensure grub.cfg exists in EFI path for iso images For live and install iso image boot configurations the bootloader configuration must also exist in the EFI boot path commit 9843778a6ee52abe4c7f928782a36a5611ac47f6 Author: Marcus Schäfer AuthorDate: Wed Mar 22 15:34:08 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 22 15:34:08 2017 +0100 Throw a proper msg on missing filesystem reference Don't set a filesystem factor if no filesystem reference is set commit 88525f981cfcd344fa1a76a0b34e938c4968289d Author: Marcus Schäfer AuthorDate: Wed Mar 22 15:00:32 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 22 15:00:32 2017 +0100 Throw a proper exception on missing boot reference commit b0030f4a1999e5ded62fc94ea5371b8d27fc7cfe Author: Marcus Schäfer AuthorDate: Wed Mar 22 13:00:35 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 22 13:00:35 2017 +0100 Update schema documentation Add explanation for attributes with no documentation Fixup explanation for hybrid attribute commit 1bfdc4bf60fbfa907a650440afc6a0064c46a948 Author: Marcus Schäfer AuthorDate: Wed Mar 22 12:37:39 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 22 12:37:39 2017 +0100 Recommend jing in case of XML validation errors, jing is used to provide good error messages. jing as a requirement will pull in all of java which is unwanted, but a Recommends seems appropriate commit 9992b8c0f3bad5650bbba89a557e6e51ce090967 Author: Marcus Schäfer AuthorDate: Wed Mar 22 12:03:49 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 22 12:35:31 2017 +0100 Update flags attribute and its documentation Delete the seed and compressed value as it is not implemented and won't be supported in the future. Properly document the existing overlay methods commit 6f2d9b53a66cc6f6fa048c55075b2d226da31b89 Author: Marcus Schäfer AuthorDate: Wed Mar 22 11:27:45 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 22 11:27:45 2017 +0100 Added doc info for kiwinoswapsearch boot parameter commit 7ea8e56c8a057df9e8b4f1db8c04634f6faf81e4 Author: Marcus Schäfer AuthorDate: Tue Mar 21 18:13:09 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 21 18:13:09 2017 +0100 Bump version: 9.4.2 → 9.4.3 commit 08275454e96f9daf47ae39e8230d4106467d5adc Author: Marcus Schäfer AuthorDate: Tue Mar 21 17:31:05 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 21 17:41:31 2017 +0100 Fixed checksum file creation If the checksum should be created from a compressed file it is expected that the checksum of the uncompressed file is added to the checksum file. This is because in a pxe deployment the uncompressed version of the file is put on disk and compared with the reference information in the checksum file commit e54916a1c869504c293cea097688e0421092862e Author: Marcus Schäfer AuthorDate: Tue Mar 21 11:10:50 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 21 17:41:31 2017 +0100 Refactor ip link detection There is no reliable way to check if a link is unplugged, thus the code has changed into the following workflow 1. use interfaces which returns success on ip link set up 2. wait for the UP state on all of these interfaces and return if one of them enters the UP state 3. call a fixed wait state to allow to kernel network drivers to settle 4. run through all remaining interfaces, discover the link state and call a DHCP discovery commit 6b4545c51d3dbbacb184796e1f677d778948ddbd Author: Marcus Schäfer AuthorDate: Mon Mar 20 12:55:25 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 20 12:55:25 2017 +0100 Bump version: 9.4.1 → 9.4.2 commit de7e49a6cfbfcca6f26885add35a25727d1640b6 Author: Marcus Schäfer AuthorDate: Mon Mar 20 12:53:58 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 20 12:53:58 2017 +0100 Fixup pxe builder filesystem image rootfs was not in toplevel commit 5a41b3a8d52d8d62292f150aa8fefbfe1bc57ba4 Author: Marcus Schäfer AuthorDate: Mon Mar 20 11:36:07 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 20 11:36:07 2017 +0100 Bump version: 9.4.0 → 9.4.1 commit 6346658ab39f4f37c47bb844cd3397a376162fa0 Author: Marcus Schäfer AuthorDate: Mon Mar 20 11:32:30 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 20 11:32:30 2017 +0100 Fixup pxe builder Generate a tarball containing all relevant pxe boot result files instead of a bunch of extra files. This also turns the pxe builder to be compatible again with the legacy kiwi pxe bundler commit aae800ae6d75994bbdf1c32335fefc8cb3807c00 Author: Marcus Schäfer AuthorDate: Fri Mar 17 16:09:41 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 17 16:09:41 2017 +0100 Don't create shasum over an md5 file commit d62ae5e31ef3e13d6a234e1559178c3ed2a137ec Author: Marcus Schäfer AuthorDate: Thu Mar 16 09:45:14 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 16 09:45:14 2017 +0100 Bump version: 9.3.3 → 9.4.0 commit 3e70f1351b85859365c898471c3bf208b64312c3 Author: Marcus Schäfer AuthorDate: Wed Mar 15 17:27:38 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 15 17:27:38 2017 +0100 Allow https location as repository source commit f71f7aea189a531f31e52df8dbec7d26b980d8a8 Author: David Cassany AuthorDate: Wed Mar 15 09:47:35 2017 +0100 Commit: David Cassany CommitDate: Wed Mar 15 09:47:35 2017 +0100 Refactor RootImport to keep images with a default name RootImport has been refactored so the image is kept with a known name that can be obtained with the Defaults class. commit bcdba8d159cda511683ca46fafbfcb64eba69c98 Author: Marcus Schäfer AuthorDate: Tue Mar 14 16:14:52 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 14 16:14:52 2017 +0100 Added SLE13 distribution matcher commit 2a29f7cc5bbce4194bb56e6117008768c3e15502 Author: Marcus Schäfer AuthorDate: Tue Mar 14 16:14:17 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 14 16:14:17 2017 +0100 Update distribution matcher in spec file commit ad2ca8d2aad741be805d70fa9a22c1ca02c0331d Author: Marcus Schäfer AuthorDate: Tue Mar 14 10:22:59 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 14 10:22:59 2017 +0100 Refactor ContainerBuilder Use Checksum instance to run a checksum match Check for existence of base image at earliest opportunity when constructing a ContainerBuilder commit 95504b1414b1a5e5bd1958cf29b6ace492658653 Author: Marcus Schäfer AuthorDate: Tue Mar 14 10:22:06 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 14 10:22:06 2017 +0100 Added checksum matcher method to Checksum class commit 15163966403bfa7ff17e33c90575916055fb9db2 Author: Marcus Schäfer AuthorDate: Tue Mar 14 10:20:44 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 14 10:20:44 2017 +0100 Delete unused code Also fixed corresponding unit test commit 0f68081211df58eff1380d44561c4e7f7df0422b Author: Marcus Schäfer AuthorDate: Mon Mar 13 15:45:32 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 13 20:20:24 2017 +0100 Handle derived image as Uri instance commit 98d56ea34f6e76c006a7f54de350544bbb7ee533 Author: David Cassany AuthorDate: Thu Mar 9 13:46:05 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 13 20:20:24 2017 +0100 Refactored RootImport and included checksum validation First, commit refactors RootImport in order to also copy the imported image after sychronizing the import. Second, it includes a checksum of the copied image which is validated in later steps. commit 9e8eb94d6dc04156e9a726ba80107a4ac65aaf2b Author: David Cassany AuthorDate: Wed Mar 8 09:32:02 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 13 20:20:24 2017 +0100 Support for layered docker images This commit includes support for building layered docker. A new layer is added on top of the base image referenced by `derived_from` attribute. commit 2b2bb847eb2383a5318dd67ad285c400114edf5b Author: Marcus Schäfer AuthorDate: Mon Mar 13 16:37:21 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 13 16:55:55 2017 +0100 Make sure LICENSE and README got installed commit 8c867eaae239b6977ac025f3976a14e529740957 Author: Marcus Schäfer AuthorDate: Mon Mar 13 14:33:47 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 13 14:33:47 2017 +0100 Add completion for versioned binaries when installing kiwi via pip, no alternatives setup done when installing via rpm will be performed. In order to allow the bash completion to work also the versioned binaries needs to be added in the completion script commit 4f0b66549e15f1238f2fc63418bde3149c998c5d Author: Marcus Schäfer AuthorDate: Mon Mar 13 14:00:10 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 13 14:00:10 2017 +0100 Bump version: 9.3.2 → 9.3.3 commit 15f211f9d1f7a1950d325fb30299958dacd8fdd8 Author: Marcus Schäfer AuthorDate: Fri Mar 10 17:08:11 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 13 09:48:18 2017 +0100 Add documentation hint for multipython package commit 557d29ac4541500b27e8d860325de5a687173712 Author: Marcus Schäfer AuthorDate: Thu Mar 9 17:21:54 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 13 09:48:18 2017 +0100 Setup package for multipython build Build package for both python2 and python3 commit b9129fab8df17a0f3ec7b6711701c9b217c5efd7 Author: Marcus Schäfer AuthorDate: Wed Mar 8 17:24:18 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 8 17:24:18 2017 +0100 Added Leap42.3 boot descriptions commit 2ba3d0c092605f3f842bb70fe5a081fc041f8b28 Author: Marcus Schäfer AuthorDate: Wed Mar 8 17:23:43 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 8 17:23:43 2017 +0100 Deleted openSUSE 13.2 boot descriptions commit e8769b8fca8b335981fc8779cdaeea4e643eda1c Author: Marcus Schäfer AuthorDate: Wed Mar 8 16:06:09 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 8 16:06:09 2017 +0100 Refactor Uri constructor Make repo_type an optional parameter, which is only required if the specified uri leaves a type choice commit 37ddf2c694372f8ad1c54c1310ba00d145fa40d6 Author: Marcus Schäfer AuthorDate: Wed Mar 8 12:33:13 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 8 12:33:13 2017 +0100 Fixup PyPI entry registry The wrong project url was referenced commit 480daac339ddfb9e4bfc0419dda74a03cddc526f Author: Marcus Schäfer AuthorDate: Tue Mar 7 17:40:07 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 7 17:40:07 2017 +0100 Bump version: 9.3.1 → 9.3.2 commit 793aefd422940b7cdaa69fa8af6ef958c1e25c16 Author: Marcus Schäfer AuthorDate: Tue Mar 7 17:35:11 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 7 17:35:11 2017 +0100 Fixed MANIFEST.in kiwi.solver code was not included into source archive commit 62d2353fad0ec2b908c0b8d0084bd40c6b77b279 Author: Marcus Schäfer AuthorDate: Tue Mar 7 16:45:41 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 7 16:45:41 2017 +0100 Bump version: 9.3.0 → 9.3.1 commit fe9064e6294fe215e393b5a94419d1fcf5d7d9a1 Author: Marcus Schäfer AuthorDate: Tue Mar 7 16:45:06 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 7 16:45:06 2017 +0100 Fixed doc api build for renamed source file commit 31afdc7b3356d940978b13cb405f71b32966dd92 Author: Marcus Schäfer AuthorDate: Tue Mar 7 16:31:45 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 7 16:31:45 2017 +0100 Bump version: 9.2.4 → 9.3.0 commit 9e219c5ac3bf52627830440c5a2456941789750e Author: Marcus Schäfer AuthorDate: Tue Mar 7 16:22:04 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 7 16:22:04 2017 +0100 Flake8 fixes for unit tests commit 37d09c1b57d3fadfe88d7366ac09c6bf68df12f9 Author: Marcus Schäfer AuthorDate: Tue Mar 7 15:33:55 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 7 15:50:40 2017 +0100 Apply code quality checks for unit tests too commit 1fe0c9a2668d3a1af1e0696dab860e0bb4fd2576 Author: David Cassany AuthorDate: Tue Mar 7 12:40:25 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 7 15:14:03 2017 +0100 Import root system from a given image This commit includes the root import feature. A `derived_from` attribute has been included with the section to make reference to the image file to import. The image format to import is assumed to be the same as the build type to import. The current format supported is docker commit b421b8d6215626f48031c30e7de52f9e063fc014 Author: Marcus Schäfer AuthorDate: Tue Mar 7 13:15:44 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 7 13:15:44 2017 +0100 Fixed import of solv module commit 6cc0b2085d55c9bd129181a52f8cba5d332a0914 Author: Marcus Schäfer AuthorDate: Tue Mar 7 12:35:20 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 7 13:03:10 2017 +0100 Flake cleanup for unit tests commit 1a5257a0e8936265dc9158217b01a5e533e20406 Author: Marcus Schäfer AuthorDate: Mon Mar 6 17:23:30 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 7 11:23:37 2017 +0100 Prevent use of project relative import statements For details on the motivation of this change please visit: https://wiki.python.org/moin/FutureProofPython commit df43f0b8f018c26f957336011896755b54fa45c9 Author: Marcus Schäfer AuthorDate: Mon Mar 6 15:34:41 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 6 15:34:41 2017 +0100 Allow activation/deactivation of sysV services systemd is still legacy sysV init compatible, thus the kiwi helper scripts to activate/deactivate services should not only be limited to systemd services. Fixes #256 commit fc112915767ff65055b2e166103ba79992d7fd58 Author: Marcus Schäfer AuthorDate: Mon Mar 6 12:03:03 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 6 12:03:03 2017 +0100 Support package capabilities in sat solver A solver operation can receive a package or pattern name but a capability name was considered a package name and failed to resolve. This commit fixes the solver operation with regards to package capabilities commit de3441d7f14ef8e39be03c6b7645aa7e3657afc6 Author: Marcus Schäfer AuthorDate: Mon Mar 6 10:57:28 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 6 10:57:28 2017 +0100 Add runtime check for kernel match If a kiwi initrd is used, the kernel used to build the kiwi initrd and the kernel used in the system image must be the same in order to avoid an inconsistent boot setup. This is related to (bsc#1027610) commit a03a1e0e27a17be028497596dea9dffd2e136ee6 Author: Marcus Schäfer AuthorDate: Fri Mar 3 16:22:29 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 6 09:18:35 2017 +0100 Added runtime check for boot image reference If an initrd_system different from kiwi is selected for a vmx (simple disk) image, it does not make sense to setup a reference to a kiwi boot image description, because no kiwi boot image will be built. Despite that it does not hurt it's still an inconsistent setup. This is related to (bsc#1027610) commit 05876a1858eb58a64b4c44d4d5ee79dd0094b6df Author: Marcus Schäfer AuthorDate: Fri Mar 3 12:11:34 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 3 12:11:34 2017 +0100 Bump version: 9.2.3 → 9.2.4 commit 640a1be98a9078cbf686c6e20bd7d2a45566e639 Author: Marcus Schäfer AuthorDate: Fri Mar 3 12:10:47 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 3 12:10:47 2017 +0100 Update documentation the docker build container is now build with the correct namespace. Thus no image tagging is required anymore commit d422d29d2518a4729c615a40913ec218da9d85ba Author: Marcus Schäfer AuthorDate: Fri Mar 3 11:32:47 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 3 11:32:47 2017 +0100 Bump version: 9.2.2 → 9.2.3 commit e88758988a0a6bb6213cccf7b428c01ddd5513ba Author: David Cassany Viladomat AuthorDate: Thu Mar 2 17:14:52 2017 +0100 Commit: GitHub CommitDate: Thu Mar 2 17:14:52 2017 +0100 Support container names with slashes (#254) Umoci tool doesn't require any other parameter than a tag to identify the container. So container_name value is not used in umoci. This Fixes#253 commit 3db5a1a6069c1e6b71b961e21e7e9b4d091430a5 Author: Marcus Schäfer AuthorDate: Tue Feb 28 16:29:09 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 2 15:35:53 2017 +0100 Add support for repository credentials The package and solver repository classes did not provide an interface to deal with repository credentials. This commit add support for the zypper package manager and the generic urlopen based download method of the solver class. This Fixes #246 commit 5ac52b94962208fb40ea4f92b2dfe2554b386f34 Author: David Cassany AuthorDate: Wed Mar 1 15:02:31 2017 +0100 Commit: David Cassany CommitDate: Wed Mar 1 15:02:31 2017 +0100 Use default command only if no entrypoit and subcommand aren't set Fixes #251 commit 5685135accd0837087551f5ade267a9c8fce3930 Author: David Cassany AuthorDate: Wed Mar 1 12:51:01 2017 +0100 Commit: David Cassany CommitDate: Wed Mar 1 13:04:12 2017 +0100 Fix tagging for OCI images This commit fixes the tagging schema for umoci. An OCI image name is path[:tag], this commit rearranges some variable names to avoid confusions between names and tags. Fixes #249 commit f89077bb9122d598ee08c0d5372400732476c531 Author: Neal Gompa AuthorDate: Tue Feb 28 07:52:25 2017 -0500 Commit: Neal Gompa CommitDate: Tue Feb 28 07:52:25 2017 -0500 Fix default reposdir path for DNF commit da74d953aa7854e9e3447a6b24532d23ce6ecb54 Author: Marcus Schäfer AuthorDate: Tue Feb 28 13:08:54 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 28 13:08:54 2017 +0100 Bump version: 9.2.1 → 9.2.2 commit 8ced385aa6f1420338a2e625c5ae0fb6757afa3f Author: Marcus Schäfer AuthorDate: Tue Feb 28 13:07:38 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 28 13:07:38 2017 +0100 Update documentation Add detailed information how to update the docker Build Container on the official dockerhub registry. This is needed to use custom or newer versions of the currently published Build Container commit 3851e427575055914e7f3e7c99e3cda9d5c28d54 Author: Marcus Schäfer AuthorDate: Tue Feb 28 12:43:11 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 28 12:43:11 2017 +0100 Bump version: 9.2.0 → 9.2.1 commit 1677f386d5c5215da1c18025facd033076d9e3cb Author: Marcus Schäfer AuthorDate: Tue Feb 28 12:42:12 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 28 12:42:12 2017 +0100 Update documentation The changes in building docker images now allows for using the docker load command to import the dice container commit d5d9cce8da67503042ed8a777d68a1dcc66b5b31 Author: Marcus Schäfer AuthorDate: Mon Feb 27 15:45:14 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 27 15:45:14 2017 +0100 Bump version: 9.1.0 → 9.2.0 commit 889ce8a98bf8b41d410abf76c64725b5d5ad5edd Author: Marcus Schäfer AuthorDate: Fri Jan 13 16:30:32 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 27 15:28:38 2017 +0100 Add check_docker_tool_chain_installed Runtime check to check for required docker tools umoci and skopeo. As long as tools tools are not available in the core distro of all distributions we avoid spec file requirements and check at runtime if they can be found commit 3e6848ed88b57e4c62bbac91d5441d857d30e458 Author: Marcus Schäfer AuthorDate: Mon Jan 9 17:03:07 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 27 15:28:38 2017 +0100 Refactor docker container creation Instead of creating a simple tarball the tools umoci and skopeo from the docker tool chain are used to create official docker images. Along with those tools more information to describe a container has been added to the schema. A complete container setup now consists of the following elements ... ... ... ... ... commit 618b32b396a69d30c9e8c075b2a6f5b3039d34bd Author: Marcus Schäfer AuthorDate: Mon Feb 27 11:35:06 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 27 11:35:06 2017 +0100 Added support for exclude docs for dnf commit 134e7bc861eb389cca3290a3ad3d707136875e1d Author: Marcus Schäfer AuthorDate: Mon Feb 27 10:19:56 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 27 10:19:56 2017 +0100 Fixup default cache and plugin dir for dnf commit 1c3524ee1310b324e5eac97035f32f23312bf561 Author: Marcus Schäfer AuthorDate: Fri Feb 24 15:08:09 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 24 15:08:09 2017 +0100 Update distribution support status Add information that Fedora systems are now supported as well commit ecb07e10f7ba85a3a37131745cb0bbabbbc0ede5 Author: Marcus Schäfer AuthorDate: Fri Feb 24 14:29:55 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 24 14:50:59 2017 +0100 Make sure bootenv can be initialized An existing grub bootenv file should be deleted prior to calling grub2-install in order to allow grub2 to create a new correct bootenv file commit 68c217c3d920a0c7564986c07f9e0d7d55335384 Author: Marcus Schäfer AuthorDate: Thu Feb 23 15:37:26 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 24 14:50:59 2017 +0100 Added DNF package management implementation DNF is the package manager used on Fedora systems and will also most likely replace yum for the next generation of RHEL. Along with the implementation here an example JeOS image description for Fedora can be found on: https://github.com/SUSE/kiwi-descriptions. This Fixes #36 commit 7285b498b37760953635996c2b1cf09c7a008834 Author: Marcus Schäfer AuthorDate: Tue Feb 21 09:20:45 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 21 09:20:45 2017 +0100 Follow up fix for network driver delay Each network interface will be switched off for a short moment when the kernel network driver is loaded. During that time the link status information would be misleading. Thus we wait a short time before the link status check is started commit dd3d36b60cd5a551bbc06062479ccb5cbad30be4 Author: David Cassany AuthorDate: Mon Feb 20 17:38:24 2017 +0100 Commit: David Cassany CommitDate: Mon Feb 20 17:38:24 2017 +0100 Include compression optimization flags for mksquashfs command This commit includes some flags for mksquashfs command in other to achieve higher compression rates. Also note that those flags were already present in KIWI former versions, thus they have been included again for compatibility reasons. This commit fixes #242 commit 37c1e1e3a1e445dd6cf274eea7af2ae2720b942b Author: Marcus Schäfer AuthorDate: Mon Feb 20 16:27:52 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 20 16:27:52 2017 +0100 Allow to convert GPT into MBR The type attribute force_mbr allows to convert a system selected for use with a GPT to use an MBR (msdos table). The attribute only takes effect on image configurations which would select the GPT partitioner. This Fixes #236 commit 5f96113350f3df6abf72796225142d880cc4927f Author: Marcus Schäfer AuthorDate: Mon Feb 20 11:34:13 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 20 11:34:13 2017 +0100 Wait for network drivers to pass init Before we check for the link status a waid period of 3 seconds should guarantee that the network drivers have passed the init routines commit 22b286e6f475ff1ae2113f69e00af937f38d050e Author: Marcus Schäfer AuthorDate: Thu Feb 16 15:37:34 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 16 15:37:34 2017 +0100 Refactor waitForLinkUp Put code which does not belong into the loop outside of the loop. Also maintain sleep timeout and retry count in variables commit 357502a032015be2dcac4582dfb2a42de03cb2b1 Author: Marcus Schäfer AuthorDate: Thu Feb 16 15:24:27 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 16 15:28:52 2017 +0100 Fixed waitForLinkUp and setIPLinkUp The setIPLinkUp method did not handle the return value of the waitForLinkUp call and always returned success even if waitForLinkUp ran into a timeout The waitForLinkUp method was improved in a way that it does not wait if the link detection discovered the interface is unplugged. The detection if a cable is connected or not only works if the ifplugstatus tool was found in the initrd commit d7ed637f9b08e8da1dc26111dc501120291c302e Author: Marcus Schäfer AuthorDate: Fri Feb 10 09:52:55 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 10 09:52:55 2017 +0100 Bump version: 9.0.2 → 9.1.0 commit d62e9ec31fdb529e1414d42a75eac85609576923 Author: Marcus Schäfer AuthorDate: Thu Feb 9 17:02:38 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 9 17:02:38 2017 +0100 Implement handling for efipartsize commit d307bb8b6be49711fcede904206d6feac4b84ad7 Author: Marcus Schäfer AuthorDate: Thu Feb 9 16:48:38 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 9 16:48:38 2017 +0100 Decrease default EFI partition size to 20MB The former default of 200MB was way too large and is a waste of space. Related to Issue #237 commit 75275e8010d0e66b4fa0e6bed3a180b78e60eadc Author: Marcus Schäfer AuthorDate: Thu Feb 9 16:47:48 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 9 16:47:48 2017 +0100 Added efipartsize attribute in type setup The attribute allows to specify a custom size for the EFI partition. Fixes #237 commit 501d8a895507fc96b432f91842aa446335cc7f96 Author: Marcus Schäfer AuthorDate: Thu Feb 9 15:34:48 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 9 15:54:24 2017 +0100 Allow bootloader="custom" for bootloader attribute If specified as such the bootloader configuration and installation will be skipped. However the editbootinstall and editbootconfig scripts will still be called. This Fixes #235 commit c6c360c6c5dabb177f8142d050d7f0f72b97d4ef Author: Marcus Schäfer AuthorDate: Thu Feb 9 11:37:38 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 9 11:37:38 2017 +0100 Fixed create_repository_solvable If the solvable already exists, the method should return it commit 9728b698a2d6946e93cd132594daef2910f4dbec Author: Marcus Schäfer AuthorDate: Wed Feb 8 17:19:37 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 8 17:19:37 2017 +0100 Added handling for spare_part attribute Add a spare partition right before the root partition of the configured size. Fixes #234 commit 85f9b2bc4c2b410b14ff11b64217c5eadc0cd884 Author: Marcus Schäfer AuthorDate: Wed Feb 8 16:27:37 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 8 16:28:47 2017 +0100 Added new type attribute spare_part spare_part receives a size value with an optional unit (M|G) and is used for disk images to allow the creaton of a spare partition of the configured size. Issue #234 commit 865f3bb2ca1bcc40c5dbd06e8a9a101038aca93e Author: Marcus Schäfer AuthorDate: Wed Feb 8 15:53:10 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 8 15:53:10 2017 +0100 Delete all traces of vboot firmware The vboot firmware setup was a workaround on arm for the chromebook platform several years ago. From a todays perspective the setup and the way to boot would be different and obsoletes the special case implementation. Thus this is gone now. Related to Issue #234 commit 1ef41aaefdb67c0c3a2bbc0b74fba7e3b004fe81 Author: Marcus Schäfer AuthorDate: Wed Feb 8 10:56:06 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 8 10:56:06 2017 +0100 Prevent quoted domain name in dhclientImportInfo We're getting domain name by parsion a lease file. Unfortunately in lease file domain name is quoted, which breaks linux resolver. This commit gets domainname unquoted commit 10217ad0d7ccde08ad1ebffc8d7c6bb2acd87c7d Author: Marcus Schäfer AuthorDate: Tue Feb 7 11:01:18 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 7 11:01:18 2017 +0100 Add manual page for image info command commit 2e6816bd0bd4e9af163d76bb454854dc616fe1eb Author: Marcus Schäfer AuthorDate: Mon Feb 6 17:38:53 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 6 17:38:53 2017 +0100 Added kiwi image info command Allow to list information about the image description. In a first implementation one can show the image name as well as run a dependency resolution for the packages listed in the XML description commit 7b06a1ac2d478837aea69d22e3ce8cea53c2f492 Author: Marcus Schäfer AuthorDate: Fri Feb 3 15:18:57 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 3 15:18:57 2017 +0100 Bump version: 9.0.1 → 9.0.2 commit 1f2a7b49b9658f374016c346547d3f2679c03756 Author: Marcus Schäfer AuthorDate: Fri Feb 3 15:17:27 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 3 15:17:27 2017 +0100 Added uri translation for SUSE factory The obs uri 'obs://openSUSE:Factory/standard' does not follow the standard http url translation schema and needed a special handling in order to resolve correctly commit 7ff1844e6f0a3138e52e5ca648f1f20c6f3007c3 Author: Marcus Schäfer AuthorDate: Thu Feb 2 15:56:42 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 2 15:56:42 2017 +0100 Eliminate instsource element and requirements The schema defintions for kiwi v8 still contained the product schema definitions aka instsource which is no longer supported by this version of kiwi. Building SUSE products is done with the kiwi v7 code base and will most probably be handled by an extra product builder tool in the future maintained and developed by the buildservice team. We would be proud if the api of the kiwi v8 code base can be helpful for the product builder in the future commit 1b39f723d16996757ad2a6726083726d91a51924 Author: Marcus Schäfer AuthorDate: Wed Feb 1 15:56:36 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 1 15:56:36 2017 +0100 Bump version: 9.0.0 → 9.0.1 commit 7141ee16e430a138657705c56818eadd579744a6 Author: Marcus Schäfer AuthorDate: Wed Feb 1 15:30:06 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 1 15:30:06 2017 +0100 Added arch attribute for ignore section The packages subsection only accepted a package name to become ignored. However a subsection to install a package allows for an arch selection. The same should apply to ignore a package. In addition the allowed content for the arch attribute has been changed from simple text to a regular expression. Allowed is a comma seperated list of reserved architecture words like they are displayed by uname -m commit 7e762a6d5ebf804a3371bb2d83709be4bd937014 Author: Marcus Schäfer AuthorDate: Wed Feb 1 11:25:00 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 1 11:25:00 2017 +0100 User format method to form the message commit d2c5f64434e242ec8daf7d488de73083da521abf Author: Marcus Schäfer AuthorDate: Wed Feb 1 11:14:32 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 1 11:14:32 2017 +0100 Added support for package locking for zypper Zypper supports the al (add lock) command which allows to ignore a package in the dependecny resolution process. This is useful to prevent installation of a package which was pulled in by e.g a recommendation flag from the spec file. Packages marked to be ignored are not handled for apt and yum right now. Using this feature together with an unsupported package manager backend results in a warning to the user commit 4f41ce901d02901eb61106df3e38b9eb63893f1e Author: David Cassany AuthorDate: Wed Feb 1 10:44:07 2017 +0100 Commit: David Cassany CommitDate: Wed Feb 1 10:44:07 2017 +0100 Included some file naming convetions commit 2b83c803d5437239d5a83fcaa193b72565fbaffd Author: David Cassany AuthorDate: Mon Jan 30 18:12:06 2017 +0100 Commit: David Cassany CommitDate: Mon Jan 30 18:20:44 2017 +0100 Components of an Image Description section This commit extends the doc/sources/workflow.rst documentation by including details about config.sh and images.sh files. commit e88dc6ae7a702c8bef48a7e7cab309fb690e1221 Author: Marcus Schäfer AuthorDate: Fri Jan 27 14:21:48 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 27 14:21:48 2017 +0100 Bump version: 8.29.6 → 9.0.0 commit a20d98394dc6b7ec90635aff635e4f22764d9fd4 Author: Marcus Schäfer AuthorDate: Thu Jan 26 15:42:20 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 26 15:42:20 2017 +0100 Update documentation Add information about new hook: handleMachineID commit 691f82e8201eb2e33312f6a8c4fe5d61785b657e Author: Marcus Schäfer AuthorDate: Thu Jan 26 15:17:26 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 26 15:17:26 2017 +0100 Bump version: 8.29.5 → 8.29.6 commit f37070a435c224ab7ee16bd499041c5fc7ab0dc4 Author: Marcus Schäfer AuthorDate: Thu Jan 26 14:38:37 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 26 14:38:37 2017 +0100 Fixup isolinux timeout configuration isolinux counts the timeout in units of 1/10 seconds. Thus the value provided in the image description needs to be adapted correctly. This Fixes #228 commit a67c4e884eda38fdabbce4e2e2a4f4aee2a50e44 Author: Marcus Schäfer AuthorDate: Thu Jan 26 11:37:28 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 26 11:37:28 2017 +0100 Bump version: 8.29.4 → 8.29.5 commit e612e4e5cf5e1c04b30853c69eb07af5b4bf0445 Author: Marcus Schäfer AuthorDate: Thu Jan 26 11:35:13 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 26 11:35:13 2017 +0100 Fixup setupMachineID Cleaning up existing machine id files by deleting them causes an interactive session to be started by systemd This is something we don't want. As the consequences of touching the machine id files seems to be too critical the method has been turned into a hook caller. This allows the user to make use of it on their own purpose and by default doesn't mess with the machine id files commit 2dc0c9154ab78bc45cc8185e59f66b7cca2f7dbc Author: Marcus Schäfer AuthorDate: Tue Jan 24 09:47:48 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 24 09:47:48 2017 +0100 Bump version: 8.29.3 → 8.29.4 commit df77ebefaed0371e213e8ac3f95c73fd45915559 Author: Marcus Schäfer AuthorDate: Tue Jan 24 09:46:13 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 24 09:46:13 2017 +0100 Change processing of setupMachineID Instead of creating new machine ids for systemd and dbus the method now cleans up all existing machine ids and leave it up to systemd to initialize and create new ids. This allows to make use of the native way how systemd retrieves and handles machine ids commit 57769bca44befc33c44f451b75957f2f8cd54524 Author: Marcus Schäfer AuthorDate: Tue Jan 24 09:40:58 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 24 09:40:58 2017 +0100 Fixup typo in ReST style commit 78635b885c27ff65a5f353cf9a606a4d85caf5b8 Author: Marcus Schäfer AuthorDate: Tue Jan 24 09:17:49 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 24 09:17:49 2017 +0100 Bump version: 8.29.2 → 8.29.3 commit 6c69f1c5e791ca5f4e1d8307599c6167319cfffe Author: Marcus Schäfer AuthorDate: Mon Jan 23 17:25:39 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 23 17:25:39 2017 +0100 Add utils.sysconfig to api documentation commit 374be7c04215c94bac8fb671be2a17a9ed304c0f Author: Marcus Schäfer AuthorDate: Mon Jan 23 11:20:05 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 23 17:24:04 2017 +0100 Completion for grub bootloader configuration The configuration files /etc/sysconfig/bootloader and /etc/default/grub needs to be created/updated with the relevant values regarding the bootloader setup done by kiwi. This Fixes #226 commit 5c5fb719eab9bc7a5aef3382e3c590b26883bcb3 Author: Marcus Schäfer AuthorDate: Fri Jan 20 16:00:59 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 20 16:00:59 2017 +0100 Apply volume attributes for btrfs and lvm The chattr utility is used to apply file attributes So far only the no-copy-on-write attribute can be specified in a volume setup. If further attributes are needed they will be added on demand commit 2411c3352dc4a15c31eed53f600c94827397f733 Author: Marcus Schäfer AuthorDate: Fri Jan 20 10:22:00 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 20 10:26:14 2017 +0100 Added attributes element in volume type commit fc7b2ada67840577a91533db8400c13227179cae Author: Marcus Schäfer AuthorDate: Thu Jan 19 15:53:48 2017 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 20 10:24:31 2017 +0100 Added volume attribute copy_on_write The copy_on_write attribute allows to activate or deactivate the copy on write functionality for the desired volume. This Fixes #218 commit 88686d3253bf0a56a74e9a1152dd0bba476f8610 Author: Marcus Schäfer AuthorDate: Thu Jan 19 14:47:27 2017 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 19 14:47:27 2017 +0100 Make sure there is a storage default setup on s390 Storage disks on s390 requires an information about the type and the blocksize. In case these information is not provided in the kiwi XML configuration, None was set as value in the zipl configuration which lead to an error. This commit provides default values for those parameters commit fedc700758f4b4e67d3f37cafb77351c12ea1ab9 Author: Marcus Schäfer AuthorDate: Wed Jan 18 14:40:29 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 18 14:40:29 2017 +0100 Bump version: 8.29.1 → 8.29.2 commit 6029c81a91459f53c5b1a8a6932ff252a3eec65d Author: David Cassany AuthorDate: Mon Jan 16 10:34:06 2017 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 18 14:29:29 2017 +0100 Fixup duplication of btrfs toplevel volume If using root btrfs snapshot, the default toplevel subvolume is set to /@/.snapshots/1/snapshot, thus all defined subvolumes are mounted under that cusomized default subvolume. For the first time subvolumes are mounted it is fine to include /@/.snapshots/1/snapshot prefix as root is not yet set to that specific path, however in any future mount this path prefix is not needed any more, as the root get mounted in /@/.snapshots/1/snapshot by default. Fixes (bsc#1015549) commit 0cfd4cca5ea0f7ff64349ff451a3cc8315824142 Author: Marcus Schäfer AuthorDate: Tue Jan 17 16:21:15 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 17 16:21:15 2017 +0100 Allow unix device names in oem-unattended-id setup In order to allow a raw device name in oem-unattended-id the /dev tree has been added to search list. This is useful if e.g a ramdisk device which is not part of any /dev/disk/... or /dev/mapper device map should be used as target disk for the deployment. Thus a setup to stick the deployment to e.g /dev/ram1 would look like this ram1 This Fixes #221 commit 387970a761c5fd899e3c617102661df5cf358300 Author: Marcus Schäfer AuthorDate: Tue Jan 17 16:05:45 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 17 16:05:45 2017 +0100 Don't delete ip tools from oemboot network tools are needed for oem disk deployment via pxe commit 7d27eed783c6a767c4a877ae5ccbeba7a4e21742 Author: Marcus Schäfer AuthorDate: Tue Jan 17 11:27:33 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 17 12:09:35 2017 +0100 Make sure setupMachineID also cares for dbus Systemd and dbus should use the same machine-id. Therefore a symlink /var/lib/dbus/machine-id pointing to /etc/machine-id is created right after systemd-machine-id-setup. Fixes #219 commit 987ffd22e2c9740e9ab222fa12b60a4a14056372 Author: Marcus Schäfer AuthorDate: Tue Jan 17 12:08:41 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 17 12:08:41 2017 +0100 Added .coveragerc Clearly indicate which source files are excluded from the coverage report commit 2c85f13ccd19a0b72f89db36e06e6f3ee199f8a1 Author: Marcus Schäfer AuthorDate: Tue Jan 10 14:19:22 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 10 14:19:22 2017 +0100 Bump version: 8.29.0 → 8.29.1 commit b77fc4ef9343af7329bc1e2a80d02aa50c102366 Author: Marcus Schäfer AuthorDate: Tue Jan 10 14:14:17 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 10 14:14:17 2017 +0100 Rebuild schema documentation commit 661c12c1910235259c960203cde6cf9e608f0c4d Author: Marcus Schäfer AuthorDate: Tue Jan 10 13:51:47 2017 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 10 13:51:47 2017 +0100 Bump version: 8.28.3 → 8.29.0 commit ce6d47a15dc4c7d5c87a8cf26f67cd5b1576520e Author: David Cassany AuthorDate: Mon Jan 9 18:33:38 2017 +0100 Commit: David Cassany CommitDate: Mon Jan 9 18:33:38 2017 +0100 Running config.sh after including the image repositories This commit rearranges some code lines in order to run the config.sh script after the repositories of the image have been included, this way repositories can be trusted and refreshed in config.sh script. commit 760c88682fb3e1bfa107e95bda1e19058b2c30a8 Author: Marcus Schäfer AuthorDate: Mon Jan 9 11:30:01 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 9 11:30:01 2017 +0100 Update container builder code to new schema layout commit 3c7ba8b92433a0608a163951fa0b27196f019a82 Author: Marcus Schäfer AuthorDate: Mon Jan 9 11:04:10 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 9 11:04:10 2017 +0100 Auto update image descriptions to schema v6.5 commit b7f7fa11eb801ce5def4f44bfcb3aa7d1815efc8 Author: Marcus Schäfer AuthorDate: Mon Jan 9 10:52:41 2017 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 9 10:52:41 2017 +0100 Update schema for container setup In preparation to support creation of native docker containers the way docker likes it, the kiwi schema has to be adapted. So far there was no way to specify additional metadata information for containers. With this commit a new section called is provided. containerconfig is a subsection of the type and only allowed for the docker image type. This constraint is checked via a schematron rule. In addition an xslt stylesheet moves the currently existing container attribute, which was used to set a name for the container, into the new containerconfig section as name attribute commit 41a1f2f613d3e0ee343415153cd0c65507c44172 Author: Marcus Schäfer AuthorDate: Tue Dec 20 10:58:04 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 20 10:58:04 2016 +0100 Bump version: 8.28.2 → 8.28.3 commit 02cdfaddb6342d84a8ec5c74c3637235ad058866 Author: Marcus Schäfer AuthorDate: Tue Dec 20 10:53:31 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 20 10:53:31 2016 +0100 Fixed quadruple_token tokenizer Information not provided should end up as a None type in the list in any case. If an empty string was provided via e.g --add-repo source,type,, the tokenizer puts in an empty string. If the information was provided as --add-repo source,type a None type was used. The code handling the information expected a None type for not provided information, with an empty string we end up in validation code which e,g complains that an empty string can't be converted into an integer base repo priority commit 6fd8c86fab169ca1ac84507a155ed1379505c92a Author: Marcus Schäfer AuthorDate: Sun Dec 18 19:57:43 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Dec 18 19:57:43 2016 +0100 Bump version: 8.28.1 → 8.28.2 commit 13a8fc57212be19221327b2708939ba479501784 Author: Marcus Schäfer AuthorDate: Sun Dec 18 19:56:32 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Dec 18 19:56:32 2016 +0100 Update documentation Default provider must be set in the caller environment if different from the default docker provider commit dbc044352a9434ef4e8cc01a6d63c9b40cadd095 Author: Marcus Schäfer AuthorDate: Fri Dec 16 17:11:33 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Dec 16 17:11:33 2016 +0100 Bump version: 8.28.0 → 8.28.1 commit 985699d5ddd0eb0618e86f6c91bd1f1b758f2beb Author: Marcus Schäfer AuthorDate: Fri Dec 16 17:10:35 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Dec 16 17:10:35 2016 +0100 Update container builder documentation Add information about the now available kiwi build box and the use of it as part of libvirt provider setup for vagrant commit 8dc7fda31d107ccde9b5f2468a954d4ac325fbc0 Author: Marcus Schäfer AuthorDate: Thu Dec 15 12:09:49 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 15 12:09:49 2016 +0100 Bump version: 8.27.5 → 8.28.0 commit b84e3b9fe0ce53eb1a5d931333d5f9e1aaf6ffdd Author: Marcus Schäfer AuthorDate: Tue Dec 13 14:36:23 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 13 14:36:23 2016 +0100 Bump version: 8.27.4 → 8.27.5 commit 691f42f3e64c3f758e31cae641a1e6223b327e20 Author: Marcus Schäfer AuthorDate: Tue Dec 13 14:35:48 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 13 14:35:48 2016 +0100 Fixup spec file build requires shadow tools are needed for %pre tasks using groupadd/useradd tools commit dec6e911872c30a686d2f70a0f6a2d15a91b23ed Author: Marcus Schäfer AuthorDate: Tue Dec 13 12:17:37 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 13 12:17:37 2016 +0100 Bump version: 8.27.3 → 8.27.4 commit f549b03886a8ebfc828c3f1b1277dea1a9f6c029 Author: Marcus Schäfer AuthorDate: Thu Dec 8 17:16:23 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 12 11:27:19 2016 +0100 Added DiskFormatVagrantLibVirt class Allow to build vagrant boxes for the libvirt provider This Fixes #15 commit 71be75e728b7b2483e8aa9c84a6c23c9e504379e Author: Marcus Schäfer AuthorDate: Thu Dec 8 15:15:13 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 12 11:18:58 2016 +0100 Update vagrantconfig schema setup Delete the virtualbox provider, As long as there is no opensource variant for the ovf creation available we won't support that provider commit 035f4d10220a2b5b4c0e3f1193930a4a2939eb34 Author: Marcus Schäfer AuthorDate: Mon Dec 12 11:05:10 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 12 11:05:10 2016 +0100 Fixup spec file tftp group/user setup Let %pre fail if groupadd/useradd failed and show the error to the user commit 7510e169746a8c3cf60678e408f63f70fa8494f9 Author: Marcus Schäfer AuthorDate: Wed Dec 7 16:55:40 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 7 16:55:40 2016 +0100 Bump version: 8.27.2 → 8.27.3 commit 6a9abc77b671b413e637dce1d16feebe0e79e961 Author: Marcus Schäfer AuthorDate: Tue Dec 6 18:55:59 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 6 18:55:59 2016 +0100 Adapt documentation to rtd schema replace topic node used for abstract by a hint. This results in a color box for the abstract which looks better than what rtd does with simple topics commit 5dacaad9cb518067200094c8252d89ab0a5c46f2 Author: Marcus Schäfer AuthorDate: Tue Dec 6 18:55:37 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 6 18:55:37 2016 +0100 Adapt schema generator to rtd doc schema commit 4030ba39a5fc0fd3e35584fa6a2e1dbb5cc63ce7 Author: Marcus Schäfer AuthorDate: Tue Dec 6 18:54:56 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 6 18:54:56 2016 +0100 Move to rtd sphinx schema The read-the-docs schema fits better into the mainstream of online documentation commit 8449b39b83ad9e25d175d74241d719f9686b6239 Author: Marcus Schäfer AuthorDate: Mon Dec 5 12:35:40 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 5 12:35:40 2016 +0100 Bump version: 8.27.1 → 8.27.2 commit e3bb8e77f1a05d4741e99227b3a28c557b2dedc3 Author: Marcus Schäfer AuthorDate: Mon Dec 5 12:24:57 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 5 12:24:57 2016 +0100 Added check_volume_setup_has_no_root_definition The root volume in a systemdisk setup is handled in a special way. It is not allowed to setup a custom name or mountpoint for the root volume. Therefore the size of the root volume can be setup via the @root volume name. This check looks up the volume setup and searches if there is a configuration for the '/' mountpoint which would cause the image build to fail commit 485c9d67a96108fbc69e66e03c9dc1a05bb847ef Author: Marcus Schäfer AuthorDate: Mon Dec 5 11:54:27 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 5 11:54:27 2016 +0100 Prevent warning about unknown opt in workflow doc commit 43589bb84b1e37230ffe8577485aba74e8312ef5 Author: Marcus Schäfer AuthorDate: Mon Dec 5 11:48:14 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 5 11:48:14 2016 +0100 Bump version: 8.27.0 → 8.27.1 commit 3b9be6ce3e8a676b8717d4831302ac09eb0e8f09 Author: Marcus Schäfer AuthorDate: Mon Dec 5 11:46:20 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 5 11:46:20 2016 +0100 Rebuild schema documentation commit 965139c370d982153cae022f5f3175a8573fd484 Author: Marcus Schäfer AuthorDate: Mon Dec 5 11:45:45 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 5 11:45:45 2016 +0100 Add a docstring for the extension section Short description what the extension section is good for commit aae06d011aa04df37c0a92457ecea03c08647605 Author: Marcus Schäfer AuthorDate: Mon Dec 5 11:43:20 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 5 11:43:20 2016 +0100 Prevent any type from attribute recursion The schema parser to create the documentation run into an endless recursion for the new k.any type. As any could be anything there is not much do document for this type. Thus it is now skipped from the traversal commit 4c42c7d15737633ab239f9670c9229db5ea890aa Author: Marcus Schäfer AuthorDate: Mon Dec 5 11:26:04 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 5 11:26:04 2016 +0100 Bump version: 8.26.1 → 8.27.0 commit b740df5086a685ed458d8c68d48dfeaf2026494d Author: Marcus Schäfer AuthorDate: Fri Dec 2 10:28:01 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Dec 2 10:28:01 2016 +0100 Update documentation per review commit e50dfded7a196ad5bbef12b9492add17a0f82119 Author: David Cassany AuthorDate: Thu Dec 1 14:13:18 2016 +0100 Commit: David Cassany CommitDate: Thu Dec 1 22:09:11 2016 +0100 Including minimum volume size offset in disk size calculation This commit adds Defaults:get_min_volume_mbytes() to the disk size calculation algorithm. This should be sufficient to hold fdisk default offset when creating the first partition and also to hold the LVM metadata. commit f13a7918eaff981a932c7a837f047eced05e93d4 Author: Marcus Schäfer AuthorDate: Thu Dec 1 11:58:38 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 1 11:58:38 2016 +0100 Added extension documentation commit eaac155067f7cea41f5626946f650a0a5b71aebb Author: Marcus Schäfer AuthorDate: Wed Nov 30 17:33:27 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 1 10:45:17 2016 +0100 Add extension validation and data access If an extension section exists the xml data in this section is validated against the RelaxNG schema which must be part of the xmlcatalog for the used extension namespace. If the data validates the method get_extension_xml_data can be used to access the etree parse result for each of the extension configurations commit c879c2b172b4c79a7cf652e0d49b25fe60ed5864 Author: Marcus Schäfer AuthorDate: Mon Nov 28 17:16:41 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 1 10:45:17 2016 +0100 Allow section for custom plugins For the use case to add additional image description information an extension section exists which allows to add custom section and attributes. Custom XML information must be connected to a namespace in order to avoid conflicts with the existing structure. The following example shows how to place additional XML information: commit d3d6674d8e9e4a148151c2ce1000151aaaaa1f3d Author: Marcus Schäfer AuthorDate: Thu Dec 1 10:41:13 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 1 10:41:56 2016 +0100 Make sure to catch exceptions from xsltproc commit 0cfcf2fb9ab98a002d08ce52a7372a77de75021b Author: David Cassany AuthorDate: Wed Nov 30 15:21:54 2016 +0100 Commit: David Cassany CommitDate: Wed Nov 30 15:54:34 2016 +0100 LVM volumes management during grub2 install During the grub2 install process volumes were not mounted properly, a proper mount order was not taken into consideration and LV device information was not given by the method get_volumes in VolumeManger. This commit forces the mount (and umount) operations to be done in coherent order and also modifies the get_volumes method in order to return the device associated to each volume. commit efb7719c78573efd155daa3dcad219d7105e3d95 Author: Marcus Schäfer AuthorDate: Fri Nov 25 11:22:31 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 25 11:22:31 2016 +0100 Fixed expansion of msdos disks If the target disk size is beyond 2TB it can't be expanded to the full size if the msdos partition table layout is in use. Because of this the disk expansion will be limited to the allowed maximum for the msdos partition table type which is at 2TB. This fixes bnc#1010966 commit 96b565815882a6a96d329370849590f855256063 Author: Marcus Schäfer AuthorDate: Thu Nov 24 13:55:30 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 24 13:55:30 2016 +0100 Bump version: 8.26.0 → 8.26.1 commit 4a25dd78bafce2aa193709004b0206b23e4d0541 Author: Marcus Schäfer AuthorDate: Thu Nov 24 13:38:27 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 24 13:38:27 2016 +0100 Fixup of string + operator vs. join use commit 996d9f4abe92c446ff33ef22943a0285f22cb32f Author: Marcus Schäfer AuthorDate: Thu Nov 24 13:29:08 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 24 13:29:08 2016 +0100 Fixed setup_disk_image_config in bootloader setup The parameter for the uuid is not enough to handle all supported disk geometries. If the disk has an extra boot partition the bootloader setup must read the boot data from the boot partition but must set the root for the kernel cmdline to the root partition. Therefore the interface needs to change and must provide both the boot_uuid and the root_uuid in oder to allow the method to setup the correct values commit 21dfce6595de7ac86a60f8450312cb172c37de94 Author: David Cassany AuthorDate: Thu Nov 24 12:26:04 2016 +0100 Commit: David Cassany CommitDate: Thu Nov 24 12:26:04 2016 +0100 Parse arch attribute as a comma separated list This commit ensure that the arch attribute of each package section is parsed as a comma separated list. This way, as in previous kiwi versions, each package might be suitable for one or more specified architectures. commit c3bad3f8f29a189cf0621971a6f9d633a82989fb Author: Marcus Schäfer AuthorDate: Thu Nov 24 10:39:10 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 24 10:39:10 2016 +0100 Fixup kernel name setup in disk builder The Kernel instance is the only correct place to ask for the kernel name. This class has the responsibility to know information about the selected kernel. The additional arch based assumption on the kernel name in the disk builder were wrong. This fixes bnc#1011936 commit 0537a6f186fcbeac7f285b963f24a60de073de82 Author: Marcus Schäfer AuthorDate: Tue Nov 22 10:36:29 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 22 10:36:29 2016 +0100 Fixed typo in solver api documentation commit 09d7f1a377f5240c03ec95b9826e1ef0e84f33ac Author: Marcus Schäfer AuthorDate: Tue Nov 22 09:54:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 22 09:54:07 2016 +0100 Bump version: 8.25.5 → 8.26.0 commit e1c85d631b6ff856b90d6f61486e5add321ab020 Author: David Cassany AuthorDate: Mon Nov 21 18:40:25 2016 +0100 Commit: David Cassany CommitDate: Mon Nov 21 18:44:46 2016 +0100 No more hard links in result bundle This commit changes the copy command of the result bundle task. Now instead of creating hardlinks a relugar copy is performed. This way we ensure that the bundled files will not be modified by overwritting a linked file. commit df4e7b7278b45cf9501f2734144d5533c8735007 Author: David Cassany AuthorDate: Mon Nov 21 18:32:51 2016 +0100 Commit: David Cassany CommitDate: Mon Nov 21 18:32:51 2016 +0100 Documentation workflow review commit c1b0a2c2b8ba5c1534bace65c396e8e1cdc34c9b Author: Marcus Schäfer AuthorDate: Mon Nov 21 16:08:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 21 16:08:55 2016 +0100 The Sat solver class - an example The Sat solver class can be used to run a solver operation over a list of packages and/or patterns in order to receive a dependency solved list of all required packages according to the request. In order to do that a set of repositories is required which provides the package metadata and their requirements. The following is an example how to use the Sat class in your application: ```python from kiwi.solver.sat import Sat from kiwi.system.uri import Uri from kiwi.solver.repository import SolverRepository solver = Sat() solver.add_repository( SolverRepository(Uri('obs://leap/42.2/repo/oss', 'yast2')) ) print(solver.solve(['vim'])) ``` commit 119e96dc8f795d07636d60df17cc53cae53e064e Author: Marcus Schäfer AuthorDate: Thu Nov 17 16:51:17 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 21 12:02:01 2016 +0100 Added Sat solver class Added implementation for Solver class based on the SUSE libsolv C library and the solv python binding commit 271a5f25afe20390f4af26a2275c0cfcd2644602 Author: Marcus Schäfer AuthorDate: Mon Nov 21 08:55:32 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 21 09:12:31 2016 +0100 Fixup code smell for kernel name list Iterating over only one list item doesn't need a loop commit 8e3e96d653b96714c32305a3b9482a1978e433c9 Author: Marcus Schäfer AuthorDate: Mon Nov 21 08:36:26 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 21 09:12:24 2016 +0100 Fixup style to be more pythonic commit 39d5db9881a391157da42b9eaec922e7e475520a Author: Marcus Schäfer AuthorDate: Fri Nov 18 16:01:13 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 21 09:07:50 2016 +0100 Fixed kernel name lookup Complete the list of kernel names for the lookup. Normally the kernel package provides a symlink to the actual kernel image file. However if the link does not exist we extend the search to a collection of names for possible kernel images. The new list now also covers kernel names as used for arm Along with the change this patch also provides an option to raise an exception if the kernel lookup did not find any kernel, which is used for the get_kernel() request in the dracut initrd system setup where it is mandatory to find a kernel image. This fixes bnc#1010874 commit 900a0de518e0c7442fc867ed528a08edca34e0ae Author: Marcus Schäfer AuthorDate: Fri Nov 18 16:24:43 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 18 16:24:43 2016 +0100 Fixed release network using ip tool Apply the cidr fix from setupNic and introduce a new method called deleteNic which replaces the wrong ip call from the releaseNetwork method. Fixes bnc#1003091 commit 1f2de06aec316ad52772818da0b81bad35326afe Author: David Cassany AuthorDate: Fri Nov 18 16:17:19 2016 +0100 Commit: David Cassany CommitDate: Fri Nov 18 16:17:19 2016 +0100 KIWI workflow documentation This commit ports the workflow documentation from previous KIWI version and also adds a sections for listing the boot parameters configurable in the Kernel command line. commit 3e16f5d458545b16bfe708ff97ccd6199cd8f029 Author: Marcus Schäfer AuthorDate: Thu Nov 17 11:04:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 17 11:04:07 2016 +0100 Bump version: 8.25.4 → 8.25.5 commit abdc2ace4ddb27d11da927859fb41e78c9990214 Author: Marcus Schäfer AuthorDate: Thu Nov 17 10:57:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 17 10:57:55 2016 +0100 Fixup lease time in setupNetworkWicked The default lease time with 300s used by wicked is relatively short and different from the default lease time of the former dhcpcd. This change causes wicked to use a lease time of 3600s This is related to bnc#1003091 commit 9b386af20daadb88bc4b7f11d931dcbba72f6988 Author: Marcus Schäfer AuthorDate: Thu Nov 17 10:49:00 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 17 10:49:00 2016 +0100 Fixup default behavior of releaseNetwork If no tool was found to communicate with the dhcp server in order to free the lease the method did nothing. However it should at least bring down the network. This is related to bnc#1003091 commit 3da7e0d000cddef9cfdfd0cb9f94053242ef4a80 Author: Marcus Schäfer AuthorDate: Wed Nov 16 17:02:30 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 16 17:02:30 2016 +0100 Bump version: 8.25.3 → 8.25.4 commit 279536ffe2f069728eb5730e6f5de9737b65227f Author: Marcus Schäfer AuthorDate: Wed Nov 16 16:51:44 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 16 16:51:44 2016 +0100 Fixup get_volumes for lvm manager The method also returned the root volume in the list of volumes but it should only return a list of volumes excluding root volume commit dfd27049e34abca63a63acfe7ec5b80c7030a426 Author: Marcus Schäfer AuthorDate: Wed Nov 16 15:57:00 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 16 15:57:00 2016 +0100 Fixup setupNic for address information in cidr Ignore netmask if address is already in cidr format commit 7e0c745086d779c97045b01de42436a8a868d132 Author: Marcus Schäfer AuthorDate: Wed Nov 16 11:32:48 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 16 11:32:48 2016 +0100 Bump version: 8.25.2 → 8.25.3 commit ccabfd0ee1395d0d45cacb694fe1e60d761b65fa Author: Marcus Schäfer AuthorDate: Tue Nov 15 21:58:51 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 15 21:58:51 2016 +0100 Fixup btrfs property setup The readonly property is set on the filesystem toplevel. kiwi has set the toplevel before any property is set. commit 7504683b3df9ed91cc9324832ebeb12a46cd7919 Author: David Cassany AuthorDate: Tue Nov 15 18:54:55 2016 +0100 Commit: David Cassany CommitDate: Tue Nov 15 18:54:55 2016 +0100 vhdfixed images result compression This commit adds compression to the Result instance of the vhdfixed disk. This concrete format is not compressed or dynamic, so that, it makes sense compress them. Also this was the behavior in previous kiwi versions. commit cf11dac3260fb72fa80c52086476b1e3f63c29ba Author: Thorsten Kukuk AuthorDate: Tue Nov 15 15:31:38 2016 +0100 Commit: Thorsten Kukuk CommitDate: Tue Nov 15 15:31:38 2016 +0100 Replace tabs with spaces commit d36c404af33b4caf3c046c028204effb2eb9e15b Author: Marcus Schäfer AuthorDate: Tue Nov 15 12:27:23 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 15 12:27:23 2016 +0100 Fixup handling for root_is_readonly_snapshot The information was not passed to the VolumeManager instance commit 87556d4ba19800d5d4a6077c7fdbe60f2e4b3f2c Author: Marcus Schäfer AuthorDate: Tue Nov 15 12:25:59 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 15 12:25:59 2016 +0100 Fixup mount_volumes in VolumeManagerBtrfs It is required to mount the toplevel btrfs filesystem if not already mounted, prior to mounting the subvolumes commit 810535b05c6c3ca7209ed9d5683280b5d9d12aaa Author: Marcus Schäfer AuthorDate: Tue Nov 15 12:16:51 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 15 12:16:51 2016 +0100 Fixed busy mount state Make sure subvolumes are umounted first. This prevents a busy state in a partition setup with an extra boot partition commit 25bad5db40545e7b79dbf9ec271157caa4e05882 Author: Marcus Schäfer AuthorDate: Mon Nov 14 14:38:13 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 14 14:38:13 2016 +0100 Bump version: 8.25.1 → 8.25.2 commit 893efe30adb9412ff811e8bc202b3f25d92d73b9 Author: Marcus Schäfer AuthorDate: Mon Nov 14 14:16:05 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 14 14:24:39 2016 +0100 Fixup creation of etc/default/grub config file Only create the file if the base directory structure in etc/default exists. commit 132fd3d3dc41e4819c09b941c2387c41d9073418 Author: Thorsten Kukuk AuthorDate: Sun Nov 13 11:15:04 2016 +0100 Commit: Thorsten Kukuk CommitDate: Sun Nov 13 11:15:04 2016 +0100 Remove empty line too much commit 119541c611c2bdeb1c5aed9e1dd4ebb4c488d6a3 Author: Thorsten Kukuk AuthorDate: Sun Nov 13 11:08:03 2016 +0100 Commit: Thorsten Kukuk CommitDate: Sun Nov 13 11:08:03 2016 +0100 Implement loading of snapshots and fix snapshot menu layout. If you want to boot an old snapshot, but not to do a rollback, we need to tell the kernel which snapshot to use. This patch also fixes the broken layout of the grub snapshot menu. commit 9c355a796ccb5973fa237419652f7ba1fecccd24 Author: Thorsten Kukuk AuthorDate: Sat Nov 12 18:24:38 2016 +0100 Commit: Thorsten Kukuk CommitDate: Sat Nov 12 18:24:38 2016 +0100 Move source of grub-snapshot.cfg to the right position grub-snapshot.cfg should not be sourced at the begining, but at the end of grub.cfg. Else with creating the first snapshot this entry is getting the default boot target and the system does not boot automatically anymore. commit 3a1edc250f523a3a3a8202534a73df75f76c8691 Author: Marcus Schäfer AuthorDate: Fri Nov 11 16:13:57 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 11 16:13:57 2016 +0100 Fixup netboot code for multipath boot device If the root disk in a netboot deployment is a multipath device we have to make sure the multipathd is started and the boot device is mapped to the wwn commit a36c4622aab00cb6b00b6cd0eaddd9b99101450e Author: Marcus Schäfer AuthorDate: Thu Nov 10 15:53:17 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 10 15:53:17 2016 +0100 Bump version: 8.25.0 → 8.25.1 commit 3983f140a4248b605dab1556024e29239e40e4b3 Author: Marcus Schäfer AuthorDate: Thu Nov 10 15:45:24 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 10 15:45:24 2016 +0100 Update doc string for download_from_repository The doc string for this method contained a mime string which is spuriously validated by the sphinx url checker. This commit rewords the text in a way that the checker is happy again commit 0e6fb2484ca532ed3763053769dd25dad337bb4f Author: Marcus Schäfer AuthorDate: Thu Nov 10 15:36:29 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Nov 10 15:36:29 2016 +0100 Bump version: 8.24.10 → 8.25.0 commit 71d902e4dd45bd25df6ff414d78baf7d10958eb9 Author: David Cassany Viladomat AuthorDate: Thu Nov 10 15:22:53 2016 +0100 Commit: GitHub CommitDate: Thu Nov 10 15:22:53 2016 +0100 Do not delete all repositories if there aren't repositories to import (#191) This commit adds a tester method to check if there is any repository marked as imageinclude. The method is used to execute import_repositories_marked_as_imageinclude method only when it is actually needed. commit 45d9a1eaa3f370e88a1c2f01c8646186ee5db7a1 Author: Marcus Schäfer AuthorDate: Wed Nov 9 17:15:56 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 9 17:15:56 2016 +0100 grub.cfg: Fixes for btrfs as rootfs This addresses the following issues * An image based on btrfs using the entire boot as a subvolume causes grub to be unable to find its config file. Thus kiwi now raises an exception in this situation * Don't prefix the bootpath with the snapshot path if the btrfs root is placed in a snapshot. Instead the file etc/default/grub must be written/updated with the SUSE_BTRFS_SNAPSHOT_BOOTING variable set to true. Once this is done the bootpath is consistently set to /boot no matter which snapshot is active commit c90211efe71607f8b076ab7c0c1b3af8f8fb51fc Author: Marcus Schäfer AuthorDate: Wed Nov 9 17:13:56 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 9 17:13:56 2016 +0100 grub.cfg: Source grub-snapshot.cfg if present Add a lookup for /.snapshots/grub-snapshot.cfg to the generated grub.cfg. The file is shell sourced if it exists commit 7b4eca3e61b227ef773ed347ae90877dababa0f5 Author: David Cassany AuthorDate: Wed Nov 9 11:17:33 2016 +0100 Commit: David Cassany CommitDate: Wed Nov 9 11:17:33 2016 +0100 No need to mock Path.which There is no need to mock Path.which as isoinfo binary from the platform is needed to run the test, so better let the system look for it, note that the binray can be located in the alternate location (/usr/lib/genisoimage/) which is not part of the PATH. In that particular case the iso_test would fail if we mock Path.which. commit 83c99ffcd06ce35d8d5f79ef107cd85916793a75 Author: David Cassany AuthorDate: Tue Nov 8 18:46:38 2016 +0100 Commit: David Cassany CommitDate: Tue Nov 8 18:46:38 2016 +0100 Updated system size calculations test commit c4fd7635fd08ff4baee63d257a1ba157530fbcd4 Author: David Cassany AuthorDate: Tue Nov 8 18:40:51 2016 +0100 Commit: David Cassany CommitDate: Tue Nov 8 18:40:51 2016 +0100 Updated test for vhd-fixed subformat type commit dc28159b75917cc59f216a05668c7149bd9c730d Author: David Cassany AuthorDate: Tue Nov 8 18:26:58 2016 +0100 Commit: David Cassany CommitDate: Tue Nov 8 18:26:58 2016 +0100 Increase the default image size for XFS filesystems When no size is specified in type section the resulting image size is calculated using the size of the whole build-root increased by an empiric factor. Some tests revealed that this factor was not enough for XFS filesystems. The empiric factor has been increased. This commit fixes #186 commit cdac18a92c5dc5c226910e2da04d218da73fc390 Author: Marcus Schäfer AuthorDate: Tue Nov 8 17:19:25 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 8 18:17:51 2016 +0100 Implemented SolverRepositoryRpmDir Add support for local rpm-dir repositories commit 0e733c29a97a49b34ac7ec2b6990b15254b8dc7d Author: Marcus Schäfer AuthorDate: Tue Nov 8 11:02:24 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 8 18:17:51 2016 +0100 Implemented SolverRepositoryRpmMd Add support for rpm-md repository types commit 2c14ee71dee027e64bd72d0c9a7a7f43ee849e5d Author: Marcus Schäfer AuthorDate: Mon Nov 7 15:48:03 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 8 18:17:51 2016 +0100 Implemented SolverRepositorySUSE Add support for SUSE online and media repository types commit ebeb43eea65926f28cb2e60953fe36b76274637e Author: Marcus Schäfer AuthorDate: Sun Nov 6 14:40:02 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 8 18:17:51 2016 +0100 Implement SolverRepositoryBase Base class and interface for building a SAT solvable from a given repository commit 2549437b4dab5bef27f26c45031cc6c4c305ef40 Author: Marcus Schäfer AuthorDate: Mon Nov 7 11:03:18 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 8 18:15:38 2016 +0100 Add repo_type info to Uri class This allows to eliminate the repo_type from the paramter list of the SolverRepository class, which then only needs an instance of Uri commit fd86f02a0615bff6129902daeac95b1239593718 Author: Marcus Schäfer AuthorDate: Fri Nov 4 12:01:19 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 8 18:15:37 2016 +0100 Added API doc hook for solver path commit 16fdb5d978a0765a1c48d59df108f984a074fb9b Author: Marcus Schäfer AuthorDate: Fri Nov 4 10:10:04 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 8 18:15:37 2016 +0100 Initial structure to support SAT solvables A SAT solvable can be used together with python-solv to implement performant package solving tasks. This is the initial structure to allow the creation of such solvable files from specified repositories. We will support the repo types yast2, rpm-md and rpm-dir in the first place. commit a36b12eee147a94c92434aa4a7afbf1ef8986d18 Author: David Cassany AuthorDate: Tue Nov 8 18:12:16 2016 +0100 Commit: David Cassany CommitDate: Tue Nov 8 18:12:16 2016 +0100 vhd-fixed name corrected in subformat init class This commit reverts the previous one and it applies the name change to the subformat class initializer. This way the schema is not altered and we keep compatibility with previous description files. commit 5bd95dc713ffe094e082b21a5b5f8a478b68ff41 Author: David Cassany AuthorDate: Tue Nov 8 17:37:23 2016 +0100 Commit: David Cassany CommitDate: Tue Nov 8 17:37:23 2016 +0100 vhdfixed format naming inconsistency vhdfixed storage format name was not updated according its real name in the kiwi schema, making it impossible to build any vhdfixed image. The schema used to expect 'vhd-fixed', however, internally, the code was expecting 'vhdfixed'. The schema has been updated. This commit fixes #184 commit 2e9769e8b0daf35f6403acffbaa4e9fec2ab2532 Author: David Cassany AuthorDate: Tue Nov 8 12:23:35 2016 +0100 Commit: David Cassany CommitDate: Tue Nov 8 12:23:35 2016 +0100 ActivateImage links correction Loading the iso image into a read-only ramdisk caused some issues due to the activatImage method cp commands. With this commit the symlinks are consistent during the preinit phase and also before running the cp command it is tested we are not in a read-only filesystem. This commit is a port form openSUSE/kiwi#613 PR commit 2dec2fa4d8e0f27584a4295cfec4c7e979466774 Author: Marcus Schäfer AuthorDate: Mon Nov 7 15:49:44 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Nov 7 15:49:44 2016 +0100 Fixup ip setup in setupNic The invocation of ip in setupNic was invalid. The way this was done causes the netmask to be set as broadcast address Related to bnc#1003091 commit f04e55c6a51d9cce302a8e13380d3ee4d3d1b23f Author: David Cassany AuthorDate: Thu Nov 3 17:05:10 2016 +0100 Commit: David Cassany CommitDate: Fri Nov 4 11:08:54 2016 +0100 updateOtherDeviceFstab did not get the fstab location parameter This is port from the kiwi v7 code base openSUSE/kiwi#610 commit 908716f8ecbcc9cadbcd5ace1267a5a76ad44df5 Author: David Cassany AuthorDate: Wed Nov 2 22:30:19 2016 +0100 Commit: David Cassany CommitDate: Fri Nov 4 11:02:23 2016 +0100 Load the default unicode font in grub2 This commit fixes #179. The default font was never loaded, the loadfont call for the default was missing. commit abfb9859ab3d065c2fe1142d1da572cafb3245b0 Author: Marcus Schäfer AuthorDate: Fri Nov 4 10:31:32 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 4 10:31:32 2016 +0100 Bump version: 8.24.9 → 8.24.10 commit cc1fa53b778b4013b52df0e64bd905fc4e61eb04 Author: Marcus Schäfer AuthorDate: Fri Nov 4 10:23:22 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 4 10:29:27 2016 +0100 Delete sphinxcontrib-programoutput setup Deleted it from virtualenv development requirements and from the sphinx configuration file commit 2c7465a8fee0f81f9306b29a70fa6f163750ea96 Author: Marcus Schäfer AuthorDate: Fri Nov 4 10:20:38 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Nov 4 10:20:38 2016 +0100 Delete use of sphinxcontrib-programoutput The developers of this sphinx extension decided to delete the module on pip and also the source from git... it's dead. Thus I replaced the dynamic usage output in the manual pages with the static version commit 03cd83f34163b20fa0492b58d08b1fd61a1dec57 Author: Marcus Schäfer AuthorDate: Wed Nov 2 17:31:45 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 2 17:31:45 2016 +0100 Bump version: 8.24.8 → 8.24.9 commit 88fc64965a89d8b1d0e69fc1c9e2078853a68ad0 Author: Marcus Schäfer AuthorDate: Wed Nov 2 17:31:06 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 2 17:31:06 2016 +0100 Fixed waitForStorageDevice Value for storage_size was not really used commit 462c8c7ca12d862fa383c7a5130d704aea4faf51 Author: Marcus Schäfer AuthorDate: Wed Nov 2 16:16:32 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 2 16:16:32 2016 +0100 Bump version: 8.24.7 → 8.24.8 commit 6780584ccc675a1c6e3108d6cdd176c37fae4433 Author: Marcus Schäfer AuthorDate: Wed Nov 2 12:04:44 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 2 12:04:44 2016 +0100 Make sure kiwiserver/kiwiservertype is used If kiwiserver and/or kiwiservertype is specified on the kernel commandline they should take over precedence for up- and download of image files compared to the host setup in the IMAGE variable. commit 6ce73d016081b5e4d7538f7a00871c2af65f3eaf Author: Marcus Schäfer AuthorDate: Wed Nov 2 11:44:29 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Nov 2 11:44:29 2016 +0100 Don't mix python module requirements The tox setup mixes the deps modules depending on the tox target with either virtualenv.dev-requirements.txt or fixed deps lists in tox.ini. This change clean up the module dependencies for development targets to be taken from virtualenv.dev-requirements.txt exclusively commit 6f985b0cc8eef550ade29185ff9ba8b0dbff09c8 Author: Marcus Schäfer AuthorDate: Tue Nov 1 21:21:27 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 1 21:21:27 2016 +0100 Update travis runtime requirements Installing python modules from source via pip requires git commit a351ab10b1e45793c2ad941a06af768a0c62563c Author: Marcus Schäfer AuthorDate: Tue Nov 1 21:07:21 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 1 21:07:21 2016 +0100 Bump version: 8.24.6 → 8.24.7 commit b9610f8bdb38500396ee1096011d82c8a56e0137 Author: Marcus Schäfer AuthorDate: Tue Nov 1 21:05:54 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Nov 1 21:05:54 2016 +0100 sphinxcontrib-programoutput no longer on pypi Use the version from git directly to build the documentation In the long we should find an alternative for this sphinx extension commit 4ac554355dd14c421d1486075e1c76bd87b6c7fe Author: Marcus Schäfer AuthorDate: Mon Oct 31 15:18:28 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Oct 31 15:18:28 2016 +0100 Fixup root init with existing host cache Creating a new root init with a shared location which already provides directories of the system failed on init of those directories. Only create the not yet existing directories commit fb304ed35a5ee6f36ad85f8c6c991ddc1ee518db Author: Marcus Schäfer AuthorDate: Mon Oct 31 14:56:30 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Oct 31 14:56:30 2016 +0100 Fixup the wicked thing again commit 16788ad34c8515d2d77406ba4b0487fd6e929bea Author: Marcus Schäfer AuthorDate: Mon Oct 31 11:16:54 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Oct 31 11:16:54 2016 +0100 Put setupNetworkWicked in line with former dhcpcd The way setupNetworkWicked implements the dhcp discovery was incomplete. This Fixes bnc#1003091 commit 368884dfb14aa99709fdb3ea5c647b868e285512 Author: Marcus Schäfer AuthorDate: Fri Oct 28 11:46:54 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 28 11:46:54 2016 +0200 Fixup assembling of mdraid array when udev discovers an mdraid array it partially starts the array. That is interfering with the mdadm --assemble call by kiwi which leads to a busy state and an array in inactive state. Therefore the method should wait until the raid array really exists no matter if the assembling is started by udev or kiwi's mdadm call. In addition if the array got assembled but is incomplete because devices are missing or the timout is fired, an additional call to start any array that has been partially assembled is required. pxeRaidAssemble will throw an exception if after this call no md device with a size > 0 will show up after a timeout. This Fixes bnc#1000742 commit 812d544d4b2211343e7ea07c51c9659f4db0f746 Author: Marcus Schäfer AuthorDate: Fri Oct 28 11:46:14 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 28 11:46:14 2016 +0200 Fixup waitForStorageDevice The function will return success if the size of the storage device can be obtained and is greater than zero. The pure success on reading from the block layer is not enough. In order to actually work with the device it must provide a size > 0. Related to bnc#1000742 commit 9aa07de73258e0c4650dd6342b94488d386a2b4c Author: Marcus Schäfer AuthorDate: Thu Oct 27 16:45:18 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 27 16:45:18 2016 +0200 Bump version: 8.24.5 → 8.24.6 commit 414cc306bee000ddb70ea3742d252bdde49f3a39 Author: Marcus Schäfer AuthorDate: Thu Oct 27 11:33:35 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 27 14:27:00 2016 +0200 Do not allow imageinclude for images build in obs Fixes #178 commit bde93e42d41ff7b432949378a89cd7d89159f956 Author: Marcus Schäfer AuthorDate: Thu Oct 27 12:02:47 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 27 12:02:47 2016 +0200 Fixup initial directory creation for new root During testing of alternative cache locations an init problem with the var/ directory was observed commit 64d13ce5a37ebdc808d3bc999e8f0b2022fbe561 Author: David Cassany AuthorDate: Wed Oct 26 17:25:07 2016 +0200 Commit: David Cassany CommitDate: Wed Oct 26 17:25:07 2016 +0200 SystemPrepare instance delete before runnig SystemSetup This commit fixes#175, now multiple profiles in OBS are possible using kiwi boot initrd. commit aa296716c81b9c73f30ea662e2d8f35126862680 Author: Marcus Schäfer AuthorDate: Tue Oct 25 21:59:51 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 25 21:59:51 2016 +0200 Use docopt's default value feature for cache dir commit c91820aa27c369b85387abdbc5a43a382ac04f49 Author: Marcus Schäfer AuthorDate: Tue Oct 25 17:51:02 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 25 17:51:57 2016 +0200 Cleanup unit tests using sys.argv The tests should restore to the default argv option set as provided by the test_helper commit 7849dfd93834d3d631c85febfe042d8e72229af7 Author: Marcus Schäfer AuthorDate: Tue Oct 25 17:49:43 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 25 17:51:57 2016 +0200 Update manual page Include information for new --shared-cache-dir option commit 5b755e7b92d7e86f617e2b5e802c3b9460c0a027 Author: Marcus Schäfer AuthorDate: Tue Oct 25 17:48:08 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 25 17:51:57 2016 +0200 Added global option --shared-cache-dir The option allows to specify an alternative shared host_to_image cache directory. The default location is /var/cache/kiwi. Fixes #92 commit e5cd3e94262177516b7c85004efd31efd11948bf Author: David Cassany AuthorDate: Tue Oct 25 15:52:13 2016 +0200 Commit: David Cassany CommitDate: Tue Oct 25 15:52:13 2016 +0200 Fixed a couple of constraints commit c233e7ba4abab29c165966373ffcfece92731377 Author: David Cassany AuthorDate: Tue Oct 25 15:22:22 2016 +0200 Commit: David Cassany CommitDate: Tue Oct 25 15:22:22 2016 +0200 Redo of xml_parse.py with updated generateDS commit 862cb1c5d9bdbb1fbe7b31a3683269aa92aa30e6 Author: Marcus Schäfer AuthorDate: Tue Oct 25 12:02:27 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 25 12:20:19 2016 +0200 Initialize the systemd machine ID on first boot The systemd machine id is considered to be a unique information Thus it is required to initialize it on first boot of the image. If the image uses the kiwi boot code (initrd) this action is performed and and Fixes #169 commit a0494725156eb0057423b977a9c3e63ae6681f51 Author: Marcus Schäfer AuthorDate: Mon Oct 24 14:57:56 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 24 14:57:56 2016 +0200 Bump version: 8.24.4 → 8.24.5 commit 8257f65c332d658def2013a15b93924cfc61dd5c Author: David Cassany AuthorDate: Mon Oct 24 14:35:09 2016 +0200 Commit: David Cassany CommitDate: Mon Oct 24 14:35:09 2016 +0200 Some tests slightly modified in order to improve coverage This commit improves some example kiwi files and tests in order to achieve a 100% code coverage. commit 25bb84b148b16e7accfc47d0550b4b386a7edf3a Author: David Cassany AuthorDate: Mon Oct 24 13:07:06 2016 +0200 Commit: David Cassany CommitDate: Mon Oct 24 13:07:06 2016 +0200 Corrections on test kiwi description files Some attributes needed to be changed in the test xmls. With this commit all the description files are consistent with the new co- occurrence constraints. commit fc66a350bdecaee94bddbc580536690f92c63768 Author: Marcus Schäfer AuthorDate: Fri Oct 21 16:54:35 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 24 09:23:11 2016 +0200 config.partids only required for kiwi initrd If dracut is used as initrd system an unused config.partids file is generated. The partition id information is only used by kiwi boot code not by dracut boot code. Related to bnc#1005246 commit 4b90a67862fe284f021da946af65b2c923bc96d7 Author: David Cassany AuthorDate: Fri Oct 21 18:08:04 2016 +0200 Commit: David Cassany CommitDate: Fri Oct 21 18:08:04 2016 +0200 Co-occurrence constraints included in the schema Constraints for pxe, iso, vmx, oem and docker image types have been included. commit 703fdba5a1ef53a3382e0750593e0747b96f3c1f Author: Marcus Schäfer AuthorDate: Thu Oct 20 16:31:29 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 20 16:31:29 2016 +0200 Bump version: 8.24.3 → 8.24.4 commit 050c6f413d0061317c787fc17e666de7b7f8aaed Author: Marcus Schäfer AuthorDate: Thu Oct 20 16:30:49 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 20 16:30:49 2016 +0200 Make sure dracut initrd is copied correctly commit 5676f2e4d0815a28ef26118949a5452838f97ede Author: David Cassany AuthorDate: Thu Oct 20 16:01:43 2016 +0200 Commit: David Cassany CommitDate: Thu Oct 20 16:01:43 2016 +0200 Fixed a rounding error in partedMBToCylinder method bc truncates number of cylinders to zero decimal places, which results in a partition that is slightly smaller than the requested size. Add one cylinder to compensate. commit 40cf0d15158ac2c50283034602c92cd2d0b617f5 Author: David Cassany AuthorDate: Thu Oct 20 12:32:29 2016 +0200 Commit: David Cassany CommitDate: Thu Oct 20 12:32:29 2016 +0200 Integrating Schematron syntax in schema Using Schematron syntax in schema co-occurrence constraints can be easily defined. This commit provides the schematron integration. commit 07c9e3407fc037517bff8c73a8bb290b99fa5fd9 Author: Marcus Schäfer AuthorDate: Wed Oct 19 22:14:12 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 22:14:12 2016 +0200 Bump version: 8.24.2 → 8.24.3 commit 6c98a17c1219854bcc751aaca98e3b517d470894 Author: Marcus Schäfer AuthorDate: Wed Oct 19 22:12:51 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 22:12:51 2016 +0200 Write fstab to kiwi boot image only For the dracut initrd system the call happens in the system root tree which already provides the fstab data commit 0725f8a392b503a49cc670966bba9f3a38db224c Author: Marcus Schäfer AuthorDate: Wed Oct 19 21:17:48 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 21:17:48 2016 +0200 Bump version: 8.24.1 → 8.24.2 commit 40f46c09d2cf1717a4ec335a44e68dbef9ad802d Author: Marcus Schäfer AuthorDate: Wed Oct 19 21:17:27 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 21:17:27 2016 +0200 Dereference boot arch symlinks commit 9af959354e05f34aa99c21c1328d4448deabddc2 Author: Marcus Schäfer AuthorDate: Wed Oct 19 20:46:30 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 20:46:30 2016 +0200 Bump version: 8.24.0 → 8.24.1 commit 041205c1ed17fde97667cfb6ac7458a7ec3e6154 Author: Marcus Schäfer AuthorDate: Wed Oct 19 20:35:51 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 20:35:51 2016 +0200 Fixed typo in build Makefile target commit 1301c9c1aa5da3ac5365279abf6ed2aa9add6f01 Author: Marcus Schäfer AuthorDate: Wed Oct 19 20:24:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 20:24:05 2016 +0200 Bump version: 8.23.0 → 8.24.0 commit a3ce96ae7888ceee199fa421efd321cf338c6687 Author: Marcus Schäfer AuthorDate: Wed Oct 19 11:34:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 11:34:05 2016 +0200 Use format method for messages in image_resize There are more places where this cleanup from %x format attributes to the format() method is required. Here it is done in the scope of the image resize task commit 1a8c5e321cc696c8f0f62f46a0141a5d84a56d10 Author: Marcus Schäfer AuthorDate: Wed Oct 19 10:24:26 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 10:24:26 2016 +0200 Bump version: 8.22.0 → 8.23.0 commit 04181cb6d40d8d8cc82f92c66160c981db7fb493 Author: Marcus Schäfer AuthorDate: Wed Oct 19 09:24:29 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 10:01:56 2016 +0200 Fixed setup.py custom install target Make install method aware of --single-version-externally-managed This option is passed to the call by pip if not installed as egg commit 36dab6999a52e237850227943f6918ddbd08ae08 Author: Marcus Schäfer AuthorDate: Wed Oct 19 00:11:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 00:18:40 2016 +0200 Added setuptools to development requirements commit 897ef278abbbb783f435ab4dc9cf18d3bae030c7 Author: Marcus Schäfer AuthorDate: Tue Oct 18 23:50:28 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 19 00:18:40 2016 +0200 Delete travis pypi deployment After weeks of try and error, this simply does not work for me Manual deployment via make pypi and a local account works fine Maybe this can be solved in the future but for now I can live with a manual step commit 88fd8211d8840cd9b8c785989e12337c166b02f5 Author: Marcus Schäfer AuthorDate: Tue Oct 18 23:11:09 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 23:52:05 2016 +0200 Package kiwi/boot/arch into sub archive The sdist target runs into an infinite loop if installed via pip. It seems the symlink files below boot/arch confuses distutils commit a7e0d3790ce9554ac15d9d8de50aba0535b306b4 Author: Marcus Schäfer AuthorDate: Tue Oct 18 21:27:53 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 21:27:53 2016 +0200 Bump version: 8.21.1 → 8.22.0 commit 83db17e9fb886139585f4dd43652c1573788f73b Author: Marcus Schäfer AuthorDate: Tue Oct 18 19:02:13 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 19:02:13 2016 +0200 Revert "pycparser 2.15 does not play well with xattr" This reverts commit 428436988d1db1017adfb6e92dbc3235d54e06b3. commit de80a1f9b7f13d00de6fb95ee927d472c4d8d703 Author: Marcus Schäfer AuthorDate: Tue Oct 18 17:47:18 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 17:47:18 2016 +0200 Only resize disk format if required Only resize the disk format if the raw disk has been changed If the size of the raw disk is the same as the requested size just print a message to the user commit a149abe8c1e2e1baac728cba351dee86d8e614fe Author: Marcus Schäfer AuthorDate: Tue Oct 18 17:35:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 17:35:11 2016 +0200 Simplify help call commit 4d817810386150d650e9b3ddb50302766ddf5a49 Author: Marcus Schäfer AuthorDate: Tue Oct 18 17:28:52 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 17:28:52 2016 +0200 Smarter way to calculate bytes from a size unit commit d85060d73ca82d971282620448b9ff4189790c0a Author: Marcus Schäfer AuthorDate: Tue Oct 18 17:20:00 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 17:20:00 2016 +0200 Explicitly bool check for the service name option From docopt we expect a True/False value for the selected service name positional parameter. Thus the code should also make it clear what we expect commit 714d01e4d58b563a0ff18b0619768e1d0ac325a4 Author: Marcus Schäfer AuthorDate: Tue Oct 18 17:10:03 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 17:10:03 2016 +0200 Use format method instead of printf like style commit 136b4efa442e044f32610879de707d41b2a41295 Author: Marcus Schäfer AuthorDate: Tue Oct 18 17:01:58 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 17:01:58 2016 +0200 Update resize_raw_disk method Do not resize the disk if an attempt to resize to the same size was made. Do not fail in this situation but indicate via a bool return value if an action has happened(True) or not(False) commit 3493b21e34d21c940faa9e0fc1e867688ecae96d Author: Marcus Schäfer AuthorDate: Tue Oct 18 16:50:32 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 16:50:32 2016 +0200 Use latest version of pip for tox setup commit 625a515234c143a501fe363be8147f08bc6c2743 Author: Marcus Schäfer AuthorDate: Tue Oct 18 16:23:18 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 16:23:18 2016 +0200 Revert "Fixup travis setup" This reverts commit ee9e633d78833d02a535e6f4d2ce775425082872. commit ce770cb884367a38d3dd2d517ac1ed54847810e8 Author: Marcus Schäfer AuthorDate: Tue Oct 18 16:23:06 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 16:23:06 2016 +0200 Revert "Fixup travis.yml" This reverts commit 1c80841e8c264ba1957e2ae6b53d2af2929479b0. commit 1c80841e8c264ba1957e2ae6b53d2af2929479b0 Author: Marcus Schäfer AuthorDate: Tue Oct 18 16:18:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 16:18:44 2016 +0200 Fixup travis.yml Make sure python-tox gets installed commit ee9e633d78833d02a535e6f4d2ce775425082872 Author: Marcus Schäfer AuthorDate: Tue Oct 18 16:14:29 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 16:14:29 2016 +0200 Fixup travis setup No need to install requirements, this is all done by tox commit 428436988d1db1017adfb6e92dbc3235d54e06b3 Author: Marcus Schäfer AuthorDate: Tue Oct 18 16:02:30 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 16:04:07 2016 +0200 pycparser 2.15 does not play well with xattr Use pycparser 2.14 in setup.py and virtual env requirements commit 70eeec4a9a8e2dc2a06113e6cfe067fa73175203 Author: Marcus Schäfer AuthorDate: Tue Oct 18 15:28:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 15:28:11 2016 +0200 Fixed setup.py install target pip calls the install target but not the build target. For kiwi's tools this means they need to run the tools compilation if not already done prior to the installation of the tools commit 368a9b1cbb85c92644deee241b90a4552db74c66 Author: Marcus Schäfer AuthorDate: Tue Oct 18 12:13:57 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 12:22:01 2016 +0200 Call dracut in system root tree Change BootImageDracut class to call dracut in the specified system root directory and not in a self prepared new root environment. dracut reads scripts and dracut module configurations from the installed system components, e.g kdump. Therefore calling it from an isolated runtime environment creates an initrd which is not matching the system components. Fixes bnc#1005246 commit c9c71f4dc581b8b470cf26d6466ebba5fe7d9fed Author: Marcus Schäfer AuthorDate: Mon Oct 17 19:26:15 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 10:13:41 2016 +0200 Added kiwi image resize command The image resize command allows to resize a disk image and its optional disk format to a new disk geometry commit 0825b250307bb8fe465a3950653229bd6f53de3e Author: Marcus Schäfer AuthorDate: Mon Oct 17 19:18:09 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 10:13:41 2016 +0200 Added manual page for image resize command commit 73f993939c190441e4b320d98ca82e9bd44a7b07 Author: Marcus Schäfer AuthorDate: Mon Oct 17 11:42:33 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 10:08:05 2016 +0200 Add raw format to subformat factory commit de76321da7a507275ff6b2d8d0d5f68a52980ad6 Author: Marcus Schäfer AuthorDate: Sat Oct 15 00:04:36 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 18 10:08:05 2016 +0200 Added resize_raw_disk method in DiskFormatBase Allow to increase the disk geometry of a disk image file in order to create free space on this disk commit a0debd086b6cfc5f96aacffaccc85a3223e48e4b Author: Marcus Schäfer AuthorDate: Mon Oct 17 11:27:55 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 17 11:27:55 2016 +0200 Allow ftp:// uri style for package repositories commit ac867be470730d9fcf58ccc39aacb16773726e3d Author: Marcus Schäfer AuthorDate: Mon Oct 17 11:26:16 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 17 11:26:16 2016 +0200 Add grub2-efi-modules in rhel boot descriptions This package provides the efi modules which are needed if a custom efi module is build by kiwi via grub2-mkimage commit 35ddb8e9d8e6a7a09c75205884f4062f001a6660 Author: Marcus Schäfer AuthorDate: Mon Oct 17 09:11:06 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 17 09:11:06 2016 +0200 Fixup doc string for target_removable attribute The default behaviour was not explained clear enough commit 1f85063007b050ad6df54b2043d373cc2bb335d6 Author: Marcus Schäfer AuthorDate: Thu Oct 13 16:06:16 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 14 08:31:41 2016 +0200 Handle target_removable in kiwi disk builder commit aa64d28666ba45e90c71c7496c13fcce8a0c2526 Author: Marcus Schäfer AuthorDate: Thu Oct 13 15:45:51 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 14 08:31:41 2016 +0200 Handle target_removable in kiwi boot code commit b7e1e293ecca658e9441efc9325c6b46945fded0 Author: Marcus Schäfer AuthorDate: Thu Oct 13 15:41:17 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 14 08:31:41 2016 +0200 Store kiwi_target_removable in profile env commit b02b565d94f15aef07543d35fdfec5775ce96ae2 Author: Marcus Schäfer AuthorDate: Thu Oct 13 15:14:40 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 14 08:31:23 2016 +0200 Added target_removable attribute Indicate if the target disk for oem images is deployed to a removable device e.g a USB stick or not. This only affects the EFI setup if requested and in the end avoids the creation of a custom boot menu entry in the firmware of the target machine on first boot. This is related to bnc#993130 commit 2e183bddb9a7466ba1864dedad736555ecc971fe Author: Marcus Schäfer AuthorDate: Thu Oct 13 14:18:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 13 14:18:42 2016 +0200 Use XML parser to test XML output for info.xml commit 7ff0eb9e3cee07e34beba1bdeec981980c969dbd Author: Marcus Schäfer AuthorDate: Thu Oct 13 11:04:56 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 13 11:04:56 2016 +0200 parenthesis in imports only for multi-line imports commit 5b49d64755a1f177e3071669d11a4e36e927ff5c Author: Marcus Schäfer AuthorDate: Thu Oct 13 10:48:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 13 10:48:39 2016 +0200 Delete unused textwrap import commit 6006a27765f5f8286f8822f770cfabc5ac21612e Author: Marcus Schäfer AuthorDate: Thu Oct 13 10:47:24 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 13 10:47:24 2016 +0200 Move info.xml test data into its own file commit 22487ba9047d360f6536f5c10352d7728efb6a63 Author: Marcus Schäfer AuthorDate: Thu Oct 13 10:39:58 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 13 10:39:58 2016 +0200 Fixup code smells per review Only import what is needed, concat strings by a join commit ba1a962d39d6f525a11b93bf57eb84589c0aef25 Author: Marcus Schäfer AuthorDate: Thu Oct 13 09:59:08 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 13 09:59:08 2016 +0200 Create info.xml file for btrfs snapshot If the system is installed into a btrfs snapshot a metadata file called info.xml is created which is used by tools like snapper. Fixes bnc#1000117 commit 719ed8a8ab4e0543991999f2cb9f649b5598d41c Author: Marcus Schäfer AuthorDate: Wed Oct 12 11:28:58 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Oct 12 11:28:58 2016 +0200 Cleanup use of cache location commit 69128b969817a4513aeb4ec05fa8c71a1449b32a Author: David Cassany AuthorDate: Tue Oct 11 17:29:39 2016 +0200 Commit: David Cassany CommitDate: Tue Oct 11 17:29:39 2016 +0200 Updated hideSplash method hideSplash method now hides the splash image regardless of an active console is detected or not. This commit is port from openSUSE/kiwi#601 commit 874b6a19ac5ae4d13163cfd88d50f56ae04f3b94 Author: David Cassany AuthorDate: Tue Oct 11 17:26:53 2016 +0200 Commit: David Cassany CommitDate: Tue Oct 11 17:26:53 2016 +0200 Fixing wrong spaces commit 5b7f4aeb59ecce40608eb2e281940e82da1d6010 Author: David Cassany AuthorDate: Tue Oct 11 17:13:50 2016 +0200 Commit: David Cassany CommitDate: Tue Oct 11 17:24:47 2016 +0200 Updated fetchFile method Now it makes sure the splash is hidden before showing any progress dialog. This commit is port from openSUSE/kiwi#601 commit a8d45d5f02598c6dc3d11c43e80cecc58cfc8f34 Author: Marcus Schäfer AuthorDate: Tue Oct 11 10:49:38 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Oct 11 10:49:38 2016 +0200 Bump version: 8.21.0 → 8.21.1 commit ef2ff20078885367957d23ea888472dd9fcd8684 Author: Marcus Schäfer AuthorDate: Mon Oct 10 17:30:08 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 10 17:30:08 2016 +0200 Fixup wicked DNS data validation wicked provides DNS info in DNSSERVERS with a space as separator and not with a ',' as it was the case in dhcpcd commit 275190dfcf26a9c336eaf36e32214eb7f796b63f Author: Marcus Schäfer AuthorDate: Mon Oct 10 12:25:57 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 10 12:25:57 2016 +0200 Do not bundle the raw disk if a format is setup Only bundle the compressed version of the .raw disk image if no disk format like qcow2, vmdk, etc... is specified. Fixes #159 commit 2a4c5f8c15c38182bef06b80a32a079ab396f7f6 Author: Marcus Schäfer AuthorDate: Mon Oct 10 09:05:32 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 10 09:05:32 2016 +0200 Do not compress disk formats Stay compatible with the former version of kiwi and do not compress disk formats like qcow2, vmdk, etc... It also does not make much sense since the disk formats itself are using a compression algorithm. Fixes #159 commit bc32ef990a03dbb0f047090881ae9b2dfa254014 Author: Marcus Schäfer AuthorDate: Mon Oct 10 08:47:33 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Oct 10 08:47:33 2016 +0200 Support yum repository priorities yum normally installs the latest version of a package, regardless of which repository provides it. The yum-plugin-priorities provides a method to prefer a package from a repository with a higher priority. Fixes #153 commit a3cf76cbc5bd89906abc364d4d5efbda14eb22a7 Author: Marcus Schäfer AuthorDate: Fri Oct 7 15:52:45 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 7 15:52:45 2016 +0200 Bump version: 8.20.22 → 8.21.0 commit 43114aa9ea0561389899c1c26546f2106b2bfba1 Author: Marcus Schäfer AuthorDate: Fri Oct 7 11:45:15 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Oct 7 11:46:46 2016 +0200 Fix attributes_not_used helper script The script is used to check which parts of the XML schema are not used by the new (kiwi v8) version. The information is helpful to find missing or obsolete attribute handling in v8 vs. v7 commit 57c0e12d17f35a1a9dfdcf57aece819e57d32b5f Author: David Cassany AuthorDate: Thu Oct 6 16:24:46 2016 +0200 Commit: David Cassany CommitDate: Thu Oct 6 16:24:46 2016 +0200 Modified few code lines to match landscape's quality standards commit 3f512a3a51a0e05d505b898a20850b84c4993d33 Author: Marcus Schäfer AuthorDate: Thu Oct 6 10:41:26 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 6 10:42:48 2016 +0200 Use tmpfs for write overlay in netboot via nbd/aoe commit 116a69310a4b00bf17dea735109250714215c58c Author: Marcus Schäfer AuthorDate: Wed Oct 5 13:34:59 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 6 09:30:44 2016 +0200 Add set_property_readonly_root for volume manager The custom option root_is_readonly_snapshot is evaluated for the method set_property_readonly_root(). If set and the root filesystem has been installed into a btrfs snapshot the filesystem is turned into read-only mode commit 527fbf6a6041e4dc29ffbdd80a922caa45e92880 Author: Marcus Schäfer AuthorDate: Wed Oct 5 13:18:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 6 09:30:44 2016 +0200 Evaluate root_is_readonly_snapshot in disk builder commit 0b9acfc035a2670fe0f1e3a7c6144d85f0bf8b94 Author: Marcus Schäfer AuthorDate: Wed Oct 5 11:32:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Oct 6 09:30:26 2016 +0200 Added btrfs_root_is_readonly_snapshot attribute The attribute allows to specify if the root filesystem should be set to read-only if it is created as a btrfs snapshot. The option only has an effect if a btrfs snapshot is used as root filesystem. Fixes bnc#1000080 commit 847ad6baa437cf9f2598498643b4948e1a42c71b Author: David Cassany AuthorDate: Wed Oct 5 18:44:54 2016 +0200 Commit: David Cassany CommitDate: Wed Oct 5 18:44:54 2016 +0200 Added support for multiple `--add-profile` options commit b5549e3281aa34e84ef98edd884d383bc6dc1425 Author: David Cassany AuthorDate: Wed Oct 5 18:27:35 2016 +0200 Commit: David Cassany CommitDate: Wed Oct 5 18:27:35 2016 +0200 Added '--add-profile' option in compat mode This commit fixes #154. With this, the compatiblity mode accepts the `--add-profile` option which was present in previous kiwi versions and that is translated to `--profile` in the current version. commit 512135d06b9d4f6f8ee0725dbd6fe359aae232c7 Author: Marcus Schäfer AuthorDate: Sat Oct 1 21:18:45 2016 +0200 Commit: Marcus Schäfer CommitDate: Sat Oct 1 21:18:45 2016 +0200 Bump version: 8.20.21 → 8.20.22 commit b77a806dd2cdb22926b8ad31fb04f1190eb5f32b Author: David Cassany AuthorDate: Fri Sep 30 17:40:34 2016 +0200 Commit: David Cassany CommitDate: Fri Sep 30 17:40:34 2016 +0200 Added test for -udf flag for genisoimage/mkisofs commit 7b7010482c0717b33e5efbb5eb1cae50f41c0c72 Author: David Cassany AuthorDate: Fri Sep 30 17:35:41 2016 +0200 Commit: David Cassany CommitDate: Fri Sep 30 17:35:41 2016 +0200 Added forcing UDF filesystem for large images Included -udf flag to force UDF filesystem usage commit 6a611b2e911685c714a08a25a2002281d3e602f8 Author: Marcus Schäfer AuthorDate: Fri Sep 30 15:00:22 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 30 15:00:22 2016 +0200 Fixed secure boot setup for iso media Provide the shim loader and the shim signed grub loader in the required boot path. Normally this task is done by the shim-install tool. However, shim-install does not exist on all distributions and the script does not operate well in CD environments from which we generate live and/or install media. Thus shim-install is used if possible at install time of the bootloader because it requires access to the target block device. In any other case the kiwi fallback code applies commit 404b71aedc4e989af10dd6f2030e32beff61dfb2 Author: David Cassany AuthorDate: Fri Sep 30 12:11:03 2016 +0200 Commit: David Cassany CommitDate: Fri Sep 30 12:11:03 2016 +0200 Added support for mkisofs genisoimage and mkisofs tools are slightly different so this commit makes sure all flags are supported in both tools. commit b828f2185064e2f7ec1f954a8009311ecf9b7c3f Author: Marcus Schäfer AuthorDate: Fri Sep 30 10:26:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 30 10:26:11 2016 +0200 Fixed hybrid setup for large ISO images The isohybrid tool uses fseek() to locate the bootloader files. That's unfortunately not 64-bit safe. In case of an ISO image bigger than 4G this leads to 32-bit offset issues. kiwi can workaround this problem by putting the bootloader files near the top of the iso image, which is done by a change in the sortfile of this commit commit a300a28d005eecf63c5e09a3c4408ef637b75135 Author: Marcus Schäfer AuthorDate: Thu Sep 29 09:53:43 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 29 10:08:51 2016 +0200 Added rpm_excludedocs handling for yum rpm supports the --excludepath option. However, yum can not be configured to pass along options to rpm or the python interface it uses. Thus only a warning about excludedocs not being supported by kiwi for yum is issued. Fixes #133 commit def6aa32d110d6dce112cd66e3f4c6e4d9619c7a Author: Marcus Schäfer AuthorDate: Thu Sep 29 09:28:49 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 29 09:45:33 2016 +0200 Added rpm_excludedocs handling for apt Setup the appropriate dpkg options to avoid the installation of manual pages and package documentation if rpm_excludedocs is set in the kiwi XML description. Related to #133 commit 10cb369f98813b3bcbe02d8ef2057ef0669fab18 Author: Marcus Schäfer AuthorDate: Tue Sep 27 16:48:37 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 27 16:48:37 2016 +0200 Make sure netboot code populates kiwi_RootPart For disk based images the file config.partids is written and imported. However, for netboot stations a disk is optional and no partids information exists. In order to provide at least the partition number for the root partition on netboot stations with a disk, the kiwi_RootPart is exported from the provided client configuration file. Fixes bnc#1000194 commit f6ed7215adb3b5bf207f0566ee5db860a3c80a38 Author: Marcus Schäfer AuthorDate: Tue Sep 27 16:17:02 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 27 16:17:02 2016 +0200 Bump version: 8.20.20 → 8.20.21 commit bb26fc71b717559286040c80abaa95eb7acc5f8e Author: Marcus Schäfer AuthorDate: Tue Sep 27 15:40:04 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 27 15:40:43 2016 +0200 Call grub2-install as chroot operation In addition to the chrooted call make sure all volumes from the volume manager (if used) are mounted at call time commit 0c8cbf6c1c06e2a6792631d6521db7ecf3d7d141 Author: Marcus Schäfer AuthorDate: Tue Sep 27 14:59:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 27 15:40:39 2016 +0200 Fixup grub default module list The test module is a required module in any case commit bd57391403874fb3ebec3a7dee4296d66c6abb5a Author: Marcus Schäfer AuthorDate: Tue Sep 27 11:56:26 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 27 11:56:26 2016 +0200 Make sure fstab exists in initrd creation system commit 1b6bf65beb0c39f1bcb20e6a8f19050b0d762c2c Author: Marcus Schäfer AuthorDate: Tue Sep 27 11:26:27 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 27 11:26:27 2016 +0200 Umount volumes prior to bootloader installation commit 487fdf2634f823b38b2f2c74efbbdf41626bf04b Author: Marcus Schäfer AuthorDate: Mon Sep 26 19:02:13 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 26 19:02:13 2016 +0200 Bump version: 8.20.19 → 8.20.20 commit 3389a72879d98b5bff6ed464d9db520d68860fa5 Author: Marcus Schäfer AuthorDate: Mon Sep 26 18:45:51 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 26 18:45:51 2016 +0200 Respect setup of devicepersistency for swap part If a swap boot partition is requested it should be added to the fstab file according to the device persistency setup or its uuid default commit b7722bc6e70db86e49f724719aebad54558456d9 Author: Marcus Schäfer AuthorDate: Mon Sep 26 18:45:08 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 26 18:45:08 2016 +0200 Update schema documentation commit 5ecdb07d27c4489a39d0399394b376a94589bdc9 Author: Marcus Schäfer AuthorDate: Mon Sep 26 18:34:46 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 26 18:34:46 2016 +0200 Bump version: 8.20.18 → 8.20.19 commit a6621aa14876c2ccceb03536c0bd0ec9abbb1662 Author: Marcus Schäfer AuthorDate: Mon Sep 26 18:24:49 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 26 18:30:14 2016 +0200 Respect setup of devicepersistency for boot part If an extra boot partition is requested it should be added to the fstab file according to the device persistency setup or the default uuid persistency type commit 6cabd4f0306c98268e6c3c5f307a4e5ae409f016 Author: Marcus Schäfer AuthorDate: Mon Sep 26 17:03:22 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 26 17:03:22 2016 +0200 Only sync .mod grub2 module files When syncing the grub2 modules to the boot directory only the .mod version of the module needs to be present commit 72341dbfb024413a2c0deb194780d73a388be988 Author: Marcus Schäfer AuthorDate: Mon Sep 26 16:53:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 26 16:53:11 2016 +0200 Mount boot volumes on grub install If there are volumes below /boot they need to be mounted before grub2-install / shim-install is called in order to make sure all data is available in the volume commit 3b0df45e9ae1910532c9f9c969106a31161596c4 Author: Marcus Schäfer AuthorDate: Fri Sep 23 22:36:23 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 23 22:36:23 2016 +0200 Bump version: 8.20.17 → 8.20.18 commit ef54157d395c9e4e18f542fc2c3d3419c13eb7fe Author: Marcus Schäfer AuthorDate: Fri Sep 23 22:13:00 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 23 22:13:00 2016 +0200 Make sure boot image dump is cleaned up commit 7cee5f9d41081986aa04bcd8eb27a29b6697776d Author: Marcus Schäfer AuthorDate: Fri Sep 23 21:46:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 23 21:46:39 2016 +0200 Refactor DiskBuilder class The DiskBuilder class is able to build a disk its corresponding format and the installation image to install this disk by using the InstallImageBuilder. However all three tasks were handled in a row which lead to the problem that resources like active mount processes were still open when e.g the disk format is created. The race conditions produced here lead to an undefined state of the resulting disk format and/or install image. In order to avoid this the DiskBuilder class has been refactored in a way that each tasks is an atomic operation which is freeing its resources after success commit 1ad67764550cf09b13b529cdebac18d2ad95349b Author: Marcus Schäfer AuthorDate: Thu Sep 22 17:06:16 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 22 17:06:16 2016 +0200 Delete root, boot, efi fstab setup from kiwi boot The kiwi boot code was responsible for setting up the contents of the fstab file on first boot. However the build process now provides an fstab with the generic label or uuid based fstab entries which allows to remove that part from the kiwi boot code commit dc96cb479a5aaaea156e52f5a0b52eac568660c3 Author: Marcus Schäfer AuthorDate: Thu Sep 22 15:19:29 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 22 16:41:16 2016 +0200 Add root, boot and efi partitions to fstab Make sure the above partitions are added to the generic fstab with their label or uuid at build time commit 3ddc4326c8f662fd65482b7688e2e7e8d0b2c766 Author: Marcus Schäfer AuthorDate: Thu Sep 22 15:18:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 22 15:18:42 2016 +0200 Added BlockID class Class to provide support for retrieving block device metadata commit d0a473cacfaa019f63a68145b60ffc6b3a407a84 Author: Marcus Schäfer AuthorDate: Thu Sep 22 15:00:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 22 15:00:11 2016 +0200 Use BlockID class for block operations commit f525baad31e403ad937370ccfca79216ca4368c2 Author: Marcus Schäfer AuthorDate: Thu Sep 22 13:33:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 22 13:45:26 2016 +0200 Fixed fstab entries for btrfs subvolumes mount options must be part of the subvol information which itself is also a mount option commit e608e2f62a477aa381eabd755105f1fe7ab22ed5 Author: David Cassany AuthorDate: Thu Sep 22 10:38:02 2016 +0200 Commit: David Cassany CommitDate: Thu Sep 22 10:38:02 2016 +0200 Corrected DEVICE_TIMEOUT variable validation Now it uses regex in order to validate the variable is an integer commit 59d262bdf240c3b3693ab5f67cb1a15d475044fb Author: Marcus Schäfer AuthorDate: Wed Sep 21 19:20:51 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 21 19:20:51 2016 +0200 Bump version: 8.20.16 → 8.20.17 commit 01b5f256fbf2924660bb287fb4695c72a503702d Author: Marcus Schäfer AuthorDate: Wed Sep 21 19:09:23 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 21 19:15:52 2016 +0200 Normalize mount path in get_fstab for lvm volumes commit 14b94a0bb9a14e8d3fb5e519cf5ed6125bcc3f24 Author: Marcus Schäfer AuthorDate: Wed Sep 21 19:03:47 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 21 19:03:47 2016 +0200 Fixed get_fstab parameter order for lvm commit 4e03170b39dd5e8f3bda132f0419fa8251ec6479 Author: Marcus Schäfer AuthorDate: Wed Sep 21 18:03:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 21 18:03:10 2016 +0200 Bump version: 8.20.15 → 8.20.16 commit 9a1e284b0fbb30b03cd75a3f14c06f8dd67e34cb Author: Marcus Schäfer AuthorDate: Wed Sep 21 17:09:26 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 21 17:09:26 2016 +0200 Delete fstab setup for volumes from kiwi boot code For persistent devices like LVM volumes or btrfs sub volumes the fstab setup can be done at build time. Fixes #142 commit f6eb260d8ed93f93e0e57beb4c8b91da94f9bc7e Author: Marcus Schäfer AuthorDate: Wed Sep 21 12:00:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 21 17:07:56 2016 +0200 Implement get_fstab for btrfs volume management commit a9f551f2607061fe661aae1141430704a4839cad Author: Marcus Schäfer AuthorDate: Wed Sep 21 11:57:59 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 21 17:07:55 2016 +0200 Fixed btrfs mount_volumes if root is snapshot The provided subvolume name contained the snapshot path which is invalid. In addition nested volumes e.g /var/cache were reduced to /cache which is wrong commit 09a1b7df949805951de09f448bc3e5f7ac6cb217 Author: Marcus Schäfer AuthorDate: Wed Sep 21 10:19:50 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 21 17:07:55 2016 +0200 Cleanup unit test Use only one instance of context manager for all tests commit f938bf8a839ba7e5dd341398024c29037b8b3af3 Author: Marcus Schäfer AuthorDate: Tue Sep 20 21:29:46 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 21 17:07:55 2016 +0200 Create fstab entries for persistent devices Instead of creating the fstab at boot time, those entries which are generic and not depending on an unknown device name can be created as part of the image building process. commit e3a43cde66af36a8bc1218074385a116d4ce98a0 Author: David Cassany AuthorDate: Wed Sep 21 12:51:04 2016 +0200 Commit: David Cassany CommitDate: Wed Sep 21 12:51:04 2016 +0200 Custom device timeout variable added This commit patches the issue bnc#992992. Now DEVICE_TIMEOUT variable can be used in order to set the device waiting timeout in watForStorageDevice function. Must be a numeric value expressed in seconds. commit 08af7bde6a2684306c82bb5af60f472f66f01030 Author: Marcus Schäfer AuthorDate: Tue Sep 20 21:29:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Sep 21 12:11:55 2016 +0200 Implement get_fstab for LVM volume management commit cdf9e47d3ac49c094f28a7ef4a46ee720041671e Author: Marcus Schäfer AuthorDate: Tue Sep 20 21:28:25 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 20 21:28:25 2016 +0200 Added get_fstab to volume manager interface The volume manager interface should allow to provide fstab entries for the volumes it manages commit c7c1d3867bf66924bc84aea7868348c9488bd154 Author: Marcus Schäfer AuthorDate: Tue Sep 20 17:05:37 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 20 17:05:37 2016 +0200 Bump version: 8.20.14 → 8.20.15 commit 55c415214b103a28db5fcf9adec71f515eca2b80 Author: Marcus Schäfer AuthorDate: Tue Sep 20 16:51:32 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 20 16:51:32 2016 +0200 Fixed evaluation of Dialog return value The return code from the Dialog boot code was evaluated after other shell code was executed. Thus the return code from the call in question was lost and misinterpreted commit fa3eba6cf5cb938302ab9738c390898da5b8f1bc Author: Marcus Schäfer AuthorDate: Tue Sep 20 16:17:50 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 20 16:35:25 2016 +0200 Make sure volumes are mounted prior to install commit f809321660985112a2fb712d44296058a5d22b45 Author: Marcus Schäfer AuthorDate: Tue Sep 20 16:17:04 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 20 16:17:04 2016 +0200 Fixup invalid character in bash source commit a22c1b50bf3ce631189cb20b996aa81f946e8683 Author: Marcus Schäfer AuthorDate: Tue Sep 20 15:09:01 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 20 15:09:01 2016 +0200 Bump version: 8.20.13 → 8.20.14 commit bc80dea8c5c5bf9d3e60f9190ff33c5ba57775ec Author: Marcus Schäfer AuthorDate: Mon Sep 19 17:41:19 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 19 17:41:19 2016 +0200 Fixup chroot adaption for caller environment The ZYPP_CONF path is provided as part of the caller environment and not as a zypper caller parameter. However the path adaptions when calls happens chrooted was only done for the commandline arguments but not for the command environment. This patch also adapts the environment, related to Issue #133 commit 7a8525acdd6d8020745b9c779a98af40e0002275 Author: Marcus Schäfer AuthorDate: Mon Sep 19 10:48:19 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 19 10:48:19 2016 +0200 Make ifplugstatus available in boot images Added ifplugd to kiwi oem|netboot images for leap and tumbleweed commit 5345dea81aeb24887a7f127aabcb604d024f84de Author: Marcus Schäfer AuthorDate: Mon Sep 19 10:42:22 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 19 10:42:22 2016 +0200 Prefer ifplugstatus for link up check Use ifplugstatus if present to check if the network link is up. Fallback is the old ip based method commit 0377b8fe020f171515da6ccc3c8838f73d129faf Author: Marcus Schäfer AuthorDate: Fri Sep 16 11:21:25 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Sep 16 11:21:25 2016 +0200 Fixup theme setup in grub2 config template Only set the theme if the .txt file describing it exists commit 905f49afc1e7a409987578252da177a2a188172d Author: Marcus Schäfer AuthorDate: Thu Sep 15 17:34:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 15 17:34:05 2016 +0200 Fixup yum group install yum groups can contain spaces, thus quoting is required Fixes #138 commit c73a71e206d923db0cd8750511df0f84dae3fa6c Author: Marcus Schäfer AuthorDate: Thu Sep 15 14:16:22 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 15 14:16:22 2016 +0200 Bump version: 8.20.12 → 8.20.13 commit 982d11e336a9dc23457d6c08cbe4d127682a5dea Author: Marcus Schäfer AuthorDate: Thu Sep 15 10:55:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Sep 15 10:55:07 2016 +0200 Follow up fix for setupNetworkWicked IP address information from wicked is imported twice. However the plain IPv4 address validation happened only on the first import. Fixes bnc#992989 commit ffbfaf772d4c4bf4cd7fbcd3c94983e584de96d7 Author: Marcus Schäfer AuthorDate: Tue Sep 13 12:01:30 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 13 12:01:30 2016 +0200 Fixed pxe install archive md5 file The md5 sum must be created from the uncompressed version of the disk image commit 31844bffd8f1db02332cf2cf8923b8c51edcc14a Author: Marcus Schäfer AuthorDate: Tue Sep 13 10:53:52 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Sep 13 11:14:29 2016 +0200 Added missing trigger file for oem pxe install The config.vmxsystem trigger file was missing in the oem install initrd used when deploying a disk image over pxe commit cd407dedec613a1664a41133d8eeccfdebd3b9b1 Author: Marcus Schäfer AuthorDate: Mon Sep 12 16:47:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 12 16:47:05 2016 +0200 Bump version: 8.20.11 → 8.20.12 commit 7dfa9ee007f057ecf2dfe67779965cfc54025fff Author: Marcus Schäfer AuthorDate: Mon Sep 12 16:24:08 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 12 16:31:48 2016 +0200 Integrate schema documentation into doc process The schema documentation is auto generated via the schema_parser helper tool. The tox doc target now also generates schema docs Fixes #53 commit 2f7a957b7a0e19fb31014101d74cb382b417ce28 Author: Marcus Schäfer AuthorDate: Mon Sep 12 16:18:57 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 12 16:31:48 2016 +0200 Schema docs generation helper A simple script to parse the RelaxNG schema that grabs relevant information in order to produce autogenerated documentation from the schema inline comments. commit f021b16fffc107463802368a84035fd66ba1e2db Author: Marcus Schäfer AuthorDate: Mon Sep 12 15:58:13 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Sep 12 15:58:13 2016 +0200 Added handling for rpm-excludedocs for zypper In zypper zypp.conf can be setup to prevent the installation of %doc marked items from rpm packages. The section in the kiwi XML description is used to provide this functionality. So far this feature is only implemented for zypper. References #133 commit c6e80a13c95a7f61b0df7334204d2ef0d19a5cbd Author: Marcus Schäfer AuthorDate: Sun Sep 11 22:20:17 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun Sep 11 22:20:17 2016 +0200 Make sure EFI modules are provided in uefi mode For EFI secure boot (uefi) the grub2 efi modules were not copied to the target directory. shim-install normally does that by invoking grub2-install. However shim-install does not allow to call grub2-install with the required parameters as needed for loop (image) based targets. Thus kiwi calls shim-install but skips grub2-install and takes care to provide the needed EFI modules. commit 82bea9ec70bd2f0d0b30389f7334069bab86be01 Author: Marcus Schäfer AuthorDate: Sun Sep 11 21:19:36 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun Sep 11 21:22:11 2016 +0200 Revert WaitForStorageDevice patch The logic to setup a wait timeout by asking a device property from a device which does not yet exist raises a chicken and egg problem commit c27c98f4942bfd2d4b498ee1b38b863e220c5426 Author: Marcus Schäfer AuthorDate: Sun Sep 11 21:07:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun Sep 11 21:07:44 2016 +0200 Fixed message typo (bnc#996255) commit aa4eb0642605a20b8bf5f7fc45b4ebc491df6a30 Author: Thomas Bechtold AuthorDate: Wed Sep 7 17:49:23 2016 +0200 Commit: Thomas Bechtold CommitDate: Wed Sep 7 17:49:23 2016 +0200 travis: Update pypi password Next try to get the automatic deployment on pypi fixed. commit 232716fc1b5fd225aa3c2febcfe59b782a8491a9 Author: Marcus Schäfer AuthorDate: Thu Aug 25 16:05:57 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 25 16:05:57 2016 +0200 Move to tar.gz as sdist target PyPI is planning to support only .tar.gz in the near future. See https://www.python.org/dev/peps/pep-0527. This Fixes #132 commit a5a9fe3c8ed1fa25c28ae349f7a2c5821465f535 Author: Marcus Schäfer AuthorDate: Thu Aug 25 15:39:24 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 25 15:44:54 2016 +0200 Activate partition using parted instead of sfdisk sfdisk changes their caller semantics incompatible. Therefore we move to a tool which is still stable in the caller options Fixes #129 commit a4a114a1fbdc445c477a924b1342515f890244ab Author: Marcus Schäfer AuthorDate: Thu Aug 25 14:27:48 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 25 14:27:48 2016 +0200 Update baseStripRPM Method is a noop and only exists for compatibility kiwi handles the deletion of packages in the core builder code commit 85e3eceee0c89e57a96cd9b53c514a44a388bbb2 Author: Marcus Schäfer AuthorDate: Thu Aug 25 14:09:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 25 14:09:39 2016 +0200 Bump version: 8.20.10 → 8.20.11 commit 7021b1147e7912b95b395b766c92026186ec74c1 Author: Marcus Schäfer AuthorDate: Thu Aug 25 14:08:35 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 25 14:08:35 2016 +0200 Revert "Update doc string for kiwi_compat.py" docopt strings are not allowed to be interrupted by a newline This reverts commit b1b92ed830820530bfd7bdc5256525f3dfc01a4a. commit 97c83c7e0d0804a3f133036f3169ccd0b7c2a9c6 Author: Marcus Schäfer AuthorDate: Thu Aug 25 12:43:43 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 25 12:43:43 2016 +0200 Bump version: 8.20.9 → 8.20.10 commit d9d41ae154d02157035568352f3660530820d76c Author: Marcus Schäfer AuthorDate: Thu Aug 25 12:32:33 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 25 12:40:12 2016 +0200 Use os.linesep Python's os module provides a portable version for the line separator which should be used whenever possible. Fixes #130 commit 01473bf28392569301825c827f7a8bf434375bb4 Author: Marcus Schäfer AuthorDate: Thu Aug 25 12:25:34 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 25 12:25:34 2016 +0200 Bump version: 8.20.8 → 8.20.9 commit 14f47f22522118c410b695722813d4c2da43019f Author: Marcus Schäfer AuthorDate: Thu Aug 25 12:24:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 25 12:24:07 2016 +0200 Fixed custom entries in vmdk machine config Each custom entry must be written in a separate line commit a1cd4a4a106caa593d1081582c372ab9fbca2cf7 Author: Marcus Schäfer AuthorDate: Wed Aug 24 17:04:15 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 24 17:04:15 2016 +0200 Update API documentation Recall sphinx-apidoc and update the generated result markup commit b1b92ed830820530bfd7bdc5256525f3dfc01a4a Author: Marcus Schäfer AuthorDate: Wed Aug 24 16:56:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 24 16:58:06 2016 +0200 Update doc string for kiwi_compat.py Make sphinx happy commit 360b7943c3a999e0bac507dbe36b2492eb246496 Author: Thomas Bechtold AuthorDate: Wed Aug 24 11:40:50 2016 +0200 Commit: Thomas Bechtold CommitDate: Wed Aug 24 11:40:50 2016 +0200 travis: Update pypi password Next try to get the automatic deployment on pypi fixed. commit a30664a2afc7956b49e2d8c7667b6e0243d5bffb Author: Marcus Schäfer AuthorDate: Wed Aug 24 11:08:02 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 24 11:08:02 2016 +0200 Bump version: 8.20.7 → 8.20.8 commit 948051817856f5e450e19fa6cc89d8540456e2cb Author: Marcus Schäfer AuthorDate: Tue Aug 23 16:38:19 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Aug 23 16:38:19 2016 +0200 Fixup get_build_type_vmconfig_entries Make sure we can rely on a list return even if no machine section exists at all. commit 9ee697f87ab7f16ebd39b0c91d27f108df9f7716 Author: Marcus Schäfer AuthorDate: Tue Aug 23 12:03:18 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Aug 23 12:03:18 2016 +0200 Add evaluation of machine's vmconfig_entry As part of the machine section it is possible to setup a custom entry which is stored in the machine configuration file. The evaluation of such an entry for the vmdk (.vmx) config file was still missing. This Fixes #122 commit 03096253c5a760648cf117919e4daab1a754ae27 Author: Thomas Bechtold AuthorDate: Tue Aug 23 08:06:11 2016 +0200 Commit: Thomas Bechtold CommitDate: Tue Aug 23 08:06:11 2016 +0200 travis: Next try to fix automatic pypi deployment Also the travis command which added the pypi deployment part formatted the yaml file. commit b88dfe563ecfbb604b5777cb9bdde5e3486ad9ab Author: Marcus Schäfer AuthorDate: Mon Aug 22 20:42:21 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 22 20:42:21 2016 +0200 Fixed bootloader configuration custom kernel parameters should be added to GRUB_CMDLINE_LINUX and not GRUB_CMDLINE_LINUX_DEFAULT Fixes bnc#994910 commit 139a95bf1e99224f9edfa248a5e9c66b35803e13 Author: David Cassany AuthorDate: Fri Aug 19 17:34:16 2016 +0200 Commit: David Cassany CommitDate: Fri Aug 19 17:34:16 2016 +0200 Use str.format for int to string convertion commit 330291bf9a3d519e35b3109b030c00f1d91e6a1b Author: David Cassany AuthorDate: Fri Aug 19 17:16:42 2016 +0200 Commit: David Cassany CommitDate: Fri Aug 19 17:16:42 2016 +0200 Setup tests corrected #124 commit 830a44e5bcc9ed22950b47dfa511bed38fb4d93b Author: David Cassany AuthorDate: Fri Aug 19 17:02:07 2016 +0200 Commit: David Cassany CommitDate: Fri Aug 19 17:02:07 2016 +0200 Fixes #124 commit a63481826a934d85a1f71d3a68670512ca92746f Author: David Cassany AuthorDate: Fri Aug 19 14:53:07 2016 +0200 Commit: David Cassany CommitDate: Fri Aug 19 14:53:07 2016 +0200 Rearranged waitForStorageDevice code comments commit 874778eeb6203698de637c70e64f218a8bf99f25 Author: David Cassany AuthorDate: Fri Aug 19 11:33:16 2016 +0200 Commit: David Cassany CommitDate: Fri Aug 19 11:33:16 2016 +0200 Added a case statement for transport types commit d62d9db9c0a6d445426b556b0e1424da597a711e Author: David Cassany AuthorDate: Fri Aug 19 09:20:22 2016 +0200 Commit: David Cassany CommitDate: Fri Aug 19 09:20:22 2016 +0200 Removed some backquotes in favour of $() commit 2541f8599c40de932a3b5f0e8729d47f5c4845f5 Author: Marcus Schäfer AuthorDate: Thu Aug 18 15:34:54 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 18 15:34:54 2016 +0200 Bump version: 8.20.6 → 8.20.7 commit d4d711f9e344cd376f9d8dc97b901e6d8fb8de62 Author: Marcus Schäfer AuthorDate: Thu Aug 18 15:30:04 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 18 15:34:37 2016 +0200 Make repository an optional element So far one repository was mandatory in the XML description. However, this is not required because all repositories can be specified on the commandline commit 1f77fa2b311b1e55a171ae7df685802edf82ac59 Author: David Cassany AuthorDate: Thu Aug 18 15:16:41 2016 +0200 Commit: David Cassany CommitDate: Thu Aug 18 15:16:41 2016 +0200 Added quotes to protect against spaces commit 8be67ad6aad85e7c1ee7bd7c3606c434a64a2b4f Author: David Cassany AuthorDate: Thu Aug 18 15:07:48 2016 +0200 Commit: David Cassany CommitDate: Thu Aug 18 15:07:48 2016 +0200 Added getDeviceTransportType method The method gets the transport type of the given device. WaitForStorageDevice reacts according to the transport type by having a shorter timeout in case the device is a usb. commit 0112e5acce799052089bccd690030c9d23b122a8 Author: David Cassany AuthorDate: Thu Aug 18 14:00:53 2016 +0200 Commit: David Cassany CommitDate: Thu Aug 18 14:00:53 2016 +0200 WaitForStorageDevice patch The function has been modified in order to distinguish a shorter timeout if the device is a usb. commit 40547b4524cb628f8eba77e0b552597ad2a6a112 Author: Marcus Schäfer AuthorDate: Wed Aug 17 16:47:20 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 17 16:47:20 2016 +0200 Bump version: 8.20.5 → 8.20.6 commit b72f2ed39b8c8d050152ccb012d418d87994e9f7 Author: Marcus Schäfer AuthorDate: Wed Aug 17 16:44:37 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 17 16:44:37 2016 +0200 Update compat options for create step The --ignore-repos, --set-repo and --add-repo options are allowed to be specified for compatibility reasons if --create is specified in the compat commandline. However, they are not used in the next generation kiwi create step because the repo information is persistently stored after the prepare step has finished, which is not the case for the legacy kiwi version commit 07f15f35d521c78cc045eca2ed8473933d6c9b31 Author: Marcus Schäfer AuthorDate: Wed Aug 17 16:38:34 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 17 16:38:34 2016 +0200 Support --ignore-repos in compat mode commit 08bbe74abcb61bafbca11a8a7ca4dfe106bc95d1 Author: Marcus Schäfer AuthorDate: Wed Aug 17 16:26:35 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 17 16:26:35 2016 +0200 Added --ignore-repos for build and prepare tasks The option allows to ignore all repos configured in the XML description. This allows to specify a complete set of repositories via the commandline commit aa9c5420247e63e1e6a7c768080b5d00ae49ca29 Author: Marcus Schäfer AuthorDate: Tue Aug 16 10:59:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Aug 16 10:59:11 2016 +0200 Bump version: 8.20.4 → 8.20.5 commit 630f26e35050b57fd8052da7eb15830bd83e7a91 Author: Marcus Schäfer AuthorDate: Tue Aug 16 10:22:09 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Aug 16 10:58:43 2016 +0200 Preserve timestamp on grub2-install copy In order to workaround the bug in shim-install which unnecessarily calls grub2-install we replace the binary by a noop before calling shim-install. However all file attributes of the grub2-install binary, timestamp, modes, etc should stay untouched (bnc#993825) commit 93b87863640b64b2ff2a25beedd89ac601dfa437 Author: Marcus Schäfer AuthorDate: Mon Aug 15 11:41:37 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 15 11:41:37 2016 +0200 Update documentation Move information about legacy kiwi in its own chapter commit d83931a67ecbd2e04b69ded8b350c286deb8360e Author: Marcus Schäfer AuthorDate: Fri Aug 12 23:16:01 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Aug 12 23:16:01 2016 +0200 Bump version: 8.20.3 → 8.20.4 commit 846103ec82c38525376288916a94f9822cdccf7a Author: Marcus Schäfer AuthorDate: Fri Aug 12 23:11:03 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Aug 12 23:11:03 2016 +0200 Update documentation Prevent to use non public url references commit 15506b1ec7043276d9568a66a1cc32f6d25c5c01 Author: Marcus Schäfer AuthorDate: Fri Aug 12 23:01:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Aug 12 23:01:10 2016 +0200 Bump version: 8.20.2 → 8.20.3 commit 161d9bbb2e550562eaa5fc4d941f9e2770abc4f3 Author: Marcus Schäfer AuthorDate: Fri Aug 12 22:59:56 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Aug 12 22:59:56 2016 +0200 Fixup vmdk header update due to the wrong file open mode the result image was truncated on update of the vm tools version commit b11fd0bc522309dc66fa02a416083f2f05f23833 Author: Marcus Schäfer AuthorDate: Fri Aug 12 12:23:47 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Aug 12 12:23:47 2016 +0200 Bump version: 8.20.1 → 8.20.2 commit a736d15e978945520f09036463689f5eb269d9c4 Author: Marcus Schäfer AuthorDate: Fri Aug 12 12:22:59 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Aug 12 12:22:59 2016 +0200 Update documentation delete broken links to online ssh key blogs commit 2d6b77ee6fafed3fe1fcc765b20aba2413cdc641 Author: Marcus Schäfer AuthorDate: Fri Aug 12 12:14:55 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Aug 12 12:14:55 2016 +0200 Bump version: 8.20.0 → 8.20.1 commit 8dfe33ed00b1bf1f99ed723ad7fb3ac93686ab9c Author: Marcus Schäfer AuthorDate: Fri Aug 12 12:11:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Aug 12 12:11:55 2016 +0200 Binary opened file should receive bytes Avoids TypeError: 'str' does not support the buffer interface for the vmdk header update commit 287f5d76e8aec39dedd45a8b1d239e73ab6d7c9b Author: Marcus Schäfer AuthorDate: Thu Aug 11 16:15:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 11 16:15:44 2016 +0200 Fixed setupNetworkWicked IP address information from wicked dhcp reply consists out of two parts but we are only interested in the plain IPv4 address information at this point. Fixes bnc#992989 commit 40d04773941d26faafafadfea244dd065b7ac528 Author: Marcus Schäfer AuthorDate: Thu Aug 11 16:06:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 11 16:07:40 2016 +0200 Make sure DHCPCHADDR is upercase Fixes bnc#992988 commit 8b150f9f44abb8e34012065a4d559588ce64a6a3 Author: Marcus Schäfer AuthorDate: Thu Aug 11 10:56:03 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 11 10:58:34 2016 +0200 Delete obsolete section The section was formerly used as part of the section. kiwi no longer supports static split images in favour of overlay systems based on e.g overlayfs. Fixes #120 commit 2fd177bd274030876ff0f3842a9399727b5e2dbc Author: Marcus Schäfer AuthorDate: Thu Aug 11 10:43:54 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 11 10:43:54 2016 +0200 Better logging if Path.which doesn't find the file commit 93fae352ab2757dab2b562684f0f98da54bfe3fe Author: Marcus Schäfer AuthorDate: Wed Aug 10 21:38:20 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 10 21:38:20 2016 +0200 Added docstring for KiwiDescriptionConflict commit f1e7984a82e747f37f1e6deff18d2fbbde4ff11f Author: Marcus Schäfer AuthorDate: Wed Aug 10 21:25:04 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 10 21:25:04 2016 +0200 Fixup Command.run if called with raise_on_error set to False commit 2f7294e25de390622ecfc163003b1bdaac63de3e Author: David Cassany AuthorDate: Wed Aug 10 18:21:37 2016 +0200 Commit: David Cassany CommitDate: Wed Aug 10 18:21:37 2016 +0200 indentation fix commit 33222a0cc34d34782d385bb37608ddb4df8e674e Author: David Cassany AuthorDate: Wed Aug 10 16:41:41 2016 +0200 Commit: David Cassany CommitDate: Wed Aug 10 16:41:41 2016 +0200 Updated logging message Updated logging formating in a way that landscape does not complain commit 0c4256e719b2c1201b9e4ae1c36f55aa2cf1c8e8 Author: David Cassany AuthorDate: Wed Aug 10 16:38:33 2016 +0200 Commit: David Cassany CommitDate: Wed Aug 10 16:38:33 2016 +0200 Updated Command to use Path.which Command.run and Command.call now make use of Path.which in order to test if the command is available or not. Also Path.which has been extended in order to support custom environments and to be able to test file permissions (read. write, execute) commit 9c5857deb5d54568b07704943482ee84b05675a2 Author: Marcus Schäfer AuthorDate: Tue Aug 9 18:50:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Aug 9 18:50:44 2016 +0200 protect systemd-detect-virt Protect systemd-detect-virt from being deleted in the kiwi initrd commit 0fdd209e731201db6ea281d8cd48dbee964711ea Author: David Cassany AuthorDate: Fri Aug 5 18:38:27 2016 +0200 Commit: David Cassany CommitDate: Fri Aug 5 18:38:27 2016 +0200 Command validation This commit includes a validation in Command.run and Command.call in order to verify the existance of the command before running it. It case it is not found in the specified environment it raises a KiwiCommandNotFound Exception. commit d8df88f23a45198965d36a1007cbf0b71b744578 Author: David Cassany AuthorDate: Fri Aug 5 09:29:11 2016 +0200 Commit: David Cassany CommitDate: Fri Aug 5 09:29:11 2016 +0200 Detailed schema validation report This commit adds the execution of a jing process if the validation fails, that way the user has more information about what is actually failing during the validation process. If jing command is not found, it just produces an info message to warn the user and kiwi finalizes as expected. commit 51b027b768d880a7452770d3c2b88b4ab8514601 Author: Marcus Schäfer AuthorDate: Thu Aug 4 11:56:14 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Aug 4 11:56:14 2016 +0200 Workaround Fix for pypi travis deployment Use all_branches: true, as we do only tag with bumpversion for a release this workaround works for us. For reference see https://github.com/travis-ci/travis-ci/issues/1675 commit 6a034e1517036f6529bdc6f201a853fd9f11f2b2 Author: Marcus Schäfer AuthorDate: Wed Aug 3 18:40:14 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 3 18:40:14 2016 +0200 Bump version: 8.19.6 → 8.20.0 commit d11c017bb34aa83cd23e9d9172d861fa417b2f62 Author: Marcus Schäfer AuthorDate: Wed Aug 3 16:19:56 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 3 16:19:56 2016 +0200 Fixed suseSetupProduct Avoid shell complaining about binary operator commit a7c663b8e7e00160a25d9b62045ea3e428f132a4 Author: Marcus Schäfer AuthorDate: Wed Aug 3 15:57:22 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 3 15:57:22 2016 +0200 Fixed baseUpdateSysConfig Check if referenced config file exists commit b07a2d94082a717bf0a810c0d38ffe047671798b Author: Marcus Schäfer AuthorDate: Wed Aug 3 15:37:02 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 3 15:40:47 2016 +0200 Delete obsolete use of SuSEconfig SuSEconfig was a tool long time ago and does not exist anymore commit c1f541036a95107eca7c072d55979e3b623358be Author: Marcus Schäfer AuthorDate: Wed Aug 3 15:27:27 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 3 15:27:27 2016 +0200 Delete obsolete sysV init boot code Traces of chkconfig, inittab, etc/init.d are gone now commit 4023c41a02b4606209b743cead54e8e5a19cbf77 Author: Marcus Schäfer AuthorDate: Wed Aug 3 15:14:56 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 3 15:14:56 2016 +0200 Fixed suseSetupProduct Fixed shell variable evaluation syntax commit 3bb4a92ec18c918cc8052fdf5c72c5afce356640 Author: Marcus Schäfer AuthorDate: Wed Aug 3 12:59:47 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Aug 3 12:59:47 2016 +0200 Less complex user, group traversal commit 4d3d3c817feae2ba19deffe6db99b139709e521f Author: David Cassany AuthorDate: Wed Aug 3 09:41:24 2016 +0200 Commit: David Cassany CommitDate: Wed Aug 3 09:41:24 2016 +0200 Simplified example config file commit d659e8a46c945e221c4bd5f252088548693ea0ed Author: David Cassany AuthorDate: Wed Aug 3 09:25:32 2016 +0200 Commit: David Cassany CommitDate: Wed Aug 3 09:25:32 2016 +0200 Updated get_users and get_user_groups methods Get_users method has been updated in order to be able to append the groups attribute when a user is defined in multiple sections in the description file. Appart from groups, all other user attributes are ignored if the user was already processed when parsing the description file. Get_users_groups method has been also updated so it returns a list of groups with unique values, keeping the description file order. commit b1a16d035732d9c834ad7b25885236b7bc39c579 Author: David Cassany AuthorDate: Tue Aug 2 17:20:50 2016 +0200 Commit: David Cassany CommitDate: Tue Aug 2 17:20:50 2016 +0200 Updated xml_state The changes here modify the method get_users in xml_state in order to provide a simple list of users instead of nested lists. Also a new method to get the groups for a given user has been included in xml_state. This is done in order to slim down and facilitate the code in kiwi/system/setup.py. This way users and groups can be handled in more natural way. commit 0ea630b6584b8418f0b76aa9a2b79c345d9f6aa4 Author: Marcus Schäfer AuthorDate: Mon Aug 1 11:15:52 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 1 11:15:52 2016 +0200 Rebuild RNG schema and parser for 6.4 commit d56122441db049126b26519299933a2d4e4b70a5 Author: Marcus Schäfer AuthorDate: Mon Aug 1 11:03:56 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 1 11:03:56 2016 +0200 Auto validate XML descriptions for schema 6.4 commit a2597b0ef880a33885d458db1d87b8cd90c18405 Author: Marcus Schäfer AuthorDate: Mon Aug 1 11:00:30 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 1 11:00:30 2016 +0200 Added schema conversion convert63to64.xsl commit 38bf221dba86f6a72ebd148ba76ac2bb2fa1aa6e Author: Marcus Schäfer AuthorDate: Mon Aug 1 11:00:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 1 11:00:07 2016 +0200 Bump kiwi schema version 6.3 -> 6.4 commit 0d0d92df62fb43e0b230c0b27a92bd00389a771b Author: Marcus Schäfer AuthorDate: Mon Aug 1 10:39:38 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Aug 1 10:39:38 2016 +0200 Fixed 6.2 to 6.3 XSL conversion Deletion of attributes of the same section must be handled in one iteration commit c0bcce34048e597712cf20ec056f1497f4931393 Author: David Cassany AuthorDate: Wed Jul 27 12:26:50 2016 +0200 Commit: David Cassany CommitDate: Wed Jul 27 12:26:50 2016 +0200 Updated the user schema layout Now each user item may or may not have a groups attribute. The groups attribute is a comma separated list of group names. If present the first group name will be the login or primary group, if not present, the underlying toolchain will assign the default login group for that user. commit 25baf73b11ace8497cded261a9db921d4fa637d4 Author: David Cassany AuthorDate: Tue Jul 26 18:04:11 2016 +0200 Commit: David Cassany CommitDate: Tue Jul 26 18:04:11 2016 +0200 New generated schema and parser commit 2d361b9f79af22a365a23bab6734514390785a85 Author: David Cassany AuthorDate: Tue Jul 26 17:59:25 2016 +0200 Commit: David Cassany CommitDate: Tue Jul 26 17:59:25 2016 +0200 Some corrections needed after rebuilding schema and parser commit 5078655eb6e0a8343b69bb3ce5f79be1eea85673 Author: Marcus Schäfer AuthorDate: Tue Jul 26 17:01:38 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 26 17:09:13 2016 +0200 Update true/false handling of text nodes The latest version of generateDS handles
true|false
text values in a way that it returns a boolean python type instead of the text string. With this change the kiwi code has to be adapted at the level of writing the shell profile which needs the string value of boolean information commit c324779bdece57fd7b81be5ee36c3688bfced3b3 Author: Marcus Schäfer AuthorDate: Tue Jul 26 16:58:27 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 26 16:58:27 2016 +0200 Regenerate data structures Regenerate xml_parse with latest version of generateDS. The call works in the python2.7 tox virtual environment as part of the following make target: $ make kiwi/schema/kiwi.rng commit c4255e4aa7fc67c61c32e79331bbb67657d7fee3 Author: Marcus Schäfer AuthorDate: Tue Jul 26 16:56:36 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 26 16:56:36 2016 +0200 Switch to latest version of generateDS Data Structures are auto generated from the XML schema. So far the development environment has requested an older version of generateDS which will go out of service soon commit 2871ca8150a5d68aa33415b03b4ecb16e4c47e76 Author: David Cassany AuthorDate: Tue Jul 26 16:22:33 2016 +0200 Commit: David Cassany CommitDate: Tue Jul 26 16:22:33 2016 +0200 fixing user schema layout commit 4a5669ffee83ebd272a423f25018f294c44cc92e Author: Marcus Schäfer AuthorDate: Tue Jul 26 13:47:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 26 13:47:05 2016 +0200 Fixed typo in boot headers OpenSuSE vs. openSUSE commit 6924b24111ce219d6a2f0af2210589406793f618 Author: Marcus Schäfer AuthorDate: Tue Jul 26 13:41:32 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 26 13:41:32 2016 +0200 Fixed typo in translation OpenSUSE vs. openSUSE commit a7c47fa4e873fa416890c3b0158989079000a206 Author: Marcus Schäfer AuthorDate: Mon Jul 25 17:52:21 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 25 17:58:07 2016 +0200 Make sure awk is available in oemboot commit 20b02bf683fb6034e1823e5c3318824f243b4dc7 Author: Marcus Schäfer AuthorDate: Mon Jul 25 10:52:20 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 25 10:52:20 2016 +0200 Explain why bytes type is redefined In python2 bytes is string which is different from the bytes type in python3. The bytes type from the builtins generalizes this type to be bytes always. However the redefinition of the bytes type is marked as Smell in landscape. Thus the code should at least inform why this is done commit 22c2227e280dfa4160aa5f66dbafd208a20be116 Author: Marcus Schäfer AuthorDate: Mon Jul 25 10:43:23 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 25 10:43:23 2016 +0200 Use six.Iterator instead of global object builtin The use of six.Iterator as base class for the CommandIterator seems more clear and explicit compared to the global object type overwritten by the builtins import. Fixes Smell reported by landscape commit 56a8c58da94257a2731e84af0d65efab4b91a167 Author: David Cassany AuthorDate: Fri Jul 22 17:34:03 2016 +0200 Commit: David Cassany CommitDate: Fri Jul 22 17:34:03 2016 +0200 Added kiwi/archive/tar class description commit 6a93cb83c4a2eb86b9e16a7b1317a271a1950b33 Author: David Cassany AuthorDate: Fri Jul 22 17:11:52 2016 +0200 Commit: David Cassany CommitDate: Fri Jul 22 17:11:52 2016 +0200 extending kiwi/archive/tar commit 561ddb35616ed05c0ff99de344bd9381ff10e368 Author: Marcus Schäfer AuthorDate: Thu Jul 21 15:22:50 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 21 15:32:52 2016 +0200 Fixing gce format build The patch is two fold, first it fixes the name of the raw disk when it is copied as disk.raw. Second it fixes the content list of the tarball to be dynamicly build instead of a static allocation. Reason for this change is that the list of files depends on the XML description whether or not a gce disk tag is configured. Fixes #113 commit da02688ef2134e5ee4d4d275c68acfb5d3729ef3 Author: David Cassany AuthorDate: Wed Jul 20 17:51:37 2016 +0200 Commit: David Cassany CommitDate: Wed Jul 20 17:51:37 2016 +0200 Fixes #111: Included support for vdi format commit 92d7109572fa30ef56e757c82c496d4891a8b492 Author: Marcus Schäfer AuthorDate: Mon Jul 18 12:32:47 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 18 12:32:47 2016 +0200 Bump version: 8.19.5 → 8.19.6 commit 62b21ce449d76a8bae4f1393d4f401fd414e4add Author: Marcus Schäfer AuthorDate: Mon Jul 18 12:12:30 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 18 12:12:30 2016 +0200 Fixed changelog generator commit db720df2e43106c44ae0111525edaf70942e075b Author: Marcus Schäfer AuthorDate: Mon Jul 18 11:14:37 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 18 11:14:37 2016 +0200 Don't ask to start recovery in unattended mode If oem-recovery is setup in the XML description along with oem-unattended set to true as well we don't ask for confirmation to run the recovery when the recovery menu entry is selected at boot time commit 10135434b83994714ff58d6a5f313815004bd26b Author: Thomas Bechtold AuthorDate: Mon Jul 18 07:14:53 2016 +0200 Commit: Thomas Bechtold CommitDate: Mon Jul 18 07:14:53 2016 +0200 Release automatically on pypi (2nd try) Last try from 142ca22d8e was not working. Update the secure hash and also set explcitly the master branch when looking for tags. commit b1d1e2208ec0ba262dc51cc33f9836062ff07978 Author: Marcus Schäfer AuthorDate: Wed Jul 13 14:31:56 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 13 14:31:56 2016 +0200 Added integration build test link to doc index commit b82537c3bf9b90088ab3234753b25c1366e0a1b4 Author: Marcus Schäfer AuthorDate: Tue Jul 12 18:44:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 12 18:44:11 2016 +0200 Bump version: 8.19.4 → 8.19.5 commit ca3e0f4c0b15349449cb88848257e4162dd8a687 Author: Marcus Schäfer AuthorDate: Tue Jul 12 18:39:17 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 12 18:39:17 2016 +0200 Don't require an iso creation toolkit commit 8c4eecd1616cb41abebf60b9136c99aa3494372a Author: Marcus Schäfer AuthorDate: Tue Jul 12 09:11:57 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 12 09:11:57 2016 +0200 Bump version: 8.19.3 → 8.19.4 commit 5dc300a56f4b9770c3df1e26d9df21dd8e027cfe Author: Marcus Schäfer AuthorDate: Mon Jul 11 13:48:06 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 11 13:48:06 2016 +0200 prefer newer overlayfs mount method mount succeeds in compat mode but this mode should only be used on older overlayfs implementations commit 49423aa4b2abe7952acffeb2be6e36fa796511d9 Author: Marcus Schäfer AuthorDate: Fri Jul 8 14:17:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 8 14:17:05 2016 +0200 Bump version: 8.19.2 → 8.19.3 commit 49c3c978786081c242acb15b851fccf7171a66b6 Author: Marcus Schäfer AuthorDate: Fri Jul 8 10:13:35 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 8 10:13:35 2016 +0200 Message commit for bug reference Fixup of VMware disk tag references (bnc#988086) commit 1123015062ae215a45f2bee095a60a05b06c9429 Author: Marcus Schäfer AuthorDate: Fri Jul 8 09:40:23 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 8 09:40:23 2016 +0200 Prevent duplication of context manager in test commit 6533f25b0a12846f9577aca62ddfe14cd63f831c Author: James Mason AuthorDate: Thu Jul 7 10:12:21 2016 -0700 Commit: James Mason CommitDate: Thu Jul 7 10:12:21 2016 -0700 Conditionally prefix encoding to vmware disk tag Prior code was always adding the encoding statement to vmware disk tag; in the event it is already present there's no need to add it a second time. See also https://github.com/openSUSE/kiwi/pull/586/commits/af1fed77af862dc44bd4322680425299ef5ad654 commit 5bb4f8291e3c0364b65c1c9d9a40e77f88f1ac6e Author: James Mason AuthorDate: Thu Jul 7 09:59:51 2016 -0700 Commit: James Mason CommitDate: Thu Jul 7 10:09:04 2016 -0700 Remove null padding on the vmware disk tag The block of data read via dd is null padded; adding the tools data after the padding breaks detection of the data. We need to remove the nulls (0x0) so appends can occur adjacent to the block of strings. See also https://github.com/openSUSE/kiwi/pull/586/commits/ee8931c76c17c79d30a128c05cc6f839a1de7156 commit d25db2199fbef320a7cf78d956caf9389b45bf80 Author: Marcus Schäfer AuthorDate: Thu Jul 7 15:31:08 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 7 15:31:08 2016 +0200 Bump version: 8.19.1 → 8.19.2 commit eddf0ca30eb14364f563db1565d051cc98b152ef Author: Marcus Schäfer AuthorDate: Thu Jul 7 11:37:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 7 11:37:05 2016 +0200 Complete doc string for Path.which method commit 92899c20641de66cd78d61aaa4ea29ae2b36c3a4 Author: Marcus Schäfer AuthorDate: Thu Jul 7 11:32:47 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 7 11:32:47 2016 +0200 Implement Path.which Python provides methods to do this but we can't rely on them to be available in all python versions commit 5e250551e4e4519caf7f67de59595e02e7a17ab0 Author: Marcus Schäfer AuthorDate: Thu Jul 7 09:57:36 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 7 09:57:36 2016 +0200 Update documentation Cleanup structure of contribution guide commit 6e8d3fe6077b8eeb14655d753066e40c16f40bef Author: Marcus Schäfer AuthorDate: Thu Jul 7 09:17:23 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jul 7 09:17:23 2016 +0200 Update documentation Complete documentation about required C libraries which needs to be installed prior to setting up the python virtual development environment commit 405a345b3eacdf08086fc241f3019b2ddf28b88a Author: Marcus Schäfer AuthorDate: Wed Jul 6 16:51:33 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 6 16:51:33 2016 +0200 Fixup dependency on genisoimage Only for SLE12 the package requires genisoimage for any other distribution mkisofs is required. The community variant with genisoimage seems to be quite outdated. However, on SLE12 only genisoimage exists. Fixes #106 commit 2e227ab8885422c0c2ef35d18c4ac2e3e7c7e616 Author: Marcus Schäfer AuthorDate: Wed Jul 6 16:37:58 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 6 16:39:47 2016 +0200 Lookup tool name by path lookup commit 2b91414ba4da90061dca03325f29352242cb1aad Author: Marcus Schäfer AuthorDate: Wed Jul 6 16:13:21 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 6 16:13:21 2016 +0200 Update import statement parenthesis only needed for multi-line multi-import commit cbf79e0f6975fd70dd8ab260e277287c1061f32c Author: Marcus Schäfer AuthorDate: Wed Jul 6 15:58:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 6 15:58:42 2016 +0200 Refactor block depth on get_volumes return early if the condition makes it clear that there is nothing more to do in this method commit 6bb6295a559d2736579608b644708184154a243f Author: Marcus Schäfer AuthorDate: Wed Jul 6 11:11:13 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jul 6 11:11:13 2016 +0200 Lookup iso creation tool Instead of strictly using genisoimage allow for using either the community variant or mkisofs as provided by J.Schilling commit 26fb8cc82834a29c67636a4a09e088cd923c954a Author: Marcus Schäfer AuthorDate: Tue Jul 5 15:03:47 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 5 17:00:01 2016 +0200 Refactor reading of volume variables in boot code Use new style profile variables without name limitations Related to #39 commit 1eb337049bba0aa43d8229f4b4f66c6d89ed1d9a Author: Marcus Schäfer AuthorDate: Tue Jul 5 13:02:36 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 5 15:54:25 2016 +0200 Refactor profile for volume setup Don't use volume names in bash variables. In addition that removes the name limitations we had for volume names Related to #39 commit 035a0c27715f38f004ce9b39e26d7b46d20ee6cb Author: Marcus Schäfer AuthorDate: Tue Jul 5 12:06:19 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 5 15:53:48 2016 +0200 Delete obsolete volume condition checks No need to check for LVSwap or LVComp in volume setup. If at all those volumes are created at boot time. Related to #39 commit 47753768bbdabaa29aa705d7f048b94be5ed2813 Author: Marcus Schäfer AuthorDate: Tue Jul 5 11:11:31 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jul 5 15:53:46 2016 +0200 Refactor use of kiwi_allFreeVolume_ Do not expect the value to come from an exported variable Instead a method to provide the information is implemented Related to #39 commit 8d2372ad3f666c99d0b3c3b3055d057d8c74dfd0 Author: Marcus Schäfer AuthorDate: Mon Jul 4 10:11:52 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jul 4 10:11:52 2016 +0200 Bump version: 8.19.0 → 8.19.1 commit cd7bb5fd19b37f720a0fbc2fc2692aef21e26493 Author: Marcus Schäfer AuthorDate: Fri Jul 1 11:26:15 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Jul 1 11:26:15 2016 +0200 Fixup cleanup of intermediate config files kiwi uses e.g etc/hosts from the host system for proper name resolution during the build. The temporary variant of that file will be deleted by kiwi at the end of the installation process. However depending on the package manager and the distribution it could happen that the intermediate config file added by kiwi is treated as existing config variant. In case of rpm a .rpmnew file variant of the config file is created and that needs to be handled by kiwi. Therefore this patch adds a private restore method for the .rpmnew case. It might be needed to add other restore methods to deal with this issue depending on how other (non rpm) based package managers handles the situation. Fixes #104 commit 2016d67754d736d6cc3c7188be8018cff6aac72c Author: Marcus Schäfer AuthorDate: Thu Jun 30 10:52:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 30 10:52:07 2016 +0200 Bump version: 8.18.9 → 8.19.0 commit cbf76e0928d89ac5e83785569cbb61e6b6dca8cd Author: Marcus Schäfer AuthorDate: Thu Jun 30 09:19:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 30 09:19:44 2016 +0200 Make sure mtab link exists in kiwi initrd On Debian systems the filesystem tools requires the presence of the mtab file, thus we make sure this file exists and links to proc/self/mounts commit 2224cc8aa899c6875897e94511d47ccc2ad1df1e Author: Marcus Schäfer AuthorDate: Wed Jun 29 21:17:14 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 29 21:17:14 2016 +0200 Refactor use of dialog program in boot code Cleanup the mess, provide only one method to run a dialog Prevent use of subshells for running the dialog program commit 7e3ad644661da6940f4504ee78315090bfc96fe5 Author: Marcus Schäfer AuthorDate: Wed Jun 29 14:50:18 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 29 14:50:18 2016 +0200 Fixed use of shutil.copytree The target dir must not exist. However in order to force copy a potentially existing target is deleted before commit 6f0ec09c0a60583d8a4066619ac6acba1bd72b55 Author: Marcus Schäfer AuthorDate: Wed Jun 29 14:47:04 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 29 14:47:04 2016 +0200 udev console init requires kbd_mode on Ubuntu keep kbd_mode in initrd commit 11c5cd20ed84264ba36b70b2e75295c3c2ec9230 Author: Marcus Schäfer AuthorDate: Wed Jun 29 14:45:54 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 29 14:45:54 2016 +0200 Added oemboot description for ubuntu-xenial Also add kiwi linuxrc/preinit links for vmxboot commit 4183d230900dfd7254ec8e7d0c369f92baea393c Author: Marcus Schäfer AuthorDate: Wed Jun 29 14:45:02 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 29 14:45:02 2016 +0200 Allow alternative location for udev console init yet another name and location for the console init utility commit 013915eb3bc573f63af543a77233171c3f41029a Author: Christian Bruckmayer AuthorDate: Wed Jun 29 11:16:09 2016 +0200 Commit: Christian Bruckmayer CommitDate: Wed Jun 29 11:52:08 2016 +0200 Remove lxc configuration from docker images Docker does not use LXC execdriver anymore. Fixes #40 commit be30801616fdebc1b7b4e150c41640ca077788ce Author: Marcus Schäfer AuthorDate: Mon Jun 27 20:15:55 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 27 20:15:55 2016 +0200 Bump version: 8.18.8 → 8.18.9 commit 0ee4eb21683f7b48ef83596ca64ba13269250d25 Author: Marcus Schäfer AuthorDate: Mon Jun 27 20:14:25 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 27 20:14:25 2016 +0200 Fix linkcheck in container_builder.rst commit abaccb674a9451fb4ee3839ce57d914585d4f4a1 Author: Marcus Schäfer AuthorDate: Mon Jun 27 20:07:37 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 27 20:07:37 2016 +0200 Fix linkcheck in container_builder.rst commit ad7026ab15b6abe048be97ff0fee40e965570f1e Author: Marcus Schäfer AuthorDate: Mon Jun 27 20:03:20 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 27 20:03:20 2016 +0200 Bump version: 8.18.7 → 8.18.8 commit 1ea8b0ed6a0d85bc4c4363a4db5aff9ec1bc9908 Author: Marcus Schäfer AuthorDate: Mon Jun 27 17:28:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 27 17:28:44 2016 +0200 Update Documentation Update state of supported distributions commit fb8bf238c2c1f34ad911b5f4397ff64e0fe3f69d Author: Marcus Schäfer AuthorDate: Mon Jun 27 16:10:21 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 27 16:10:21 2016 +0200 Apply editorial review changes commit a3112ff6e0f5ae03e6540f121dcd98479607a963 Author: Marcus Schäfer AuthorDate: Mon Jun 27 12:20:24 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 27 12:20:24 2016 +0200 Apply editorial review changes commit ae69f148c1a18a661bcb4973d660ae1e814d283b Author: Marcus Schäfer AuthorDate: Mon Jun 27 12:19:18 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 27 12:19:18 2016 +0200 Apply editorial review changes commit 800eb134b2f15c4340da2b28860dbbc6b7c5d67a Author: Marcus Schäfer AuthorDate: Mon Jun 27 11:34:27 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 27 11:34:27 2016 +0200 Delete traces of obsolete code commit bf6841c41d3da18dde846e9ce65d6c398984e71e Author: Marcus Schäfer AuthorDate: Mon Jun 27 11:31:16 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 27 11:31:16 2016 +0200 Prevent unconditional deletion of toplevel data The kiwi initrd descriptions calls suseStripInitrd() as part of the images.sh script. This function unconditionally removes toplevel directories like /home. Instead of deleting the data it is better to exclude them when the cpio archive is created commit 33fd415d04cec7ce674bf92c05a90f9071daf2a0 Author: Marcus Schäfer AuthorDate: Fri Jun 24 15:17:22 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 24 15:17:22 2016 +0200 Bump version: 8.18.6 → 8.18.7 commit 3e7676c85df046dbd04f1469929c5c49767baf29 Author: Marcus Schäfer AuthorDate: Fri Jun 24 14:30:26 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 24 14:30:26 2016 +0200 Added serial console support for isolinux loader Generate a serial line setup for the isolinux.cfg file according to the bootloader_console attribute from the XML description. In addition delete the use of the obsolete vga kernel parameter and work with the MENU RESOLUTION ui configuration parameter instead commit 5cae5eb86b5157f32e30e90fa64ca4eedd1cc895 Author: Marcus Schäfer AuthorDate: Fri Jun 24 11:32:52 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 24 11:32:52 2016 +0200 Bump version: 8.18.5 → 8.18.6 commit 1a78ff2b6b851ba1f1f75df612b14eae7ed6ec5e Author: Marcus Schäfer AuthorDate: Fri Jun 24 11:16:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 24 11:16:39 2016 +0200 Fixed setup of default install menu entry The attribute installboot allows to specify the default boot menu entry in an install image. It can be set to harddisk, install or failsafe install. The setup of that information in the bootloader configuration was not properly processed commit db238fe89976da58dcd25e4cd8aaa81d1558bfc8 Author: Marcus Schäfer AuthorDate: Thu Jun 23 17:11:46 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 23 17:11:46 2016 +0200 Fix landscape Smells commit f2bd051d316c46a31dc11352402932ce73e69b15 Author: Marcus Schäfer AuthorDate: Thu Jun 23 15:14:58 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 23 15:14:58 2016 +0200 Update location of build container commit 00f9f19f08a7c84c3a411d590d45f5f082f3f30b Author: Marcus Schäfer AuthorDate: Thu Jun 23 15:10:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 23 15:10:05 2016 +0200 Update dice source link commit 27f37573f5ecc530deec0235a664037e376b4f6b Author: Marcus Schäfer AuthorDate: Thu Jun 23 11:53:35 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 23 11:53:35 2016 +0200 Update Dice project location commit 899a594e8489a661c6faff5ae52110535b565d69 Author: Marcus Schäfer AuthorDate: Thu Jun 23 10:51:31 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 23 10:51:31 2016 +0200 Apply editorial review changes commit 3335e78bbc9e55162f215deb56ff51b4ad34afcf Author: Marcus Schäfer AuthorDate: Wed Jun 22 17:35:13 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 22 17:35:13 2016 +0200 Bump version: 8.18.4 → 8.18.5 commit 46c15618bccd05043d8a6e8ca7d3a632d03f10f7 Author: Marcus Schäfer AuthorDate: Wed Jun 22 17:00:53 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 22 17:00:53 2016 +0200 Fixed building of install image If dracut is requested as initrd_system in combination with building an installiso we have to overrule the initrd_system setup for building the install image. The code to install an image is kiwi's oem install code and unknown to dracut. The process will end up using dracut as initrd in the system image but kiwi's initrd on the install image commit 1879eaa595d2b3148d5848703bcca1740e51130d Author: Marcus Schäfer AuthorDate: Wed Jun 22 16:12:29 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 22 16:12:29 2016 +0200 Delete kiwi-tools from rhel boot descriptions kiwi-tools is no longer a requirement but an optional package It contains tools like utimer or dcounter which provides nice boot timer or progress dialogs for showing data transfer progress. In the Virtualization:Appliances:CommonBoot repo we provide mandatory and optional packages used by kiwi if they don't exist for the target distribution commit c0888eacbf6d09b92a7ee6da568975dc073656f6 Author: Marcus Schäfer AuthorDate: Wed Jun 22 15:59:03 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 22 15:59:03 2016 +0200 Better warning message for root cmdline setup Under certain circumstance the root=UUID= parameter must be setup in the cmdline of the image. If the required uuid value is not provided a warning message is shown to the user. This commit makes the warning message more meaningful commit 7f826d9527e002ed03000db3498239ba95f81b78 Author: Marcus Schäfer AuthorDate: Wed Jun 22 15:56:59 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 22 15:56:59 2016 +0200 Extend unit tests for boot image setup Expect kiwi_initrdname to be set in the profile of the boot image root system commit 4e4c981b466b2abc1692a32a32b990eaabc8660d Author: Marcus Schäfer AuthorDate: Wed Jun 22 15:54:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 22 15:54:44 2016 +0200 Call plymouth only when installed commit 166f735882225eec9a6238340314292dd39f3e73 Author: Marcus Schäfer AuthorDate: Wed Jun 22 15:53:54 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 22 15:53:54 2016 +0200 Add delete method for profile variables commit 5db527d40c5c4265434abd8f8e73b28c61e1c37e Author: Marcus Schäfer AuthorDate: Tue Jun 21 16:30:22 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 21 16:30:22 2016 +0200 Added article about self contained building The article describes how to make use of the dice project to control and maintain image build processes in a contained environment commit b031748cdda3e0a2cb4ee13432f8761f3dfbf3f6 Author: Marcus Schäfer AuthorDate: Tue Jun 21 14:26:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 21 14:26:42 2016 +0200 Fix grub bootloader template Keep gfxpayload commit a6d171e34666b95d3008e69d4020f63def041296 Author: Marcus Schäfer AuthorDate: Tue Jun 21 11:58:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 21 12:32:21 2016 +0200 Update bootloader console setup in boot code Use the variable kiwi_bootloader_console which represents the setup of the bootloader console from the XML description and setup the GRUB_TERMINAL configuration option to allow grub2-mkconfig to pick up the value. If no console setup exists in the XML description, gfxterm is used by default commit 4887539f107fac29f6078b30cb2a9c71475b078d Author: Marcus Schäfer AuthorDate: Tue Jun 21 11:54:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 21 11:54:11 2016 +0200 Make bootloader_console availabe in profile The variable kiwi_bootloader_console is exposed into the profile environment commit 87dec3e7691e5d68686a11a106d6a6495059c6df Author: Marcus Schäfer AuthorDate: Tue Jun 21 11:22:20 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 21 11:22:20 2016 +0200 Delete obsolete code All traces of lilo and elilo are gone now commit ce102396a23c4932c8ea701b039686aa2fa8489b Author: Marcus Schäfer AuthorDate: Tue Jun 21 11:16:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 21 11:18:12 2016 +0200 Fixed grub2 bootloader config template Load fonts only when they exist, do not duplicate font setup in template commit b84ae83d75f3887e52b6a30fc24dfb6603fdc9ae Author: Marcus Schäfer AuthorDate: Tue Jun 21 10:39:19 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 21 10:39:19 2016 +0200 Fixed bootloader theme check The check for the theme was not always called, but this is required since the theme check will reset the bootloader console if no graphics theme could be found commit 8a8e6153baec0d0d76b6b0226aaf4cd26613b713 Author: Marcus Schäfer AuthorDate: Mon Jun 20 22:41:06 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 20 22:41:06 2016 +0200 Bump version: 8.18.3 → 8.18.4 commit 746268cfb7cd9e8e19c3afcda12a49fddcfd735a Author: Marcus Schäfer AuthorDate: Mon Jun 20 22:21:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 20 22:21:10 2016 +0200 Apply back openSUSE 13.2 support Until Leap42.2 is not yet released we should keep the support for 13.2 commit a4a9ffa9aa691990740dc058fe8cdc3cfdfc1e86 Author: Marcus Schäfer AuthorDate: Mon Jun 20 18:13:33 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 20 18:24:43 2016 +0200 Added support for setting the bootloader console Some bootloader e.g grub supports graphics, text and also serial consoles to hand over the output of the bootloader menu. With this patch we allow to customize the console used by the bootloader. So far only grub makes use of the new attribute This references Trello: https://trello.com/c/q9EhNKKV/155-support-for-grub2-serial-console commit 32dd0fe8a12fe258987e3ae10bfa81d804f414b1 Author: Marcus Schäfer AuthorDate: Mon Jun 20 09:34:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 20 09:34:11 2016 +0200 Bump version: 8.18.2 → 8.18.3 commit c004bc9ab5968c5d50060a90f0fbda04a48855e6 Author: Marcus Schäfer AuthorDate: Mon Jun 20 08:52:59 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 20 08:52:59 2016 +0200 Fixed typo in message text commit 25954047b295c610206713684cba19f0bd298c12 Author: Marcus Schäfer AuthorDate: Mon Jun 20 08:47:41 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 20 08:47:41 2016 +0200 Fixed vmxboot/ubuntu-xenial boot description dracut should be installed to support initrd_system="dracut" commit 55464d2724d56a7774928565895e0c14380b50b6 Author: Marcus Schäfer AuthorDate: Mon Jun 20 00:35:09 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 20 00:35:09 2016 +0200 Update iso|vmxboot debian boot descriptions commit 364ca918199d376eb3c1aee35d92d4339d0dff86 Author: Marcus Schäfer AuthorDate: Mon Jun 20 00:09:38 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Jun 20 00:09:38 2016 +0200 Fixup ldd check for unused libraries commit d0baaa1a9405e62dc54ee7e3f4eb72f2588d73bb Author: Marcus Schäfer AuthorDate: Sun Jun 19 22:46:49 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun Jun 19 23:27:53 2016 +0200 Update vmxboot/ubuntu-xenial boot description Complete description to be usable with kiwi initrd boot code too commit 2ec8ab133dcbcf93073d97c84bd8e41e3720708f Author: Marcus Schäfer AuthorDate: Sun Jun 19 22:42:58 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun Jun 19 23:27:53 2016 +0200 Added baseCreateCommonKernelFile The stripKernel functions return early if the dracut initrd system is requested. However it is required in any case to lookup the kernel and provide a common name kiwi expects to be present commit 75f183afe66b3d77264421cdfdcc2f16b4e22570 Author: Marcus Schäfer AuthorDate: Sun Jun 19 22:41:59 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun Jun 19 23:27:53 2016 +0200 Set logger mode to append commit d66389878852eb32c78d37411f891804dbc9487a Author: Marcus Schäfer AuthorDate: Fri Jun 17 16:23:06 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun Jun 19 23:27:53 2016 +0200 Fixup copy_boot_delete_packages if no section exists in the target the code does not add the packages to become deleted. This patch changes the behavior in a way that a new section is created commit 49a16686dfcb7646476799f3703a755d947245b1 Author: Marcus Schäfer AuthorDate: Thu Jun 16 17:35:03 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun Jun 19 23:27:53 2016 +0200 Add isoboot support for Ubuntu system Next step to allow creation of Debian based live systems Related to Issue #37 commit 9ffe81ff4656816fbd0e6026e1acaa04034d4357 Author: Marcus Schäfer AuthorDate: Sat Jun 18 21:44:16 2016 +0200 Commit: Marcus Schäfer CommitDate: Sat Jun 18 21:44:16 2016 +0200 Bump version: 8.18.1 → 8.18.2 commit e10075fc4b409912ce7d3ddb4104b42c3c794325 Author: Marcus Schäfer AuthorDate: Sat Jun 18 21:43:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Sat Jun 18 21:43:42 2016 +0200 Add distro flag match for Leap42.2 commit f6a2515c81155fe42f8179d9ce071ca1798ab571 Author: Marcus Schäfer AuthorDate: Sat Jun 18 20:58:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Sat Jun 18 20:58:39 2016 +0200 Bump version: 8.18.0 → 8.18.1 commit c21a3a6b84df7f1d929fa4260f36e26a7362a327 Author: Marcus Schäfer AuthorDate: Sat Jun 18 20:55:37 2016 +0200 Commit: Marcus Schäfer CommitDate: Sat Jun 18 20:56:46 2016 +0200 Preserve zypper package cache zypper deletes the package cache if a repo is removed. For the purpose of image building this should not happen commit ba6fbd4c179053ea3462b04f25fc38b1386a5f4b Author: Marcus Schäfer AuthorDate: Sat Jun 18 16:28:46 2016 +0200 Commit: Marcus Schäfer CommitDate: Sat Jun 18 20:56:46 2016 +0200 Pass initrd_system to profile The common functions baseStripInitrd and baseStripKernel need to be skipped if the initrd system is set to dracut. They read that information from the exported kiwi_initrd_system profile environment variable commit 38114f6076f81c903946db39973f80aa49f75a9a Author: Marcus Schäfer AuthorDate: Sat Jun 18 10:06:43 2016 +0200 Commit: Marcus Schäfer CommitDate: Sat Jun 18 10:06:43 2016 +0200 Don't delete dracut from boot image environment If the dracut initrd system is requested we need dracut to stay in the environment from which it is called commit edbaef679755838e7067f5e9be12d4b34742648f Author: Marcus Schäfer AuthorDate: Thu Jun 16 13:57:33 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 16 13:57:33 2016 +0200 Added suse-leap42.2 descriptions Obsolete suse-13.2 commit e4003fe21288cf141b0daf9d79852d8b9ecd8823 Author: Marcus Schäfer AuthorDate: Thu Jun 16 13:47:13 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 16 13:47:13 2016 +0200 Update hyper links in project README commit 29719ed84bd63c9286ae007a0e48a23713b900f4 Author: Marcus Schäfer AuthorDate: Thu Jun 16 12:03:46 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 16 12:03:46 2016 +0200 Rename kiwi boot code files Maintain them as common code base for all distributions During the years of development it has turned out that differences in the boot process between the distros can be handled in one code base. There is no need to maintain a basically identical copy for the different distributions commit be36f103b4c6e172c25418c05b28fe9ddb26fa8b Author: Marcus Schäfer AuthorDate: Thu Jun 16 10:33:54 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 16 10:33:54 2016 +0200 Style fixes: E275 missing whitespace after keyword commit be5d858c488d09c3340b0369e923911cb90ac274 Author: Marcus Schäfer AuthorDate: Thu Jun 16 10:30:14 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 16 10:30:14 2016 +0200 Delete obsolete C tools commit f44e7400e00e1e85143570b7bcffd83f6314c25b Author: Marcus Schäfer AuthorDate: Thu Jun 16 10:25:30 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 16 10:25:30 2016 +0200 Prevent use of setctsid setctsid is a suse extension to start a program on a new controlling terminal. While it is very useful it does not exist on other distributions which causes a problem in kiwi's common initrd code. This patch replaces the use of setctsid with setsid and sulogin commit 9fb6dcb749ac9c325bd2111b4b1322e6665648a2 Author: Marcus Schäfer AuthorDate: Thu Jun 16 10:12:41 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 16 10:12:41 2016 +0200 Open log file in mode 'w' and in utf-8 locale commit f126b147a66c629ffec54f23426c0c3f704501c2 Author: Marcus Schäfer AuthorDate: Thu Jun 16 09:11:09 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 16 09:11:09 2016 +0200 Delete obsolete mkinitrd code This version of kiwi supports only distros using dracut commit 2cca35702d25f97e5ee6316e3ddb6e78e567afa2 Author: Marcus Schäfer AuthorDate: Thu Jun 16 09:06:38 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 16 09:06:38 2016 +0200 Delete obsolete sysV init console setup code commit a92625bf83049cb3047f1cc4e836ff434eafed57 Author: Marcus Schäfer AuthorDate: Thu Jun 16 09:01:57 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 16 09:01:57 2016 +0200 Make use of utimer in kiwi initrd optional commit fc58be7234997a7056da6581df29352f5df82ddb Author: Marcus Schäfer AuthorDate: Wed Jun 15 16:44:28 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 15 16:44:28 2016 +0200 Bump version: 8.17.0 → 8.18.0 commit 319fb9e6e4dd61f6a5d30824898863c1a0958c6a Author: Marcus Schäfer AuthorDate: Wed Jun 15 16:27:45 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 15 16:27:45 2016 +0200 Adapt to common python style Private methods should start with _f() not __f() commit a219c52746c2e878506031dfdd0ed09dac748251 Author: Marcus Schäfer AuthorDate: Wed Jun 15 16:20:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 15 16:20:10 2016 +0200 Prevent temporary files to be synced to image The package manager instances created temporary package manager configuration files. The instance destructor and thus the cleanup of the instance should be called prior to the sync of the root filesystem data in order to prevent temporary configuration files to be present in the image commit 8d0df28296466ef300dee0dc27de2b018cbd06f7 Author: Marcus Schäfer AuthorDate: Wed Jun 15 13:01:27 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 15 13:01:27 2016 +0200 Grammar fixes for doc strings commit b3dc48d24128a21b60ec21533a96b3980739ce5d Author: Marcus Schäfer AuthorDate: Wed Jun 15 12:57:00 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 15 12:57:00 2016 +0200 Syntax change for Importing one module commit 8b340bfb5758fb6a44878c65763f60217a665c4d Author: Thomas Schraitle AuthorDate: Mon Jun 13 17:07:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 15 12:33:59 2016 +0200 Refactor RootInit class Instead of calling multiple subprocesses make use of the os capabilities for directories, symlinks and device nodes commit ba6847d013c4a1996ab907b2b3bfbe19f46f2647 Author: Marcus Schäfer AuthorDate: Wed Jun 15 11:01:16 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 15 11:01:16 2016 +0200 Update test_load_schema_from_xml_content test Read schemaversion from RelaxNG instead of using a fixed value commit d1da7435ef837d0f60a4cdd50dcaaa8c73ec931d Author: Marcus Schäfer AuthorDate: Wed Jun 15 10:18:27 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 15 10:19:04 2016 +0200 debootstrap errors deserve their own exception commit 9aea83a7c1878e6a7c369c8653317d18fdb95a2e Author: Marcus Schäfer AuthorDate: Tue Jun 14 17:22:37 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 15 10:19:04 2016 +0200 Add documentation for Exceptions commit 7d37f3f849380beac0288a097c86583a746f161b Author: Marcus Schäfer AuthorDate: Tue Jun 14 17:27:24 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 14 17:27:24 2016 +0200 Avoid glob imports This could start a series of further changes in the unit test as we have allowed for glob imports there. So treat this one as a start commit c843806b3178ab1143b7f7dd840be0d55ce01f49 Author: Thomas Schraitle AuthorDate: Tue Jun 14 16:09:12 2016 +0200 Commit: Thomas Schraitle CommitDate: Tue Jun 14 16:09:12 2016 +0200 Support Tox with interactively positional arguments Use posargs for py.test, see http://tox.readthedocs.io/en/latest/example/general.html commit e3baaec0a11dee1148168cbd38f88b76e3773a31 Author: Marcus Schäfer AuthorDate: Tue Jun 14 15:51:17 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 14 15:51:17 2016 +0200 Format message with named format parameters commit b20e1e657f1d1845792bf1a4427d6beacea7c75d Author: Marcus Schäfer AuthorDate: Tue Jun 14 15:46:40 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 14 15:46:40 2016 +0200 Avoid re-assigning variable commit a79d52b3688be20e07d0db0d219a6bbe7f5a072f Author: Marcus Schäfer AuthorDate: Tue Jun 14 12:12:47 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 14 12:12:47 2016 +0200 Fixed unit test for profile variables commit 4ca75860e73674529095ed3fa9aed0a08f7c5059 Author: Marcus Schäfer AuthorDate: Tue Jun 14 11:53:43 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Jun 14 11:53:43 2016 +0200 Handle XML per content or file more explicit commit db6c64cfe7e1e75c74eae85ec186271bbb6aa859 Author: Thomas Schraitle AuthorDate: Tue Jun 14 09:34:24 2016 +0200 Commit: Thomas Schraitle CommitDate: Tue Jun 14 09:34:24 2016 +0200 Differentiate between Python 2.7 and 3 in doc commit 4b0e77d1a2db362c996eb5e69e8fef66991481f6 Author: Thomas Schraitle AuthorDate: Tue Jun 14 09:27:41 2016 +0200 Commit: Thomas Schraitle CommitDate: Tue Jun 14 09:27:41 2016 +0200 State Python 2.7 in Trove category of setup.py commit c2ae0cdcc183aedd3d7de634f8f16158e59de610 Author: Marcus Schäfer AuthorDate: Fri Jun 10 11:03:02 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 10 11:03:02 2016 +0200 Fixed use of shutil.copytree commit e5d04c48b650285a1f9918a3b40f3badb21b5804 Author: Marcus Schäfer AuthorDate: Fri Jun 10 11:00:50 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Jun 10 11:00:50 2016 +0200 Update ubuntu xenial vmxboot description Make sure all drivers exists when dracut is called to allow inclusion of potentially all needed driver modules commit 5c37c86e9c2c1eae4d2d2fd2b53510e390c0cbde Author: Bo Maryniuk AuthorDate: Thu Jun 9 20:08:42 2016 +0200 Commit: Bo Maryniuk CommitDate: Thu Jun 9 20:08:42 2016 +0200 Fix Lithuanian translation commit 2e78c969785f4f8b01ac6814e4961f25ed46b778 Author: Bo Maryniuk AuthorDate: Thu Jun 9 20:01:21 2016 +0200 Commit: Bo Maryniuk CommitDate: Thu Jun 9 20:01:21 2016 +0200 Fix Ukrainian translation commit 5e8c10471ae5b90958590f919eb9e562e4642b99 Author: Marcus Schäfer AuthorDate: Thu Jun 9 17:50:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 9 17:50:07 2016 +0200 Update grub2 config tempplate Load font collection commit 4c32f85c64c4859869273f27a9d643a6a667d5b9 Author: Marcus Schäfer AuthorDate: Thu Jun 9 17:20:55 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 9 17:20:55 2016 +0200 Refactor use of os.walk result commit 079a50df5b15d68d9b65d2bf2f9037425d1e4364 Author: Marcus Schäfer AuthorDate: Thu Jun 9 16:56:31 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 9 16:56:31 2016 +0200 Integrate python improvement suggestions commit 88d34d6284089b09b3b2b68de7534963c425316d Author: Marcus Schäfer AuthorDate: Thu Jun 9 16:34:22 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 9 16:34:22 2016 +0200 Integrate python improvement suggestions commit 8e6023fd017baa27cb454cb111928ffc423c11dd Author: Marcus Schäfer AuthorDate: Thu Jun 9 14:45:12 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 9 14:45:12 2016 +0200 don't intermingle suse namespace with debian commit e2d00e2a257381531a6f9e48308b30fb9640a6fb Author: Marcus Schäfer AuthorDate: Thu Jun 9 14:38:09 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 9 14:38:09 2016 +0200 Deleted libxslt-tools from spec template commit c221392de95316d59933f4a983805f94e27ec2fa Author: Marcus Schäfer AuthorDate: Thu Jun 9 14:33:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 9 14:33:07 2016 +0200 Fixup indentation of travis setup commit ff5407f2e72c1aecaa9e5a585d34ee96ed90039d Author: Marcus Schäfer AuthorDate: Thu Jun 9 13:19:40 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 9 13:20:25 2016 +0200 Fixed license setup in spec file commit d6ded84577487f5dcc42ea164cd1a52d9096ff90 Author: Bo Maryniuk AuthorDate: Thu Jun 9 12:30:31 2016 +0200 Commit: Bo Maryniuk CommitDate: Thu Jun 9 12:30:31 2016 +0200 Remove unused import (F401) and an extra line (W391) commit 95751722c8e80fbbfc0910a1f425e00519e5dcee Author: Bo Maryniuk AuthorDate: Thu Jun 9 12:09:47 2016 +0200 Commit: Bo Maryniuk CommitDate: Thu Jun 9 12:09:47 2016 +0200 Fix tests for Python3 commit 20c9376f6949034c49f444980f46d72bf90653e2 Author: Bo Maryniuk AuthorDate: Thu Jun 9 11:52:33 2016 +0200 Commit: Bo Maryniuk CommitDate: Thu Jun 9 11:52:33 2016 +0200 Fix tests for the XPath processing commit 584ce24110d904a18d2d25e164a0229eca1f601e Author: Bo Maryniuk AuthorDate: Thu Jun 9 11:34:10 2016 +0200 Commit: Bo Maryniuk CommitDate: Thu Jun 9 11:38:33 2016 +0200 Allow XMLDescription to be loaded also from the XML string commit 298cc204f46233f93a9453846bbac64cd0c47d2c Author: Bo Maryniuk AuthorDate: Thu Jun 9 11:33:35 2016 +0200 Commit: Bo Maryniuk CommitDate: Thu Jun 9 11:38:33 2016 +0200 Reimplement XSLT processing using LXML instead of calling 3rd party tools commit 142ca22d8e22b71df3d9d6053a9fb643c855d89b Author: Thomas Bechtold AuthorDate: Thu Jun 9 11:33:49 2016 +0200 Commit: Thomas Bechtold CommitDate: Thu Jun 9 11:33:49 2016 +0200 Release automatically on pypi for new tags When a new tag gets created, automatically release it on pypi so we don't have todo it manually. commit db0ec819229e70223fa33c81ebc7480663926c32 Author: Marcus Schäfer AuthorDate: Thu Jun 9 11:29:38 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 9 11:29:38 2016 +0200 Added tox 2.7 target for travis commit efa5a1b343b266cbb8e2b481b1fde9989e73d188 Author: Marcus Schäfer AuthorDate: Thu Jun 9 11:27:31 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Jun 9 11:27:31 2016 +0200 Fixed creation of password hashes kiwi uses the openssl command for this purpose but did not strip the newline at the end of the hash output commit 08f9ff1972914d84cecd0ac37a500a5dcf8bc61e Author: Marcus Schäfer AuthorDate: Wed Jun 8 20:47:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:47:44 2016 +0200 Apply python 2.x compatibility decorators commit e699dc10ee257ebc898d11030ac2d598b7475100 Author: Marcus Schäfer AuthorDate: Wed Jun 8 20:08:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:41:10 2016 +0200 Fixup grub2 theme setup We can't expect that specific fonts to exist for all theme packages in all distributions. The code here should rely only on theme.txt In addition we check if any theme or font related data is found in the legacy grub location boot/grub which imho should not be used for grub2 commit c69111d424ee7879617ec4e1cfbeabf4aa6a9232 Author: Marcus Schäfer AuthorDate: Wed Jun 8 12:11:34 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:41:10 2016 +0200 Update ubuntu-xenial boot description No need for a drivers setup here, vmxboot is only the container to run dracut commit 742cb8a4626bfc3197f5752bc43824e56b368c20 Author: Marcus Schäfer AuthorDate: Tue Jun 7 21:52:08 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:41:09 2016 +0200 Added boot image description vmxboot/ubuntu-xenial commit 4d531535ace4744e4f71670916a7135d7018bfe0 Author: Marcus Schäfer AuthorDate: Mon Jun 6 14:46:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:41:09 2016 +0200 debootstrap installs apt-get Don't add the specified package manager to the list of bootstrap packages for apt-get, because that is covered by debootstrap commit a5b568915cddd74e6d10ac9f7f46ef40d79f3aef Author: Marcus Schäfer AuthorDate: Mon Jun 6 14:15:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:41:09 2016 +0200 Allow additional bootstrap packages for apt-get commit 42c9a84992bafa06ac104fa55f5ed2c66319366e Author: Marcus Schäfer AuthorDate: Sun Jun 5 23:09:15 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:41:09 2016 +0200 Don't run apt-get with mounted /dev commit 8134d12e5c86e60baa46334fa7e11275f69b736b Author: Marcus Schäfer AuthorDate: Sun Jun 5 22:48:36 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:41:09 2016 +0200 Fixed force-yes option for apt-get commit 591de9b7d9db019f7c071381a8efff20946bfd8e Author: Marcus Schäfer AuthorDate: Sat Jun 4 18:31:29 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:41:09 2016 +0200 Allow unattended installation of debian packages commit e16baa00ddd0d320e97bc98f7b391c7e0e5d778f Author: Marcus Schäfer AuthorDate: Fri Jun 3 22:15:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:41:09 2016 +0200 Added PackageManagerApt class Support installation/removal of deb packages Related to #37 commit c3004b48eb5b6f17825fb7787660c80144c1ae51 Author: Marcus Schäfer AuthorDate: Fri Jun 3 12:02:55 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:41:09 2016 +0200 Support for apt-get package manager Starting to support Debian based distributions also means to support the deb repository types. This commit adds the RepositoryApt class to handle deb repositories for image building. Related to #37 commit 77628658d3959d261160320c755ce24659229953 Author: Marcus Schäfer AuthorDate: Wed Jun 8 20:38:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:38:07 2016 +0200 Added tox target for python 2.7 commit 80fb5ac71cf10688ed89a69de864ea07049e53de Author: Marcus Schäfer AuthorDate: Wed Jun 8 20:27:54 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 8 20:27:54 2016 +0200 python 2.x compatibility added new requirements six and future modules are needed for the compat layer commit 80900e46c569a8efde7d81402fba8da696a87ddd Author: Bo Maryniuk AuthorDate: Wed Jun 8 11:46:36 2016 +0200 Commit: Bo Maryniuk CommitDate: Wed Jun 8 11:46:36 2016 +0200 Bring byte strings to Py2 compatibility in ISO commit 6ee5981bd5652812fba528d8ff70abe5a8bf1f8a Author: Bo Maryniuk AuthorDate: Tue Jun 7 23:44:33 2016 +0200 Commit: Bo Maryniuk CommitDate: Tue Jun 7 23:44:33 2016 +0200 Make iterators Py2 comptible commit 06b95b727dd2dac3c3b789467026bebd5e20e04d Author: Bo Maryniuk AuthorDate: Tue Jun 7 17:54:24 2016 +0200 Commit: Bo Maryniuk CommitDate: Tue Jun 7 17:54:24 2016 +0200 Replace 'builtins.open' with patch_open decorator commit 596ff2da231b891411ac83b7cfa665bb8acce0c4 Author: Bo Maryniuk AuthorDate: Tue Jun 7 17:35:06 2016 +0200 Commit: Bo Maryniuk CommitDate: Tue Jun 7 17:35:06 2016 +0200 Add mock_open and patch_open helpers commit 0debfa405241d5bb280a617a14907c1389250360 Author: Bo Maryniuk AuthorDate: Tue Jun 7 17:13:03 2016 +0200 Commit: Bo Maryniuk CommitDate: Tue Jun 7 17:13:03 2016 +0200 Remove double requirement commit 782612a013850480cd734a4999eb84087f5bf7bb Author: Bo Maryniuk AuthorDate: Tue Jun 7 16:04:46 2016 +0200 Commit: Bo Maryniuk CommitDate: Tue Jun 7 16:04:46 2016 +0200 Use ConfigParser from six commit e7ff0801d73b6146f50ef5bc0eefbdb60252c757 Author: Bo Maryniuk AuthorDate: Tue Jun 7 16:04:23 2016 +0200 Commit: Bo Maryniuk CommitDate: Tue Jun 7 16:04:23 2016 +0200 Move urlparse to the Six package commit 12b2601333125c1db4766850f307993fe9a21101 Author: Bo Maryniuk AuthorDate: Tue Jun 7 16:04:01 2016 +0200 Commit: Bo Maryniuk CommitDate: Tue Jun 7 16:04:01 2016 +0200 Remove duplicate key commit 168b0f92dc86b66fa51078dfec5e9e713c3f5f07 Author: Bo Maryniuk AuthorDate: Tue Jun 7 16:03:46 2016 +0200 Commit: Bo Maryniuk CommitDate: Tue Jun 7 16:03:46 2016 +0200 Add print function for Python 2 commit 856d0c4c1a3e0952712a56bbda8aec09b50cfe7d Author: Bo Maryniuk AuthorDate: Tue Jun 7 16:03:27 2016 +0200 Commit: Bo Maryniuk CommitDate: Tue Jun 7 16:03:27 2016 +0200 Add missing init file commit cb71d73ea31e714997834be32db4608ed8d14dd4 Author: Bo Maryniuk AuthorDate: Tue Jun 7 15:30:30 2016 +0200 Commit: Bo Maryniuk CommitDate: Tue Jun 7 15:30:30 2016 +0200 Add Python2 compatibilitiy requirements commit 6ed20b1829ab26bf4e9ebb306304b49225cfd7dc Author: Marcus Schäfer AuthorDate: Wed Jun 1 15:33:47 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 1 15:33:47 2016 +0200 Bump version: 8.16.5 → 8.17.0 commit fbb8a03f89d5d75ba5054deaa426fc3eb1ba9f1b Author: Marcus Schäfer AuthorDate: Wed Jun 1 15:32:14 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 1 15:32:38 2016 +0200 Added pypi make target for upload Please note an appropirate ~/.pypirc file and registered user is required to upload commit a8efd95b112cf98184ae38303ec9f6174110d6a5 Author: Marcus Schäfer AuthorDate: Wed Jun 1 14:38:50 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 1 14:38:50 2016 +0200 switch_root / pivot_root quiet call commit b301d8d1198f10fd7e929358b22f80db8a19fed3 Author: Marcus Schäfer AuthorDate: Wed Jun 1 14:38:25 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 1 14:38:25 2016 +0200 Increase default boot partition size to be 300M commit 7b1521cf303f55481567cc5943657d6621616d81 Author: Marcus Schäfer AuthorDate: Wed Jun 1 12:24:48 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 1 12:24:48 2016 +0200 Delete obsolete isFSTypeReadOnly from boot code The check was used to detect if a read-only root filesystem is in use, which can be done by checking if kiwi_ROPart is defined commit 6664ddcffcb4bc4fd158a1fb065925860794c9cb Author: Marcus Schäfer AuthorDate: Wed Jun 1 12:05:41 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 1 12:05:41 2016 +0200 Refactor use of global FSTYPE variable The kiwi boot code populates a global FSTYPE variable which was used at several places. However there was no clarity for which storage device this filesystem value was detected for. Thus the entire handling has been refactored and there is no global FSTYPE variable anymore commit ec35b4029c0ee063eed2a46ccf502eb6d0b55cc2 Author: Marcus Schäfer AuthorDate: Tue May 31 17:25:19 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 1 08:40:51 2016 +0200 Add attribute Allow to activate the overlay root setup for disk images commit c79afab617e29f087455a5b349bd45896e1f7d99 Author: Marcus Schäfer AuthorDate: Fri May 27 10:45:31 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Jun 1 08:40:51 2016 +0200 Support for overlay disk images overlay disk images uses a readonly root partition and are overlayed using overlayfs to hook in a cow based read-write space. This commit implements the basic disk setup. Implementation to boot such a disk in the kiwi boot code is still missing, as well as the investigation if dracut is able to boot such a disk too. References #65 commit cd0894247cb979ecf25c20d45d477f001211fb24 Author: Marcus Schäfer AuthorDate: Tue May 31 16:15:16 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 31 16:15:16 2016 +0200 Bump version: 8.16.4 → 8.16.5 commit bf39698d6e71d17852fcab55efd5e9e3a4d038f2 Author: Marcus Schäfer AuthorDate: Tue May 31 16:14:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 31 16:14:42 2016 +0200 Update development status Status :: 5 - Production/Stable commit 0ebe7770568852d354098befafa6f5f3d065f782 Author: Marcus Schäfer AuthorDate: Tue May 31 15:43:35 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 31 15:49:31 2016 +0200 Don't search for kiwicompat in fixed absolute path Allow alternative locations from search PATH commit b77f4ba05f7dd7a69faa787558439ff71dbde36a Author: Marcus Schäfer AuthorDate: Tue May 31 13:02:41 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 31 13:02:41 2016 +0200 Integrate git attribute setup to sdist command commit 0f084a14af4504e18321e9a7a3cb8d7910b8fb23 Author: Marcus Schäfer AuthorDate: Tue May 31 10:46:48 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 31 10:46:48 2016 +0200 Add C tools binaries to git ignore list commit be56346c6fe78049ae8627219f57c7dda2222a85 Author: Marcus Schäfer AuthorDate: Tue May 31 10:42:56 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 31 10:42:56 2016 +0200 Fixed command class name for distutils The overwritten build and install commands should not change their name in order to stay consistent on e.g --help commit bd309840758eb3c2e30cf924c1adef211afbe080 Author: Marcus Schäfer AuthorDate: Tue May 31 10:32:28 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 31 10:32:28 2016 +0200 Fixed kiwicompat binary lookup The test for os.path.exists on just the binary name without a path specification always fails if not present in current directory. Let execvp do the job for us commit 2d6f8a3ebfa5a27a16d8b57908f461a62671f3ff Author: Marcus Schäfer AuthorDate: Tue May 31 10:11:58 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 31 10:11:58 2016 +0200 Fixed entry point for kiwicompat commit eafd17a4fcd8bdc70840ea5bdcbed8b79010d57c Author: Marcus Schäfer AuthorDate: Tue May 31 10:00:51 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 31 10:02:22 2016 +0200 Use path lookup for kiwi-ng in kiwi_compat Instead of a fixed path use the PATH lookup. This would allow to install kiwi at alternative places as long as the path is part of the shell search PATH commit 69992390ee85ecb78bf6301461b09eafdd1cdc0a Author: Marcus Schäfer AuthorDate: Tue May 31 09:38:28 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 31 10:02:22 2016 +0200 Create completion data at build time commit 8c60ef66c56a39e094955b890563ebd8cdb92349 Author: Marcus Schäfer AuthorDate: Mon May 30 19:07:49 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon May 30 19:07:49 2016 +0200 Move all build and install tasks to setup.py In an effort to distribute kiwi on pypi it should not be required to call make targets for a complete installation. Therefore the compilation of the C tools as well as the installation of the man pages and the bash completion has been added to setup.py. The spec file to build an rpm package has been changed to use setup.py exclusively commit 4241c3c0bfe1ae7448025f58b9834716cfcca572 Author: Marcus Schäfer AuthorDate: Fri May 27 15:17:12 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri May 27 15:17:12 2016 +0200 Delete obsolete .releasetags from MANIFEST.in This avoids a warning on setup.py build commit ed2e6695b18fcc9bc091cb599b4f61d78504ac8a Author: Marcus Schäfer AuthorDate: Fri May 27 15:16:38 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri May 27 15:16:38 2016 +0200 Fixed warnings in C written tools commit e2e2e108695008be7a21cccde5b3cc1352c00b75 Author: Marcus Schäfer AuthorDate: Fri May 27 10:50:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri May 27 10:50:42 2016 +0200 Bump version: 8.16.3 → 8.16.4 commit 9e507a3c3f163b54df2532b4c1237ac5bcb2b5e8 Author: Marcus Schäfer AuthorDate: Fri May 27 10:50:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri May 27 10:50:10 2016 +0200 Fixed spec file update-alternatives is used, thus needs to be required commit fa8eba2a22f4260470473adf75aa207d098dcf43 Author: Marcus Schäfer AuthorDate: Thu May 26 00:35:46 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu May 26 00:35:46 2016 +0200 Bump version: 8.16.2 → 8.16.3 commit 75458c9e12b349959cb389999410f42c44e10187 Author: Marcus Schäfer AuthorDate: Thu May 26 00:33:13 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu May 26 00:33:13 2016 +0200 Fixed completion generator In addition cleanup the main docopt definition commit 174e6baab715a8e4d8faf62e014ae74a10d08ca3 Author: Marcus Schäfer AuthorDate: Wed May 25 23:39:51 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 25 23:39:51 2016 +0200 Fixed completion conflict with legacy kiwi commit 0f67c8fb4670e871a5411cef9ec64cacc168fc26 Author: Marcus Schäfer AuthorDate: Tue May 24 15:26:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 24 15:26:07 2016 +0200 Bump version: 8.16.1 → 8.16.2 commit f3a13e714414fafcc7ecf48811ce0d99c85d4aae Author: Marcus Schäfer AuthorDate: Tue May 24 15:23:43 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 24 15:23:43 2016 +0200 Fixed spec file rpmlintrc file must be mentioned as source commit 2db2be1499f105e7ee7dc582c000d8602891990e Author: Marcus Schäfer AuthorDate: Tue May 24 10:50:22 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 24 10:50:22 2016 +0200 Bump version: 8.16.0 → 8.16.1 commit 4e6c8977bb531adae2ffdf0f9ccc71b6cf34ee9a Author: Marcus Schäfer AuthorDate: Tue May 24 10:49:09 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 24 10:49:09 2016 +0200 Update quickstart documentation kiwi can also be used as a module in other python3 projects. An example how to do that has been added to the quickstart commit 0e38be71992a65317933ee1beb1b639f8287ed63 Author: Marcus Schäfer AuthorDate: Mon May 23 12:01:36 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon May 23 12:01:36 2016 +0200 Bump version: 8.15.5 → 8.16.0 commit 17de09d26da18fce3007e237f2d3abe397b234ff Author: Marcus Schäfer AuthorDate: Mon May 23 11:33:46 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon May 23 11:33:46 2016 +0200 Added support for grub2 console switch entry An additional hidden entry allows the user to switch between the graphics and the serial console by pressing the 't' key. The kiwi grub2 template adds this switch if the terminal mode is set to graphics. The additional entries are only effective of the grub_platform is set to efi. Fixes #80 commit cd2112bd7defab4c411d286621f7f9da7966e2cc Author: Marcus Schäfer AuthorDate: Mon May 23 09:58:40 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon May 23 10:07:30 2016 +0200 Fixed add_repo for zypper repositories Always run zypper addrepo in order to make any change in the repository definition to become effective commit 8afddeb06408a234c569cb82d3414659f3929821 Author: Marcus Schäfer AuthorDate: Mon May 23 09:40:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon May 23 09:40:07 2016 +0200 Fixed add_repo for yum repositories Always create the repo file from scratch in order to make any change in the repository definition to become effective commit 4140397a1441a7e55f8c95b2df2c9f555cde41d3 Author: Marcus Schäfer AuthorDate: Sat May 21 21:45:57 2016 +0200 Commit: Marcus Schäfer CommitDate: Sat May 21 21:45:57 2016 +0200 Bump version: 8.15.4 → 8.15.5 commit e1c6fb37162e7ff1b3f326c22e995a65f4293b79 Author: Marcus Schäfer AuthorDate: Sat May 21 21:45:08 2016 +0200 Commit: Marcus Schäfer CommitDate: Sat May 21 21:45:08 2016 +0200 Split quickstart into two parts Split the quickstart information into a development and a user part commit 5f1402b1dca99b3b7ef30a09456baa18f73d8daa Author: Marcus Schäfer AuthorDate: Sat May 14 21:19:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Sat May 14 21:19:05 2016 +0200 Bump version: 8.15.3 → 8.15.4 commit 1b2f842f812285b1db82dd80055cc8a9389a0608 Author: Marcus Schäfer AuthorDate: Fri May 13 18:47:18 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri May 13 19:44:47 2016 +0200 Added readonly check for persistent data When creating a partition for persistent data, check if the device class has the readonly flag set before trying to write anything there. Fixes #74 commit 01995b98520ebf2ff7da7051b953dd4d4da2b65a Author: Marcus Schäfer AuthorDate: Fri May 13 10:48:23 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri May 13 10:48:23 2016 +0200 Bump version: 8.15.2 → 8.15.3 commit 63bf8d90c939e1343a52a90b444dae5b0fc82fd1 Author: Marcus Schäfer AuthorDate: Fri May 13 10:27:17 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri May 13 10:27:17 2016 +0200 Fixed removal of a package in XMLState If a was unwanted in a section the former code sets the name of the package to a python None type. This causes the rest of the code to operate on potential None types which causes unexpected TypeError's under certain conditions. Instead of leaving an inconsistent package section the entire package section reference should be deleted from the packages instance holding it. Fixes #76 commit cfa7714f31f4e10aba16fdb52cec775ce0ad62f6 Author: Marcus Schäfer AuthorDate: Thu May 12 21:10:15 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu May 12 21:10:15 2016 +0200 Exit code for --version call should be zero commit 1fc329afacbf02b89a2f85d542c2c78ab7a398fe Author: Marcus Schäfer AuthorDate: Thu May 12 09:56:35 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu May 12 09:56:35 2016 +0200 Bump version: 8.15.1 → 8.15.2 commit d71da51cb989cae99f23f675091a6aaaf088fa1e Author: Marcus Schäfer AuthorDate: Thu May 12 09:55:29 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu May 12 09:55:29 2016 +0200 Set config.sh and images.sh scripts as optional commit 0b5033f51beaf397eb31b74f26c55d68e37565d3 Author: Marcus Schäfer AuthorDate: Thu May 12 09:20:14 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu May 12 09:20:14 2016 +0200 Bump version: 8.15.0 → 8.15.1 commit 682021e7e58a2f1f21f1bb27ce2c20b80a233e8a Author: Marcus Schäfer AuthorDate: Wed May 11 23:01:30 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 11 23:01:30 2016 +0200 Fixed landscape smell Unused variable 'key' commit 05e8eebd999aa68d6a62aeb32dc0071856289e92 Author: Marcus Schäfer AuthorDate: Wed May 11 22:57:50 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 11 22:57:50 2016 +0200 Fixed landscape smell Redefining built-in 'help' commit 414fbcbc1fa28fe56834d8df4c96ead21f124b2b Author: Marcus Schäfer AuthorDate: Wed May 11 22:53:58 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 11 22:53:58 2016 +0200 Fixed landscape error Dangerous default value [] as argument commit 06a7472a4fcafa5883583219125115fcfdcda4a0 Author: Marcus Schäfer AuthorDate: Wed May 11 22:42:41 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 11 22:49:22 2016 +0200 Refactor import_description split code into more readable parts commit 39d76e754cb1896b3e1104dd95de6c783c0664da Author: Marcus Schäfer AuthorDate: Wed May 11 21:33:00 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 11 21:40:51 2016 +0200 Make sure mandatory vmdk settings exists Even without a machine section configuration the minimum required information must be presented to the settings template commit 4e095621f4ec5674fbc3838e533a6af94500e11f Author: Marcus Schäfer AuthorDate: Wed May 11 19:42:04 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 11 19:42:04 2016 +0200 Added store_to_result for vmdk format The vmdk format provides more than the standard result store. for vmdk we need to store the vmdk and the settings file commit 026fb7b5e32425a0b7174d58d43f18cb32632e20 Author: Marcus Schäfer AuthorDate: Wed May 11 19:30:01 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 11 19:30:01 2016 +0200 Reduce amount of mountpoint check calls commit 4124d545e0ce624adb2e22fd7929c2bf187c016c Author: Marcus Schäfer AuthorDate: Wed May 11 19:18:22 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 11 19:18:22 2016 +0200 Refactor subformat classes Add a generic store_to_result method which allows to store the format result files into an instance of Result. This allows to customize result handling per format when needed commit d1e689e00b738d144d84d4b1699f7463717c0626 Author: Marcus Schäfer AuthorDate: Wed May 11 18:46:02 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 11 18:46:02 2016 +0200 Create VMware settings file for vmdk subformat In order to run or convert the vmdk with VMware products a settings file is required. commit 99cf51394b7f01b24665a726eb9ab5c64470734e Author: Marcus Schäfer AuthorDate: Tue May 10 16:17:31 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 10 16:17:31 2016 +0200 Added dropped features information for lxc commit 69ff4a938a91c985cc21bb477131593d99b4a71f Author: Marcus Schäfer AuthorDate: Tue May 10 14:23:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 10 14:23:10 2016 +0200 Bump version: 8.14.2 → 8.15.0 commit 030550a280099734f9bfbed2ca1f639e191dae0a Author: Marcus Schäfer AuthorDate: Tue May 10 13:02:52 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue May 10 13:02:52 2016 +0200 Fixed script/archive lookup If a script or archive is specified with an absolute path in the image description, kiwi should not assume this path to exist below the image description directory but just take the absolute path as it is. Fixes #70 commit ea01c4fc38257675f58c887e9a4f7001578d1a03 Author: Marcus Schäfer AuthorDate: Sun May 8 19:04:41 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun May 8 19:11:52 2016 +0200 Load logging at runtime for MountManager commit eab75e22bb854a142d4f6130c388019639fb2b83 Author: Marcus Schäfer AuthorDate: Sun May 8 19:03:52 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun May 8 19:03:52 2016 +0200 Runtime checker message fixes Start with an empty line to improve readability commit 183d34172b61b98928b485f7cdc99287fa2e7433 Author: Marcus Schäfer AuthorDate: Sun May 8 18:52:32 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun May 8 18:52:32 2016 +0200 Integrate runtime checks for tasks Call appropriate runtime checks for prepare, create and build tasks. Fixes #20 commit 08ee4ee420914d0e590eb26a79ea9662a0bcebe5 Author: Marcus Schäfer AuthorDate: Sun May 8 18:32:01 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun May 8 18:32:01 2016 +0200 Create instance of runtime_checker for any CliTask commit 8b41a88d9edfacc85fe28fcd9e327eba75dc77c6 Author: Marcus Schäfer AuthorDate: Fri May 6 15:12:55 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri May 6 15:12:55 2016 +0200 Fixed building documentation commit cf81bad86760bfaba0758419945a874c18abbd1b Author: Thomas Schraitle AuthorDate: Thu May 5 13:39:31 2016 +0200 Commit: Thomas Schraitle CommitDate: Thu May 5 13:39:31 2016 +0200 Reuse env in tox.ini Reuse virtualenv directory with envdir. Should speed up things a bit. Taken from https://blog.ionelmc.ro/2015/04/14/tox-tricks-and-patterns/#partial-environment-reuse https://blog.ionelmc.ro/2015/04/14/tox-tricks-and-patterns/#environment-reuse commit c60d76b9d40c37afb1f7730d470cf3b84ac86161 Author: Thomas Schraitle AuthorDate: Thu May 5 13:36:37 2016 +0200 Commit: Thomas Schraitle CommitDate: Thu May 5 13:36:37 2016 +0200 Use more compact config for tox.ini Rewrite basepython to make it more compact Taken from https://blog.ionelmc.ro/2015/04/14/tox-tricks-and-patterns/#compact-configuration commit 3a225a92f4a7f7f05898b1ea3912c29c384ab00a Author: Thomas Schraitle AuthorDate: Thu May 5 13:19:25 2016 +0200 Commit: Thomas Schraitle CommitDate: Thu May 5 13:19:25 2016 +0200 Add requirements section in Quick Start * Describe what KIWI needs to run, further requirements, and for development * Introduce 'ghkiwi' as prefix in "extlinks" to shorten external links and to make linking to KIWI's GitHub repository more intuitive and consistent. For example, the string :ghkiwi:`tox.ini` is replaced with https://github.com/SUSE/kiwi/blob/master/tox.ini commit a64a3cbc9a3c0e3dc9bc69b83557edb5cf61fad5 Author: Marcus Schäfer AuthorDate: Wed May 4 18:24:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 4 18:24:11 2016 +0200 Added check_target_directory_not_in_shared_cache Runtime checker method to check if the target directory was set to - or below the shared cache directory commit 82d6c96e1fb97bfb65fb21599ef817d5c1f79061 Author: Marcus Schäfer AuthorDate: Wed May 4 11:47:50 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 4 11:47:50 2016 +0200 Bump version: 8.14.1 → 8.14.2 commit 82235cc22b6eb439a5c8505d54e9300d2a612a95 Author: Marcus Schäfer AuthorDate: Wed May 4 11:33:57 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 4 11:33:57 2016 +0200 Move creation of mountpoint dir to setup method The volume management classes should create the temporary mountpoint directory when it is needed and not when an instance of the class is created commit 400468a4557bfd44e00d0d0b801db2144296d018 Author: Marcus Schäfer AuthorDate: Wed May 4 10:30:17 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed May 4 11:05:03 2016 +0200 Cleanup use of temporary directories All mkdtemp created directories are created with the 'kiwi_' prefix. In addition all code parts which leaves tmpdirs in the system after kiwi is done were fixed commit 0db9e928fd0f3bfb9b9a6a2e04a725717bef5781 Author: Marcus Schäfer AuthorDate: Mon May 2 16:15:12 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon May 2 16:15:12 2016 +0200 Bump version: 8.14.0 → 8.14.1 commit 8971de052353ab4bb191a405e662a52f394b7ac2 Author: Marcus Schäfer AuthorDate: Mon May 2 11:18:28 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon May 2 11:18:28 2016 +0200 Added python3-xattr dependency commit c429c1828984a84e52dfcb92d1f54adb8b2a0b5a Author: Marcus Schäfer AuthorDate: Mon May 2 11:16:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon May 2 11:16:10 2016 +0200 Added xattr checker for DataSync class The method target_supports_extended_attributes() checks if the sync target directory supports extended filesystem attributes. The method is called on sync_data() and will remove the -X / -A options if provided. A warning message is issued to the caller if the rsync option list has changed because of the underlaying filesystem limitations commit f3b2a045acde580c4700d0f8ca55ae294fce6e2b Author: Marcus Schäfer AuthorDate: Mon May 2 09:52:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon May 2 09:52:07 2016 +0200 Fixed subformat creation The option -c makes only sense for the qcow2 subformat, whereas on all other format it cause qemu-img convert to fail commit 741e3a8c044087f65bef253dc8be4873f35d9f4c Author: Thomas Schraitle AuthorDate: Sun May 1 19:18:51 2016 +0200 Commit: Thomas Schraitle CommitDate: Sun May 1 19:18:51 2016 +0200 Use iterator protocol instead of StopIteration CommandIterator contains already the __iter__ magic method. We don't need to manually use while and next() in order to advance to the next element. => Code refactored to "for line in self.command" which does exactly the same job, but is better readable. Plus we avoid the nasty try...except block. commit fd382e797ffab95bd544c9e43b08ef0753560ffa Author: Thomas Schraitle AuthorDate: Sat Apr 30 12:05:27 2016 +0200 Commit: Thomas Schraitle CommitDate: Sat Apr 30 12:05:27 2016 +0200 Remove kiwi.logger.init() function The init function is mostly unneccessary and can be directly created in the kiwi.logger module. commit 0033d9d76e1b0ccbc6233b58a297dbb02f43639c Author: Thomas Schraitle AuthorDate: Sat Apr 30 11:53:47 2016 +0200 Commit: Thomas Schraitle CommitDate: Sat Apr 30 11:53:47 2016 +0200 Remove useless __init__.py commit b2f8f2a40efa1696cdc4bd36a110b72285f227fa Author: Marcus Schäfer AuthorDate: Fri Apr 29 21:16:49 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 29 21:16:49 2016 +0200 Fixup usage messages commit f8d0fe69a255f95efcfb8e5f2e2f1f70ad24d17b Author: Marcus Schäfer AuthorDate: Fri Apr 29 16:49:19 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 29 16:49:19 2016 +0200 Bump version: 8.13.4 → 8.14.0 commit 3b7c4217ebc4c6104ad1fc1fffbba52616d51a2f Author: Marcus Schäfer AuthorDate: Wed Apr 27 17:01:29 2016 +0200 Commit: cloud-init created default user CommitDate: Fri Apr 29 14:30:15 2016 +0000 Add check_image_include_repos_http_resolvable Runtime checker method to check if repositories marked with the imageinclude attribute are using a publicly available protocol commit 685c830e457c02c4f7f228700c0e604aaf609de4 Author: Marcus Schäfer AuthorDate: Wed Apr 27 16:58:42 2016 +0200 Commit: cloud-init created default user CommitDate: Fri Apr 29 14:30:15 2016 +0000 Add shared cache location to Defaults commit a07bbcac89c6c9316a1511a2106d81f7726bf893 Author: Marcus Schäfer AuthorDate: Fri Apr 22 10:30:26 2016 +0200 Commit: cloud-init created default user CommitDate: Fri Apr 29 14:30:01 2016 +0000 Added RuntimeChecker class An instance of RuntimeChecker allows to semantically check for error conditions according to the provided image description and build options. Related to #20 commit a2f9684c2570b684159e5f77a87b507af3cb2e54 Author: Marcus Schäfer AuthorDate: Fri Apr 29 16:26:20 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 29 16:26:20 2016 +0200 Added support for custom rootfs label A new attribute has been added This Fixes #66 commit cf991c1a4c088d0646c18a82fb9426fc4b6d410f Author: Marcus Schäfer AuthorDate: Fri Apr 29 15:49:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 29 15:49:10 2016 +0200 Update grub2 bootloader template menuentries Mark all menuentries as --unrestricted. Fixes #64 commit 84a6844059f972f89d4d6e6a81c2d0cf5985fa59 Author: Marcus Schäfer AuthorDate: Fri Apr 29 09:26:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 29 09:26:05 2016 +0200 Bump version: 8.13.3 → 8.13.4 commit 18d9d8ada1470cda38a8befcd92fd571c9ebf828 Author: Marcus Schäfer AuthorDate: Fri Apr 29 09:24:58 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 29 09:24:58 2016 +0200 Fixed shared local repository mounts commit 42cff9230fad795947d128006a783b2947339cc5 Author: Marcus Schäfer AuthorDate: Thu Apr 28 18:04:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 28 18:04:42 2016 +0200 Bump version: 8.13.2 → 8.13.3 commit 6b1211b8dd6b3241971943863fabed9793d02f87 Author: Marcus Schäfer AuthorDate: Thu Apr 28 15:14:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 28 16:54:06 2016 +0200 Added evaluation of imageincluded repositories repositories marked as imageinclude needs to be added permanently to the image. Fixes #56 commit b5bdbed6e1b5c65ed25a7d1b414b7b9efe7d7178 Author: Marcus Schäfer AuthorDate: Thu Apr 28 14:30:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 28 14:30:10 2016 +0200 Make xz the default compressor for squashfs When creating squashfs compressed files use xz as compressor if not other compressor is specified. Fixes #63 commit d5f1bdd1595437db8cd90c5d9d3dd53414d49fc8 Author: Marcus Schäfer AuthorDate: Thu Apr 28 14:21:57 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 28 14:21:57 2016 +0200 Added --add|delete package for prepare command Allow additional packages to be installed/deleted when calling system prepare. Fixes #62 commit 24ab1a15c85f618628d298622c385f7854f01fec Author: Marcus Schäfer AuthorDate: Thu Apr 28 14:14:16 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 28 14:14:16 2016 +0200 Alpha sort option documentation Alpha sort options in usage and man pages commit 29c66acca83055bfcb37d48636d731fb1d3a7a79 Author: Marcus Schäfer AuthorDate: Thu Apr 28 14:04:51 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 28 14:04:51 2016 +0200 Added --add|delete package for build command Allow additional packages to be installed/deleted when calling system build. Related to Issue #62 commit 22bd4e4dcbc84faf992234e5e150d1aa461933a6 Author: Marcus Schäfer AuthorDate: Thu Apr 28 11:36:06 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 28 11:36:06 2016 +0200 Fixed completion generator complete for kiwi and kiwi-ng commit 5d3005ceafcbf770ac4585a5b15d3f19421aaf59 Author: Marcus Schäfer AuthorDate: Thu Apr 28 10:16:27 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 28 10:16:27 2016 +0200 Prevent double render on usage commit 60f3abe3fe1e9539592d8e246d6a7a2322be3892 Author: Marcus Schäfer AuthorDate: Wed Apr 27 11:39:52 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 27 11:39:52 2016 +0200 Bump version: 8.13.1 → 8.13.2 commit faf862fa41d6293bc9dbe246d222acb3dcc01dd0 Author: Marcus Schäfer AuthorDate: Wed Apr 27 11:08:13 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 27 11:08:13 2016 +0200 Allow alternative if isolinux-config failed If the setup of the base directory failed because isolinux-config was not able to identify the isolinux.bin signature, we create a compat /isolinux directory and hardlink all loader files commit 894758547ca9dcbf085f3d917d82e974d14d4ee6 Author: Marcus Schäfer AuthorDate: Wed Apr 27 11:02:16 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 27 11:02:16 2016 +0200 Fixed typo in message Fix condition to show the grub module info message commit ef67966e5beaf5b0e5ba8b2c1cefb9c009ad55bc Author: Marcus Schäfer AuthorDate: Wed Apr 27 08:48:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 27 08:48:39 2016 +0200 Use program output for synopsis in documentation commit 7040b416275a2bd8fd45d28bc6d75a1ff0070247 Author: Marcus Schäfer AuthorDate: Tue Apr 26 18:02:54 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 26 18:02:54 2016 +0200 Provide custom usage message Instead of the docopt way to show the usage information we provide a kiwi specific usage information. The usage data now always consists of: 1. the generic call kiwi [global options] service [] 2. the command specific usage defined by the docopt string short form by default, long form with -h | --help 3. the global options commit 0bf00ba3c41096a8c0da409a91bf6507efdf9a48 Author: Marcus Schäfer AuthorDate: Tue Apr 26 14:58:01 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 26 14:58:01 2016 +0200 Fixed loadSELinuxPolicy enforce policy is located in /sys/fs/selinux commit f86fe19beff7cad2122489c6dd6d96096512dfd7 Author: Marcus Schäfer AuthorDate: Tue Apr 26 14:56:12 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 26 14:56:12 2016 +0200 No authconfig on RHEL >= 7 commit 8d507e049d94a5db66bf01a3bac122ff4340a858 Author: Marcus Schäfer AuthorDate: Tue Apr 26 14:41:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 26 14:41:44 2016 +0200 Activate SELinux for RHEL systems Added new boot method loadSELinuxPolicy and call it as part of the rhel-preinit phase. This put SELinux in enforcing mode also from the kiwi initrd commit 24011064b35dd865b28f3ea7c49f54ed644ef5ea Author: Marcus Schäfer AuthorDate: Tue Apr 26 12:40:23 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 26 12:40:23 2016 +0200 Handle fsmountoptions attribute in all builders commit 27d13c555323d663977086e6d9d24021219d27fd Author: Marcus Schäfer AuthorDate: Tue Apr 26 11:53:19 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 26 11:53:19 2016 +0200 Refactor custom_args handling for VolumeManager class Allow for two elements fs_create_options and fs_mount_options in a VolumeManager instance and pass along the information to the FileSystem and MountManager instances commit a9d0b607d79135251606a60f6093855599c97e8c Author: Marcus Schäfer AuthorDate: Tue Apr 26 11:02:28 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 26 11:02:28 2016 +0200 Refactor custom_args handling for FileSystem class Any FileSystem class can receive a custom_args dictionary which by defaults ensures the presence of an empty list for create_options and mount_options. The create_options are used in the subclasses when the filesystem is being created and the mount_options are passed to the MountManager when the filesystem is mounted for e.g data_sync commit b0472abc8e445d0b46979f5a3566459f2253e59c Author: Marcus Schäfer AuthorDate: Tue Apr 26 09:20:42 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 26 09:20:42 2016 +0200 Make kiwicompat understand --version | -v option commit c40d397b6eabef60a5ec0119debbefc495364125 Author: Thomas Schraitle AuthorDate: Tue Apr 26 09:17:04 2016 +0200 Commit: Thomas Schraitle CommitDate: Tue Apr 26 09:17:04 2016 +0200 Small spelling corrections Apply title style: * package -> Package * module -> Module * Use backticks for kiwi.* modules to avoid spelling problems commit 26fca7f5f6c66e0bfec24d5022bdafdd9504e11a Author: Thomas Schraitle AuthorDate: Tue Apr 26 09:12:59 2016 +0200 Commit: Thomas Schraitle CommitDate: Tue Apr 26 09:12:59 2016 +0200 Update spell-checking wordlist GitHub, JeOS, KIWI, LXC, squashfs, stderr, stdin, stdout, Submodules, Subpackages, zypper commit 12856d4c8c2f555b9ea634a063beb4b0b7f7cc6e Author: Thomas Schraitle AuthorDate: Tue Apr 26 08:47:07 2016 +0200 Commit: Thomas Schraitle CommitDate: Tue Apr 26 08:47:07 2016 +0200 Add "spell" rule in Makefile Also included in the help target commit b969f374742596c345e4ce619c18ea4b7208745e Author: Thomas Schraitle AuthorDate: Tue Apr 26 08:45:33 2016 +0200 Commit: Thomas Schraitle CommitDate: Tue Apr 26 08:45:33 2016 +0200 Enable Acronyms, importable modules, and builtins commit 30bb562a570ac72b464d8a33213f26e44df3cff1 Author: Thomas Schraitle AuthorDate: Mon Apr 25 18:34:17 2016 +0200 Commit: Thomas Schraitle CommitDate: Mon Apr 25 18:34:45 2016 +0200 First draft to "beautify" HTML appearance * Add GitHub button and "Fork me" widgets * Add Travis button * Remove obsolete code commit 6e927d7c2cc31fc529fa2c76bdc1c0345dcd6320 Author: Marcus Schäfer AuthorDate: Mon Apr 25 18:05:36 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 25 18:05:36 2016 +0200 Bump version: 8.13.0 → 8.13.1 commit 6df0282d1ca9a89649a512ce579a29abc7dea306 Author: Marcus Schäfer AuthorDate: Mon Apr 25 12:40:49 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 25 12:50:10 2016 +0200 Added support for SELinux file security contexts Systems using SELinux require the filesystem data to be labeled according to a security context configuration. kiwi now checks for the presence of /etc/selinux/targeted/contexts/files/file_contexts and labels accordingly if it exists. This Fixes #52 commit 2f1e892fb65e6cca2f1401df580e684bf28dbfa3 Author: Marcus Schäfer AuthorDate: Mon Apr 25 12:39:28 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 25 12:50:10 2016 +0200 Make grub2 installation path lookup dynamic Not all linux systems installs grub2 below /usr/lib/grub2 For example RHEL7 packages it below /usr/lib/grub. Therefore kiwi needs to be flexible with this path commit 176a6d1690da5cf2c8e720334c78f48dd2f8ae93 Author: Thomas Schraitle AuthorDate: Fri Apr 22 16:25:58 2016 +0200 Commit: Thomas Schraitle CommitDate: Fri Apr 22 16:25:58 2016 +0200 Used :returncode: for sphinxcontrib-programoutput Fix a warning when calling "kiwi-ng". As the script returns 1, it is considered to have failed by the program-output directive. The returncode line fixes that. See more info here: https://pythonhosted.org/sphinxcontrib-programoutput/#error-handling commit 63add3325cb9987557dab62cc3668e84313261e1 Author: Thomas Schraitle AuthorDate: Fri Apr 22 13:30:45 2016 +0200 Commit: Thomas Schraitle CommitDate: Fri Apr 22 13:31:54 2016 +0200 Integrate version string from placeholder Use |version| placeholder, no bumpversion etc. is needed. Actually, it's taken from conf.py commit 8733afc8f2401b10ede5039831dfc95b2d11811a Author: Thomas Schraitle AuthorDate: Fri Apr 22 09:52:49 2016 +0200 Commit: Thomas Schraitle CommitDate: Fri Apr 22 09:52:49 2016 +0200 Spell checking doc and extended word list commit 0c3f3c226f02071c4c6d434feba74468f9b4bf0c Author: Marcus Schäfer AuthorDate: Thu Apr 21 18:52:06 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 21 18:52:06 2016 +0200 Add filesystem requires in kiwi-boot-requires In order to have all filesystem creation tools available when building in the buildservice we need to require them in kiwi-boot-requires commit 07f557ced464ab9f28b73a928e01895c317ea00a Author: Marcus Schäfer AuthorDate: Thu Apr 21 16:27:36 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 21 16:27:36 2016 +0200 Bump version: 8.12.0 → 8.13.0 commit 606b131d7708403c175ea85a3fe4984a47ddf8fa Author: Marcus Schäfer AuthorDate: Thu Apr 21 15:50:17 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 21 16:21:00 2016 +0200 Set ident export-subst git attribute on version.py commit c4f022161c17a028a12723de2337e3d2bcb7e259 Author: Marcus Schäfer AuthorDate: Thu Apr 21 12:16:26 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 21 12:16:26 2016 +0200 Bump version: 8.11.0 → 8.12.0 commit 2c31d70ecb274283ad4246422a3431fbc0ce563d Author: Marcus Schäfer AuthorDate: Thu Apr 21 12:07:09 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 21 12:07:09 2016 +0200 Fixed documentation link references Use redirected target and fix broken targets according to link check on make build commit ec60cc58a8b28923236f6d01bd46e09b9a296887 Author: Marcus Schäfer AuthorDate: Thu Apr 21 11:51:36 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 21 11:51:36 2016 +0200 Fixed typo in documentation Missing question mark at end of sentence commit 6368ef0ab843c1ae95b4f7860297a34d0ec75064 Author: Marcus Schäfer AuthorDate: Thu Apr 21 11:46:53 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 21 11:46:53 2016 +0200 Bump version: 8.10.1 → 8.11.0 commit 4b1c59624ce8ef12729fb1594963ba1378f273ad Author: Marcus Schäfer AuthorDate: Thu Apr 21 11:46:18 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 21 11:46:18 2016 +0200 Fixed typo commit 785b3a04476dbe7d987b29ede67e907b79a62214 Author: Marcus Schäfer AuthorDate: Thu Apr 21 11:32:21 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 21 11:32:21 2016 +0200 Added Legacy KIWI vs. Next Generation chapter commit 3f8d7f80ea4badff4924e7c019357d8fa0001786 Author: Thomas Schraitle AuthorDate: Thu Apr 21 08:48:33 2016 +0200 Commit: Thomas Schraitle CommitDate: Thu Apr 21 08:48:33 2016 +0200 md -> rst, radically shortend README commit 0b1460aa4909b956566004206da963664d11b994 Author: Thomas Schraitle AuthorDate: Wed Apr 20 17:01:36 2016 +0200 Commit: Thomas Schraitle CommitDate: Wed Apr 20 17:01:36 2016 +0200 More substantial changes of the doc * Overall: try to be more consistent * index.rst * Move "Supported Distributions" and "Dropped Features" sections * Quick Start: * Add abstract * Add note about automatic link creation * Move "example appliance description" sections and subsections further down * Streamlined "Contributing" section * Corrected titles and distinguish more between descriptive and procedural commit bb5ae9f5e60213377fb567a8527a397b1fe1a66e Author: Thomas Schraitle AuthorDate: Wed Apr 20 15:22:15 2016 +0200 Commit: Thomas Schraitle CommitDate: Wed Apr 20 15:22:15 2016 +0200 Remove useless substitutions (placeholders) commit fd849229cbdbfc0925f0bfab863ceca050dab78f Author: Thomas Schraitle AuthorDate: Wed Apr 20 15:21:16 2016 +0200 Commit: Thomas Schraitle CommitDate: Wed Apr 20 15:21:16 2016 +0200 Add KIWI logo commit a15e1cf0e077f4893b1c60a77317034289015f49 Author: Thomas Schraitle AuthorDate: Wed Apr 20 15:17:54 2016 +0200 Commit: Thomas Schraitle CommitDate: Wed Apr 20 15:20:56 2016 +0200 Move Motivation section from quickstart to index commit 4aad113d98847b69d82286bdf514be2999fae960 Author: Thomas Schraitle AuthorDate: Wed Apr 20 12:39:55 2016 +0200 Commit: Thomas Schraitle CommitDate: Wed Apr 20 12:39:55 2016 +0200 Correct heading and remove build status commit 30ee0d229197c5f459781b33561e373767875a7a Author: Thomas Schraitle AuthorDate: Wed Apr 20 11:27:59 2016 +0200 Commit: Thomas Schraitle CommitDate: Wed Apr 20 11:35:32 2016 +0200 Add QuickStart Guide and improve documentation * Added Quick Start Guide, taken from README.md * Improve index/main file: * Shortend main entry page * Make more headings * Add feature highlights to draw attention * Add sidebar with important KIWI links * Use ordered list of KIWI concept (prep and creation step) commit c8b95d96d97bf746a514c1d88d0c19706e52f34d Author: Marcus Schäfer AuthorDate: Wed Apr 20 10:37:20 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 20 10:37:20 2016 +0200 Add package manager requirements in spec file commit 87e9a2defe4b5a15992e61125010ee31afc9fb68 Author: Marcus Schäfer AuthorDate: Tue Apr 19 12:24:03 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 19 12:24:03 2016 +0200 Update README commit 36b1d6a8aa1dc20c9a2aa56fb7452267322a272b Author: Marcus Schäfer AuthorDate: Tue Apr 19 12:23:10 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 19 12:23:10 2016 +0200 Update README commit 077aabd69c53d55770d0039cb22fe698cdd6e2fd Author: Marcus Schäfer AuthorDate: Tue Apr 19 12:21:55 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 19 12:21:55 2016 +0200 Update README commit 7de75965ea610620d71dae42f4c8ee4efcdd6566 Author: Marcus Schäfer AuthorDate: Tue Apr 19 11:02:43 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 19 11:02:43 2016 +0200 Move program name from kiwi-py3 to kiwi-ng commit 47e83f7dcfbe36cde3df3132a723dc5e425fedb2 Author: Marcus Schäfer AuthorDate: Tue Apr 19 10:09:20 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 19 10:09:20 2016 +0200 Added genisoimage requirement to kiwi spec file On SLE12 we only have genisoimage, on Leap and Tumbleweed we have both genisoimage and mkisofs. For the moment both toolkits produces working iso images with kiwi, thus I chose the save default with genisoimage commit 91afaad9232110c9ca1d8c871f5e1bab31801c17 Author: Marcus Schäfer AuthorDate: Tue Apr 19 10:07:21 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 19 10:07:21 2016 +0200 Be more flexible for isoinfo lookup isoinfo can either be provided by the community package in /usr/lib/genisoimage/isoinfo or by the mkisofs package from J. Schilling in /usr/bin/isoinfo. kiwi should be smart enough to lookup which tool is installed. /usr/bin/isoinfo will be preferred commit dfff0f21beb1c92248a8523315e17f1747dcbef6 Author: Marcus Schäfer AuthorDate: Tue Apr 19 08:44:51 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 19 08:44:51 2016 +0200 Update README Added link to documentation commit b2351e111ff6944b52694426558a2692069ecf96 Author: Marcus Schäfer AuthorDate: Mon Apr 18 20:30:06 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 20:30:06 2016 +0200 Try with latest version of travis-sphinx commit 6a20374e52f3124787df4ac13f53d5bec1abea3a Author: Marcus Schäfer AuthorDate: Mon Apr 18 19:01:31 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 19:01:31 2016 +0200 ghp-import required for travis-sphinx deploy commit 96b44d68ae0bfef2dd9acbfb3800b9a59ff95e22 Author: Marcus Schäfer AuthorDate: Mon Apr 18 18:29:49 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 18:29:49 2016 +0200 Make sure enchant library is present for travis commit 3aabe1b974e9672e4988ac628594910d14354202 Author: Marcus Schäfer AuthorDate: Mon Apr 18 18:23:36 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 18:23:36 2016 +0200 Update tox setup Update TOXENV targets commit 30667b3ec2985d43aa268913c7bdd8a912e7db49 Author: Marcus Schäfer AuthorDate: Mon Apr 18 17:59:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 17:59:07 2016 +0200 Move travis-sphinx build tox target to script section commit 5f37b578d7b0a149283ab38a090a0677099e0372 Author: Marcus Schäfer AuthorDate: Mon Apr 18 17:46:59 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 17:47:38 2016 +0200 Use tox target for travis-sphinx commit 8973f64fc3dcdb8a7b923021289d4fd97f6bcce5 Author: Marcus Schäfer AuthorDate: Mon Apr 18 17:31:12 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 17:31:12 2016 +0200 Put travis-sphinx build into script section commit ce61d4bc4da16efcf20f69f2167d9e49f01c3cc7 Author: Marcus Schäfer AuthorDate: Mon Apr 18 17:23:03 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 17:23:03 2016 +0200 Make travis-sphinx deploy work It's required to call travis-sphinx build in order to be able to run the deploy command commit 63253068caa496945e0ee8acbe5f561638996a25 Author: Marcus Schäfer AuthorDate: Mon Apr 18 17:12:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 17:12:39 2016 +0200 Fixed documentation linkcheck results commit ccf1ce6c7c05a84907ac131e8447cafd935e70ff Author: Marcus Schäfer AuthorDate: Mon Apr 18 17:06:17 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 17:06:17 2016 +0200 Make sure shared mount directories exists Create shared directory path on the host _and_ in the new root directory to make sure the bind mount works commit fb805ee10001fb0769e30491b46e80e19bc2c3c2 Author: Marcus Schäfer AuthorDate: Mon Apr 18 16:57:17 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 16:57:17 2016 +0200 Update documentation entry page commit a71c2e6d37d350dbad5c014921c8cb20dce3475f Author: Marcus Schäfer AuthorDate: Mon Apr 18 12:20:00 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 12:20:00 2016 +0200 Use travis-sphinx to deploy doc to github https://suse.github.io/kiwi commit 3ccd2b0d185eb28f8b8bd8488e2ae3dbe6765169 Author: Marcus Schäfer AuthorDate: Mon Apr 18 10:05:27 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 10:05:27 2016 +0200 Fixed package requirements libxslt-tools provides required xsltproc commit c9693623c131c4d283d174382a0c6dcd6e90bd78 Author: Marcus Schäfer AuthorDate: Mon Apr 18 09:59:18 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 09:59:18 2016 +0200 Update README for style and markup commit 7e8dead2e20d922fbc813b688d3e49f488b4cbb7 Author: Marcus Schäfer AuthorDate: Mon Apr 18 09:58:18 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 09:58:18 2016 +0200 Fixed README, wrong markup commit 068a5691170db1290166c5e61633430dbbbb836c Author: Marcus Schäfer AuthorDate: Mon Apr 18 09:57:08 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 09:57:08 2016 +0200 Update README Add information how to build with dice commit 33468110b1d509c0fa275ea800e5c5d6bfc8dcd9 Author: Marcus Schäfer AuthorDate: Mon Apr 18 09:36:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 18 09:36:44 2016 +0200 Add part_msdos module for self build EFI image commit 81a8f2253172928cb1be578c6423e97015ef5f6e Author: Marcus Schäfer AuthorDate: Fri Apr 15 14:45:23 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 15 14:45:23 2016 +0200 Update tox.ini Documentation building requires sphinx_rtd_theme and sphinxcontrib-programoutput commit fc4b8d6d7a712724f9bc60968bda751558932150 Author: Marcus Schäfer AuthorDate: Fri Apr 15 14:41:16 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 15 14:41:16 2016 +0200 Update volume_manager inline API documentation References #49 commit b7cf1aa30272dc0f61f04cbf41d22b014a78c27f Author: Marcus Schäfer AuthorDate: Fri Apr 15 11:58:44 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 15 11:58:44 2016 +0200 Update utils inline API documentation References #49 commit c1e3b2214c05b09102b2ca08fb92175b10db9eae Author: Marcus Schäfer AuthorDate: Fri Apr 15 11:43:17 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 15 11:43:17 2016 +0200 Update tasks inline API documentation References #49 commit ea42d733c6a82f33b1d3dfacabcb7f8a7b9876cc Author: Marcus Schäfer AuthorDate: Fri Apr 15 11:24:51 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 15 11:24:51 2016 +0200 Complete system inline API documentation References #49 commit 359a01615596487bb6db89bd7fe986707f176fcc Author: Marcus Schäfer AuthorDate: Fri Apr 15 10:35:19 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 15 10:35:19 2016 +0200 Use Path.wipe instead of directly calling rm commit 98b8018af193f6f66294b713ad2ec03435de955e Author: Marcus Schäfer AuthorDate: Fri Apr 15 10:34:00 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 15 10:34:00 2016 +0200 Update system inline API documentation References #49 commit 4855fd92be983bfddb0456b58d22c02a39bfeb8d Author: Marcus Schäfer AuthorDate: Fri Apr 15 09:34:12 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 15 09:34:12 2016 +0200 Update storage inline API documentation References #49 commit 4f5322f61805a5f5d945ccad660c0799ab049355 Author: Marcus Schäfer AuthorDate: Thu Apr 14 16:34:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 14 16:34:39 2016 +0200 Fixed typo commit 32c553bbd251291b428f2e7748fdf323fd3b729c Author: Marcus Schäfer AuthorDate: Thu Apr 14 15:38:31 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 14 15:38:31 2016 +0200 Cleanup use of partition id maps For the partition setup the Disk class uses dictionaries to map the partition name to the partition number. However there are public partition names such as 'kiwi_BootPart' and kiwi internal partition names such as 'boot'. The code should make it more clear which mapping table is used commit ceb904716ac0c5125a35c7ed6d131f54349381db Author: Marcus Schäfer AuthorDate: Thu Apr 14 14:57:11 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 14 14:57:11 2016 +0200 Update repository inline API documentation References #49 commit 22d1492775fc6fbaed284b857c679b9bade9f6d3 Author: Marcus Schäfer AuthorDate: Thu Apr 14 14:26:19 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 14 14:29:28 2016 +0200 Update partitioner inline API documentation References #49 commit b24f500549201dfabb193f75fee91b73508fd09a Author: Marcus Schäfer AuthorDate: Thu Apr 14 14:25:49 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 14 14:25:49 2016 +0200 Complete bootloader inline API documentation References #49 commit d13f1b3e7f5a62e45ccc561570e2bed52edc920a Author: Marcus Schäfer AuthorDate: Thu Apr 14 11:53:35 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 14 11:53:35 2016 +0200 Update README Add chapter about signing commits commit 4019043667d5a7f788b6a2408e9dc48de20b68d7 Author: Marcus Schäfer AuthorDate: Thu Apr 14 11:41:17 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 14 11:41:17 2016 +0200 Update README commit 364c737277b5b04fb8f1494550613fc8b2034fb4 Author: Marcus Schäfer AuthorDate: Thu Apr 14 11:36:27 2016 +0200 Commit: Marcus Schäfer CommitDate: Thu Apr 14 11:36:27 2016 +0200 Update README commit c5bcecc56a6f71c5f83e727aaf12094d7e181e33 Author: Marcus Schäfer AuthorDate: Wed Apr 13 17:52:12 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 13 17:52:12 2016 +0200 Update package_manager inline API documentation References #49 commit 2b8b5e91f3bc5544440acf9045d551170c1f6562 Author: Marcus Schäfer AuthorDate: Wed Apr 13 17:16:39 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 13 17:16:39 2016 +0200 Update filesystem inline API documentation References #49 commit 1a0f0a444228cfc4a629ea94e124795dff91c383 Author: Marcus Schäfer AuthorDate: Wed Apr 13 16:53:53 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 13 16:53:53 2016 +0200 Update container inline API documentation References #49 commit 9fd988f4e5acb36baf60cfec749fcb060416413c Author: Marcus Schäfer AuthorDate: Wed Apr 13 12:52:25 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 13 12:52:25 2016 +0200 Update builder inline API documentation References #49 commit 37ad6008aafd83c2726be8e0b259fc2bf8ad070d Author: Marcus Schäfer AuthorDate: Wed Apr 13 11:50:14 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 13 11:50:14 2016 +0200 Update bootloader/template inline API documentation References #49 commit e2966efe63aba9f1470c06bba4a7b52ac4803622 Author: Marcus Schäfer AuthorDate: Wed Apr 13 11:42:28 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 13 11:42:28 2016 +0200 Complete bootloader install interface commit 48695c61259b1e5457cdb4438fd1f71908a5e48c Author: Marcus Schäfer AuthorDate: Wed Apr 13 11:40:25 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 13 11:40:25 2016 +0200 Update bootloader/install inline API documentation References #49 commit 6e1b7c9c8857a6c650d5f8d5f3efd8d9bb91dc75 Author: Marcus Schäfer AuthorDate: Wed Apr 13 11:22:46 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 13 11:22:46 2016 +0200 Move get_failsafe_kernel_options to Defaults commit 71d03a32017749a58a39c832974b9df00c5edb2c Author: Marcus Schäfer AuthorDate: Wed Apr 13 11:15:56 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 13 11:15:56 2016 +0200 Update bootloader/config inline API documentation References #49 commit bc577bd758e2185e1ea94833cb7ce32482542d88 Author: Marcus Schäfer AuthorDate: Tue Apr 12 15:24:20 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 12 15:24:20 2016 +0200 Update boot/image inline API documentation References #49 commit f5de55229d021a0d157e1f93a0223fd749c080cb Author: Marcus Schäfer AuthorDate: Tue Apr 12 15:12:33 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 12 15:12:49 2016 +0200 Update archive inline API documentation References #49 commit 659fe9a79526925901b6d0607da3b6d5d9b9fe78 Author: Marcus Schäfer AuthorDate: Tue Apr 12 11:12:18 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 12 11:12:18 2016 +0200 Delete traces of zfs support commit d87685e717c0c050c051cedbff7e024ddef83e86 Author: Marcus Schäfer AuthorDate: Tue Apr 12 11:10:01 2016 +0200 Commit: Marcus Schäfer CommitDate: Tue Apr 12 11:11:00 2016 +0200 Update inline API documentation References #49 commit 3fc61acc961700b93c6a310634289a96f17e0d4d Author: Marcus Schäfer AuthorDate: Mon Apr 11 16:11:48 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 11 16:11:48 2016 +0200 Update inline API documentation commit e03a430f4ca3314225edcfe34a437c7e25d0ac00 Author: Marcus Schäfer AuthorDate: Mon Apr 11 16:02:29 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 11 16:02:29 2016 +0200 Update inline API documentation commit 486f12e426ea98bc0c38688580085efcdf28c23a Author: Marcus Schäfer AuthorDate: Mon Apr 11 15:42:13 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 11 15:42:13 2016 +0200 Update inline API documentation commit 8e6812dcf62b07340c05daeafd446c1886ddb155 Author: Marcus Schäfer AuthorDate: Mon Apr 11 15:09:26 2016 +0200 Commit: Marcus Schäfer CommitDate: Mon Apr 11 15:09:26 2016 +0200 Update inline API documentation commit 6468b7c8ab1015f7bdddda63549ae7c8355c9c0f Author: Marcus Schäfer AuthorDate: Sun Apr 10 22:47:52 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun Apr 10 22:51:20 2016 +0200 Ignore auto generated code for API docs commit 58861fdcc8ddf70d4969ccba41eaed1b23cd79af Author: Marcus Schäfer AuthorDate: Sun Apr 10 22:43:15 2016 +0200 Commit: Marcus Schäfer CommitDate: Sun Apr 10 22:51:20 2016 +0200 Update inline API documentation commit 9be138acc8ee4cb6a0d048d7662cdd9ee2c39c12 Author: Marcus Schäfer AuthorDate: Fri Apr 8 16:09:15 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 8 16:10:15 2016 +0200 Update api documentation setup commit b2552121f87c5d04d1f61bfbecc65bca8de64ea9 Author: Marcus Schäfer AuthorDate: Thu Apr 7 12:04:53 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 8 16:10:15 2016 +0200 Create Initial autodoc structure Called 'sphinx-apidoc -o source/api ../kiwi' commit 7e2a332a92bed2c45407894122220783f6c953d5 Author: Marcus Schäfer AuthorDate: Thu Apr 7 12:04:24 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 8 16:10:15 2016 +0200 Fixup docstring for kiwi/command.py commit 467d3ee54c3602a6ae743d75d3d428de27a76bb9 Author: Marcus Schäfer AuthorDate: Thu Apr 7 11:03:06 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 8 16:10:15 2016 +0200 Move manual page documentation in subdirectory Separate api documentation from manual pages commit 7fee187cf5feac24f4d1b3948fb4522cac4a464f Author: Marcus Schäfer AuthorDate: Thu Apr 7 10:16:40 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 8 16:10:15 2016 +0200 Update virtualenv development setup make sure we can build the docu in the development environment commit e0f2418984cb70086ba54dc093129426b1b91f07 Author: Marcus Schäfer AuthorDate: Wed Apr 6 16:16:48 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 8 16:10:14 2016 +0200 Add docstrings for Cli class References Issue #49 commit 54cf56b19466f26519af2c530ea7b9644ee47cdd Author: Marcus Schäfer AuthorDate: Fri Apr 8 11:48:05 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 8 11:50:01 2016 +0200 package kiwi-pxeboot must not be noarch We want to specify for which arch we provide it. Thus it's not allowed to specify it as noarch even though it provides only noarch data commit 8c32f4af004e0992d6631304da3ea3ae9194e16d Author: Marcus Schäfer AuthorDate: Wed Apr 6 11:02:59 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Apr 6 11:02:59 2016 +0200 Fixed ppc setup of etc/default/grub_installdevice On power grub must be installed into the Prep partition into the master boot record of the disk commit d8379ef4e2f0984c5594ff29dfa3c80df2c2b3a9 Author: Thomas Schraitle AuthorDate: Mon Apr 4 10:47:21 2016 +0200 Commit: Thomas Schraitle CommitDate: Mon Apr 4 10:47:21 2016 +0200 Add Python 3.5 to be consistent with Travis commit 8b3bd2054a730508142bf4c4185b8cab242946e0 Author: Marcus Schäfer AuthorDate: Sat Apr 2 23:27:14 2016 +0200 Commit: Marcus Schäfer CommitDate: Sat Apr 2 23:27:14 2016 +0200 Fixed logger unit test commit e68d61dc6b9afeecb411211b4c5f535d905ff113 Author: Marcus Schäfer AuthorDate: Fri Apr 1 22:50:00 2016 +0200 Commit: Marcus Schäfer CommitDate: Fri Apr 1 22:50:00 2016 +0200 Make color output an option By default no color output is used commit 5cbca6d461cc0f98255d731bb474748e924ce361 Author: Marcus Schäfer AuthorDate: Wed Mar 30 17:41:07 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Mar 30 17:41:07 2016 +0200 Added missing kiwi-packagemanager provides The buildservice looks up for a package manager capability commit 5f0cac443a595f01a529e315140393146d355b86 Author: Marcus Schäfer AuthorDate: Wed Mar 30 15:28:55 2016 +0200 Commit: Marcus Schäfer CommitDate: Wed Mar 30 15:28:55 2016 +0200 Fixed spec file syslinux is not a requirement for the base package commit 6161e202c32363b3a203a7a4ebd28b7f07278411 Author: Marcus Schäfer AuthorDate: Thu Mar 24 16:57:38 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 24 16:57:38 2016 +0100 Check for derived description path in prepare too commit 773033eebe9569665f1b3872a5e337c4478966c0 Author: Marcus Schäfer AuthorDate: Thu Mar 24 16:41:47 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 24 16:41:47 2016 +0100 Refactor SystemSetup class the information about the description_dir is part of the provided xml_state instance. There is no need to pass that information along twice commit cc8b18e4ea836713c527bcc9151b14eeb374ffc6 Author: Marcus Schäfer AuthorDate: Thu Mar 24 16:29:28 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 24 16:29:28 2016 +0100 Fixed use of derived_description_dir Only in import_description we need to check for both locations commit d8c8480fd4f4b1ca2a71d2123ef347fbb602fcb6 Author: Marcus Schäfer AuthorDate: Thu Mar 24 16:00:48 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 24 16:00:48 2016 +0100 Make sure import_description preserves archives commit f1c5531e248aacf37a87017db35cd6687936575e Author: Marcus Schäfer AuthorDate: Thu Mar 24 11:14:14 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 24 11:14:14 2016 +0100 Refactor InstallBootLoaderGrub2 constructor architecture dependant device setup belongs to the install method where it is actually needed. That prevents the construction of the instance to be architecture specific commit 535bff4010f2695e9a4c74693de202cfb5c0e191 Author: Marcus Schäfer AuthorDate: Wed Mar 23 17:41:13 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 17:41:13 2016 +0100 Make list of efi grub modules arch dependant commit c46f692397c00c4e0c36fd41b0290f8bf9c6a169 Author: Marcus Schäfer AuthorDate: Wed Mar 23 17:37:57 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 17:37:57 2016 +0100 Revert "Delete efi_uga module from list" This reverts commit 191d423eb571d3cc08f34b5e4ef15eb6296a6563. commit 191d423eb571d3cc08f34b5e4ef15eb6296a6563 Author: Marcus Schäfer AuthorDate: Wed Mar 23 17:03:31 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 17:04:29 2016 +0100 Delete efi_uga module from list commit 7ce8a3d8f57cc89137fee03ddca13922e9ac08db Author: Marcus Schäfer AuthorDate: Wed Mar 23 16:52:34 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 16:52:34 2016 +0100 add multiboot grub module only on demand multiboot is only needed for self build grub images in Xen guest mode commit 2a4aac0b4fb307e1557464f54f6652e9719be969 Author: Marcus Schäfer AuthorDate: Wed Mar 23 15:56:39 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 15:56:39 2016 +0100 Don't raise if kversion exits with error In this case a default value applies commit 0eef3d733694ba7ebcb8ea90c4dda3671b5ba5d9 Author: Marcus Schäfer AuthorDate: Wed Mar 23 15:19:31 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 15:19:31 2016 +0100 Activate partitioner support for arm commit 82ab918cb46e427535e44a39d318676ce8c08911 Author: Marcus Schäfer AuthorDate: Wed Mar 23 15:00:39 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 15:00:39 2016 +0100 Add optional derived_from param to XMLDescription An instance of XMLDescription can now optionally become constructed with a path to an image description this instance was derived from. This is currently used for building the kiwi boot image to tell the boot image XML description instance from which system image instance it was derived from commit 0eace0773c50b19cddacb70eb3ab05c753ab58f8 Author: Marcus Schäfer AuthorDate: Wed Mar 23 12:41:42 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 12:41:42 2016 +0100 Evaluate default video mode for iso images commit c43f226577628faaff64b99f31b8fbe69b37c122 Author: Marcus Schäfer AuthorDate: Wed Mar 23 12:13:04 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 12:13:04 2016 +0100 Added custom profile for arm/oemboot/suse-tumbleweed commit 9b1c2b83c38020d3b02af868e127a087d496a6ed Author: Marcus Schäfer AuthorDate: Wed Mar 23 12:08:32 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 12:08:32 2016 +0100 Update firmware types for arm architectures Add efi and uefi as allowed types, complete architecture name list set efi as default firmware for arm commit 9f0016956e7a8b126333215275a7af37322867cc Author: Marcus Schäfer AuthorDate: Wed Mar 23 11:08:38 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 11:10:40 2016 +0100 Added pre/post hooks for bootloader setup/install preInstallBootLoader, postInstallBootLoader preSetupBootLoader, postSetupBootLoader commit 3b5c937cd315199a647e286337b8a70f3d6522c4 Author: Marcus Schäfer AuthorDate: Wed Mar 23 09:23:56 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 23 09:23:56 2016 +0100 Fixed architecture dependant tests commit 08d39049bc3b2d61e26edbba1ec64bbb958abbe4 Author: Marcus Schäfer AuthorDate: Tue Mar 22 16:15:47 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 22 16:20:51 2016 +0100 Added support for virtual boot partition on arm Triggered by the firmware="vboot" setup an EFI setup plus a raw partition without filesystem is created as first partition. The size of the partition can be controlled by the vbootsize attribute. The vboot feature is used by the arm architecture to provide a space in the partition table for custom code as required by e.g the chromebook. The final customization of the vboot space is board specific and can't be implemented in a generic way in kiwi. For finalizing the vboot space the script hooks editbootconfig and editbootinstall can be used This is related to Issue #17 commit e98ab5f39eed8895e724ce0a1dab449cd275ab79 Author: Marcus Schäfer AuthorDate: Tue Mar 22 11:28:11 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 22 11:32:03 2016 +0100 Rename partition id kiwi_JumpPart to kiwi_EfiPart This makes it explicit for what purpose the partition is really used. EFI is not configured the same for all architectures but what is consistent is that on this partition an efi image is located to become loaded by some firmware commit 3a021594b3bfc415d694f9370bce2fc2648620a4 Author: Marcus Schäfer AuthorDate: Tue Mar 22 10:17:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 22 10:28:25 2016 +0100 Activate boot partition only for msdos tables commit 2229072b275fa0336e5cfef3c06938b1687377a0 Author: Marcus Schäfer AuthorDate: Tue Mar 22 09:55:28 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 22 10:28:25 2016 +0100 have tar preserve all xattrs By default tar will only preserve a subset of the capabilities with --xattrs. Adding --xattrs-include=* should preserve all capabilities (e.g. user.*, security.capability etc.). commit e08b74f3eee5e5eb91ffac967e2bbd0754aa1add Author: Marcus Schäfer AuthorDate: Tue Mar 22 09:18:14 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 22 10:28:05 2016 +0100 Preserve hybrid GPT status on boot Added createHybridGPT method and setup the hybrid GPT/MBR table if requested by the XML configuration. In addition move the partition activation call also into the partition table finalize method. This is related to Issue #17 commit 848c5144fb84fa29ea887216edaf3d5d5c16a565 Author: Marcus Schäfer AuthorDate: Mon Mar 21 17:16:45 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 21 17:17:05 2016 +0100 Refactor partition table setup code Added two methods preparePartitionTable and finalizePartitionTable which are used to prepare the partition table to allow resizing and to finalize for partition flags after resizing. This replaces the updatePartitionTable method commit a5015dedcede7496d6d6011c9d59682ff8747101 Author: Marcus Schäfer AuthorDate: Mon Mar 21 11:39:46 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 21 12:41:51 2016 +0100 Delete obsolete GPT fixup code Related to bnc#825221 code was added to recreate the disk with a new GPT label. The reason was that parted created a gpt_sync_mbr partition table when kiwi repartitioned the disk to use the full geometry. This was an unwanted behavior by parted and causes the additional code in kiwi. The current parted version behaves correctly and thus makes this additional code obsolete commit f954861f896eaeff9a89520c72269583731121ee Author: Marcus Schäfer AuthorDate: Fri Mar 18 15:46:56 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 21:41:14 2016 +0100 Added support for hybrid GPT Embedding an MBR into a GPT is required for a collection of boards, e.g arm rapberry PI. The kiwi configuration provides a new attribute called AuthorDate: Fri Mar 18 11:16:52 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 11:21:06 2016 +0100 Update all XML descriptions to schema v6.3 commit 545421f3ab498ff11185c0236f99f91aeeeda90a Author: Marcus Schäfer AuthorDate: Fri Mar 18 11:15:58 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 11:21:06 2016 +0100 Added make valid target to Makefile make valid applies the latest XSLT processing to the boot and test image descriptions commit 9c0d36a2b956cbd8d563ecb84da2823f88598d91 Author: Marcus Schäfer AuthorDate: Fri Mar 18 11:03:15 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 11:21:06 2016 +0100 Added XSL stylesheet convert62to63.xsl auto convert from schema v6.2 to v6.3 commit 73ef1e583386bd7e4398f8e6b7d4119908c6559f Author: Marcus Schäfer AuthorDate: Fri Mar 18 11:01:49 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 11:21:06 2016 +0100 Update schema to version 6.3 - Deleted obsolete split section - Deleted zfsoptions, fsreadwrite and fsreadonly attributes - Updated allowed values for bootloader and filesystems commit 8217431c7eb0172b37c15f6e0b3772cb4af8ae1a Author: Marcus Schäfer AuthorDate: Fri Mar 18 10:28:47 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 10:28:47 2016 +0100 Delete obsolete support for syslinux(extlinux) grub2 or the architecture specific loader requirement is supported but the alternative x86 loaders syslinux/extlinux were not really used commit bb412e94cfbd6ff451e083b740a9ddc9c9a5b75c Author: Marcus Schäfer AuthorDate: Fri Mar 18 10:23:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 10:23:07 2016 +0100 Delete obsolete support for uboot arm boot is using grub2 efi images loaded by a firmware. The firmware could be uboot but due to the non generic way to setup the board that it loads the firmware all of these tasks are handled by custom scripts called via the kiwi editbootconfig / editbootinstall script hooks. Therefore kiwi itself does not have to setup or install uboot commit 514c1b6f348df84818acaa829c9a8f3c5a15b614 Author: Marcus Schäfer AuthorDate: Fri Mar 18 10:20:27 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 10:20:27 2016 +0100 Delete obsolete support for yaboot grub2 is used for ppc64 platforms, so far no older ppc platform is supported commit b1b73b4f072a104f11b76b8dfe2d9367a5fc274a Author: Marcus Schäfer AuthorDate: Fri Mar 18 10:15:08 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 10:15:08 2016 +0100 Delete obsolete kernelCheck method commit a9a4f8d4f816d8b7bf11a9c9dacbcd26bf4fb35b Author: Marcus Schäfer AuthorDate: Fri Mar 18 10:12:13 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 10:12:13 2016 +0100 Delete obsolete support for legacy grub commit 134b6658a771da75259251da2bd92e50e9bc5ea8 Author: Marcus Schäfer AuthorDate: Fri Mar 18 09:59:45 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 09:59:45 2016 +0100 Delete obsolete support for split(combined) image commit 6d2ff2c00eb68a9484acbaaaa5dbbfd23ee32738 Author: Marcus Schäfer AuthorDate: Fri Mar 18 09:30:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 09:30:55 2016 +0100 Delete obsolete support for reiserfs commit e0515ada76c45f710bb0a3423eeeedc57f2d1d42 Author: Marcus Schäfer AuthorDate: Fri Mar 18 09:27:53 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 09:27:53 2016 +0100 Delete support for ZFS filesystem btrfs is the way to go these days and zfs still has some proprietary bits in it commit 015f268f9df611427880509156049079f7c6736b Author: Marcus Schäfer AuthorDate: Fri Mar 18 09:23:15 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 09:23:15 2016 +0100 Avoid the copy of the kiwi initrd to /run the kiwi initrd copies itself to /run/initramfs in order to have a way to jump into the initrd system from the later system. However the kiwi initrd is unpacked pretty big and exists also only for the very first boot. commit 4b684749a4f16a5b10b0439b3dc1e4afceb75072 Author: Marcus Schäfer AuthorDate: Fri Mar 18 08:58:40 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 18 08:58:40 2016 +0100 Execute haveged in udevStart if fips is enabled This ensure there is at least a source of entropy for /dev/random when the fips mode is enabled. Without it, VMware virtual machines hang at boot (bnc#964204) commit b9eb921b503824444223ca98286904214f83d1e7 Author: Marcus Schäfer AuthorDate: Thu Mar 17 16:31:53 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 17 16:31:53 2016 +0100 Fixed use of dracut initrd system for arm platform commit 19f6ad921e79a3e661182d2a0d491b0851c0a69d Author: Marcus Schäfer AuthorDate: Thu Mar 17 16:07:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 17 16:07:55 2016 +0100 Added EFI images name for 32bit arm architectures commit e246e72a52332123fb22edbdec243cd9c648e2f0 Author: Marcus Schäfer AuthorDate: Thu Mar 17 10:42:08 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 17 10:42:08 2016 +0100 Refactor data subpackage Move from data to utils, data is generally considered as text data and not code commit c4c3c7054f89c4f31a561610f0c8eca3e141090e Author: Marcus Schäfer AuthorDate: Wed Mar 16 17:31:46 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 16 17:31:46 2016 +0100 Fixed 32bit x86 builds Put it all under the ix86 namespace commit f97dbf6fda25d238bf6ab00e3356e20847437a03 Author: Marcus Schäfer AuthorDate: Wed Mar 16 12:57:25 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 16 12:57:25 2016 +0100 Refactor grub2 EFI support EFI support was target specific to the x86_64 architecture This commit changes the structure to allow more architectures supporting EFI. Thus the arm64 EFI support has been added as a plus commit 40a54683011b87f1a7db03a6773c7aa3a1f6595e Author: Thomas Schraitle AuthorDate: Mon Mar 14 12:57:01 2016 +0100 Commit: Thomas Schraitle CommitDate: Mon Mar 14 12:57:01 2016 +0100 Add {toxinidir} variable for check target commit 4404be06b9c0fa711e1e9bfc907035bfc70c55e5 Author: Marcus Schäfer AuthorDate: Mon Mar 14 12:35:16 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 14 12:35:16 2016 +0100 Delete nose reference from virtualenv setup commit e6cc5bfa09162469e31d7ea81e307d8476ce9c38 Author: Marcus Schäfer AuthorDate: Mon Mar 14 09:55:29 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 14 12:23:14 2016 +0100 Move from nose to pytest nose is no longer maintained, thus we have to move to another testing system. This commit updates the tox setup and all tests to use pytest instead of nose. commit ed4098da3c065ef639aa1fde7429e15c06db0885 Author: Marcus Schäfer AuthorDate: Mon Mar 14 11:04:34 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 14 11:04:34 2016 +0100 Prevent file duplicate badness in spec file commit 0983e64f2dfde38ee8b1c7bb33b4d03ed0aa22ec Author: Marcus Schäfer AuthorDate: Mon Mar 14 10:28:12 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 14 10:28:12 2016 +0100 Revert "Added pv kernel profile" There is no kernel-pv This reverts commit f0c37709e941e18a1f9b963811a85bd772ee96ac. commit d7e364e50b97833cb677f4fe406d36e05b913e13 Author: Marcus Schäfer AuthorDate: Fri Mar 11 16:23:24 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 11 16:23:24 2016 +0100 Fixed boot mount path at grub2 install commit abfd0bf57e7324d5252e308972904acf6f72e629 Author: Marcus Schäfer AuthorDate: Fri Mar 11 16:11:57 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 11 16:11:57 2016 +0100 Revert "Revert "Call shim-install with --removable"" Try again using --removable for shim-install This reverts commit e3d7d0239d58e901e7d61e215317b93cf0ee1bfb. commit cc5638faa80b1255a096ee3d7663e19062b1335b Author: Marcus Schäfer AuthorDate: Fri Mar 11 16:09:54 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 11 16:09:54 2016 +0100 Fixed normalizing paths between host and image commit e3d7d0239d58e901e7d61e215317b93cf0ee1bfb Author: Marcus Schäfer AuthorDate: Fri Mar 11 15:30:00 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 11 15:30:00 2016 +0100 Revert "Call shim-install with --removable" With --removable shim-install does not work for image building This reverts commit d03baa9ee1d0ff44c76afadfc388791b1c5d29fa. commit f0c37709e941e18a1f9b963811a85bd772ee96ac Author: Marcus Schäfer AuthorDate: Fri Mar 11 15:12:21 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 11 15:12:21 2016 +0100 Added pv kernel profile commit e4ff01ea7a994c88358718b402d1b26ab32a170b Author: Marcus Schäfer AuthorDate: Thu Mar 10 15:01:30 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 10 15:01:30 2016 +0100 Add handling for OPAL firmware setup on ppc64 This adds a capability of creating an image for Bare metal POWER platform, where firmware parses grub2.cfg and simply kexecs into an image kernel commit d02bdc18b9d6d9dfb2f9599a280b8a734397300d Author: Marcus Schäfer AuthorDate: Thu Mar 10 14:36:35 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 10 14:36:35 2016 +0100 Refactor FirmWare class provide a default firmware for each supported architecture Avoid special sauce in the FirmWare constructor commit c2e70734565fdee28941c9b9d8e99775da3bd51e Author: Marcus Schäfer AuthorDate: Thu Mar 10 14:23:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 10 14:23:55 2016 +0100 Adding opal firmware type for ppc64 architectures commit e6d8483cc360e5f54f95d1719c284e3f01142131 Author: Thomas Schraitle AuthorDate: Thu Mar 10 13:33:50 2016 +0100 Commit: Thomas Schraitle CommitDate: Thu Mar 10 13:33:50 2016 +0100 First draft of issue#43 Add templates for contributing, issue, and pull requests commit d03baa9ee1d0ff44c76afadfc388791b1c5d29fa Author: Marcus Schäfer AuthorDate: Thu Mar 10 11:29:28 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 10 11:29:28 2016 +0100 Call shim-install with --removable The --removable is to prevent shim-install from writing host's uefi boot entry by pretending itself as removable disk commit 8fb633257b849e1d8dd4c27c68685cdc82047916 Author: Marcus Schäfer AuthorDate: Wed Mar 9 18:33:16 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 9 18:33:16 2016 +0100 Delete obsolete shim setup code from kiwi Due to the use of shim-install the code in kiwi to setup for secure boot is no longer needed commit 1e9b6dd9d62e406fd77ca91482d9d25ad7383f4f Author: Marcus Schäfer AuthorDate: Wed Mar 9 18:11:34 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 9 18:12:38 2016 +0100 Use shim-install to setup EFI secure boot commit 349d1a33873c66a36b93a606fc1a716e08f713c1 Author: Marcus Schäfer AuthorDate: Wed Mar 9 12:16:04 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 9 12:16:04 2016 +0100 Fixed completion generator Some global options were missing commit 161a8b3f64c46453b84f0555e1119fe514fea73f Author: Marcus Schäfer AuthorDate: Wed Mar 9 10:29:13 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 9 10:29:13 2016 +0100 Update README Fixed pyvenv call to use python3 commit d03b392213d8e2214f4c29f9a42d63889e168e71 Author: Marcus Schäfer AuthorDate: Wed Mar 9 10:26:58 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 9 10:26:58 2016 +0100 Update README style fixes commit 5616f72a7eb368e01ea23b5895ed2977b82d2292 Author: Marcus Schäfer AuthorDate: Wed Mar 9 10:25:33 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 9 10:25:33 2016 +0100 Update README Fixed url to packages on the buildservice commit b61ee7ce3b4552c5ef2c92caf0c2d8e5b7da555e Author: Marcus Schäfer AuthorDate: Wed Mar 9 10:13:52 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 9 10:13:52 2016 +0100 Update README Be more clear about semantic versioning as documented here: http://semver.org/ commit 39d08c35f3c4605c973af04ba819b6167855f526 Author: Marcus Schäfer AuthorDate: Wed Mar 9 10:04:44 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 9 10:05:47 2016 +0100 Continue Refactor into subpackage Move container_setup from toplevel into container.setup commit 8fc71a4e346fec514dbfa6f78ce1f20840bd5f70 Author: Marcus Schäfer AuthorDate: Tue Mar 8 16:40:06 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 8 16:40:06 2016 +0100 Fixed completion generator The generated completion code was confused by the -py3 in the program name if used with kiwi-py3 commit 1ab40fa33a4ebd199f94b1cb0df4c73e7e394d97 Author: Marcus Schäfer AuthorDate: Tue Mar 8 16:21:00 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 8 16:21:00 2016 +0100 Continue Refactor into subpackage Move task classes into tasks namespace commit dbd20e8ba308ded843c354149e130391cc7bbfbd Author: Marcus Schäfer AuthorDate: Tue Mar 8 15:20:23 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 8 15:21:19 2016 +0100 Move storage and subformat tests to match namespace commit b3c8d071de214c8cecff36f7447b852ae420abb6 Author: Marcus Schäfer AuthorDate: Tue Mar 8 15:15:08 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 8 15:15:08 2016 +0100 Move builder test cases to match namespace commit b4197d33a43320f6d44c723131c3a14a11e41def Author: Marcus Schäfer AuthorDate: Tue Mar 8 15:09:54 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 8 15:11:13 2016 +0100 Continue Refactor into subpackage Move DataSync, Checksum and Compress into the data namespace commit aa6d327a27098cb7da779d823c6ada9e58b350d2 Author: Marcus Schäfer AuthorDate: Tue Mar 8 14:53:56 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 8 14:53:56 2016 +0100 Continue Refactor into subpackage Move Kernel class to system namespace commit 24c27b8a97608dc36d58f0b18f4a117a7a2c4bd3 Author: Dinar Valeev AuthorDate: Thu Feb 25 23:48:33 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 8 11:54:09 2016 +0100 Add support for POWER architecture Implements requirements for the partition and bootloader setup in order to build images for ppc64 architectures. Fixes #18 commit 31d868ffe66ae8ae85d9aa95e687ef57f441f9fc Author: Marcus Schäfer AuthorDate: Mon Mar 7 17:35:32 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 7 17:35:32 2016 +0100 Package new system namespace commit 612c57414826a3e4a030a62ee93d6f3e20eaeb97 Author: Marcus Schäfer AuthorDate: Mon Mar 7 17:33:39 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 7 17:33:39 2016 +0100 Continue Refactor into subpackage system install, update, size, users, result should have their own namespace commit 80bb7c5e78556e245e5ba97b58739dc237670e50 Author: Marcus Schäfer AuthorDate: Mon Mar 7 12:04:56 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Mar 7 12:11:15 2016 +0100 Consolidate all rsync calls into DataSync class commit f5da3dd11721dd5ba2025f2120b3665193cad564 Author: Marcus Schäfer AuthorDate: Sun Mar 6 14:38:39 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Mar 6 14:38:39 2016 +0100 Release mount after data sync for volume managers commit ec92ffdba194820d5b1d6e299672bcac5aaba3c4 Author: Marcus Schäfer AuthorDate: Fri Mar 4 17:20:48 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 4 17:20:48 2016 +0100 Fixed LVM volume setup for oem image type For the oem image type the requested volume sizes are applied on first boot of the appliance. Therefore inside of the image the volumes only needs to be created with their minimum required size commit 96079ecaf6f4bacc073a3593b777f660c3ed36a2 Author: Marcus Schäfer AuthorDate: Fri Mar 4 16:38:21 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 4 16:38:21 2016 +0100 Refactor use of kiwi_LVM_ profile variables Reduce code duplication and encapsulate the reading of the data from the profile into a readVolumeSetup function. This is related to Issue #39 commit 49aaa59bf0cfd4fcddee70bfdcbd5501d1a8bc82 Author: Marcus Schäfer AuthorDate: Fri Mar 4 10:01:53 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Mar 4 10:01:53 2016 +0100 Preserve extended attributes in tar archives tar doesn't preserve extended attributes by default, causing Docker images to not have any correct set-capabilities bits set on binaries such as ping. This is fixed by adding the --xattrs flag to the tar command commit 3c3ad79cfdf8bd22214fa6e0999166c0f927079a Author: Marcus Schäfer AuthorDate: Thu Mar 3 11:20:15 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 3 11:20:15 2016 +0100 Sort output from helper/kiwi-boot-packages commit a2bfb6c48ddf1387f546520d1951da65c4661d8d Author: Marcus Schäfer AuthorDate: Thu Mar 3 11:05:42 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Mar 3 11:05:42 2016 +0100 Fixed gce disk format The order of the files in the tarball is important. The first entry must be the manifest.json followed by disk.raw. In addition the style of the manifest.json has been adapted too. A space after colon seems to be required for gce to accept the data commit 00fb222bc3a08475133ca0da10d68404b71a1e48 Author: Marcus Schäfer AuthorDate: Wed Mar 2 21:38:02 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 2 21:38:02 2016 +0100 Fixed kernel names for dracut initrd system If dracut is used as initrd system we should not use the kiwi one shot names linux.vmx, initrd.vmx but stick with the official naming convention for kernel and initrd which is kernel-, initrd- commit 0597bee5ba3012b11a15a35b1ecf4cbda7d69166 Author: Marcus Schäfer AuthorDate: Wed Mar 2 21:35:14 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Mar 2 21:35:14 2016 +0100 Skip local repos if they don't exist Instead of raising an exception if a local repository does not exist, we will continue with a warning message. This is needed for a flawless integration with the buildservice. Inside of a buildservice environment only those repos are setup from which packages were taken. Thus it can happen that a configured repository does not exist in the buildservice build environment if the resolver would not take any package from this repository. kiwi should not fail to build such an image commit ecc351a6b9e1a87985820aac74974111d7419559 Author: Marcus Schäfer AuthorDate: Tue Mar 1 12:09:29 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 1 12:09:29 2016 +0100 Avoid lvcreate to ask for wiping swap signature When kiwi creates the logical volume for the swap space and there is already a swap signature at the place on disk, lvm stops and asks what to do with it. This should be generally avoided at that stage in the boot process Fixes (bnc#968601) commit 0fbaf0fdc36904e5e374f63073d502d3b73a4a51 Author: Marcus Schäfer AuthorDate: Tue Mar 1 11:34:03 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Mar 1 11:34:03 2016 +0100 Calculate checksum in chunks commit dfd9fea4109465ce0e2180df50275a916aa5c769 Author: Marcus Schäfer AuthorDate: Mon Feb 29 21:36:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 21:36:55 2016 +0100 Don't prevent an oem image from a custom disk size An oem disk ist a self expandable disk and thus it normally doesn't make sense to specify a disk size for it. However there are filesystems like btrfs which are very hard to precalculate a minimum required disk space for X bytes of data. In this situation a user should have the opportunity to specify a size commit 48ca3ae500f2030c5a7156b7eca71e9ca25f2713 Author: Marcus Schäfer AuthorDate: Mon Feb 29 21:23:31 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 21:23:31 2016 +0100 Don't call dracut in background from kiwi initrd This was useful to speedup the boot but opens a potential race condition if a reboot happens while dracut is still processing. With the last extension to use dracut as initrd system people now have the choice what fits their needs better and this allows us to revert the background call commit d0fa83681f0043e01aceb381357d83b483c0ffcc Author: Marcus Schäfer AuthorDate: Mon Feb 29 20:52:25 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 20:52:25 2016 +0100 Added support for using dracut initrd As of today only the kiwi initrd could be used with an image build. This commit adds a new initrd_system attribute and allows to select between kiwi and dracut as initrd system. Please note the dracut initrd does not support all features of the kiwi initrd. This fixes #25 commit 45ae3bda450c5ebfb37b592a05fdcfab6850a35b Author: Marcus Schäfer AuthorDate: Mon Feb 29 15:03:28 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 15:03:28 2016 +0100 Add a feature drop list to the README commit 242376b57a41bd78185e0325e2c7b58e58dcdf42 Author: Marcus Schäfer AuthorDate: Mon Feb 29 14:47:35 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 14:47:35 2016 +0100 update MANIFEST.in due to structure changes commit 61fe301ad96bcd170a2a28f19ebfd7e2a4125976 Author: Marcus Schäfer AuthorDate: Mon Feb 29 11:57:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 11:57:55 2016 +0100 Update README Use the real executable name for the documentation commit f644d39a2f30655f62534c35ec8365c1ab1bf02d Author: Marcus Schäfer AuthorDate: Mon Feb 29 11:37:27 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 11:37:27 2016 +0100 Continue Refactor into subpackage storage operations should have their own namespace commit 10a036932f702002798728a81af464754d6a431e Author: Marcus Schäfer AuthorDate: Mon Feb 29 11:02:58 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 11:02:58 2016 +0100 Continue Refactor into subpackage container and container_setup should have their own namespace commit 043efcbbe97c3eb58e6e95b0e5e42b839aef65de Author: Marcus Schäfer AuthorDate: Mon Feb 29 10:43:28 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 10:43:28 2016 +0100 Continue Refactor into subpackage disk namespace init is not a factory, thus the Disk class should have its own namespace. We choose disk.storage commit b43a12bd83f2c2b06907b9dff8ab0e9539df243e Author: Marcus Schäfer AuthorDate: Mon Feb 29 10:38:08 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 10:38:08 2016 +0100 Continue Refactor into subpackage rename dformat to subformat commit 1e21da7201e2d84ffab0a3d8e39e7bcae033c4c3 Author: Marcus Schäfer AuthorDate: Mon Feb 29 10:32:01 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 10:32:01 2016 +0100 Continue Refactor into subpackage The builder classes should have their own namespace commit 82d36ab060490a986d00d3530dd6e662373ae68a Author: Marcus Schäfer AuthorDate: Mon Feb 29 09:29:20 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 29 09:29:20 2016 +0100 Fixed update alternative setup for kiwi completion kiwi itself is provided as update alternative for kiwi-py3 Thus the completion should be based on kiwi-py3 commit 45bc5a03a7c6c14b16b914bb356a8c36eafc50fa Author: Thomas Schraitle AuthorDate: Fri Feb 26 20:40:12 2016 +0100 Commit: Thomas Schraitle CommitDate: Sat Feb 27 10:31:31 2016 +0100 Refactor into subpackage to fix #23 Codecoverage are 100% and tests are green Changes: * Refactor archive_*.py -> archive subpackage * Refactor partitioner_*.py -> partitioner subpackage * Refactor package_manager_*.py -> package_manager/ subpackage * Refactor bootloader_config*.py -> bootloader/config/ subpackage * Refactor bootloader_template*.py -> bootloader/template/ subpackage * Refactor bootloader_install*.py -> bootloader/install/ subpackage * Refactor repository*.py -> repository/ subpackage * Refactor filesystem*.py -> filesystem/ subpackage * Refactor dist_*.py -> dist/dformat subpackage The name `dformat` as package name is needed to avoid any name conflicts with the built-in function `format`. * Refactor volume_manager*.py -> volume_manager/ subpackage * Refactor boot_image*.py -> boot/image/ subpackage commit 1ea142f2ebb20a07da4fec2bb14d7ff2e20182c0 Author: Thomas Schraitle AuthorDate: Fri Feb 26 20:00:40 2016 +0100 Commit: Thomas Schraitle CommitDate: Fri Feb 26 20:00:40 2016 +0100 Remove unecessary Travis requirements commit 18b5a0f04bbaa71503c4e8dd1e9f65d5084c3a7d Author: Thomas Schraitle AuthorDate: Fri Feb 26 19:58:30 2016 +0100 Commit: Thomas Schraitle CommitDate: Fri Feb 26 19:58:30 2016 +0100 Fix check target Didn't have a basepython line, fixed strange tox error commit 98f2cd47c604d402f7af3b1d40aa56a49c4eab67 Author: Thomas Schraitle AuthorDate: Fri Feb 26 19:49:06 2016 +0100 Commit: Thomas Schraitle CommitDate: Fri Feb 26 19:52:52 2016 +0100 Enhanced Contributing, add new Developing section * Create a procedure in section Contributing * Add new Developing section to describe how to use tox commit 0d38e7e199c97cbb16a246c1ea1529c57c142548 Author: Marcus Schäfer AuthorDate: Fri Feb 26 17:13:37 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 26 17:13:37 2016 +0100 Fixed device map for VolumeManagerBtrfs The return value from get_device must be a map containing an instance of a DeviceProvider, not only the DeviceProvider commit 04764a42df045a1caec102f7f0f9532ec4682e2a Author: Marcus Schäfer AuthorDate: Fri Feb 26 16:39:24 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 26 16:50:31 2016 +0100 Refactor use of mount/umount calls Provide a MountManager class and handle all mount/umount calls in instances of MountManager commit a888de2b770f1336e39d3e29ee5396f0b57ca1b8 Author: Thomas Schraitle AuthorDate: Wed Feb 24 13:13:21 2016 +0100 Commit: Thomas Schraitle CommitDate: Fri Feb 26 11:36:06 2016 +0100 Use tox in .travis.yml, remove .travis.script commit 31bffb7b3dcb4bb0546b2b1ded6bf42eeedacbf7 Author: Marcus Schäfer AuthorDate: Fri Feb 26 09:31:26 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 26 09:31:26 2016 +0100 Don't write grub.cfg to EFI directory Originally the file was written there as reference, but nothing will ever update that file if the real grub configuration changes. Thus it doesn't make sense to provide this information (bnc#968270) commit 147c0706eb6bd7d3b980bc366fdf637471e2e424 Author: Marcus Schäfer AuthorDate: Thu Feb 25 17:18:31 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 25 17:18:31 2016 +0100 Refactor grub2 bootloader installation Make use of grub2-install to install the bootloader commit f43546fd595ba0e5fb5621256ccc36b7007628f7 Author: Marcus Schäfer AuthorDate: Thu Feb 25 10:12:39 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 25 10:12:39 2016 +0100 Changed debug log in case of failed command Also log the stdout data from a failed command. So far we expected error data on stderr but there are also commands which print error messages on stdout. It should us at least worth a debug message with this information commit 9c2b77e0b5e5407004a258d69a8df1a40440b3b8 Author: Marcus Schäfer AuthorDate: Wed Feb 24 12:09:09 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 24 12:09:09 2016 +0100 Fixed helper/kiwi-boot-packages Take care for packages marked for a specific architecture commit 066ad4d8de21759c4d1793cfedd969b7192c915b Author: Marcus Schäfer AuthorDate: Wed Feb 24 11:49:31 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 24 11:49:31 2016 +0100 Delete unused helper/run-pep8 commit 9e597e6a53deaf07b62d83c4cca7f30bb0de5c0d Author: Marcus Schäfer AuthorDate: Wed Feb 24 11:47:21 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 24 11:47:21 2016 +0100 Adapt make flake target to changed tox target commit e48a3082282d7176f567717dd35972bc13b9143c Author: Thomas Schraitle AuthorDate: Wed Feb 24 11:38:31 2016 +0100 Commit: Thomas Schraitle CommitDate: Wed Feb 24 11:38:31 2016 +0100 Add --cover-min-percentage=100 and helper script commit ea4e815eb6fb213bad1774a3eac4cdda8bc4ee63 Author: Marcus Schäfer AuthorDate: Wed Feb 24 11:28:02 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 24 11:28:02 2016 +0100 Fixed spec file for kiwi-boot-requires The meta package for the buildservice has to require the new python3-kiwi package commit 96f52b5b143c855232c951850a1b83e7c35246a0 Author: Thomas Schraitle AuthorDate: Wed Feb 24 11:22:58 2016 +0100 Commit: Thomas Schraitle CommitDate: Wed Feb 24 11:22:58 2016 +0100 Use --cover-min-percentage=100 instead of coverage commit 4929c206aa0262e2551890afc888ba790cc439a9 Author: Thomas Schraitle AuthorDate: Wed Feb 24 11:11:34 2016 +0100 Commit: Thomas Schraitle CommitDate: Wed Feb 24 11:11:34 2016 +0100 Replace helper/coverage-check with coverage Use --fail-under=99 option which fails for tests under 100% commit 8c8fc6bf87d45f3a1af1dc306df0839a4d7df770 Author: Marcus Schäfer AuthorDate: Wed Feb 24 10:59:52 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 24 11:00:54 2016 +0100 keep packages in yum cache commit 3bcc90ad7adfb9751d814d691936408e39222da0 Author: Thomas Schraitle AuthorDate: Wed Feb 24 10:53:29 2016 +0100 Commit: Thomas Schraitle CommitDate: Wed Feb 24 10:53:29 2016 +0100 Rename flake -> check, move spell * Move spell target/step to doc.spell * Call doc.spell in the doc target/step * Rename flake to check (to make it independant of any tool) commit 5de6fd5781a866ffcebea582fcccfb915ef2e347 Author: Marcus Schäfer AuthorDate: Wed Feb 24 10:37:00 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 24 10:37:00 2016 +0100 Spelling fixes commit bd0449bc4957b14384e396df68223b38e1ccd694 Author: Marcus Schäfer AuthorDate: Wed Feb 24 10:20:36 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 24 10:24:08 2016 +0100 Tox setup updates Integrate with Makefile, delete pep8 target from Makefile, use flake8, update travis script, delete coverage reference, we want 100% anywhere commit a0102cddbfe262a35a7ebe5ed5f4a452bdddebd6 Author: Marcus Schäfer AuthorDate: Wed Feb 24 10:13:43 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 24 10:13:43 2016 +0100 Fixed raid_device_test The test did not mock os.path.exists and thus could fail on systems which uses a raid system commit a3de628ac6ec5fa618b47e2b24aff03c655d8266 Author: Thomas Schraitle AuthorDate: Wed Feb 24 08:24:32 2016 +0100 Commit: Thomas Schraitle CommitDate: Wed Feb 24 08:24:32 2016 +0100 Update word list commit 0b751fe5138587af6df6038cec3f5383c93a619c Author: Thomas Schraitle AuthorDate: Tue Feb 23 20:58:34 2016 +0100 Commit: Thomas Schraitle CommitDate: Tue Feb 23 21:11:33 2016 +0100 Remove empty line to avoid error message Avoid following error message: CRITICAL **: enchant_is_title_case: assertion `word && *word' failed commit cb579a822bfb2ad98b3f7131d9e0ad1b5db08e8f Author: Thomas Schraitle AuthorDate: Tue Feb 23 20:58:12 2016 +0100 Commit: Thomas Schraitle CommitDate: Tue Feb 23 20:58:12 2016 +0100 Activate personal spellchecking dictionary commit 0d614529e72bce5dc3f39b620e3d6a835f118e04 Author: Marcus Schäfer AuthorDate: Tue Feb 23 16:53:02 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 23 16:53:02 2016 +0100 Open travis check for all branches commit 6fe0205f0aa1de3037f1234f9fb64f613b798e55 Author: Marcus Schäfer AuthorDate: Tue Feb 23 16:29:35 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 23 16:29:35 2016 +0100 Added kiwi-filesystem provides to spec template The main python3-kiwi package provides support for these filesystem image types commit a9d0eddd89e36a1960d2d8d2e8dfa97810de67ef Author: Thomas Schraitle AuthorDate: Tue Feb 23 15:42:02 2016 +0100 Commit: Thomas Schraitle CommitDate: Tue Feb 23 15:57:56 2016 +0100 Integrated Tox * First incarnation of tox.ini * Extend MANIFEST.in * Add doc/requirements.txt * Extend conf.py with 'sphinxcontrib.spelling' extension * Add wordlist to doc/source/spelling_wordlist.txt * Add flake8 section in setup.cfg commit 9c2c868889069d1be8ab76768166c40a99e78074 Author: Marcus Schäfer AuthorDate: Tue Feb 23 14:38:31 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 23 14:38:31 2016 +0100 Fixed cmdline lookup Only check contents of cmdline if it is not None commit 0eeb37bf2e7019a64f203f21fdc7b82a84a71a77 Author: Marcus Schäfer AuthorDate: Tue Feb 23 12:38:27 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 23 12:38:27 2016 +0100 No fdupes checking required anymore commit ef2fca16c14f619b856cf76c58a8e371bef9a309 Author: Marcus Schäfer AuthorDate: Tue Feb 23 12:25:37 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 23 12:25:37 2016 +0100 Don't track root/usr/share/locale in boot images The data there is now generated by the make po target commit 3bdaaa9f2d485285ec34639b6796d5822413728a Author: Marcus Schäfer AuthorDate: Tue Feb 23 12:01:03 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 23 12:01:03 2016 +0100 Fixed fuzzy i18n for en_US/LC_MESSAGES/kiwi.po commit 8cb70923d0294cb1ba753069296278a941b05fde Author: Marcus Schäfer AuthorDate: Tue Feb 23 11:32:36 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 23 11:32:36 2016 +0100 Added kiwi-image provides to spec template The main python3-kiwi package provides support for these image types. commit 221d937d02d10ae457bd25fcc4ea0b14325d2869 Author: Marcus Schäfer AuthorDate: Tue Feb 23 09:50:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 23 09:50:55 2016 +0100 Prevent any output if quiet is set If exec >/dev/null is run before setterm clears the screen, then "Failed to find cpu0 device node" is displayed even if quiet is set. commit 61fc3b5836390bb2adeac93e1a08d0cfd57f5684 Author: Marcus Schäfer AuthorDate: Tue Feb 23 08:55:13 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 23 08:56:27 2016 +0100 Fixed shell syntax in grub2 template Fixes (bnc#961334) commit cc6584df34a7d145116ea277548ef7c8093a66f1 Author: Marcus Schäfer AuthorDate: Mon Feb 22 17:47:16 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 22 17:47:16 2016 +0100 Refactor suseStripKernel The way the method downsizes the kernel tree is wrong in several places and very hard to read. Therefore the code has been refactored and splitted into task methods which can run independently from each other. As one result the kernel tree is not missing any metadata and/or update weak-updates paths anymore. Fixes (bnc#965830) commit 17c1c1690d3070dc5c4990ff3c0ed56c11f5ac95 Author: Marcus Schäfer AuthorDate: Mon Feb 22 09:54:21 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 22 09:54:21 2016 +0100 Remove flush before resize filesystem According to the manpage, -F is flushing the fileystem buffer caches. which is only really useful for doing resize2fs time trials. With current Tumbleweed installed on MMC, -F triggers a Inappropriate ioctl for device while trying to flush error, and then fails to resize. commit 802378b830cc7e4adcb907a17064c899e1c17744 Author: Marcus Schäfer AuthorDate: Mon Feb 22 09:50:30 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 22 09:50:30 2016 +0100 Update arm boot image descriptions Grub2 adds 35MB to the initrd for no reason on armv6/v7, as those images use u-boot scripts for booting. commit e3bbd331f32f543bd542490a94273c8815919d4c Author: Marcus Schäfer AuthorDate: Mon Feb 22 09:47:46 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 22 09:47:46 2016 +0100 Fixed checkFileSystem call In the refactoring fc363cc, the parameters of checkFileSystem got changed to expect the device name, but one of the invocations didn't pass down the device name due to a typo. commit 92ea6504a6f7474fb12b9ee86e0a7e0e694b1db3 Author: Marcus Schäfer AuthorDate: Sun Feb 21 23:29:10 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 21 23:29:10 2016 +0100 Ignore fdasd errors Like fdisk, fdasd also reports an error when re-reading the partition table. But the table was written correctly so we continue for the moment and add a debug message commit d522d69a52622f19eca6a680b72ddd6d641c6793 Author: Marcus Schäfer AuthorDate: Sun Feb 21 22:40:50 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 21 22:46:07 2016 +0100 Fixed boot image result filename Has to follow the naming convention commit fd8c2b75bd4e1974f3120df8e8a4a08092524bb6 Author: Marcus Schäfer AuthorDate: Sun Feb 21 22:40:08 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 21 22:46:07 2016 +0100 Fixed pxe builder kernel/hypervisor target path commit bb57bfc949ef4221631233c0b3f5b6f074b76f7b Author: Marcus Schäfer AuthorDate: Sun Feb 21 22:20:12 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 21 22:20:12 2016 +0100 Use bytes type with hashlib commit 62ebb7e09875224a7407d5da1e21d79eaf4e4aad Author: Marcus Schäfer AuthorDate: Sun Feb 21 19:28:48 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 21 21:32:19 2016 +0100 Refactor result bundler instead of being clever in the result bundler we should be more explicit when adding a result to the result instance. Therefore the result.add method now also allows to specify if this result should be part of a result bundle and whether it should be placed compressed or uncompressed in this bundle commit 37ae59cbc13bce1ff5e5ccb57c3f722cfcf9116a Author: Marcus Schäfer AuthorDate: Sun Feb 21 15:14:57 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 21 21:32:06 2016 +0100 Added metadata rpm files to all builders rpm packages and verification information is now added to all builder results. Fixes #13 commit 3a2c3554fcd404ef1eb6aa5daa966b281c461a54 Author: Marcus Schäfer AuthorDate: Sun Feb 21 13:53:32 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 21 21:05:24 2016 +0100 Added the following system setup methods export_rpm_package_list and export_rpm_package_verification Used to provide rpm package metadata and verification information for rpm based image builds commit 094fe871841ac907e971b94e0250f22ef64b9ab8 Author: Thomas Schraitle AuthorDate: Sun Feb 21 14:39:30 2016 +0100 Commit: Thomas Schraitle CommitDate: Sun Feb 21 14:39:30 2016 +0100 Fixing code smells from Landscape.io https://landscape.io/github/SUSE/kiwi/161/messages/smell Fixed issues: * Unused imports * Unused variables * Specify string format arguments as logging function parameters (log.warning("%s bla" % x) -> log.warning("%s bla", x) commit 34d9ceb45a97190eb83da48ecb8c4ef5ff5cdc34 Author: Thomas Schraitle AuthorDate: Sun Feb 21 14:38:57 2016 +0100 Commit: Thomas Schraitle CommitDate: Sun Feb 21 14:38:57 2016 +0100 Ignore backup files commit 5f86eb5311f60d415cab58552acfe1ec5bef2057 Author: Thomas Schraitle AuthorDate: Fri Feb 19 19:57:37 2016 +0100 Commit: Thomas Schraitle CommitDate: Fri Feb 19 19:57:37 2016 +0100 Improve doc * Consistently use KIWI * Fixed punctuation * Added zypper ar for adding KIWI's OBS repo commit da6973a7b593351b87ad82b37f4bd9ea4e028286 Author: Marcus Schäfer AuthorDate: Fri Feb 19 11:52:12 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 19 11:59:37 2016 +0100 Fixed unit test read return result Unit test mocking read should return a bytes array and not a string because that's what python3 would do in reality commit f02303e34b0f641cf8f002363f6313bbcee021be Author: Marcus Schäfer AuthorDate: Fri Feb 19 11:34:51 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 19 11:59:16 2016 +0100 Fixed path location in disk_format_image result commit 68b7cd5e0cdadd15827c15718f0fb014b130e7ec Author: Marcus Schäfer AuthorDate: Fri Feb 19 11:31:45 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 19 11:51:42 2016 +0100 Fixed disk format builder This one was missing the output image name adaptions commit 9745d598d287e6ca235a5f892f9b768c22cfb452 Author: Marcus Schäfer AuthorDate: Fri Feb 19 11:04:18 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 19 11:51:42 2016 +0100 Regenerate xml_parse data structures for python3 commit f173d5a7c937b23c978963081d6d4170f9b29528 Author: Marcus Schäfer AuthorDate: Fri Feb 19 10:23:50 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 19 11:05:04 2016 +0100 Better error response in debug output If a Command.run fails with an error code != 0 but not data was produced on the stderr channel, we provide this as information to the caller commit 20351bbfb1d7ce22b6743697f67b58f9eaeae45d Author: Marcus Schäfer AuthorDate: Fri Feb 19 10:11:29 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 19 10:11:29 2016 +0100 Port kiwicompat to python 3 commit 13743b7ff55028334539ca18aa77a86b35904acc Author: Marcus Schäfer AuthorDate: Thu Feb 18 11:40:51 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 18 11:40:51 2016 +0100 Port helper tools to python3 Also fixes completion to correctly parse the toplevel --compat option commit 8f4877395b59337fc2b0640ff29bbadce336bdff Author: Marcus Schäfer AuthorDate: Thu Feb 18 11:09:12 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 18 11:09:12 2016 +0100 Do not activate dmraid paritions Only activate the device itself, not the partitions, that may also exist. If partitions exist, the UDEV rules will create the corresponding "_partX" symlinks for each partition within "/dev/mapper, which is totally sufficient. commit 31630ff7357ab332fdfd1392d76730f23fba080f Author: Marcus Schäfer AuthorDate: Thu Feb 18 10:09:34 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 18 10:09:34 2016 +0100 Fixed cut and paste error in spec template correct the project Url commit 3196bf552dac6449484b78795bd9c7e761483050 Author: Marcus Schäfer AuthorDate: Thu Feb 18 09:01:48 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 18 09:01:48 2016 +0100 Update README add install information for python3-devel commit e67a7b1821797359c39a98e31b2a05a138e64275 Author: Marcus Schäfer AuthorDate: Thu Feb 18 09:00:23 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 18 09:00:23 2016 +0100 Fixed README wrong reference to env2 where it should be env3 commit ce884dc73d0ea23c6677989f0514461957cdf32e Author: Marcus Schäfer AuthorDate: Thu Feb 18 08:58:47 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 18 08:58:47 2016 +0100 Update README commit a7d16f210f10fe70011c70fb41692e5354750be3 Author: Marcus Schäfer AuthorDate: Wed Feb 17 22:40:47 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 17 22:40:47 2016 +0100 Update travis env to python 3.4 commit 40e6308aa90227549ca5b63f41648a036bc17d46 Author: Marcus Schäfer AuthorDate: Wed Feb 17 19:20:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 17 22:38:38 2016 +0100 Port application from python 2.7 to 3.4 For new applications like this kiwi version and its use cases it is better to base it on a more recent python version commit 5f878d64eb8e044011ae2ff5714f76ab7e8bffb8 Author: Marcus Schäfer AuthorDate: Wed Feb 17 13:49:44 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 17 13:49:44 2016 +0100 Fixed bundling container results Container images are already compressed, there is no need for the bundler to do that again commit f9ab6a35a7ce0b2f2de52b0a5e31be798c1a37ac Author: Marcus Schäfer AuthorDate: Wed Feb 17 10:58:02 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 17 10:58:02 2016 +0100 Use pinch_system with force in any case Deletion of packages should be done with the force flag set. Otherwise the package manager computes a resolved list for the deletion targets which causes other packages to be deleted which is unwanted commit 8dbf932c05c7b7ebfdfbcd49cb2d4e37b5cdc06c Author: Marcus Schäfer AuthorDate: Wed Feb 17 10:56:40 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 17 10:56:40 2016 +0100 Fixed host to image root data setup On bind mounts check if the origin path exists on the host. On copy check if the origin file exists on the host commit a5170050cc606997bcc3f4343ed1c09f660d850d Author: Marcus Schäfer AuthorDate: Wed Feb 17 10:54:58 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 17 10:54:58 2016 +0100 Fixed deactivate_systemd_service Check if the service file exists, if not there is no need to deactivate an non existing service. commit 8caa8dcc02704cb723cc61d57fa70e488374ba13 Author: Marcus Schäfer AuthorDate: Tue Feb 16 17:05:26 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 17 08:56:34 2016 +0100 Use alternatives mechanism for completion file This avoids the package conflict with the legacs kiwi version commit 2a6a55ddd0f04090de8a69cdf93f951cab517987 Author: Marcus Schäfer AuthorDate: Tue Feb 16 08:49:41 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 16 08:49:41 2016 +0100 Weaken kiwi-tools requirement commit 406749db423b177213b330d4dd9d5a92e024183d Author: Marcus Schäfer AuthorDate: Mon Feb 15 12:59:54 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 15 12:59:54 2016 +0100 Handle 32bit Intel arch as ix86 in boot code commit 4d1fcbad374d54171749e3f01cb13cc49143dcaa Author: Marcus Schäfer AuthorDate: Mon Feb 15 12:46:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 15 12:46:07 2016 +0100 Allow building 32bit bios images commit e3bbd427d85e8d98ac7474e77e1bd3ab0be3dc34 Author: Marcus Schäfer AuthorDate: Mon Feb 15 10:57:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 15 10:57:07 2016 +0100 Delete %post from kiwi-pxeboot We do not provide a default config file for the pxe setup anymore. There is no good default file we can provide here because we don't know how the user has configured a pxe image. The documentation should explain how to setup the pxe config and infrastructure with the help of the static data provided by the kiwi-pxeboot package commit 2df90b0c340968a754baab89f0cac1b108ee196c Author: Marcus Schäfer AuthorDate: Mon Feb 15 10:50:26 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 15 10:53:58 2016 +0100 Don't require python-Sphinx at build time Sphinx is not available on all platforms and required only to build the manual pages. Thus the make build target can build the man pages and pack the result into the source tarball commit 0114a28bef58857351d4ee06ce066b5b6204b6f8 Author: Marcus Schäfer AuthorDate: Mon Feb 15 10:08:36 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 15 10:08:36 2016 +0100 Don't strip ctc_configure from initrd ctc_configure is used on s390 images commit 8d738b31d1377efc6b46c6353baffab6ade0b3b7 Author: Marcus Schäfer AuthorDate: Mon Feb 15 00:14:22 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 15 00:14:22 2016 +0100 Added man page for result bundle command commit bdd80502b8953ff8cede67c89d917a07b89274e8 Author: Marcus Schäfer AuthorDate: Mon Feb 15 00:08:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Feb 15 00:08:55 2016 +0100 Added result bundler commit 474262413f48b1019ea9786f15cc869846ffe2bf Author: Marcus Schäfer AuthorDate: Fri Feb 12 21:17:06 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 12 21:17:06 2016 +0100 Added kiwi-boot-requires buildservice meta package commit 887195b9379bde80736cb8be376135d09293973a Author: Marcus Schäfer AuthorDate: Thu Feb 11 17:27:33 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 11 17:27:33 2016 +0100 Delete unused .releasetags helper Fixes #9 commit d421fc7f144ea3432d7380343916d64acb415e52 Author: Marcus Schäfer AuthorDate: Thu Feb 11 17:24:18 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 11 17:24:18 2016 +0100 Update README commit 4284c180caffbf7771d81ca25456d4f2d99da42d Author: Marcus Schäfer AuthorDate: Thu Feb 11 17:22:16 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 11 17:22:16 2016 +0100 Update README commit 64a7b83958f626f10a3592b5f5ed15f43151a494 Author: Marcus Schäfer AuthorDate: Thu Feb 11 17:08:30 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 11 17:08:30 2016 +0100 Added system update manual page commit 2ec23f212e3ad48aba1a248d1cf78f6ec20e6b23 Author: Marcus Schäfer AuthorDate: Thu Feb 11 16:24:09 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 11 16:24:09 2016 +0100 Create manual pages Create man pages for result list, system build, prepare and create commit 2e342fe2998f0076609dcca35d321a0fbcb598d4 Author: Marcus Schäfer AuthorDate: Thu Feb 11 11:31:45 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 11 11:31:45 2016 +0100 Added pv xen drivers to boot descriptions Beginning with SLE12 SP2 the default kernel is a pvops capable kernel. This means it can be used in a Xen HVM full virtual machine as well as in a PV - paravirtual machine. However it's required to keep the paravirtual net, block modules in the initrd. As their location also has move an update of the boot image descriptions was necessary commit bd41015972080e750a04809a23e2a247b7e37ebc Author: Marcus Schäfer AuthorDate: Thu Feb 11 11:25:49 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 11 11:25:49 2016 +0100 Fixed wait message in waitFor boot functions Better indicate for what we are waiting commit 196ea0dc414ae8f7fd5adc8337d1a9545077bdeb Author: Marcus Schäfer AuthorDate: Thu Feb 11 11:24:50 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 11 11:24:50 2016 +0100 Load xen modules by alias only commit 8c08dcc54cdc6665ab794eec5165c9d1ef17a7ca Author: Marcus Schäfer AuthorDate: Thu Feb 11 10:49:28 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 11 11:19:57 2016 +0100 Fixed validation of custom root cmdline variable A variable of the format root=LABEL=x was not correctly validated commit bc7b0d6af910d30b77b773a3a24b91a8e042af21 Author: Marcus Schäfer AuthorDate: Thu Feb 11 10:24:57 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 11 11:19:57 2016 +0100 Change default ec2 root_cmdline_parameter For ec2 based firmware the value root=UUID=x is provided instead of a static device node commit a7fb5649f5e9e023f233b4fd57dd37b795cae058 Author: Marcus Schäfer AuthorDate: Thu Feb 11 10:09:15 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 11 11:19:57 2016 +0100 Refactor internal boot image task Make a factory out of the task and allow to have e.g a dracut boot image task at a later point in time. The BootImageBase class creates an interface for this implementation. So far only BootImageKiwi is implemented commit e9a0b2c198951e73a4a2e9f702776857847cc54b Author: Marcus Schäfer AuthorDate: Wed Feb 10 16:26:35 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 10 16:26:35 2016 +0100 Added export_modprobe_setup method to SystemSetup export_modprobe_setup copies the contents of etc/modprobe.d to a specified target root directory. The method is used to transfer the modprobe configuration from the system image to the boot image commit 1bd61fda4b27db999e5c35aef7e63f75086cd44a Author: Marcus Schäfer AuthorDate: Wed Feb 10 11:41:45 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 10 11:41:45 2016 +0100 Fixed archive_builder_test Mock platform value commit 54421f1240b835d68bf31b899eed1ba91b6183cf Author: Marcus Schäfer AuthorDate: Wed Feb 10 11:19:34 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 10 11:19:34 2016 +0100 Added compatibility information to main man page commit bc45bcc36f9985680a0ffcf023272b0f52bb68de Author: Marcus Schäfer AuthorDate: Wed Feb 10 10:33:11 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 10 10:33:11 2016 +0100 Put arch and version to output image file name commit d6e65f5d4a4701a6ffcd3d9c31cc149c4f85ffda Author: Marcus Schäfer AuthorDate: Wed Feb 10 09:07:44 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 10 09:07:44 2016 +0100 Added quick start example to main kiwi manual page commit ebc0a4ef4355ed14260f10b6c22c94335d84ae79 Author: Marcus Schäfer AuthorDate: Tue Feb 9 22:37:52 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 22:37:52 2016 +0100 Fill master manual page with content commit a1aab40cae273bcde00d7b811221dfdea1d57796 Author: Marcus Schäfer AuthorDate: Tue Feb 9 21:12:03 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 21:12:03 2016 +0100 Added git like command completion Provide a 'Did you mean' log message for unclear task names commit aa6aab934ba53247c5d972a4ae6b9ba37b62487a Author: Marcus Schäfer AuthorDate: Tue Feb 9 17:54:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 17:54:07 2016 +0100 Update README commit e083b73453fc8d7f6640057a5a539836da90a3f2 Author: Marcus Schäfer AuthorDate: Tue Feb 9 17:47:51 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 17:47:51 2016 +0100 Fixed non-executable-script rpmlint warning commit c3c89b12d6734213e7f1e0fde112b56df49e44a7 Author: Marcus Schäfer AuthorDate: Tue Feb 9 17:41:52 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 17:41:52 2016 +0100 Man pages are below level 2 commit 59080fbda84df68adf3a98041270f6af8fef1d70 Author: Marcus Schäfer AuthorDate: Tue Feb 9 17:40:25 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 17:40:25 2016 +0100 Fixed rpm-buildroot-usage rpmlint warning commit 1171dd6289e64e4a7101e1242563086facd33760 Author: Marcus Schäfer AuthorDate: Tue Feb 9 17:36:53 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 17:36:53 2016 +0100 Fixed non-executable-script rpmlint warning commit a476cfc09767a1fb2d4734e059a8d9ea751390b9 Author: Marcus Schäfer AuthorDate: Tue Feb 9 17:22:35 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 17:30:22 2016 +0100 Delete unused .md5 script commit b2bb34f57f5f018bff27628b1a88dd5d8284efa8 Author: Marcus Schäfer AuthorDate: Tue Feb 9 16:57:54 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 17:30:22 2016 +0100 Fixed rpm package build commit bcaf135f4c3d9fc0358c362d9eeb2c8527e0ffef Author: Marcus Schäfer AuthorDate: Tue Feb 9 16:23:50 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 16:23:50 2016 +0100 Fixed dracut call Always create a generic initrd, don't pass -H commit 2bb73c33f4d8c5020cc6af886c1e3c901158591c Author: Marcus Schäfer AuthorDate: Tue Feb 9 15:43:15 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 15:43:15 2016 +0100 Fixed custom args setup for vmdk format custom args is a hash with option/value pairs. For vmdk the option could be e.g adapter_type=value and the value is None. This is by intention because qemu which receives those type of options allows only the syntax "-o option=value". The kiwi code setting up the options did not check correctly if there really is a value for e.g adapter_type commit ff09a8034969f418002cd95b51f87f60dc08e7ac Author: Marcus Schäfer AuthorDate: Tue Feb 9 15:28:06 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 15:28:06 2016 +0100 Allow alternative locations for grub installation Different distributions install grub2 to different places. Therefore kiwi should not use a fixed location but allow to lookup grub data at several places commit 366ffa77edeaed0982a5c03c63cc6c5e6147a71c Author: Marcus Schäfer AuthorDate: Tue Feb 9 11:22:27 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 11:22:27 2016 +0100 Fixed unit test for fix_boot_catalog on big endian commit 6f50830ccd7da4297c3859dc33296b1492fbdb2b Author: Marcus Schäfer AuthorDate: Tue Feb 9 11:16:33 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 9 11:16:33 2016 +0100 Fixed unit test for fix_boot_catalog on big endian commit 52ad8d89f03d78e1015fea37c84f5eabc2a0a643 Author: Marcus Schäfer AuthorDate: Sun Feb 7 19:47:56 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 7 19:47:56 2016 +0100 Make sure to cleanup yum requests after processing commit f540dc4b04ca9f7d9d7c7229a97079cb582ab283 Author: Marcus Schäfer AuthorDate: Sun Feb 7 18:12:31 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 7 18:12:31 2016 +0100 Fixed CommandIterator check for output before sending an iteration stop commit 3b01fd2f32863e69f48b4694bf5defd548fbca7b Author: Marcus Schäfer AuthorDate: Sun Feb 7 17:36:49 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 7 17:36:49 2016 +0100 Fixed stateful copy of repository section Profiles are not copied because they might not exist in the target description commit ef2dfd2681b87c6a70d3b80e0865f9bf814a26a7 Author: Marcus Schäfer AuthorDate: Sun Feb 7 15:45:15 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 7 15:45:15 2016 +0100 Fixed host to root path patcher Don't be confused by multiple /'es commit 637d9b54abf0d806e384f1beb31710ba57de7496 Author: Marcus Schäfer AuthorDate: Sun Feb 7 14:50:59 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 7 15:16:10 2016 +0100 Added support for yum package manager commit ca1539a98f4d5ede33c2e02a265f0424dc914628 Author: Marcus Schäfer AuthorDate: Sun Feb 7 14:48:03 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 7 14:52:34 2016 +0100 Fixed use of iso mounted repositories When using an iso as repo, kiwi mounts it to a temporary location. The location is different for each build and therefore the zypper repo file needs to be recreated for any new build in this situation commit b98908e512e78a2c09496597ba34601709ce5a44 Author: Marcus Schäfer AuthorDate: Sun Feb 7 00:54:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 7 14:52:12 2016 +0100 Check if config file exists Before updating a config file, check if it exists. If it is not present skip the configuration and print a warning message commit 0624b59588743f806745d24e7b71e3ad53123d23 Author: Marcus Schäfer AuthorDate: Sat Feb 6 21:26:48 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Feb 7 14:52:12 2016 +0100 Added yum repository support commit 5494ce0915f736b982e5a661f3c69cbc0b7ffe4a Author: Marcus Schäfer AuthorDate: Sat Feb 6 14:16:39 2016 +0100 Commit: Marcus Schäfer CommitDate: Sat Feb 6 14:16:39 2016 +0100 Make man install target more stable commit f8c041815ffe513e5af4aaf90995c37a2c1c6b92 Author: Marcus Schäfer AuthorDate: Sat Feb 6 14:13:51 2016 +0100 Commit: Marcus Schäfer CommitDate: Sat Feb 6 14:13:51 2016 +0100 Update source manifest include only doc Makefile and source, the pages are build at build time commit 04020611a86a7bba48702acbcfe1248a77f4b449 Author: Marcus Schäfer AuthorDate: Sat Feb 6 14:10:04 2016 +0100 Commit: Marcus Schäfer CommitDate: Sat Feb 6 14:10:04 2016 +0100 Include installation of man pages to spec file commit e132246b354de5b88cfa7353a92b7ca75d8dc9c5 Author: Marcus Schäfer AuthorDate: Sat Feb 6 13:55:10 2016 +0100 Commit: Marcus Schäfer CommitDate: Sat Feb 6 13:55:10 2016 +0100 Added man page templates for all commands commit b6945bb7e6c8461afcd4d8ba48c3721323a298c8 Author: Marcus Schäfer AuthorDate: Fri Feb 5 12:06:40 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 5 12:06:40 2016 +0100 Added man page templates Added template for master page and result_list commit 4c4ae90affd1d4deab617e19bb8f98ea862fd285 Author: Marcus Schäfer AuthorDate: Fri Feb 5 11:08:03 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 5 11:08:03 2016 +0100 Added initial sphinx documentation structure The documentation will cover kiwi manual pages. more detailed documentation will be written and maintained in colaboration with the documentation department commit c55e4c790fb5a553cd118d276bdeac7248afd831 Author: Marcus Schäfer AuthorDate: Fri Feb 5 09:44:11 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Feb 5 09:44:11 2016 +0100 Fixed use of noglob shell option commit f2ff481bf2419e8f0594720626eb8b5c3a1c1abf Author: Marcus Schäfer AuthorDate: Thu Feb 4 15:06:56 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Feb 4 15:06:56 2016 +0100 Added support for kiwi --compat The --compat call will trigger the call of the kiwicompat tool written to support legacy kiwi commandlines. An example could look like the following call: sudo kiwi --compat -- --build /my/description --type vmx -d /my/dest Please be aware the -- is required to tell docopt to treat all options as parameters commit 638083fb7661c8b839b72bd5f3c0fb86afe508ab Author: Marcus Schäfer AuthorDate: Wed Feb 3 22:32:33 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 3 22:32:33 2016 +0100 Prevent duplicate error logging commit 2e9f596c4a4bfa5ada61928a1103bd10edb65c9d Author: Marcus Schäfer AuthorDate: Wed Feb 3 22:14:52 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 3 22:14:52 2016 +0100 Refactor CommandProcess class Use an iterator class to run through the process. implement poll variants explicit and clear structured commit 22792e3e026295b5b551f6efd4d0487d35054d63 Author: Marcus Schäfer AuthorDate: Wed Feb 3 15:57:24 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 3 15:57:24 2016 +0100 Fixed updateRootDeviceFstab Support by-label mount entries for btrfs subvolumes This fixes bnc#964474 commit 131904e8aa7ce98f20df060ed8fa0c90e5f81e4d Author: Marcus Schäfer AuthorDate: Wed Feb 3 15:49:30 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Feb 3 15:52:09 2016 +0100 Add kiwicompat to Makefile build and install target commit d46029297ecd5f5b1a511f0b528149bbef39fb74 Author: Marcus Schäfer AuthorDate: Tue Feb 2 23:45:23 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 2 23:45:23 2016 +0100 Update README commit 75afede75162a24bcd9c31275fe074fde3b79b1c Author: Marcus Schäfer AuthorDate: Tue Feb 2 23:41:42 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 2 23:41:42 2016 +0100 Update README commit ff03553b873102d0d16877574b3c62e688b03018 Author: Marcus Schäfer AuthorDate: Tue Feb 2 23:12:00 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 2 23:26:17 2016 +0100 Bump version: 8.10.0 → 8.10.1 commit 8ce43af5b428a9179bb8aa6aba21b34ad545b7f3 Author: Marcus Schäfer AuthorDate: Tue Feb 2 22:21:20 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 2 23:26:17 2016 +0100 Prepare for package building commit a11f299f83c21e8dbed43a15ff0cdab86f1ba52b Author: Marcus Schäfer AuthorDate: Tue Feb 2 15:52:34 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 2 15:52:34 2016 +0100 Follow up fix for fstab setup Use the system installed fstab as default if present commit a1871cfa4bd5dfb597cf90f279746fb2dc04abf6 Author: Marcus Schäfer AuthorDate: Tue Feb 2 15:01:02 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 2 15:01:02 2016 +0100 Support building in buildservice worker The repo setup inside of a buildservice worker uses a static path below /usr/src/packages/SOURCES/repos/. We need to adapt the provided obs uri type to match this criteria commit 03c7e6c50cc049e6d833b650031caed61c316479 Author: Marcus Schäfer AuthorDate: Tue Feb 2 10:27:20 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Feb 2 10:27:20 2016 +0100 Don't add kernel filesystems to fstab Systems with systemd which this kiwi version aims for, doesn't need proc, sysfs, debugfs and friends to be part of the fstab This fixes bnc#964472 commit 264fb56d93ed781243957a997c91ee5f83a2409e Author: Marcus Schäfer AuthorDate: Fri Jan 29 21:07:03 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 29 21:07:03 2016 +0100 Fixed btrfs build with snapshots commit c4d496720eac180d8e5098274ec53c21bd63b7ac Author: Marcus Schäfer AuthorDate: Fri Jan 29 16:21:02 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 29 16:21:02 2016 +0100 Allow system to be installed on btrfs snapshot This fixes (bnc#946648) commit d173fb468ca02728a309e427345b32ad9b7ac032 Author: Marcus Schäfer AuthorDate: Fri Jan 29 14:43:47 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 29 14:43:47 2016 +0100 Put kiwi_btrfs_root_is_snapshot to boot profile commit 1d1ed3626101444d5992e61250e8447f97cc0399 Author: Marcus Schäfer AuthorDate: Fri Jan 29 14:38:29 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 29 14:38:29 2016 +0100 Recompile schema and data structures New attribute btrfs_root_is_snapshot and methods commit 708b23fe5efb8b38cec2174b5a40fb5586ac8ebb Author: Marcus Schäfer AuthorDate: Wed Jan 27 14:57:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 29 14:35:36 2016 +0100 Evaluate kiwi_btrfs_root_is_snapshot in boot code If set it's required to mount the subvolumes like it is done with lvm volumes. In addition this patch fixes the update of the fstab file which has to contain an entry for each subvolume excluding snapshots and the toplevel This is related to (bnc#946648) commit 8834345182e9aab3c97b2a42e3c544adc411326c Author: Marcus Schäfer AuthorDate: Wed Jan 27 14:40:42 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 29 14:34:43 2016 +0100 Added btrfs_root_is_snapshot attribute This is related to (bnc#946648) commit 6a0292c9583dee1a8ecfe20e733eeb11f2dd80a5 Author: Marcus Schäfer AuthorDate: Wed Jan 27 12:36:44 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 27 12:36:44 2016 +0100 Added fix_boot_catalog and relocate_boot_catalog commit 1e2309ef8c98a5fdc493bdecef86aa41e9d9ddd0 Author: Marcus Schäfer AuthorDate: Tue Jan 26 09:50:51 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 26 09:50:51 2016 +0100 Prevent duplicate validation of cmdline commit 79be39945bef278e2e925a3bc2509b6c0066c5c9 Author: Marcus Schäfer AuthorDate: Tue Jan 26 09:33:41 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 26 09:33:41 2016 +0100 Fixed grub2 xen guest bootloader config commit e8f0a651bf7f905f85273fc151f2fd23199900a6 Author: Marcus Schäfer AuthorDate: Mon Jan 25 22:05:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 22:05:07 2016 +0100 More modules not present for grub2/x86_64-xen commit 6358ff68062c5d3e144873de33bf15b9f976d2e2 Author: Marcus Schäfer AuthorDate: Mon Jan 25 21:57:08 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 21:57:08 2016 +0100 There is no multiboot module for grub2/x86_64-xen commit 672ead733854914583c1b2e2953011e15a961b96 Author: Marcus Schäfer AuthorDate: Mon Jan 25 21:44:19 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 21:44:19 2016 +0100 Make sure get_partition_table_type returns a value commit 11ff0f0f0f1d1c26eca09afec385abbffa9f4a16 Author: Marcus Schäfer AuthorDate: Mon Jan 25 21:35:06 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 21:35:06 2016 +0100 Use bash to call config scripts commit 37737779650c24c87b86d95a526697c74948ec7a Author: Marcus Schäfer AuthorDate: Mon Jan 25 18:25:20 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 18:25:20 2016 +0100 Fixed regular expression pattern use re.escape to make sure the search string has special regular expression characters quoted correctly commit e95eab38fac0cc3de76872ac152e9f33c1c79f41 Author: Marcus Schäfer AuthorDate: Mon Jan 25 17:09:19 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 17:09:19 2016 +0100 Added support for using internal build service An option --obs-repo-internal was added commit 26933705c7be96e08430b4438728900747c13198 Author: Marcus Schäfer AuthorDate: Mon Jan 25 16:24:23 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 16:24:23 2016 +0100 Add support for alternative config file *.kiwi commit 15544f9a8c07f10f6e3cb1292a45db85a74197b9 Author: Marcus Schäfer AuthorDate: Mon Jan 25 16:13:16 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 16:13:16 2016 +0100 Allow to build directly from buildservice checkout commit 60b8622d620c426d084869722f2eeb4ab0bd94d2 Author: Marcus Schäfer AuthorDate: Mon Jan 25 12:07:36 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 12:07:36 2016 +0100 Fix misleading variable name commit 0356527dba9b46b5cfc4ae1fb03bc0f21a3047c3 Author: Marcus Schäfer AuthorDate: Mon Jan 25 12:05:18 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 12:05:18 2016 +0100 Move default boot timeout to Defaults class commit b4e117b6eae5fffe6da1e0dee730330afbde71e1 Author: Marcus Schäfer AuthorDate: Mon Jan 25 12:01:58 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 12:01:58 2016 +0100 Fixed boot exclude for zipl case commit 56af5925f91eb3787764d121275a627772753f29 Author: Marcus Schäfer AuthorDate: Mon Jan 25 11:47:41 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 11:47:41 2016 +0100 Fixed zipl bootloader setup and install quote special characters in title for menu. refactor the zipl bootloader install class to know about the boot partition device node commit baad1c652b45be5d1054fa42119769967b984524 Author: Marcus Schäfer AuthorDate: Mon Jan 25 11:47:15 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 11:47:15 2016 +0100 Added title quoting method for older loaders commit 8c790b32084d3d7bb94770a6e13a4e7612b5cd04 Author: Marcus Schäfer AuthorDate: Mon Jan 25 10:34:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 10:34:41 2016 +0100 Move VTOC creation into Disk class commit bd9d23385d6a10bde10adceef7792c7646264a44 Author: Marcus Schäfer AuthorDate: Mon Jan 25 10:18:28 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 10:34:41 2016 +0100 Fixed missing setup_disk_boot_images for zipl The interface class implements this with a raise condition by default. For zipl no bootloader images needs to be created Thus implement the method and pass commit 917e8c134824903db40257805a9b3d2c820e4a05 Author: Marcus Schäfer AuthorDate: Mon Jan 25 10:17:39 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 10:17:39 2016 +0100 Fixed typo in list assignment commit 6e22093cb1721b95c5fa57e9ac42b9e3c7102fdc Author: Marcus Schäfer AuthorDate: Mon Jan 25 10:16:37 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 10:16:37 2016 +0100 Fixed LoopDevice class custom blocksize value must be passed as string to the command level not as integer commit e40395e99fa59e026e5c2249a48d90360af2b531 Author: Marcus Schäfer AuthorDate: Mon Jan 25 09:49:27 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 09:49:27 2016 +0100 Platform fixes for XML tests commit b8c6b07dbb272387c1819e43ca5808e91895057e Author: Marcus Schäfer AuthorDate: Mon Jan 25 09:42:00 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 09:42:00 2016 +0100 Platform endian fix for vhd tag test commit c9036833688374dd0b9ac37614495d3aa946301f Author: Marcus Schäfer AuthorDate: Mon Jan 25 09:26:52 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 09:26:52 2016 +0100 Platform fixes for unit tests commit bfe75b869ff3e1c7ec89b5ba79534b71d9be4863 Author: Marcus Schäfer AuthorDate: Mon Jan 25 09:12:24 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 09:12:24 2016 +0100 Platform mock for grub2 bootloader tests commit d4da2907018c7f89ba83d00b290e70ca9fe0c2fb Author: Marcus Schäfer AuthorDate: Mon Jan 25 09:09:09 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 25 09:09:09 2016 +0100 Platform mock for grub2 bootloader tests commit 9fc642b1f8e31c4211047617a278af7915fbce9b Author: Marcus Schäfer AuthorDate: Sun Jan 24 21:29:06 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Jan 24 21:29:06 2016 +0100 Added BootLoaderInstallZipl class commit a72f143e8ea951b8bb66f92a38880f89b5edcdb7 Author: Marcus Schäfer AuthorDate: Sun Jan 24 12:26:41 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Jan 24 12:26:41 2016 +0100 Activate zipl bootloader config in factory class commit ccdfc108da73711c2c80f79ba58c2e19fb2a2a0d Author: Marcus Schäfer AuthorDate: Fri Jan 22 15:48:02 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 22 15:48:02 2016 +0100 Finished BootLoaderConfigZipl class and tests commit 2bdf0ad68623d300f370e731150b7764752e3aee Author: Marcus Schäfer AuthorDate: Fri Jan 22 10:49:14 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 22 10:49:14 2016 +0100 Delete unused patch statement from test commit 1ede864322118990226bce5d7b795f38c62e2057 Author: Marcus Schäfer AuthorDate: Thu Jan 21 17:06:19 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 21 17:06:19 2016 +0100 Added BootLoaderConfigZipl class The implementation is still unfinished commit 8f0c277f1408b271f0196559c41311e34fef8130 Author: Marcus Schäfer AuthorDate: Thu Jan 21 16:29:12 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 21 16:32:30 2016 +0100 Pass the disk device to the bootloader config As a custom option the BootLoaderConfig instance now receives the target disk device node. So far this is only used in the zipl case where it is needed which is the reason why it is kept as a custom argument commit 9524e79d52f4e74a793680016e667bf7c9fe4c9b Author: Marcus Schäfer AuthorDate: Thu Jan 21 15:37:44 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 21 15:39:22 2016 +0100 Allow custom options for bootloader config classes commit bfe534029c9e081a49507599075e8a7db2bab8d9 Author: Marcus Schäfer AuthorDate: Thu Jan 21 11:38:20 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 21 11:38:20 2016 +0100 Added zipl bootloader template commit e348441ff480fb3ae0fdb3dc1b4db97fe53a8688 Author: Marcus Schäfer AuthorDate: Wed Jan 20 17:50:12 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 20 17:50:12 2016 +0100 Added partitioner_dasd for s390 commit 8370f2fcb1fed8b007b48e9554227867105333d8 Author: Marcus Schäfer AuthorDate: Wed Jan 20 17:06:09 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 20 17:06:09 2016 +0100 Refactor Firmware class more information from the XML description is needed in order to make e.g decisions about the partition table type to use according to the firmware setup in combination with e.g the target loader type on s390. Thus the class now receives an instance of the XML state and not only the firmware attribute value commit 01248084064ff34b2e253cb10389cddcffb15c5e Author: Marcus Schäfer AuthorDate: Wed Jan 20 16:02:09 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 20 16:02:09 2016 +0100 Disable setup of hwclock hwclock seems not exist on all supported architectures. In addition the build process should not fiddle with the build host hardware clock commit 6eb44ffebbff4716dffa93530a969182bc1bf32a Author: Marcus Schäfer AuthorDate: Wed Jan 20 11:12:18 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 20 11:12:18 2016 +0100 No need for a condition if there is no alternative commit f6e18d362ceaa16bcb0096969d32ac66036d9831 Author: Marcus Schäfer AuthorDate: Wed Jan 20 11:02:57 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 20 11:02:57 2016 +0100 No need for a condition if there is no alternative commit a2f9085673d303f98558cf7be6052c0724ad93c1 Author: Marcus Schäfer AuthorDate: Wed Jan 20 10:59:20 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 20 10:59:43 2016 +0100 Use 800x600 default for grub2 gfxmode commit 24d28d5de4ab772b032ecadda9f859f083e7f592 Author: Marcus Schäfer AuthorDate: Wed Jan 20 10:58:42 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 20 10:59:43 2016 +0100 Close progress line with CR when finished commit ad0353d6fc3212a3e7619d4ff746e4786df8aa7f Author: Marcus Schäfer AuthorDate: Wed Jan 20 10:34:15 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 20 10:59:43 2016 +0100 Added ImageBuilder factory commit c6f37c2f12f092e42e2070a72827530807d2e70a Author: Marcus Schäfer AuthorDate: Tue Jan 19 17:04:29 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 19 17:04:29 2016 +0100 Added system build command Allows to combine prepare and create into one big task commit b67a7a12bbe9e8339a56aadefc6342d6be32ed45 Author: Marcus Schäfer AuthorDate: Tue Jan 19 15:21:50 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 19 15:21:50 2016 +0100 Better error message for pickle exceptions There is no meaningfull error message for pickle.load exceptions. Thus only provide the exception type and our own message commit 4efcb4cb4cebc87cec1bbaa87409ed2315eeea7e Author: Marcus Schäfer AuthorDate: Tue Jan 19 15:02:06 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 19 15:02:06 2016 +0100 Use pickle instead of marshal commit 7bb5c32bcd9458def4d5efb7cd172a23ada6a49a Author: Marcus Schäfer AuthorDate: Tue Jan 19 14:39:21 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 19 14:39:21 2016 +0100 Fixes for the container builder in the setup if the files to update do not exist the process failed. This patch adds a check prior to changing the file commit 16a112f567affe835a0b9ea6fcfa35045e18d1f5 Author: Marcus Schäfer AuthorDate: Tue Jan 19 14:38:58 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 19 14:38:58 2016 +0100 Make sure the create task creates the target dir commit ce7fa6b6912d6760324e87d1624e67225906c65b Author: Marcus Schäfer AuthorDate: Tue Jan 19 14:38:17 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 19 14:38:17 2016 +0100 Fixed result object dump marshal.dump requires an open file object not a filename commit edbb2e7aa9afa17fed20664c4f21dc7dace7378d Author: Marcus Schäfer AuthorDate: Tue Jan 19 12:45:43 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 19 12:45:43 2016 +0100 Added ContainerBuilder currently supports building of docker containers commit d7ded563f366cbfebbe8c0b17ef95dff91d2ba53 Author: Marcus Schäfer AuthorDate: Tue Jan 19 11:53:34 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 19 11:53:34 2016 +0100 Added ContainerImage class Factory plus implementation for docker commit febd69ec0ffa74fac571fc7e8d8b97d6ac4dc706 Author: Marcus Schäfer AuthorDate: Tue Jan 19 11:08:08 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 19 11:15:18 2016 +0100 Refactor variable name for root directory If it is clear the source directory is the root directory of the image the variable should be named root_dir not source_dir commit 5d6fa811f5d66b1e685b42e53c924f4df340090e Author: Marcus Schäfer AuthorDate: Mon Jan 18 17:30:38 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 18 17:30:38 2016 +0100 Fixing landscape issues commit ae21222c61fd759c4d29f6cfc8bfbeba4f1a236a Author: Marcus Schäfer AuthorDate: Mon Jan 18 16:59:58 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 18 16:59:58 2016 +0100 Added ContainerSetup classes Base and Factory plus implementation for docker commit 2267023dbddf92bfc46a00b041f637affdca1591 Author: Marcus Schäfer AuthorDate: Fri Jan 15 15:48:52 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 15 15:48:52 2016 +0100 Refactor user/groups setup Provide an easier to travers data type in xml_state for the user and groups. The get_users() method returns a list of tuples which assigns each user list the group name and id it belongs to commit 5fb3ae17decd843ad26a8172b21d7e57271c07e4 Author: Marcus Schäfer AuthorDate: Fri Jan 15 11:45:29 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 15 11:45:29 2016 +0100 Use normpath to avoid double slash in output commit 9c60b1f1286919ac638d7ee56ce0ab161b01b2d1 Author: Marcus Schäfer AuthorDate: Fri Jan 15 11:38:08 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 15 11:38:08 2016 +0100 Added kiwi result task Implementing 'kiwi result list' which marshal loads the serialized result instance from a previous build and shows the build results commit 4a4f9b4b656abb264b943e8e386ffe48e3cf2228 Author: Marcus Schäfer AuthorDate: Fri Jan 15 10:44:35 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 15 10:44:35 2016 +0100 Dump the result instance as a marshal dump commit 899b4a70181a2d603d71361967ce2a146016678b Author: Marcus Schäfer AuthorDate: Thu Jan 14 15:59:57 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 14 16:40:07 2016 +0100 Add clic as supported live media build target commit 773db92b4dcdeef417cdf5a54ec0aa823bc043cd Author: Marcus Schäfer AuthorDate: Thu Jan 14 13:59:11 2016 +0100 Commit: Marcus Schäfer CommitDate: Thu Jan 14 13:59:11 2016 +0100 Added FileSystemClicFs class commit d0319ed6476af0407209c0fca84f8b090b895588 Author: Marcus Schäfer AuthorDate: Wed Jan 13 21:52:05 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 13 21:52:05 2016 +0100 Fixed contents of header_end block off by one bug commit a1e603ef0c501c3c234cc5a33a072c2957c8cf36 Author: Marcus Schäfer AuthorDate: Wed Jan 13 16:56:37 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 13 16:56:37 2016 +0100 Finished LiveImageBuilder for overlay iso type commit 6305dfc1ff78cf752ba6cd1bb86fd6ecd04fe5f2 Author: Marcus Schäfer AuthorDate: Wed Jan 13 16:04:20 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 13 16:15:28 2016 +0100 Added check if UDF extension is needed or not commit cbced042c5f9d714443377d94dff78e49fa08047 Author: Marcus Schäfer AuthorDate: Wed Jan 13 12:39:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 13 12:39:55 2016 +0100 Put supported live image iso types into defaults commit 37103549976480b4091897619f655532a5678390 Author: Marcus Schäfer AuthorDate: Wed Jan 13 12:04:09 2016 +0100 Commit: Marcus Schäfer CommitDate: Wed Jan 13 12:04:09 2016 +0100 Added live ISO grub2 efi template and setup commit ecfa3136b5d3199696cfa2e851ea8731d54f01d0 Author: Marcus Schäfer AuthorDate: Tue Jan 12 23:08:51 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 23:08:51 2016 +0100 pep8 fixes commit 36dd77190d74268722d3b1a22f719f95e787508e Author: Marcus Schäfer AuthorDate: Tue Jan 12 22:50:29 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:50:29 2016 +0100 Rebuild schema and data structures commit d82a734a16de69e2047364e7468d9e07259bba9c Author: Marcus Schäfer AuthorDate: Tue Jan 12 15:39:39 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:51 2016 +0100 Don't use filesystem specific mount option When mounting the read write filesystem, prevent using filesystem specific options like barrier commit f614749343c801a0a620fa1da2d6aba41e1ada28 Author: Marcus Schäfer AuthorDate: Tue Jan 12 15:38:08 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:51 2016 +0100 Use HYBRID_EXT4_OPTS in fat container filesystem commit fd68903a7924d4fde0bd7a506bd82ffb74582a18 Author: Marcus Schäfer AuthorDate: Tue Jan 12 15:34:40 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Check read write filesystem prior to mounting If a filesystem type could be identified on the read write partition check it before mounting to eliminate a potential dirty state commit 8e05ac2131a1014b40fa9da3fb49aa6332e3cb2d Author: Marcus Schäfer AuthorDate: Tue Jan 12 15:26:55 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Cascade exfat mount try normal mount first, if this does not work try fuse mount Normally this is done automatically by the mount program but if not we will give the direct fuse mount a chance commit ed1d953005dc2f686b16c550868626fa0bb6acc2 Author: Marcus Schäfer AuthorDate: Mon Jan 11 16:30:09 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Added support for exfat as hybrid filesystem In addition to fat also exfat is now supported as persistent write filesystem. Because of the limitations of a fat filesystem fat and exfat are only used as a container filesystem providing an ext4 linux filesystem as a cowfile. The algorithm to create the size of the cow file has also been changed to use half of the size of the write partition or on fat a max size of 4G. The size of the cowfile is also prepared to become overwritten. However the XML definition and implementation to do this is still missing commit 7ad754b9fef9d7a3343031f0b787b58737bf6dec Author: Marcus Schäfer AuthorDate: Mon Jan 11 16:08:17 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Reread partition table after hybrid setup The hybrid write partition is created via fdisk. Some version of fdisk does not send the ioctl to let the kernel reread the table or fdisk itself holds it busy. Thus we actively initiate a reread via blockdev commit 840b3ec6d8fe4f489b4f395f99b6a744a882277b Author: Marcus Schäfer AuthorDate: Mon Jan 11 16:05:28 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Optimize ext4 hybrid write filesystem options Optimized for 512kB erase block size commit 0c1bcc083ea57abe8ec5ed42278de162c816ee11 Author: Marcus Schäfer AuthorDate: Mon Jan 11 12:54:57 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Use mount options to increase overlay performace For overlay filesystems not writing into a tmpfs performance is more important than safety. We use this combination of options for now, if you encounter stability problems please let us know commit a4bfbd3432497348cdf8a749c11e4fe4f48548e7 Author: Marcus Schäfer AuthorDate: Mon Jan 11 12:32:43 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Use -f force option for extX filesystem checker commit b38671d09ff36dd9a37e82a76f71f9afeea65e32 Author: Marcus Schäfer AuthorDate: Mon Jan 11 12:25:15 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Refactor and cleanup setupReadWrite Fix misleading error message and refactor the code to be less complex and more clear in the processing of tasks commit 8e961c3c218b0174d3be49f015ce3333c8b7b07c Author: Marcus Schäfer AuthorDate: Mon Jan 11 11:38:59 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Allow custom cowfile name for persistent data Instead of a fixed name 'cowfile' we allow a custom name which is predefined in HYBRID_PERSISTENT_FILENAME and prepared to become overwritten by an XML defintion whose implementation will follow later. Reason for the change is that a cowfile is visible as plain data file to the operating system if e.g used on a live stick. It should be more clear to the user what this file is good for commit 109e10fe23fbc455bf73fa66d597332d94a2c6c1 Author: Marcus Schäfer AuthorDate: Mon Jan 11 11:29:23 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Protect mkfs.exfat from being deleted Added to the strip tools section in order to keep it in the initrd commit 054c56fa554383417f8b0cd677db1b984a8317bd Author: Marcus Schäfer AuthorDate: Mon Jan 11 19:11:12 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Make createFileSystem more robust When passing in a loop file instead of a device name, the method should be smart enough to handle the name without shell evaluation commit 67b514cc6f115a3ed25baa1cadb80f12ae428f9e Author: Marcus Schäfer AuthorDate: Mon Jan 11 11:26:23 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Added support for exfat creation and probing In preparation to use exfat instead of vfat in a loop container for persistent data it's required to provide support for mkfs.exfat commit e2646508b44e0ad727a718a9f14be3e107133ead Author: Marcus Schäfer AuthorDate: Mon Jan 11 11:20:24 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:48:50 2016 +0100 Make loop_setup and loop_delete more robust The methods did not cope well with filenames containing bash characters with special meaning e.g spaces. For use with a iso hybrid cowfile whose name is visible in the OS the methods should be able to work with any given filename commit 84f5167f17655131857b9066066840edfa6ee095 Author: Marcus Schäfer AuthorDate: Tue Jan 12 22:47:20 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:47:20 2016 +0100 Allow xfs as hybrid RW file system commit c196705f548f8a01a1437c6afd795c68255bfd68 Author: Marcus Schäfer AuthorDate: Tue Jan 12 16:32:35 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 22:19:07 2016 +0100 Continue with LiveImageBuilder class Added isolinux bootloader setup, finished live build procedure Live metadata injection still missing. grub2 efi boot for live image still missing commit ed7be57e6e70220b06fcd77ca91c4abc09dddabc Author: Marcus Schäfer AuthorDate: Tue Jan 12 10:38:53 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 12 10:38:53 2016 +0100 Fixed Makefile target to build data structures A change in kiwi/schema/kiwi.rnc triggers the build of the schema rng version as well as an auto update of the data structures via python's generateDS. The intermediate xsd schema format is only relevant for the data structure creation process commit 8b056f9928ef071e0b08f69c01a12a0b482d72e9 Author: Marcus Schäfer AuthorDate: Sun Jan 10 19:12:58 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Jan 10 19:12:58 2016 +0100 Started with LiveImageBuilder class Added interface and required steps. tests and implementation are missing and will follow commit 8b2a5690d136687f88b007347c95452a637c03be Author: Marcus Schäfer AuthorDate: Sun Jan 10 14:42:46 2016 +0100 Commit: Marcus Schäfer CommitDate: Sun Jan 10 14:46:29 2016 +0100 Added archive builder commit 0bd3dc7856cdf05646592c935602da5db84d38d7 Author: Marcus Schäfer AuthorDate: Sat Jan 9 21:56:41 2016 +0100 Commit: Marcus Schäfer CommitDate: Sat Jan 9 21:56:41 2016 +0100 Added repo handling to compat caller Also added process execution with translated arguments commit fe4eebd690bcb9a6a36d2f11ee3a23f71bda726d Author: Marcus Schäfer AuthorDate: Fri Jan 8 14:01:07 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 8 14:01:07 2016 +0100 Add compat translation for prepare/create/upgrade commit eae8f9caef5b8dac91891e21c8ecb90f619de08f Author: Marcus Schäfer AuthorDate: Tue Jan 5 17:01:35 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 5 17:01:35 2016 +0100 Added kiwicompat to support legacy commandline commit 91c0b672cea7b11c1036679495851f4560fec24c Author: Marcus Schäfer AuthorDate: Tue Jan 5 15:40:40 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 5 15:40:40 2016 +0100 Added install pxe archive support commit 1a15ee0ba6b69d905531249f608c92406dd78dcd Author: Marcus Schäfer AuthorDate: Tue Jan 5 12:24:03 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 5 12:24:03 2016 +0100 Added warning message if pxedeploy section is used At the moment there is no class to build the pxe client config file from information provided with the optional pxedeploy section. However this is not fatal to the build because the file could be created manually too. Thus a warning message is shown which will go away when the pxe client config file creation has been ported commit 3ef9bcbff2eccfed649f4eb7ccc5058c96201199 Author: Marcus Schäfer AuthorDate: Tue Jan 5 11:46:43 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 5 11:46:43 2016 +0100 cleanup test data to be consistent commit 17402c42ba9fbdbc0d9b9a3add504dc0e2ab22af Author: Marcus Schäfer AuthorDate: Tue Jan 5 11:36:10 2016 +0100 Commit: Marcus Schäfer CommitDate: Tue Jan 5 11:36:10 2016 +0100 Added recovery setup commit c081e364e5b4fb745e8be262ce31452fa449cc31 Author: Marcus Schäfer AuthorDate: Mon Jan 4 12:19:27 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 4 13:15:40 2016 +0100 Added DiskFormatGce class implementation commit a5bc05db6ddb206517ff57fbab23f6cc97fe7ae1 Author: Marcus Schäfer AuthorDate: Mon Jan 4 10:30:05 2016 +0100 Commit: Marcus Schäfer CommitDate: Mon Jan 4 10:30:05 2016 +0100 Fixed suffix name for compressed archives commit c7567338a51a9559c439d50ab7faf325d05d8ed8 Author: Marcus Schäfer AuthorDate: Sat Jan 2 19:17:00 2016 +0100 Commit: Marcus Schäfer CommitDate: Sat Jan 2 19:17:00 2016 +0100 Added creation of gnu and xz archives to tar class commit 0e03524a09dc4fb0af6cccbe50763dcda727538f Author: Marcus Schäfer AuthorDate: Sat Jan 2 18:42:14 2016 +0100 Commit: Marcus Schäfer CommitDate: Sat Jan 2 18:42:14 2016 +0100 Refactor result collection Put the creation of a result object into the builder classes and return them from there. The builder instances knows about the results not the task instances commit 4afa87606228bdb005abeeac8933288a3685d7b2 Author: Marcus Schäfer AuthorDate: Fri Jan 1 22:34:04 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 1 22:55:09 2016 +0100 Fixed option handling for vmdk format commit c408114b39de54feaa26a61fe4ba9b1f61cab495 Author: Marcus Schäfer AuthorDate: Fri Jan 1 22:03:49 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 1 22:09:34 2016 +0100 Activate disk format building in disk builder If disk format and install media is configured together only the install media will be built and a warning message for skipping the disk format is shown commit 87d7273c869b08ecec5b3ac229eea1fc8a2cd1d7 Author: Marcus Schäfer AuthorDate: Fri Jan 1 21:03:47 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 1 21:03:47 2016 +0100 Added custom argument handling for disk formats commit 7ddb0ae86b6fd63147f61c0ad51eba7d228e524e Author: Marcus Schäfer AuthorDate: Fri Jan 1 19:18:29 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 1 19:18:29 2016 +0100 Added DiskFormat factory commit 660bd9ad28a19b07009c10aa008524943d60e4bb Author: Marcus Schäfer AuthorDate: Fri Jan 1 19:07:19 2016 +0100 Commit: Marcus Schäfer CommitDate: Fri Jan 1 19:07:19 2016 +0100 Added DiskFormatVmdk class implementation commit 00b8ae10661d5f0f354330ddb06f47253fa7f1f3 Author: Marcus Schäfer AuthorDate: Tue Dec 29 18:36:42 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 29 18:36:42 2015 +0100 pep8 fixes commit 0bc56e824dc60a2836de37fcd4f24c126865a98d Author: Marcus Schäfer AuthorDate: Tue Dec 29 18:34:42 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 29 18:34:42 2015 +0100 Added DiskFormatVhdFixed class implementation commit 434006464880b477ffb2026307876224b1142dba Author: Marcus Schäfer AuthorDate: Tue Dec 29 18:33:47 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 29 18:33:47 2015 +0100 Delete unused test data symlinks commit b1ba8d5e10f1bf3150468ce4dd45d87680dfc7a4 Author: Marcus Schäfer AuthorDate: Wed Dec 23 16:38:40 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 23 16:38:40 2015 +0100 Added DiskFormatVhd class implementation commit b8192a6c451008de6c4fc1e17bc0bb7d6b389950 Author: Marcus Schäfer AuthorDate: Wed Dec 23 12:57:54 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 23 12:57:54 2015 +0100 Added DiskFormat base class Also added implementation for DiskFormatQcow2. More format classes will follow next commit a0d527777a92428b7c0d56456b27138882ce93fc Author: Marcus Schäfer AuthorDate: Wed Dec 23 10:58:35 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 23 10:58:35 2015 +0100 Fixed import of kernel parameters including spaces Kernel parameters like PRODUCT_TYPE=“PRODUCT BANANA” breaks the code in includeKernelParameters. This patch allows spaces for values in a way that it replaces the embedded whitespace with \030 before parsing and then reverting after parsing. Thanks to Jay Nitikman for providing the patch commit 6793fe6d02e3dbaf654ef023840232002c735cc5 Author: Marcus Schäfer AuthorDate: Tue Dec 22 19:44:49 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 22 19:44:49 2015 +0100 Fixed LUKS setup for dracut The system image has to provide /etc/crypttab to allow dracut to create a working initrd for reboot. In addition the name of the luks map must be 'luks' to make dracut happy. commit d2f71d0b0c20862c6258b64b2eb5e905055fceb1 Author: Marcus Schäfer AuthorDate: Tue Dec 22 18:34:56 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 22 18:34:56 2015 +0100 luks setup triggers boot partition by default commit a724baf75ed3c2d922db01b442f30500e82cfd08 Author: Marcus Schäfer AuthorDate: Tue Dec 22 11:30:54 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 22 14:13:11 2015 +0100 Add LuksDevice class and implementation Also implemented luks support in DiskBuilder commit 54726ba9d729229a88a6eaa1c2c901b79535d077 Author: Marcus Schäfer AuthorDate: Tue Dec 22 09:39:36 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 22 09:39:36 2015 +0100 Handle /boot/vc files for Raspberry Pi openSUSE Tumbleweed raspberrypi-firmware[-branding-openSUSE] packages have been updated to install files to /boot/vc rather than /boot. Ensure that all files in /boot/vc are provided in image/loader for further reference commit 9bf7f110ae0cc7fd2ca440a918d67124df57cd85 Author: Marcus Schäfer AuthorDate: Tue Dec 22 09:37:00 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 22 09:37:00 2015 +0100 Refactor file system check in boot code commit 742a8723f3d9a19cbd52a92a7d39c7d64fa2fb3c Author: Marcus Schäfer AuthorDate: Mon Dec 21 16:50:53 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 21 16:53:16 2015 +0100 Make sure VolumeManager instance updates root map An instance of volume manager could cause the creation of a new device e.g in case of LVM. The master device map in the disk builder has to be updated with this device commit d8efad6db491f4e7c7600cd5573f18d936b98570 Author: Marcus Schäfer AuthorDate: Mon Dec 21 16:23:45 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 21 16:23:45 2015 +0100 Fixed unconditional lookup of boot partition id commit 05c3ccadcd406431640ada624ed0b8e24f027902 Author: Marcus Schäfer AuthorDate: Mon Dec 21 12:17:10 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 21 12:18:53 2015 +0100 Package check for packages marked for deletion If none of the packages to become deleted are installed we will raise an error, basically to force people to fixup the image description commit 39aae1e154304f36129b52c03e0f5d5afd7f1625 Author: Marcus Schäfer AuthorDate: Mon Dec 21 11:57:53 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 21 12:18:53 2015 +0100 Better error message for call with unknown command If kiwi is called with an unknown command an error message showing which commands actually exists should be shown commit fe2ddcfad9c53b8b45848a98839e2b826f950543 Author: Marcus Schäfer AuthorDate: Mon Dec 21 11:32:11 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 21 11:32:11 2015 +0100 Fixed user group creation The command name is groupadd not addgroup commit 731069daf17f86aa9e2e074806e66c92a364bd73 Author: Marcus Schäfer AuthorDate: Mon Dec 21 10:19:37 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 21 10:19:37 2015 +0100 Fixed label and UUID support for XFS creation commit c8e58b583859dfb1b162b579aa892550be5a706d Author: Marcus Schäfer AuthorDate: Mon Dec 21 10:07:34 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 21 10:07:34 2015 +0100 Traverse dictionary in ordered mode commit a04d34e14578080da53455a636d534d0503c4f42 Author: Marcus Schäfer AuthorDate: Mon Dec 21 09:53:01 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 21 09:53:01 2015 +0100 Return sorted lists for packages/archives commit cf0bc6566700faf11446cc31376485e811214aab Author: Marcus Schäfer AuthorDate: Mon Dec 21 09:43:53 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 21 09:43:53 2015 +0100 Traverse dictionary in ordered mode commit a843a7880452c18330ba18785e9f778454cab02f Author: Marcus Schäfer AuthorDate: Mon Dec 21 09:17:46 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 21 09:17:46 2015 +0100 Traverse dictionary in ordered mode commit 115ee5d4bdbe1bfaeb90cee3d9284e70e1b69116 Author: Marcus Schäfer AuthorDate: Mon Dec 21 09:12:03 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 21 09:12:03 2015 +0100 Traverse dictionary in ordered mode commit cd3ae5e3c5804c71a66bbe897724d268645138ae Author: Marcus Schäfer AuthorDate: Fri Dec 18 16:18:22 2015 +0100 Commit: Marcus Schäfer CommitDate: Fri Dec 18 16:46:04 2015 +0100 Added __githash__ to version.py Any time the version.py is changed and committed the git ident will be reset by git. After a checkout of version.py the ident will be updated in version.py to the git commit id of version.py Whenever we relase a new kiwi version the process is as follows: 1. run bumpversion to set the version for the release 2. run tox to create the source tarball for the release We have to make sure tox calls a git checkout of version.py commit 65466ea8e731318a35d7067150198307472af7f6 Author: Marcus Schäfer AuthorDate: Thu Dec 17 15:46:58 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 17 15:46:58 2015 +0100 Consolidate use of Makefiles for schema conversion As we are going to switch to tox the Makefile setup should be cleaned up. The make targets to build xsd and rng schemas has been moved to the master Makefile commit 34f98a745822ab771c3ee57440bb38928081ac84 Author: Marcus Schäfer AuthorDate: Thu Dec 17 15:41:56 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 17 15:41:56 2015 +0100 Consolidate use of Makefiles for locale setup As we are going to switch to tox the Makefile setup should be cleaned up. The make targets to handle po files and their installation has now been moved to the master Makefile commit 712c1b6053de8164cb5dcd306603ba7688e9e600 Author: Marcus Schäfer AuthorDate: Thu Dec 17 15:29:37 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 17 15:29:37 2015 +0100 Update translation po files with template commit cfd66dd6eca58c81b47a66ef6cb8a9b8941fa56c Author: Marcus Schäfer AuthorDate: Thu Dec 17 14:43:18 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 17 14:43:18 2015 +0100 Consolidate use of Makefiles for compiling tools As we are going to switch to tox the Makefile setup should be cleaned up. I'm going to move the various places and its tasks into one master Makefile to make it easier to move the targets one after the other into a tox setup. commit 4a4eb6c646e9637991293e0cac3ad59e8c27e547 Author: Marcus Schäfer AuthorDate: Thu Dec 17 11:26:49 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 17 11:26:49 2015 +0100 Refactor source code structure All files referenced by kiwi should live below the kiwi namespace and should be referenced by the resource_filename() method from the pkg_resources commit d808b241b77b05b2d137be068e0073a55f25afcd Author: Marcus Schäfer AuthorDate: Wed Dec 16 12:01:17 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 16 12:01:17 2015 +0100 Update exclude list for boot image runtime data There are some directories needed during boot image creation time, e.g grub2 modules to create grub images. But at boot time this data is no longer required and would just waste space in the initrd commit 2ec322add7c78104d31c235c55aa94f8b51985a8 Author: Marcus Schäfer AuthorDate: Wed Dec 16 11:59:39 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 16 11:59:39 2015 +0100 Delete dracut from boot images dracut is needed in the system and also called from there by the kiwi boot image, but inside of the boot image it is not needed and just wastes space commit 9d625b987a85c8a7854a7bdf27ef21a791ee888c Author: Marcus Schäfer AuthorDate: Wed Dec 16 11:59:00 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 16 11:59:00 2015 +0100 Add some paths not needed in the boot image commit 845150aef2bf552e840b86c4ec173d3375708369 Author: Marcus Schäfer AuthorDate: Wed Dec 16 10:59:10 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 16 11:04:23 2015 +0100 Added boot messages translations commit e29d290473878831df55c7dcab6a2e86d1edb21c Author: Marcus Schäfer AuthorDate: Wed Dec 16 10:41:14 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 16 10:41:14 2015 +0100 Exclude /image from boot images commit 200824bb357f938c1a5e15584e4883d95ea319ce Author: Marcus Schäfer AuthorDate: Wed Dec 16 10:38:29 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 16 10:38:29 2015 +0100 Change default boot image description path Let the default boot image description path point to boot/arch commit 92d53decf2bb73052c053721bd82f2ad16480cdf Author: Marcus Schäfer AuthorDate: Wed Dec 16 10:30:58 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 16 10:30:58 2015 +0100 Make sure the boot image profile provides its name The variable kiwi_initrdname was added to the .profile environment for boot image builds commit bf6f46cdff7ae49fc61fb6d9dc4a059eb5301ed0 Author: Marcus Schäfer AuthorDate: Wed Dec 16 10:30:16 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 16 10:30:16 2015 +0100 Update boot image functions Delete a lot of legacy code from the bash boot code commit 0861179f03a76d9a829b026af3a7cd8398a056e1 Author: Marcus Schäfer AuthorDate: Wed Dec 16 10:29:19 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 16 10:29:19 2015 +0100 Added boot image descriptions Provide boot(initrd) image descriptions for supported architectures and distributions commit 8ff532847e76a28b61cfef36dbf12bda96c81575 Author: Marcus Schäfer AuthorDate: Tue Dec 15 15:40:22 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 15 15:40:22 2015 +0100 Fixed unit tests, mock NamedTemporaryFile commit 3d065e5a85b50318f2aa64ac63d3760dc20d7059 Author: Marcus Schäfer AuthorDate: Tue Dec 15 15:05:32 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 15 15:05:32 2015 +0100 Added coverage to developer requirements commit f00d4eb727d96d801009cd7d6dbff1307b314438 Author: Thomas Schraitle AuthorDate: Tue Dec 15 14:01:07 2015 +0100 Commit: Thomas Schraitle CommitDate: Tue Dec 15 14:01:07 2015 +0100 Use "next generation" string To distinguish it between old and new KIWI commit d29925867519bee34bb39a179db62dd8159902fe Author: Thomas Schraitle AuthorDate: Tue Dec 15 13:17:19 2015 +0100 Commit: Thomas Schraitle CommitDate: Tue Dec 15 13:26:45 2015 +0100 Review and add corrections * Consistent spelling: kiwi -> KIWI, python -> Python * Add punctuation * Use backticks for scripts and dirs commit 6e00c74e61aa9084cf90eee50271f6692775dd10 Author: Marcus Schäfer AuthorDate: Tue Dec 15 12:41:05 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 15 12:41:05 2015 +0100 Update development status to be inline with setup.py commit 3eace7f90d7d7da173e73f26c70d492567f4c92c Author: Marcus Schäfer AuthorDate: Tue Dec 15 12:33:06 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 15 12:33:06 2015 +0100 Deleted no longer needed bin/kiwi script commit 2ca8916618ab412a893283f9db5c6eae5b0ef7b3 Author: Marcus Schäfer AuthorDate: Tue Dec 15 12:32:32 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 15 12:32:32 2015 +0100 Update README Added developer information how to contribute commit 02f4bdfd167dca4e13054b985e952424824631ab Author: Marcus Schäfer AuthorDate: Tue Dec 15 12:19:31 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 15 12:19:31 2015 +0100 Minor changes in virtualenv setup file names Moved the requirements.txt setup files into a namespace called .virtualenv in order to stay compatible with the .travis requirement files commit 1bff89565ec8ca583884814f96a737461b8af734 Author: Marcus Schäfer AuthorDate: Tue Dec 15 11:55:01 2015 +0100 Commit: Marcus Schäfer CommitDate: Tue Dec 15 11:55:01 2015 +0100 Update development status in setup.py commit 64424b3884ea6a25757c4da1fb775aa06092fcde Author: Thomas Schraitle AuthorDate: Mon Dec 14 22:01:00 2015 +0100 Commit: Thomas Schraitle CommitDate: Mon Dec 14 23:03:25 2015 +0100 Fix #3: Requirement for Virtual Envs * Add requirements.txt and dev-requirements.txt The dev-requirements.txt installs requirements.txt automatically * Ignore .env, .env2, and .env3 virtual env directories commit 098f72079868f8ec0f4e7fb973629827eff3040f Author: Thomas Schraitle AuthorDate: Mon Dec 14 22:28:52 2015 +0100 Commit: Thomas Schraitle CommitDate: Mon Dec 14 22:32:25 2015 +0100 Fix #5: Improve setup.py * setup.py: - use setuptools always, no need to check for distutils - include keywords 'include_package_data', 'zip_safe', and 'classifiers' * setup.cfg: - add bdist_wheel and sdist section * Add missing MANIFEST.in (needed for setup.py dist) * Remove executable bit for LICENSE and README.md commit 3bd50f18d56317745bb3b3a089b919ee5b88d90c Author: Thomas Schraitle AuthorDate: Mon Dec 14 21:16:41 2015 +0100 Commit: Thomas Schraitle CommitDate: Mon Dec 14 21:16:41 2015 +0100 Fix #4: support bumpversion with .bumpversion.cfg commit 62c077e8caf6ace7e06fb728451fe73dfa7c2f0b Author: Marcus Schäfer AuthorDate: Mon Dec 14 17:31:55 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 14 17:31:55 2015 +0100 Added RaidDevice class implementation in disk_builder commit 68ce70f10e79f706663d70edc51884ce9ae2ca2d Author: Marcus Schäfer AuthorDate: Fri Dec 11 18:15:37 2015 +0100 Commit: Marcus Schäfer CommitDate: Fri Dec 11 18:15:37 2015 +0100 Fixed hybrid call offset number should be passed as string to Command commit 686e6d1bba620ac6d24fd7a928d2757d96fd750d Author: Thomas Schraitle AuthorDate: Fri Dec 11 16:42:50 2015 +0100 Commit: Thomas Schraitle CommitDate: Fri Dec 11 16:42:50 2015 +0100 __VERSION__ -> __version__ commit d0519409ee9d5bac047594d8f7f74e0af97ae2f3 Author: Thomas Schraitle AuthorDate: Fri Dec 11 16:33:24 2015 +0100 Commit: Thomas Schraitle CommitDate: Fri Dec 11 16:33:24 2015 +0100 Rename __VERSION__ -> __version__ commit 7d596adc2e332492cc537e4b4ad4bf9b00b0abaf Author: Marcus Schäfer AuthorDate: Thu Dec 10 18:18:54 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 10 18:18:54 2015 +0100 Added hybrid ISO setup commit ded33d52124ff909ac5814f08dd035101d5d377f Author: Marcus Schäfer AuthorDate: Thu Dec 10 17:43:04 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 10 17:43:04 2015 +0100 Refactor creation of a PackageManager factory commit ada5b1a666afb6c75d646ac553d7b63966496f04 Author: Marcus Schäfer AuthorDate: Thu Dec 10 17:41:14 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 10 17:41:14 2015 +0100 Refactor creation of a Repository factory commit 77911a3f67207552632cd4ab3ae83f7f8cd87e8b Author: Marcus Schäfer AuthorDate: Thu Dec 10 17:39:06 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 10 17:39:06 2015 +0100 Refactor creation of a BootLoaderInstall factory commit 1649939ed01bda04496e509ad0d561b37a991d8d Author: Marcus Schäfer AuthorDate: Thu Dec 10 17:36:40 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 10 17:36:40 2015 +0100 Refactor creation of a VolumeManager factory commit c508c8838e931186b506869d668852cfea5fcc99 Author: Marcus Schäfer AuthorDate: Thu Dec 10 17:34:13 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 10 17:34:13 2015 +0100 Refactor creation of a BootLoaderConfig factory commit b6586b4ba6a7013811f5df0e5950f4f79469c7a9 Author: Marcus Schäfer AuthorDate: Thu Dec 10 17:30:34 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 10 17:30:34 2015 +0100 Refactor creation of a Partitioner factory commit 4f95bd084a44d289dd02330f16bd27485b9c5d08 Author: Marcus Schäfer AuthorDate: Thu Dec 10 16:54:07 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 10 16:54:07 2015 +0100 Refactor creation of a FileSystem factory commit adb7da5fa8373f2821c147e58f6bdbad623da82b Author: Marcus Schäfer AuthorDate: Thu Dec 10 14:01:10 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 10 14:01:10 2015 +0100 Fixed travis setup commit abc917b0fa1b637aae8d807fc583bd254134c0ff Author: Marcus Schäfer AuthorDate: Thu Dec 10 09:39:05 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 10 09:39:05 2015 +0100 Refactor InstallImageBuilder no need to provide the name of the disk image, this information can be created from the xml state commit 5587117f7ee97d4e6b4fd764c0d8a935ef3ddbcf Author: Marcus Schäfer AuthorDate: Thu Dec 10 09:29:17 2015 +0100 Commit: Marcus Schäfer CommitDate: Thu Dec 10 09:29:17 2015 +0100 Fixed missing md5 file on install media commit 5ca5e44221d7cf5a5dad01e72d39e82dd0fd660d Author: Marcus Schäfer AuthorDate: Wed Dec 9 18:10:26 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 9 18:10:26 2015 +0100 Travis testing needs cdrtools for isoinfo commit 2c8df54ee30fba0ad83343a4cd6c41e1c993be1b Author: Marcus Schäfer AuthorDate: Wed Dec 9 18:00:53 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 9 18:00:53 2015 +0100 Added two pass ISO creation system The kiwi ISO's are prepared to be hybrid by adding an end header block so that isohybrid can place its gpt header at the correct offset address commit a6e1d24c9fb709e79f6934ed10521bb20dcef4d4 Author: Marcus Schäfer AuthorDate: Wed Dec 9 17:59:59 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 9 17:59:59 2015 +0100 Added user log messages for install media builder commit e1f092934831b8a628aa79ec2375231f8838432d Author: Marcus Schäfer AuthorDate: Wed Dec 9 17:59:17 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 9 17:59:17 2015 +0100 Fixed grub bootloader template for install case Template was missing the cdinst option commit ff52d672fe9e94cb377b821bcc9afbde2014a313 Author: Marcus Schäfer AuthorDate: Wed Dec 9 17:06:22 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 9 17:06:22 2015 +0100 Added create_header_end_block method in Iso class commit f4d3711aa59f24a1fda3534371c3c3aa7734c8a7 Author: Marcus Schäfer AuthorDate: Wed Dec 9 12:53:00 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 9 12:53:00 2015 +0100 Added isols method in Iso class commit d561c23697518fe6adf38760ea72fbea4f045b3e Author: Marcus Schäfer AuthorDate: Wed Dec 9 10:44:16 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 9 10:44:16 2015 +0100 Fixed ui theme setup in isolinux.cfg commit 61ea327a4c6b5daed617147fffddf22ea2df1ec2 Author: Marcus Schäfer AuthorDate: Wed Dec 9 10:39:21 2015 +0100 Commit: Marcus Schäfer CommitDate: Wed Dec 9 10:39:21 2015 +0100 Added isolinux bootloader support commit 48a96d65287e9b2d9921a9d304ce028e4ae21b7d Author: Marcus Schäfer AuthorDate: Mon Dec 7 12:00:54 2015 +0100 Commit: Marcus Schäfer CommitDate: Mon Dec 7 12:00:54 2015 +0100 Prevent zypper failing on outdated system solvable commit 205a073b6d43cba3b7ce0b8dc0e6924466f343eb Author: Marcus Schäfer AuthorDate: Sun Dec 6 20:48:57 2015 +0100 Commit: Marcus Schäfer CommitDate: Sun Dec 6 20:48:57 2015 +0100 landscape: fix unused imports commit 6be405d98630100643daa49af4ff1c17fece6f0a Author: Marcus Schäfer AuthorDate: Sun Dec 6 20:43:38 2015 +0100 Commit: Marcus Schäfer CommitDate: Sun Dec 6 20:43:38 2015 +0100 Refactor boot data extraction from boot image Allow data extraction multiple times, don't move files away from their original location commit 83364d2ced7cbf1666197521ca700ab45c66575d Author: Marcus Schäfer AuthorDate: Sat Dec 5 22:47:52 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 22:47:52 2015 +0100 landscape: fix unused imports commit 455fe23ffbf03a64b118a7efe6985e712bfc4c42 Author: Marcus Schäfer AuthorDate: Sat Dec 5 22:46:30 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 22:46:30 2015 +0100 landscape: fix unused variables commit 7edead83b970149e3a7498cf79b878449b685289 Author: Marcus Schäfer AuthorDate: Sat Dec 5 22:34:47 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 22:34:47 2015 +0100 Add debug message for repo cleanup commit 77a8860d7c2672dcf894ebdfab693486caa6ac43 Author: Marcus Schäfer AuthorDate: Sat Dec 5 22:17:27 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 22:17:27 2015 +0100 landscape: fix unused variables commit 70a756e3595ab9c3af9b614a351e26d44537d92f Author: Marcus Schäfer AuthorDate: Sat Dec 5 21:53:51 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 21:53:51 2015 +0100 landscape: fix unused imports commit 1c11967a0424419674a1cdb25fc9c5e2b687ecda Author: Marcus Schäfer AuthorDate: Sat Dec 5 21:17:15 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 21:17:15 2015 +0100 landscape: fix dangerous defaults commit 5322eb9d79fabeb8ee6c62aa7074cf1203a4d3f4 Author: Marcus Schäfer AuthorDate: Sat Dec 5 21:15:43 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 21:15:43 2015 +0100 landscape: fix dangerous defaults commit 0fcb8aea2160ea8b2913744a8cc6130e337ea1c6 Author: Marcus Schäfer AuthorDate: Sat Dec 5 21:04:53 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 21:04:53 2015 +0100 Added landscap config file skip checking auto generated code commit fbf46c2ee49ebfe093d8deca4d5af960eaf0af4f Author: Marcus Schäfer AuthorDate: Sat Dec 5 19:37:22 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 19:37:22 2015 +0100 Update README commit 244e4cf6aab7c0064aa0764c8054ecaf57c53a5b Author: Marcus Schäfer AuthorDate: Sat Dec 5 19:35:27 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 19:35:27 2015 +0100 Set naster branch for travis setup commit b6e40cba63f99217e898545e6dd74b449a843cdf Author: Marcus Schäfer AuthorDate: Sat Dec 5 17:00:02 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 17:00:02 2015 +0100 Update README commit d032b9558adb13f143dba1b2448b20b97763a59d Author: Marcus Schäfer AuthorDate: Sat Dec 5 16:53:01 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 16:53:01 2015 +0100 Update README Travis and Landscape status commit a4a4450b6ccadac8f8eea6370707fd64486e3230 Author: Marcus Schäfer AuthorDate: Sat Dec 5 16:51:08 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 16:51:08 2015 +0100 Update README commit 9a0c51de3e9f35435edc67fc52f03d8884899ab2 Author: Marcus Schäfer AuthorDate: Sat Dec 5 16:46:24 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 16:46:24 2015 +0100 Update README commit 09daca60c0e0ed608cf42b121be6453f7d8bdd37 Author: Marcus Schäfer AuthorDate: Sat Dec 5 16:17:10 2015 +0100 Commit: Marcus Schäfer CommitDate: Sat Dec 5 16:17:10 2015 +0100 KIWI - appliance builder next generation a rewrite of the current kiwi from https://github.com/openSUSE/kiwi ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7573156 kiwi-11.1.8/package/python-kiwi.changes.deb6ca.fix0000644000000000000000000000101215273675667016634 0ustar00commit deb6ca8631f655e8b99e96582245714256d2954f Author: David Cassany AuthorDate: Fri Feb 16 15:08:49 2024 +0100 Commit: David Cassany CommitDate: Fri Feb 16 15:08:49 2024 +0100 Include partprobe in initrd for s390 This commit includes partprobe, in addition to parted, on s390 based systems. Otherwise partx is used and apparently it does not properly support s390. Fixes bsc#1219798 Signed-off-by: David Cassany ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7573156 kiwi-11.1.8/package/systemd-tmpfiles-for-suse.conf0000644000000000000000000000033615273675667017041 0ustar00d /srv/tftpboot 0755 tftp tftp d /srv/tftpboot/KIWI 0755 tftp tftp d /srv/tftpboot/pxelinux.cfg 0755 tftp tftp d /srv/tftpboot/image 0755 tftp tftp d /srv/tftpboot/upload 0755 tftp tftp d /srv/tftpboot/boot 0755 tftp tftp ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7573156 kiwi-11.1.8/pyproject.toml0000644000000000000000000000713715273675667012447 0ustar00[tool.poetry] name = "kiwi" version = "11.1.8" description = "KIWI - Appliance Builder" license = "GPL-3.0-or-later" readme = "README.rst" homepage = "https://osinside.github.io/kiwi/" documentation = "https://osinside.github.io/kiwi/" repository = "https://github.com/OSInside/kiwi" authors = [ "Marcus Schäfer ", ] maintainers = [ "Marcus Schäfer ", "David Cassany Viladomat ", "Neal Gompa ", "Dan Čermák ", ] packages = [ { include = "kiwi"}, ] include = [ { path = "completions", format = "sdist" }, { path = ".bumpversion.cfg", format = "sdist" }, { path = ".coverage*", format = "sdist" }, { path = "setup.cfg", format = "sdist" }, { path = "doc/source", format = "sdist" }, { path = "doc/Makefile", format = "sdist" }, { path = "dracut", format = "sdist" }, { path = "helper", format = "sdist" }, { path = "kiwi.yml", format = "sdist" }, { path = "build-tests.sh", format = "sdist" }, { path = "Makefile", format = "sdist" }, { path = "package", format = "sdist" }, { path = "selinux", format = "sdist" }, { path = "test", format = "sdist" }, { path = "kiwi/runtime_checker_metadata.yml", format = "sdist" }, ] classifiers = [ # classifier: http://pypi.python.org/pypi?%3Aaction=list_classifiers "Development Status :: 5 - Production/Stable", "Intended Audience :: Developers", "Operating System :: POSIX :: Linux", "Topic :: System :: Operating System", ] [tool.poetry.urls] "Bug Tracker" = "https://github.com/OSInside/kiwi/issues" [tool.poetry.dependencies] python = "^3.9" typer = ">=0.19.0" lxml = ">=4.6.0" requests = ">=2.25.0" PyYAML = ">=5.4.0" simplejson = ">=3.17.0" Cerberus = ">=1.3.0" progressbar2 = ">=3.53" # Optional dependencies for markup extra anymarkup-core = { version = ">=0.8.0", optional = true } xmltodict = { version = ">=0.12.0", optional = true } toml = { version = "*", optional = true } solv = { version = "*", optional = true } [tool.poetry.extras] markup = [ "anymarkup-core", "xmltodict" , "toml" ] integration_tests = ["pytest-container"] libsolv = ["solv" ] [tool.poetry.plugins] [tool.poetry.plugins."kiwi.tasks"] image_info = "kiwi.tasks.image_info" image_resize = "kiwi.tasks.image_resize" result_bundle = "kiwi.tasks.result_bundle" result_list = "kiwi.tasks.result_list" system_boxbuild = "kiwi.tasks.system_boxbuild" system_build = "kiwi.tasks.system_build" system_create = "kiwi.tasks.system_create" system_prepare = "kiwi.tasks.system_prepare" system_stackbuild = "kiwi.tasks.system_stackbuild" system_stash = "kiwi.tasks.system_stash" system_update = "kiwi.tasks.system_update" [tool.poetry.scripts] kiwi-ng = "kiwi.kiwi:main" [tool.poetry.group.test] [tool.poetry.group.test.dependencies] # python unit testing framework pytest = ">=6.2.0" pytest-cov = "*" pytest-xdist = "*" # Optional dependencies for shell functions integration tests pytest-container = {version = "*", optional = true} # type checking mypy = ">=0.971" types-requests = "*" types-PyYAML = "*" types-mock = "*" types-simplejson = "*" [tool.poetry.group.style] [tool.poetry.group.style.dependencies] flake8 = ">=4.0.0" [tool.poetry.group.docs] [tool.poetry.group.docs.dependencies] sphinx = ">=5.0.0" sphinx_rtd_theme = "*" sphinxcontrib-spelling = "*" pyenchant = "*" ghp-import = "*" pdoc = ">=12.0.0" [tool.poetry.group.development] [tool.poetry.group.development.dependencies] python-dateutil = "*" generateDS = "==2.29.24" bumpversion = "*" black = "==25.11.0" [build-system] requires = ["poetry-core>=1.2.0"] build-backend = "poetry.core.masonry.api" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7573156 kiwi-11.1.8/selinux/Makefile0000644000000000000000000000166615273675667012663 0ustar00# This file is part of kiwi # Copyright (C) 2026 Neal Gompa # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 3 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU Library General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this. If not, see . TARGETS?= kiwi SHARE?=/usr/share MODULES?=${TARGETS:=.pp.bz2} all: ${TARGETS:=.pp.bz2} %.pp.bz2: %.pp @echo Compressing $^ -\ $@ bzip2 -9 $^ %.pp: %.te make -f ${SHARE}/selinux/devel/Makefile $@ clean: rm -f *~ *.tc *.pp *.pp.bz2 rm -rf tmp ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7585878 kiwi-11.1.8/selinux/README.md0000644000000000000000000000140115273675667012465 0ustar00# kiwi-selinux This is the SELinux policy module for the [kiwi image builder tool](https://osinside.github.io/kiwi). ## Licensing Copyright (C) 2026 Neal Gompa This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 3 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this. If not, see . ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7585878 kiwi-11.1.8/selinux/kiwi.fc0000644000000000000000000000150315273675667012466 0ustar00# This file is part of kiwi # Copyright (C) 2026 Neal Gompa # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 3 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU Library General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this. If not, see . /usr/bin/kiwi -- gen_context(system_u:object_r:kiwi_exec_t,s0) /usr/bin/kiwi-ng(.*) -- gen_context(system_u:object_r:kiwi_exec_t,s0) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7585878 kiwi-11.1.8/selinux/kiwi.if0000644000000000000000000000540115273675667012475 0ustar00# This file is part of kiwi # Copyright (C) 2026 Neal Gompa # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 3 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU Library General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this. If not, see . ## policy for kiwi ######################################## ## ## Execute kiwi_exec_t in the kiwi domain. ## ## ## ## Domain allowed to transition. ## ## # interface(`kiwi_domtrans',` gen_require(` type kiwi_t, kiwi_exec_t; ') corecmd_search_bin($1) domtrans_pattern($1, kiwi_exec_t, kiwi_t) ') ###################################### ## ## Execute kiwi in the caller domain. ## ## ## ## Domain allowed access. ## ## # interface(`kiwi_exec',` gen_require(` type kiwi_exec_t; ') corecmd_search_bin($1) can_exec($1, kiwi_exec_t) ') ######################################## ## ## Execute kiwi in the kiwi domain, and ## allow the specified role the kiwi domain. ## ## ## ## Domain allowed to transition ## ## ## ## ## The role to be allowed the kiwi domain. ## ## # interface(`kiwi_run',` gen_require(` type kiwi_t; attribute_role kiwi_roles; ') kiwi_domtrans($1) roleattribute $2 kiwi_roles; ') ######################################## ## ## Role access for kiwi ## ## ## ## Role allowed access ## ## ## ## ## User domain for the role ## ## # interface(`kiwi_role',` gen_require(` type kiwi_t; attribute_role kiwi_roles; ') roleattribute $1 kiwi_roles; kiwi_domtrans($2) ps_process_pattern($2, kiwi_t) allow $2 kiwi_t:process { signull signal sigkill }; ') ######################################## ## ## kiwi nnp / nosuid transitions to domain ## ## ## ## Domain to be allowed to transition into. ## ## # interface(`kiwi_nnp_nosuid_trans',` gen_require(` type kiwi_t; class process2 { nnp_transition nosuid_transition }; ') allow kiwi_t $1:process2 {nnp_transition nosuid_transition}; ') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7585878 kiwi-11.1.8/selinux/kiwi.te0000644000000000000000000000413615273675667012513 0ustar00# This file is part of kiwi # Copyright (C) 2026 Neal Gompa # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 3 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU Library General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this. If not, see . policy_module(kiwi, 1.0.0) ######################################## # # Declarations # attribute_role kiwi_roles; roleattribute system_r kiwi_roles; type kiwi_t; type kiwi_exec_t; application_domain(kiwi_t, kiwi_exec_t) role kiwi_roles types kiwi_t; ######################################## # # kiwi local policy # allow kiwi_t self:fifo_file manage_fifo_file_perms; allow kiwi_t self:unix_stream_socket create_stream_socket_perms; # ##################################### # Customization # # make an kiwi_t unconfined domain unconfined_domain(kiwi_t) # execute setfiles in the setfiles_mac domain # when in the kiwi_t domain seutil_domtrans_setfiles_mac(kiwi_t) kiwi_nnp_nosuid_trans(setfiles_mac_t) # allow the package manager running in the kiwi_t domain # to execute package scriptlets in the rpm_script_t domain optional_policy(` rpm_transition_script(kiwi_t, kiwi_roles) ') # Allow sysadm and unconfined to run kiwi optional_policy(` gen_require(` type sysadm_t; role sysadm_r; ') kiwi_run(sysadm_t, sysadm_r) ') optional_policy(` gen_require(` type unconfined_t; role unconfined_r; ') kiwi_run(unconfined_t, unconfined_r) ') optional_policy(` gen_require(` type unconfined_service_t; role system_r; ') kiwi_run(unconfined_service_t, system_r) ') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7585878 kiwi-11.1.8/setup.cfg0000644000000000000000000000201515273675667011342 0ustar00[sdist] # Used by setup.py sdist formats=gztar [tool:pytest] norecursedirs = .git build .tox/ .tmp/ addopts = --ignore=.tmp/ --ignore=.git/ --ignore=.tox/ -p no:warnings testpaths = test/unit [flake8] # For error codes, see # http://pep8.readthedocs.org/en/latest/intro.html#error-codes # # This file is generated automatically: exclude=xml_parse.py # we allow long lines (E501) # we ignore warnings about quoting of escape sequences (W605) # black intentionally violates PEP 8: E203, whitespace before : # black intentionally violates PEP 8: W503 line break before binary operator # black intentionally violates PEP 8: E704 multiple statements on one line ignore = E501, W605, E203, W503, E704 # we allow a custom complexity level max-complexity = 28 [doc8] max-line-length = 90 verbose = 1 [mypy] ignore_missing_imports = True # every function has to be fully annotated disallow_untyped_defs = True disallow_incomplete_defs = True warn_unused_ignores = True [mypy-kiwi.xml_parse.*] # skip auto generated code ignore_errors = True ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.758792 kiwi-11.1.8/test/data/.config/kiwi/config.yml0000644000000000000000000000005315273675667015667 0ustar00--- # Example config file for unit testing ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.758792 kiwi-11.1.8/test/data/__init__.py0000644000000000000000000000000015273675667013512 0ustar00././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.758792 kiwi-11.1.8/test/data/appx/AppxManifest.xml0000644000000000000000000000471415273675667015512 0ustar00 @PRETTY_NAME@ @PUBLISHER_DISPLAY_NAME@ Assets\StoreLogo.png ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.758792 kiwi-11.1.8/test/data/bootinfo.txt0000644000000000000000000000024015273675667013767 0ustar00 Bob Bob boot &device;:1,\boot\grub2\powerpc-ieee1275\grub.elf ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.758792 kiwi-11.1.8/test/data/boxbuild/kiwi_boxed_plugin.yml0000644000000000000000000000277415273675667017462 0ustar00box: - name: suse mem_mb: 8096M processors: 4 console: hvc0 arch: - name: x86_64 cmdline: - root=/dev/vda1 - rd.plymouth=0 source: obs://Virtualization:Appliances:SelfContained:suse/images packages_file: SUSE-Box.x86_64-1.42.1-System-BuildBox.report boxfiles: - SUSE-Box.x86_64-1.42.1-Kernel-BuildBox.tar.xz - SUSE-Box.x86_64-1.42.1-System-BuildBox.qcow2 container: some use_initrd: true - name: universal mem_mb: 8096M processors: 4 console: hvc0 arch: - name: x86_64 cmdline: - root=/dev/vda3 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:universal/images packages_file: Universal-Box.x86_64-1.1.2-System-BuildBox.report boxfiles: - Universal-Box.x86_64-1.1.2-Kernel-BuildBox.tar.xz - Universal-Box.x86_64-1.1.2-System-BuildBox.qcow2 container: some use_initrd: true - name: aarch64 cmdline: - root=/dev/vda2 - rd.plymouth=0 - selinux=0 source: obs://Virtualization:Appliances:SelfContained:universal/images packages_file: Universal-Box.aarch64-1.1.2-System-BuildBox.report boxfiles: - Universal-Box.aarch64-1.1.2-Kernel-BuildBox.tar.xz - Universal-Box.aarch64-1.1.2-System-BuildBox.qcow2 container: some use_initrd: true ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7589824 kiwi-11.1.8/test/data/boxbuild/kiwi_boxed_plugin_invalid.yml0000644000000000000000000000002715273675667021155 0ustar00box: - foo: suse ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7589824 kiwi-11.1.8/test/data/boxbuild/target/result.code0000644000000000000000000000000215273675667016653 0ustar001 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7589824 kiwi-11.1.8/test/data/credentials0000644000000000000000000000001215273675667013624 0ustar00user:pass ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7589824 kiwi-11.1.8/test/data/description/config.xml0000644000000000000000000002576415273675667015743 0ustar00 Marcus ms@suse.com Testing various configuration states en_US,de_DE true 15.3 1.13.2 zypper en_US us.map.gz Europe/Berlin true true openSUSE openSUSE 1 2048 true 42 swap false false false 10 2048 true false 4 numvcpus = "4" cpuid.coresPerSocket = "2" SIGINT This is a comment ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7589824 kiwi-11.1.8/test/data/description.buildservice/appliance.kiwi0000644000000000000000000002576415273675667021254 0ustar00 Marcus ms@suse.com Testing various configuration states en_US,de_DE true 15.3 1.13.2 zypper en_US us.map.gz Europe/Berlin true true openSUSE openSUSE 1 2048 true 42 swap false false false 10 2048 true false 4 numvcpus = "4" cpuid.coresPerSocket = "2" SIGINT This is a comment ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7589824 kiwi-11.1.8/test/data/dnf_broken.conf0000644000000000000000000000002115273675667014362 0ustar00gpgcheck=1 [main ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7589824 kiwi-11.1.8/test/data/dnf_proxy.conf0000644000000000000000000000013015273675667014264 0ustar00[main] gpgcheck=1 proxy=http://dnf-proxy:3128 proxy_username=user proxy_password=secret ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7589824 kiwi-11.1.8/test/data/dracut_config0000644000000000000000000000060415273675667014145 0ustar00dracutconfig: dracutmodules=all dracutconfig: fileloglvl=0 dracutconfig: fw_dir=/lib/firmware/updates/6.18.0-2-default /lib/firmware/updates /lib/firmware/6.18.0-2-default /lib/firmware dracutconfig: hostonly_cmdline=yes dracutconfig: initrdname=initrd-kernel_version dracutconfig: kmsgloglvl=0 dracutconfig: libdirs= /lib64 /usr/lib64 /lib /usr/lib dracutconfig: omit_drivers=^i2o_scsi$ ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759284 kiwi-11.1.8/test/data/etc/default/zipl2grub.conf.in0000644000000000000000000000370615273675667017014 0ustar00## This is the template for '@zipldir@/config' and is subject to ## rpm's %config file handling in case of grub2-s390x-emu package update. [defaultboot] defaultmenu = menu [grub2] target = @zipldir@ ramdisk = @zipldir@/initrd,0x2000000 image = @zipldir@/image parameters = "root=@GRUB_DEVICE@ @GRUB_EMU_CONMODE@ @GRUB_CMDLINE_LINUX@ @GRUB_CMDLINE_LINUX_DEFAULT@ initgrub quiet splash=silent plymouth.enable=0 " [grub2-mem1G] target = @zipldir@ image = @zipldir@/image ramdisk = @zipldir@/initrd,0x2000000 parameters = "root=@GRUB_DEVICE@ @GRUB_EMU_CONMODE@ @GRUB_CMDLINE_LINUX@ @GRUB_CMDLINE_LINUX_DEFAULT@ initgrub quiet splash=silent plymouth.enable=0 mem=1G " [skip-grub2] target = @zipldir@ ramdisk = @zipldir@/initrd,0x2000000 image = @zipldir@/image parameters = "root=@GRUB_DEVICE@ @GRUB_CONMODE@ @GRUB_CMDLINE_LINUX@ @GRUB_CMDLINE_LINUX_DEFAULT@ " #@ #@[grub2-previous] #@ target = @zipldir@ #@ image = @zipldir@/image.prev #@ ramdisk = @zipldir@/initrd.prev,0x2000000 #@ parameters = "root=@GRUB_DEVICE@ @GRUB_EMU_CONMODE@ @GRUB_CMDLINE_LINUX@ @GRUB_CMDLINE_LINUX_DEFAULT@ initgrub quiet splash=silent plymouth.enable=0 " #@ #@[grub2-mem1G-previous] #@ target = @zipldir@ #@ image = @zipldir@/image.prev #@ ramdisk = @zipldir@/initrd.prev,0x2000000 #@ parameters = "root=@GRUB_DEVICE@ @GRUB_EMU_CONMODE@ @GRUB_CMDLINE_LINUX@ @GRUB_CMDLINE_LINUX_DEFAULT@ initgrub quiet splash=silent plymouth.enable=0 mem=1G " #@ #@[skip-grub2-previous] #@ target = @zipldir@ #@ image = @zipldir@/image.prev #@ ramdisk = @zipldir@/initrd.prev,0x2000000 #@ parameters = "root=@GRUB_DEVICE@ @GRUB_CONMODE@ @GRUB_CMDLINE_LINUX@ @GRUB_CMDLINE_LINUX_DEFAULT@ " :menu target = @zipldir@ timeout = 60 default = 1 prompt = 0 secure = @SUSE_SECURE_BOOT@ 1 = grub2 2 = skip-grub2 3 = grub2-mem1G #@ 4 = grub2-previous #@ 5 = skip-grub2-previous #@ 6 = grub2-mem1G-previous ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759284 kiwi-11.1.8/test/data/etc/os-release0000644000000000000000000000060315273675667014147 0ustar00NAME="openSUSE Leap" VERSION="15.5" ID="opensuse-leap" # some comment ID_LIKE="suse opensuse" VERSION_ID="15.5" PRETTY_NAME="openSUSE Leap 15.5" # some other comment ANSI_COLOR="0;32" CPE_NAME="cpe:/o:opensuse:leap:15.5" BUG_REPORT_URL="https://bugs.opensuse.org" HOME_URL="https://www.opensuse.org/" DOCUMENTATION_URL="https://en.opensuse.org/Portal:Leap" LOGO="distributor-logo-Leap" ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/etc/selinux/targeted/policy/policy.some_policy0000644000000000000000000000000015273675667022504 0ustar00././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_apt_config.xml0000644000000000000000000000170215273675667015761 0ustar00 Bob user@example.com Testing various configuration for apt packagemanager 1.13.2 apt en_US us.map.gz Europe/Berlin ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_arm_disk_size_config.xml0000644000000000000000000000224215273675667020020 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_btrfs_config.xml0000644000000000000000000000331715273675667016321 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE 2048 true ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_btrfs_vol_config.xml0000644000000000000000000000150715273675667017200 0ustar00 Marcus Schäfer marcus.schaefer@suse.com Some 1.15.5 zypper ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_config.xml0000644000000000000000000003063515273675667015124 0ustar00 Marcus ms@suse.com Testing various configuration states en_US,de_DE true 15.3 1.13.2 zypper en_US us.map.gz Europe/Berlin true true openSUSE openSUSE 1 2048 true 42 swap false false false 10 2048 true false 4 numvcpus = "4" cpuid.coresPerSocket = "2" SIGINT This is a comment ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_config_target_dir.xml0000644000000000000000000002335515273675667017331 0ustar00 Marcus ms@suse.com Testing various configuration states en_US,de_DE true 1.13.2 zypper en_US us.map.gz Europe/Berlin true true openSUSE openSUSE 1 2048 true 42 swap false false false 10 2048 true false 4 numvcpus = "4" cpuid.coresPerSocket = "2" This is a comment ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_containers_config.xml0000644000000000000000000000143515273675667017345 0ustar00 Some some@example.com Test containers section used in the buildservice 1.1.1 zypper ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_deprecated_schema.xml0000644000000000000000000000140715273675667017272 0ustar00 Marcus ms@suse.com Testing too old schema version condition 1.13.2 zypper en_US us.map.gz Europe/Berlin ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_disk_config.xml0000644000000000000000000000277015273675667016135 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE false true ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_disk_size_config.xml0000644000000000000000000000267215273675667017170 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE true 200 true ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_disk_size_empty_vol_config.xml0000644000000000000000000000247715273675667021271 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE false ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_disk_size_oem_volume_config.xml0000644000000000000000000000304015273675667021405 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_disk_size_partition_too_small_config.xml0000644000000000000000000000202215273675667023317 0ustar00 Marcus Schäfer ms@suse.com test partition too small 1.1.1 zypper ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_disk_size_partitions_config.xml0000644000000000000000000000232615273675667021440 0ustar00 Marcus Schäfer ms@suse.com test partitions setup 1.1.1 zypper ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_disk_size_vol_root_config.xml0000644000000000000000000000261115273675667021104 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE false ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_disk_size_volume_config.xml0000644000000000000000000000330715273675667020553 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE false ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_disk_size_volume_too_small_config.xml0000644000000000000000000000157415273675667022630 0ustar00 Marcus Schäfer ms@suse.com Test volume setup too small 1.1.1 zypper false ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_dot_profile_config.xml0000644000000000000000000000442615273675667017511 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE true 2048 true false schäfer ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_dot_profile_live_config.xml0000644000000000000000000000225415273675667020525 0ustar00 Marcus Schäfer bob@example.com Test dot profile env for Live images 1.1.0 zypper en_US us.map.gz Europe/Berlin ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_hkd_config.xml0000644000000000000000000000242415273675667015745 0ustar00 Some some@example.com Test containers section used in the buildservice 1.1.1 zypper ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_include_config.xml0000644000000000000000000000167415273675667016630 0ustar00 Marcus ms@suse.com Testing include raise condition 1.13.2 zypper en_US us.map.gz Europe/Berlin ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_include_config_from_description_dir.xml0000644000000000000000000000170715273675667023111 0ustar00 Marcus ms@suse.com Testing include from image description directory 1.13.2 zypper en_US us.map.gz Europe/Berlin ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_include_config_missing_reference.xml0000644000000000000000000000173015273675667022370 0ustar00 Marcus Schäfer ms@suse.com Test for missing include reference 1.1.0 zypper en_US us.map.gz Europe/Berlin true ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_kernel_flavor_config.xml0000644000000000000000000000373215273675667020033 0ustar00 Marcus Schäfer ms@suse.com Disk image with boot menu entries for more than one kernel flavor 1.1.1 zypper ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_lvm_arch_config.xml0000644000000000000000000000146615273675667016777 0ustar00 Marcus Schäfer some@some.com Test arch specific volume setup 1.1.1 zypper ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_lvm_custom_rootvol_config.xml0000644000000000000000000000271115273675667021152 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_lvm_default_config.xml0000644000000000000000000000403215273675667017476 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE 2048 true ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_lvm_no_root_config.xml0000644000000000000000000000331615273675667017535 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE 2048 true ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_lvm_no_root_full_usr_config.xml0000644000000000000000000000342715273675667021453 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE 2048 true ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_lvm_preferred_config.xml0000644000000000000000000000334015273675667020031 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE 2048 true ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_multiple_users_config.xml0000644000000000000000000000411715273675667020254 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE false ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_no_default_type.xml0000644000000000000000000000340615273675667017034 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE false ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_no_image_packages_config.xml0000644000000000000000000000217715273675667020620 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_no_imageinclude_config.xml0000644000000000000000000000523315273675667020322 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image de_DE 1 2048 true false 1.13.2 zypper en_US us.map.gz Europe/Berlin true openSUSE openSUSE ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_partitions_config.xml0000644000000000000000000000213315273675667017370 0ustar00 Marcus Schäfer ms@suse.com test partitions setup 1.1.1 zypper ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_ppc_disk_size_config.xml0000644000000000000000000000226715273675667020032 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_pxe_config.xml0000644000000000000000000000224715273675667015776 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image 1.13.2 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_runtime_checker_boot_desc_not_found.xml0000644000000000000000000000214415273675667023114 0ustar00 Marcus Schäfer ms@suse.com JeOS 1.1.0 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_runtime_checker_config.xml0000644000000000000000000002005415273675667020345 0ustar00 Marcus Schäfer ms@suse.com openSUSE 13.2 JeOS, is a small text based image de_DE zypper 1.13.2 zypper en_US us.map.gz Europe/Berlin true openSUSE openSUSE Tumbleweed JeOS text based Tumbleweed JeOS text based false false 2048 true false 1 2048 true false swap ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_runtime_checker_conflicting_types.xml0000644000000000000000000000147715273675667022633 0ustar00 Marcus Schäfer ms@suse.de Test conflicting type setup 1.1.0 zypper ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_runtime_checker_include_nested_reference.xml0000644000000000000000000000173115273675667024104 0ustar00 Marcus Schäfer ms@suse.com Test for missing include reference 1.1.0 zypper en_US us.map.gz Europe/Berlin true ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_runtime_checker_no_boot_reference.xml0000644000000000000000000000212115273675667022550 0ustar00 Marcus Schäfer ms@suse.com JeOS 1.1.0 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_runtime_checker_no_initrd_system_reference.xml0000644000000000000000000000214015273675667024503 0ustar00 Marcus Schäfer ms@suse.com JeOS 1.1.0 zypper en_US us.map.gz Europe/Berlin true false openSUSE openSUSE ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/example_this_path_config.xml0000644000000000000000000000142015273675667017155 0ustar00 Marcus Schäfer ms@suse.com Test this path source in repo 1.1.1 zypper ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/fstab0000644000000000000000000000116615273675667012441 0ustar00UUID=bd604632-663b-4d4c-b5b0-8d8686267ea2 / ext4 acl,user_xattr 0 1 UUID=daa5a8c3-5c72-4343-a1d4-bb74ec4e586e swap swap defaults 0 0 UUID=FCF7-B051 /boot/efi vfat defaults 0 0 LABEL=BOOT /boot xfs defaults 0 0 LABEL=foo /home ext4 defaults 0 0 PARTUUID=3c8bd108-01 /bar ext4 defaults 0 0 /dev/mynode /foo ext4 defaults 0 0 # entry with the same mountpoint, expected to be skipped LABEL=bar /home xfs defaults 0 0 # this comment line and the line above should be ignored by the parser ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/gz_data.gz0000644000000000000000000000003415273675667013363 0ustar001Vgz_data././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/image_info/config.xml0000644000000000000000000000320615273675667015500 0ustar00 Marcus ms@suse.com Testing image info module 1.13.2 zypper en_US us.map.gz Europe/Berlin true true openSUSE openSUSE ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/include.xml0000644000000000000000000000014015273675667013553 0ustar00 ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/include_repo.xml0000644000000000000000000000025715273675667014611 0ustar00 ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/info.xml0000644000000000000000000000026115273675667013067 0ustar00 single 1 first root filesystem 2016-01-01 00:00:00 ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.759378 kiwi-11.1.8/test/data/iso_listing.txt0000644000000000000000000015615315273675667014512 0ustar00 Directory listing of / drwx------ 4 0 0 2048 Dec 9 2015 [ 29 02] . drwx------ 4 0 0 2048 Dec 9 2015 [ 29 02] .. drwxr-xr-x 4 0 0 2048 Dec 9 2015 [ 32 02] boot -rw-r--r-- 1 0 0 35 Dec 9 2015 [ 2160 00] config.isoclient drwxr-xr-x 3 0 0 2048 Dec 9 2015 [ 30 02] EFI -rw-r--r-- 1 0 0 37 Dec 9 2015 [ 2158 00] header_end -rw-r--r-- 1 0 0 339083264 Dec 9 2015 [ 2161 00] LimeJeOS-openSUSE-13.2.raw.squashfs Directory listing of /boot/ drwxr-xr-x 4 0 0 2048 Dec 9 2015 [ 32 02] . drwx------ 4 0 0 2048 Dec 9 2015 [ 29 02] .. -rw-r--r-- 1 0 0 11 Dec 9 2015 [ 168137 00] 0x21342eba drwxr-xr-x 4 0 0 2048 Dec 9 2015 [ 33 02] grub2 -rw-r--r-- 1 0 0 11 Dec 9 2015 [ 168138 00] mbrid -rw-r--r-- 1 0 0 1484762 Dec 9 2015 [ 168139 00] unicode.pf2 drwxr-xr-x 3 0 0 2048 Dec 9 2015 [ 73 02] x86_64 Directory listing of /EFI/ drwxr-xr-x 3 0 0 2048 Dec 9 2015 [ 30 02] . drwx------ 4 0 0 2048 Dec 9 2015 [ 29 02] .. drwxr-xr-x 2 0 0 2048 Dec 9 2015 [ 31 02] BOOT Directory listing of /boot/grub2/ drwxr-xr-x 4 0 0 2048 Dec 9 2015 [ 33 02] . drwxr-xr-x 4 0 0 2048 Dec 9 2015 [ 32 02] .. -rw-r--r-- 1 0 0 1534 Dec 9 2015 [ 168864 00] grub.cfg drwxr-xr-x 3 0 0 2048 Dec 9 2015 [ 69 02] themes drwxr-xr-x 2 0 0 71680 Dec 9 2015 [ 34 02] x86_64-efi Directory listing of /boot/x86_64/ drwxr-xr-x 3 0 0 2048 Dec 9 2015 [ 73 02] . drwxr-xr-x 4 0 0 2048 Dec 9 2015 [ 32 02] .. -rw-r--r-- 1 0 0 4194304 Dec 9 2015 [ 110 00] efi drwxr-xr-x 2 0 0 14336 Dec 9 2015 [ 74 02] loader Directory listing of /EFI/BOOT/ drwxr-xr-x 2 0 0 2048 Dec 9 2015 [ 31 02] . drwxr-xr-x 3 0 0 2048 Dec 9 2015 [ 30 02] .. -rw-r--r-- 1 0 0 829952 Dec 9 2015 [ 167729 00] bootx64.efi -rw-r--r-- 1 0 0 72 Dec 9 2015 [ 168135 00] earlyboot.cfg -rw-r--r-- 1 0 0 1534 Dec 9 2015 [ 168136 00] grub.cfg Directory listing of /boot/grub2/themes/ drwxr-xr-x 3 0 0 2048 Dec 9 2015 [ 69 02] . drwxr-xr-x 4 0 0 2048 Dec 9 2015 [ 33 02] .. drwxr-xr-x 3 0 0 4096 Dec 9 2015 [ 70 02] openSUSE Directory listing of /boot/grub2/x86_64-efi/ drwxr-xr-x 2 0 0 71680 Dec 9 2015 [ 34 02] . drwxr-xr-x 4 0 0 2048 Dec 9 2015 [ 33 02] .. -rw-r--r-- 1 0 0 102486 Oct 9 2014 [ 168865 00] acpi.module -rw-r--r-- 1 0 0 16432 Oct 9 2014 [ 168916 00] acpi.mod -rw-r--r-- 1 0 0 1928 Oct 9 2014 [ 168925 00] adler32.mod -rw-r--r-- 1 0 0 13570 Oct 9 2014 [ 168926 00] adler32.module -rw-r--r-- 1 0 0 8272 Oct 9 2014 [ 168933 00] affs.mod -rw-r--r-- 1 0 0 48584 Oct 9 2014 [ 168938 00] affs.module -rw-r--r-- 1 0 0 9016 Oct 9 2014 [ 168962 00] afs.mod -rw-r--r-- 1 0 0 57682 Oct 9 2014 [ 168967 00] afs.module -rw-r--r-- 1 0 0 23080 Oct 9 2014 [ 168996 00] ahci.mod -rw-r--r-- 1 0 0 77397 Oct 9 2014 [ 169008 00] ahci.module -rw-r--r-- 1 0 0 7627 Oct 9 2014 [ 169046 00] all_video.module -rw-r--r-- 1 0 0 1017 Oct 9 2014 [ 169050 00] all_video.mod -rw-r--r-- 1 0 0 17043 Oct 9 2014 [ 169051 00] aout.module -rw-r--r-- 1 0 0 1488 Oct 9 2014 [ 169060 00] aout.mod -rw-r--r-- 1 0 0 5104 Oct 9 2014 [ 169061 00] appleldr.mod -rw-r--r-- 1 0 0 40469 Oct 9 2014 [ 169064 00] appleldr.module -rw-r--r-- 1 0 0 4472 Oct 9 2014 [ 169084 00] archelp.mod -rw-r--r-- 1 0 0 29595 Oct 9 2014 [ 169087 00] archelp.module -rw-r--r-- 1 0 0 8912 Oct 9 2014 [ 169102 00] ata.mod -rw-r--r-- 1 0 0 51255 Oct 9 2014 [ 169107 00] ata.module -rw-r--r-- 1 0 0 48709 Oct 9 2014 [ 169133 00] at_keyboard.module -rw-r--r-- 1 0 0 7424 Oct 9 2014 [ 169157 00] at_keyboard.mod -rw-r--r-- 1 0 0 35299 Oct 9 2014 [ 169161 00] backtrace.module -rw-r--r-- 1 0 0 2512 Oct 9 2014 [ 169179 00] backtrace.mod -rw-r--r-- 1 0 0 10328 Oct 9 2014 [ 169181 00] bfs.mod -rw-r--r-- 1 0 0 64476 Oct 9 2014 [ 169187 00] bfs.module -rw-r--r-- 1 0 0 28401 Oct 9 2014 [ 169219 00] bitmap.module -rw-r--r-- 1 0 0 41693 Oct 9 2014 [ 169233 00] bitmap_scale.module -rw-r--r-- 1 0 0 3120 Oct 9 2014 [ 169254 00] bitmap.mod -rw-r--r-- 1 0 0 5256 Oct 9 2014 [ 169256 00] bitmap_scale.mod -rw-r--r-- 1 0 0 3184 Oct 9 2014 [ 169259 00] blocklist.mod -rw-r--r-- 1 0 0 25896 Oct 9 2014 [ 169261 00] blocklist.module -rw-r--r-- 1 0 0 30299 Oct 9 2014 [ 169274 00] boot.module -rw-r--r-- 1 0 0 3320 Oct 9 2014 [ 169289 00] boot.mod -rw-r--r-- 1 0 0 49000 Oct 9 2014 [ 169291 00] bsd.mod -rw-r--r-- 1 0 0 223565 Oct 9 2014 [ 169315 00] bsd.module -rw-r--r-- 1 0 0 135072 Oct 9 2014 [ 169425 00] btrfs.module -rw-r--r-- 1 0 0 29160 Oct 9 2014 [ 169491 00] btrfs.mod -rw-r--r-- 1 0 0 22425 Oct 9 2014 [ 169506 00] bufio.module -rw-r--r-- 1 0 0 2864 Oct 9 2014 [ 169517 00] bufio.mod -rw-r--r-- 1 0 0 4248 Oct 9 2014 [ 169519 00] cat.mod -rw-r--r-- 1 0 0 34076 Oct 9 2014 [ 169522 00] cat.module -rw-r--r-- 1 0 0 37220 Oct 9 2014 [ 169539 00] cbfs.module -rw-r--r-- 1 0 0 5400 Oct 9 2014 [ 169558 00] cbfs.mod -rw-r--r-- 1 0 0 6224 Oct 9 2014 [ 169561 00] cbls.mod -rw-r--r-- 1 0 0 20176 Oct 9 2014 [ 169565 00] cbls.module -rw-r--r-- 1 0 0 3840 Oct 9 2014 [ 169575 00] cbmemc.mod -rw-r--r-- 1 0 0 30908 Oct 9 2014 [ 169577 00] cbmemc.module -rw-r--r-- 1 0 0 1592 Oct 9 2014 [ 169593 00] cbtable.mod -rw-r--r-- 1 0 0 11835 Oct 9 2014 [ 169594 00] cbtable.module -rw-r--r-- 1 0 0 4088 Oct 9 2014 [ 169600 00] cbtime.mod -rw-r--r-- 1 0 0 18836 Oct 9 2014 [ 169602 00] cbtime.module -rw-r--r-- 1 0 0 15552 Oct 9 2014 [ 169612 00] chain.mod -rw-r--r-- 1 0 0 90027 Oct 9 2014 [ 169620 00] chain.module -rw-r--r-- 1 0 0 4712 Oct 9 2014 [ 169664 00] cmdline_cat_test.mod -rw-r--r-- 1 0 0 40634 Oct 9 2014 [ 169667 00] cmdline_cat_test.module -rw-r--r-- 1 0 0 2880 Oct 9 2014 [ 169687 00] cmp.mod -rw-r--r-- 1 0 0 19658 Oct 9 2014 [ 169689 00] cmp.module -rw-r--r-- 1 0 0 3638 Oct 9 2014 [ 169699 00] command.lst -rw-r--r-- 1 0 0 28583 Oct 9 2014 [ 169701 00] configfile.module -rw-r--r-- 1 0 0 3504 Oct 9 2014 [ 169715 00] configfile.mod -rw-r--r-- 1 0 0 4296 Oct 9 2014 [ 169717 00] cpio.mod -rw-r--r-- 1 0 0 28906 Oct 9 2014 [ 169720 00] cpio.module -rw-r--r-- 1 0 0 29149 Oct 9 2014 [ 169735 00] cpio_be.module -rw-r--r-- 1 0 0 4312 Oct 9 2014 [ 169750 00] cpio_be.mod -rw-r--r-- 1 0 0 2560 Oct 9 2014 [ 169753 00] cpuid.mod -rw-r--r-- 1 0 0 15342 Oct 9 2014 [ 169755 00] cpuid.module -rw-r--r-- 1 0 0 2104 Oct 9 2014 [ 169763 00] crc64.mod -rw-r--r-- 1 0 0 13687 Oct 9 2014 [ 169765 00] crc64.module -rw-r--r-- 1 0 0 113360 Oct 9 2014 [ 169772 00] cryptodisk.module -rw-r--r-- 1 0 0 72530 Oct 9 2014 [ 169828 00] crypto.module -rw-r--r-- 1 0 0 936 Oct 9 2014 [ 169864 00] crypto.lst -rw-r--r-- 1 0 0 6944 Oct 9 2014 [ 169865 00] crypto.mod -rw-r--r-- 1 0 0 15856 Oct 9 2014 [ 169869 00] cryptodisk.mod -rw-r--r-- 1 0 0 33815 Oct 9 2014 [ 169877 00] cs5536.module -rw-r--r-- 1 0 0 3824 Oct 9 2014 [ 169894 00] cs5536.mod -rw-r--r-- 1 0 0 3192 Oct 9 2014 [ 169896 00] date.mod -rw-r--r-- 1 0 0 15906 Oct 9 2014 [ 169898 00] date.module -rw-r--r-- 1 0 0 2976 Oct 9 2014 [ 169906 00] datehook.mod -rw-r--r-- 1 0 0 26822 Oct 9 2014 [ 169908 00] datehook.module -rw-r--r-- 1 0 0 1936 Oct 9 2014 [ 169922 00] datetime.mod -rw-r--r-- 1 0 0 25035 Oct 9 2014 [ 169923 00] datetime.module -rw-r--r-- 1 0 0 3080 Oct 9 2014 [ 169936 00] disk.mod -rw-r--r-- 1 0 0 25360 Oct 9 2014 [ 169938 00] disk.module -rw-r--r-- 1 0 0 13568 Oct 9 2014 [ 169951 00] diskfilter.mod -rw-r--r-- 1 0 0 64382 Oct 9 2014 [ 169958 00] diskfilter.module -rw-r--r-- 1 0 0 30725 Oct 9 2014 [ 169990 00] div_test.module -rw-r--r-- 1 0 0 5800 Oct 9 2014 [ 170006 00] div_test.mod -rw-r--r-- 1 0 0 21795 Oct 9 2014 [ 170009 00] dm_nv.module -rw-r--r-- 1 0 0 2720 Oct 9 2014 [ 170020 00] dm_nv.mod -rw-r--r-- 1 0 0 3040 Oct 9 2014 [ 170022 00] echo.mod -rw-r--r-- 1 0 0 23127 Oct 9 2014 [ 170024 00] echo.module -rw-r--r-- 1 0 0 2272 Oct 9 2014 [ 170036 00] efifwsetup.mod -rw-r--r-- 1 0 0 14414 Oct 9 2014 [ 170038 00] efifwsetup.module -rw-r--r-- 1 0 0 38266 Oct 9 2014 [ 170046 00] efinet.module -rw-r--r-- 1 0 0 5560 Oct 9 2014 [ 170065 00] efinet.mod -rw-r--r-- 1 0 0 55109 Oct 9 2014 [ 170068 00] efi_gop.module -rw-r--r-- 1 0 0 13864 Oct 9 2014 [ 170095 00] efi_gop.mod -rw-r--r-- 1 0 0 7520 Oct 9 2014 [ 170102 00] efi_uga.mod -rw-r--r-- 1 0 0 41069 Oct 9 2014 [ 170106 00] efi_uga.module -rw-r--r-- 1 0 0 133392 Oct 9 2014 [ 170127 00] ehci.module -rw-r--r-- 1 0 0 25312 Oct 9 2014 [ 170193 00] ehci.mod -rw-r--r-- 1 0 0 6096 Oct 9 2014 [ 170206 00] elf.mod -rw-r--r-- 1 0 0 35981 Oct 9 2014 [ 170209 00] elf.module -rw-r--r-- 1 0 0 2176 Oct 9 2014 [ 170227 00] eval.mod -rw-r--r-- 1 0 0 20489 Oct 9 2014 [ 170229 00] eval.module -rw-r--r-- 1 0 0 8416 Oct 9 2014 [ 170240 00] exfat.mod -rw-r--r-- 1 0 0 49500 Oct 9 2014 [ 170245 00] exfat.module -rw-r--r-- 1 0 0 2288 Oct 9 2014 [ 170270 00] exfctest.mod -rw-r--r-- 1 0 0 21658 Oct 9 2014 [ 170272 00] exfctest.module -rw-r--r-- 1 0 0 52736 Oct 9 2014 [ 170283 00] ext2.module -rw-r--r-- 1 0 0 8544 Oct 9 2014 [ 170309 00] ext2.mod -rw-r--r-- 1 0 0 6992 Oct 9 2014 [ 170314 00] extcmd.mod -rw-r--r-- 1 0 0 51204 Oct 9 2014 [ 170318 00] extcmd.module -rw-r--r-- 1 0 0 53243 Oct 9 2014 [ 170344 00] fat.module -rw-r--r-- 1 0 0 8672 Oct 9 2014 [ 170370 00] fat.mod -rw-r--r-- 1 0 0 163596 Oct 9 2014 [ 170375 00] file.module -rw-r--r-- 1 0 0 24352 Oct 9 2014 [ 170455 00] file.mod -rw-r--r-- 1 0 0 2976 Oct 9 2014 [ 170467 00] fixvideo.mod -rw-r--r-- 1 0 0 24263 Oct 9 2014 [ 170469 00] fixvideo.module -rw-r--r-- 1 0 0 122066 Oct 9 2014 [ 170481 00] font.module -rw-r--r-- 1 0 0 17784 Oct 9 2014 [ 170541 00] font.mod -rw-r--r-- 1 0 0 214 Oct 9 2014 [ 170550 00] fs.lst -rw-r--r-- 1 0 0 26381 Oct 9 2014 [ 170551 00] fshelp.module -rw-r--r-- 1 0 0 3704 Oct 9 2014 [ 170564 00] fshelp.mod -rw-r--r-- 1 0 0 266177 Oct 9 2014 [ 170566 00] functional_test.module -rw-r--r-- 1 0 0 118376 Oct 9 2014 [ 170696 00] functional_test.mod -rw-r--r-- 1 0 0 27001 Oct 9 2014 [ 170754 00] gcry_md5.module -rw-r--r-- 1 0 0 8136 Oct 9 2014 [ 170768 00] gcry_sha1.mod -rw-r--r-- 1 0 0 39577 Oct 9 2014 [ 170772 00] gcry_tiger.module -rw-r--r-- 1 0 0 34000 Oct 9 2014 [ 170792 00] gcry_twofish.mod -rw-r--r-- 1 0 0 37463 Oct 9 2014 [ 170809 00] gcry_sha256.module -rw-r--r-- 1 0 0 42235 Oct 9 2014 [ 170828 00] gcry_seed.module -rw-r--r-- 1 0 0 9144 Oct 9 2014 [ 170849 00] gcry_rmd160.mod -rw-r--r-- 1 0 0 51407 Oct 9 2014 [ 170854 00] gcry_rijndael.module -rw-r--r-- 1 0 0 44516 Oct 9 2014 [ 170880 00] gcry_whirlpool.module -rw-r--r-- 1 0 0 227652 Oct 9 2014 [ 170902 00] gcry_serpent.module -rw-r--r-- 1 0 0 34646 Oct 9 2014 [ 171014 00] gcry_blowfish.module -rw-r--r-- 1 0 0 41935 Oct 9 2014 [ 171031 00] gcry_sha512.module -rw-r--r-- 1 0 0 4104 Oct 9 2014 [ 171052 00] gcry_md4.mod -rw-r--r-- 1 0 0 6088 Oct 9 2014 [ 171055 00] gcry_sha256.mod -rw-r--r-- 1 0 0 29480 Oct 9 2014 [ 171058 00] gcry_camellia.mod -rw-r--r-- 1 0 0 3400 Oct 9 2014 [ 171073 00] gcry_rsa.mod -rw-r--r-- 1 0 0 3288 Oct 9 2014 [ 171075 00] gcry_rfc2268.mod -rw-r--r-- 1 0 0 33550 Oct 9 2014 [ 171077 00] gcry_idea.module -rw-r--r-- 1 0 0 23242 Oct 9 2014 [ 171094 00] gcry_crc.module -rw-r--r-- 1 0 0 45809 Oct 9 2014 [ 171106 00] gcry_sha1.module -rw-r--r-- 1 0 0 17016 Oct 9 2014 [ 171129 00] gcry_des.mod -rw-r--r-- 1 0 0 43728 Oct 9 2014 [ 171138 00] gcry_cast5.module -rw-r--r-- 1 0 0 2392 Oct 9 2014 [ 171160 00] gcry_arcfour.mod -rw-r--r-- 1 0 0 26684 Oct 9 2014 [ 171162 00] gcry_dsa.module -rw-r--r-- 1 0 0 24165 Oct 9 2014 [ 171176 00] gcry_arcfour.module -rw-r--r-- 1 0 0 9640 Oct 9 2014 [ 171188 00] gcry_blowfish.mod -rw-r--r-- 1 0 0 220990 Oct 9 2014 [ 171193 00] gcry_camellia.module -rw-r--r-- 1 0 0 14824 Oct 9 2014 [ 171301 00] gcry_cast5.mod -rw-r--r-- 1 0 0 3904 Oct 9 2014 [ 171309 00] gcry_crc.mod -rw-r--r-- 1 0 0 73539 Oct 9 2014 [ 171311 00] gcry_des.module -rw-r--r-- 1 0 0 3416 Oct 9 2014 [ 171347 00] gcry_dsa.mod -rw-r--r-- 1 0 0 4080 Oct 9 2014 [ 171349 00] gcry_idea.mod -rw-r--r-- 1 0 0 25241 Oct 9 2014 [ 171351 00] gcry_md4.module -rw-r--r-- 1 0 0 4848 Oct 9 2014 [ 171364 00] gcry_md5.mod -rw-r--r-- 1 0 0 26191 Oct 9 2014 [ 171367 00] gcry_rfc2268.module -rw-r--r-- 1 0 0 20888 Oct 9 2014 [ 171380 00] gcry_rijndael.mod -rw-r--r-- 1 0 0 48996 Oct 9 2014 [ 171391 00] gcry_rmd160.module -rw-r--r-- 1 0 0 27983 Oct 9 2014 [ 171415 00] gcry_rsa.module -rw-r--r-- 1 0 0 16208 Oct 9 2014 [ 171429 00] gcry_seed.mod -rw-r--r-- 1 0 0 16536 Oct 9 2014 [ 171437 00] gcry_serpent.mod -rw-r--r-- 1 0 0 7336 Oct 9 2014 [ 171446 00] gcry_sha512.mod -rw-r--r-- 1 0 0 13536 Oct 9 2014 [ 171450 00] gcry_tiger.mod -rw-r--r-- 1 0 0 76986 Oct 9 2014 [ 171457 00] gcry_twofish.module -rw-r--r-- 1 0 0 22800 Oct 9 2014 [ 171495 00] gcry_whirlpool.mod -rwxr-xr-x 1 0 0 1890 Oct 9 2014 [ 171507 00] gdb_grub2 -rw-r--r-- 1 0 0 9072 Oct 9 2014 [ 171508 00] geli.mod -rw-r--r-- 1 0 0 39054 Oct 9 2014 [ 171513 00] geli.module -rw-r--r-- 1 0 0 8536 Oct 9 2014 [ 171533 00] gettext.mod -rw-r--r-- 1 0 0 52827 Oct 9 2014 [ 171538 00] gettext.module -rw-r--r-- 1 0 0 702226 Oct 9 2014 [ 171564 00] gfxmenu.module -rw-r--r-- 1 0 0 60512 Oct 9 2014 [ 171907 00] gfxmenu.mod -rw-r--r-- 1 0 0 4656 Oct 9 2014 [ 171937 00] gfxterm_background.mod -rw-r--r-- 1 0 0 7792 Oct 9 2014 [ 171940 00] gfxterm_menu.mod -rw-r--r-- 1 0 0 44930 Oct 9 2014 [ 171944 00] gfxterm_menu.module -rw-r--r-- 1 0 0 92675 Oct 9 2014 [ 171966 00] gfxterm.module -rw-r--r-- 1 0 0 18056 Oct 9 2014 [ 172012 00] gfxterm.mod -rw-r--r-- 1 0 0 43006 Oct 9 2014 [ 172021 00] gfxterm_background.module -rwxr-xr-x 1 0 0 611 Oct 9 2014 [ 172042 00] gmodule.pl -rw-r--r-- 1 0 0 5056 Oct 9 2014 [ 172043 00] gptsync.mod -rw-r--r-- 1 0 0 27085 Oct 9 2014 [ 172046 00] gptsync.module -rw-r--r-- 1 0 0 918392 Oct 9 2014 [ 172060 00] grub.efi -rw-r--r-- 1 0 0 56580 Oct 9 2014 [ 172509 00] gzio.module -rw-r--r-- 1 0 0 11576 Oct 9 2014 [ 172537 00] gzio.mod -rw-r--r-- 1 0 0 6424 Oct 9 2014 [ 172543 00] halt.mod -rw-r--r-- 1 0 0 61965 Oct 9 2014 [ 172547 00] halt.module -rw-r--r-- 1 0 0 8544 Oct 9 2014 [ 172578 00] hashsum.mod -rw-r--r-- 1 0 0 45901 Oct 9 2014 [ 172583 00] hashsum.module -rw-r--r-- 1 0 0 11240 Oct 9 2014 [ 172606 00] hdparm.mod -rw-r--r-- 1 0 0 53426 Oct 9 2014 [ 172612 00] hdparm.module -rw-r--r-- 1 0 0 1848 Oct 9 2014 [ 172639 00] hello.mod -rw-r--r-- 1 0 0 13937 Oct 9 2014 [ 172640 00] hello.module -rw-r--r-- 1 0 0 3968 Oct 9 2014 [ 172647 00] help.mod -rw-r--r-- 1 0 0 33387 Oct 9 2014 [ 172649 00] help.module -rw-r--r-- 1 0 0 31340 Oct 9 2014 [ 172666 00] hexdump.module -rw-r--r-- 1 0 0 4472 Oct 9 2014 [ 172682 00] hexdump.mod -rw-r--r-- 1 0 0 71995 Oct 9 2014 [ 172685 00] hfs.module -rw-r--r-- 1 0 0 10456 Oct 9 2014 [ 172721 00] hfs.mod -rw-r--r-- 1 0 0 4336 Oct 9 2014 [ 172727 00] hfspluscomp.mod -rw-r--r-- 1 0 0 77950 Oct 9 2014 [ 172730 00] hfsplus.module -rw-r--r-- 1 0 0 10608 Oct 9 2014 [ 172769 00] hfsplus.mod -rw-r--r-- 1 0 0 33503 Oct 9 2014 [ 172775 00] hfspluscomp.module -rw-r--r-- 1 0 0 49786 Oct 9 2014 [ 172792 00] http.module -rw-r--r-- 1 0 0 8880 Oct 9 2014 [ 172817 00] http.mod -rw-r--r-- 1 0 0 4504 Oct 9 2014 [ 172822 00] iorw.mod -rw-r--r-- 1 0 0 25676 Oct 9 2014 [ 172825 00] iorw.module -rw-r--r-- 1 0 0 67588 Oct 9 2014 [ 172838 00] iso9660.module -rw-r--r-- 1 0 0 12320 Oct 9 2014 [ 172872 00] iso9660.mod -rw-r--r-- 1 0 0 56362 Oct 9 2014 [ 172879 00] jfs.module -rw-r--r-- 1 0 0 8928 Oct 9 2014 [ 172907 00] jfs.mod -rw-r--r-- 1 0 0 8880 Oct 9 2014 [ 172912 00] jpeg.mod -rw-r--r-- 1 0 0 66088 Oct 9 2014 [ 172917 00] jpeg.module -rw-r--r-- 1 0 0 828233 Oct 9 2014 [ 172950 00] kernel.exec -rw-r--r-- 1 0 0 94944 Oct 9 2014 [ 173355 00] kernel.img -rw-r--r-- 1 0 0 6360 Oct 9 2014 [ 173402 00] keylayouts.mod -rw-r--r-- 1 0 0 38579 Oct 9 2014 [ 173406 00] keylayouts.module -rw-r--r-- 1 0 0 23113 Oct 9 2014 [ 173425 00] keystatus.module -rw-r--r-- 1 0 0 3064 Oct 9 2014 [ 173437 00] keystatus.mod -rw-r--r-- 1 0 0 46883 Oct 9 2014 [ 173439 00] ldm.module -rw-r--r-- 1 0 0 8344 Oct 9 2014 [ 173462 00] ldm.mod -rw-r--r-- 1 0 0 135614 Oct 9 2014 [ 173467 00] legacycfg.module -rw-r--r-- 1 0 0 35956 Oct 9 2014 [ 173534 00] legacy_password_test.module -rw-r--r-- 1 0 0 44384 Oct 9 2014 [ 173552 00] legacycfg.mod -rw-r--r-- 1 0 0 15912 Oct 9 2014 [ 173574 00] legacy_password_test.mod -rw-r--r-- 1 0 0 135063 Oct 9 2014 [ 173582 00] linux.module -rw-r--r-- 1 0 0 12848 Oct 9 2014 [ 173648 00] linux16.mod -rw-r--r-- 1 0 0 65086 Oct 9 2014 [ 173655 00] linuxefi.module -rw-r--r-- 1 0 0 20456 Oct 9 2014 [ 173687 00] linux.mod -rw-r--r-- 1 0 0 87564 Oct 9 2014 [ 173697 00] linux16.module -rw-r--r-- 1 0 0 8712 Oct 9 2014 [ 173740 00] linuxefi.mod -rw-r--r-- 1 0 0 4720 Oct 9 2014 [ 173745 00] loadbios.mod -rw-r--r-- 1 0 0 43349 Oct 9 2014 [ 173748 00] loadbios.module -rw-r--r-- 1 0 0 9408 Oct 9 2014 [ 173770 00] loadenv.mod -rw-r--r-- 1 0 0 61339 Oct 9 2014 [ 173775 00] loadenv.module -rw-r--r-- 1 0 0 28035 Oct 9 2014 [ 173805 00] loopback.module -rw-r--r-- 1 0 0 4800 Oct 9 2014 [ 173819 00] loopback.mod -rw-r--r-- 1 0 0 47090 Oct 9 2014 [ 173822 00] ls.module -rw-r--r-- 1 0 0 6672 Oct 9 2014 [ 173845 00] ls.mod -rw-r--r-- 1 0 0 7232 Oct 9 2014 [ 173849 00] lsacpi.mod -rw-r--r-- 1 0 0 43745 Oct 9 2014 [ 173853 00] lsacpi.module -rw-r--r-- 1 0 0 5264 Oct 9 2014 [ 173875 00] lsefi.mod -rw-r--r-- 1 0 0 17043 Oct 9 2014 [ 173878 00] lsefimmap.module -rw-r--r-- 1 0 0 3512 Oct 9 2014 [ 173887 00] lsefisystab.mod -rw-r--r-- 1 0 0 31819 Oct 9 2014 [ 173889 00] lsefi.module -rw-r--r-- 1 0 0 3312 Oct 9 2014 [ 173905 00] lsefimmap.mod -rw-r--r-- 1 0 0 43680 Oct 9 2014 [ 173907 00] lsefisystab.module -rw-r--r-- 1 0 0 15391 Oct 9 2014 [ 173929 00] lsmmap.module -rw-r--r-- 1 0 0 2824 Oct 9 2014 [ 173937 00] lsmmap.mod -rw-r--r-- 1 0 0 7264 Oct 9 2014 [ 173939 00] lspci.mod -rw-r--r-- 1 0 0 25276 Oct 9 2014 [ 173943 00] lspci.module -rw-r--r-- 1 0 0 47301 Oct 9 2014 [ 173956 00] lssal.module -rw-r--r-- 1 0 0 3848 Oct 9 2014 [ 173980 00] lssal.mod -rw-r--r-- 1 0 0 9496 Oct 9 2014 [ 173982 00] luks.mod -rw-r--r-- 1 0 0 70183 Oct 9 2014 [ 173987 00] luks.module -rw-r--r-- 1 0 0 43445 Oct 9 2014 [ 174022 00] lvm.module -rw-r--r-- 1 0 0 9664 Oct 9 2014 [ 174044 00] lvm.mod -rw-r--r-- 1 0 0 12232 Oct 9 2014 [ 174049 00] lzopio.mod -rw-r--r-- 1 0 0 74099 Oct 9 2014 [ 174055 00] lzopio.module -rw-r--r-- 1 0 0 4824 Oct 9 2014 [ 174092 00] macbless.mod -rw-r--r-- 1 0 0 32912 Oct 9 2014 [ 174095 00] macbless.module -rw-r--r-- 1 0 0 88900 Oct 9 2014 [ 174112 00] macho.module -rw-r--r-- 1 0 0 10736 Oct 9 2014 [ 174156 00] macho.mod -rw-r--r-- 1 0 0 2784 Oct 9 2014 [ 174162 00] mdraid09_be.mod -rw-r--r-- 1 0 0 24046 Oct 9 2014 [ 174164 00] mdraid09_be.module -rw-r--r-- 1 0 0 21594 Oct 9 2014 [ 174176 00] mdraid1x.module -rw-r--r-- 1 0 0 2752 Oct 9 2014 [ 174187 00] mdraid09.mod -rw-r--r-- 1 0 0 22315 Oct 9 2014 [ 174189 00] mdraid09.module -rw-r--r-- 1 0 0 2728 Oct 9 2014 [ 174200 00] mdraid1x.mod -rw-r--r-- 1 0 0 3176 Oct 9 2014 [ 174202 00] memdisk.mod -rw-r--r-- 1 0 0 21022 Oct 9 2014 [ 174204 00] memdisk.module -rw-r--r-- 1 0 0 4520 Oct 9 2014 [ 174215 00] memrw.mod -rw-r--r-- 1 0 0 22901 Oct 9 2014 [ 174218 00] memrw.module -rw-r--r-- 1 0 0 5576 Oct 9 2014 [ 174230 00] minicmd.mod -rw-r--r-- 1 0 0 39755 Oct 9 2014 [ 174233 00] minicmd.module -rw-r--r-- 1 0 0 5504 Oct 9 2014 [ 174253 00] minix.mod -rw-r--r-- 1 0 0 35584 Oct 9 2014 [ 174256 00] minix2.module -rw-r--r-- 1 0 0 5592 Oct 9 2014 [ 174274 00] minix3.mod -rw-r--r-- 1 0 0 5688 Oct 9 2014 [ 174277 00] minix2_be.mod -rw-r--r-- 1 0 0 35151 Oct 9 2014 [ 174280 00] minix.module -rw-r--r-- 1 0 0 5656 Oct 9 2014 [ 174298 00] minix3_be.mod -rw-r--r-- 1 0 0 5616 Oct 9 2014 [ 174301 00] minix_be.mod -rw-r--r-- 1 0 0 5592 Oct 9 2014 [ 174304 00] minix2.mod -rw-r--r-- 1 0 0 39851 Oct 9 2014 [ 174307 00] minix2_be.module -rw-r--r-- 1 0 0 35640 Oct 9 2014 [ 174327 00] minix3.module -rw-r--r-- 1 0 0 39779 Oct 9 2014 [ 174345 00] minix3_be.module -rw-r--r-- 1 0 0 38978 Oct 9 2014 [ 174365 00] minix_be.module -rw-r--r-- 1 0 0 75293 Oct 9 2014 [ 174385 00] mmap.module -rw-r--r-- 1 0 0 9704 Oct 9 2014 [ 174422 00] mmap.mod -rw-r--r-- 1 0 0 4817 Oct 9 2014 [ 174427 00] moddep.lst -rw-r--r-- 1 0 0 2207 Oct 9 2014 [ 174430 00] modinfo.sh -rw-r--r-- 1 0 0 24596 Oct 9 2014 [ 174432 00] morse.module -rw-r--r-- 1 0 0 3344 Oct 9 2014 [ 174445 00] morse.mod -rw-r--r-- 1 0 0 500438 Oct 9 2014 [ 174447 00] mpi.module -rw-r--r-- 1 0 0 43640 Oct 9 2014 [ 174692 00] mpi.mod -rw-r--r-- 1 0 0 20924 Oct 9 2014 [ 174714 00] msdospart.module -rw-r--r-- 1 0 0 3664 Oct 9 2014 [ 174725 00] msdospart.mod -rw-r--r-- 1 0 0 156332 Oct 9 2014 [ 174727 00] multiboot2.module -rw-r--r-- 1 0 0 20896 Oct 9 2014 [ 174804 00] multiboot2.mod -rw-r--r-- 1 0 0 133248 Oct 9 2014 [ 174815 00] multiboot.module -rw-r--r-- 1 0 0 18944 Oct 9 2014 [ 174881 00] multiboot.mod -rw-r--r-- 1 0 0 6584 Oct 9 2014 [ 174891 00] nativedisk.mod -rw-r--r-- 1 0 0 33078 Oct 9 2014 [ 174895 00] nativedisk.module -rw-r--r-- 1 0 0 540943 Oct 9 2014 [ 174912 00] net.module -rw-r--r-- 1 0 0 74056 Oct 9 2014 [ 175177 00] net.mod -rw-r--r-- 1 0 0 29942 Oct 9 2014 [ 175214 00] newc.module -rw-r--r-- 1 0 0 4480 Oct 9 2014 [ 175229 00] newc.mod -rw-r--r-- 1 0 0 69453 Oct 9 2014 [ 175232 00] nilfs2.module -rw-r--r-- 1 0 0 9800 Oct 9 2014 [ 175266 00] nilfs2.mod -rw-r--r-- 1 0 0 178752 Oct 9 2014 [ 175271 00] normal.mod -rw-r--r-- 1 0 0 1107635 Oct 9 2014 [ 175359 00] normal.module -rw-r--r-- 1 0 0 85875 Oct 9 2014 [ 175900 00] ntfs.module -rw-r--r-- 1 0 0 15392 Oct 9 2014 [ 175942 00] ntfs.mod -rw-r--r-- 1 0 0 33216 Oct 9 2014 [ 175950 00] ntfscomp.module -rw-r--r-- 1 0 0 5688 Oct 9 2014 [ 175967 00] ntfscomp.mod -rw-r--r-- 1 0 0 4296 Oct 9 2014 [ 175970 00] odc.mod -rw-r--r-- 1 0 0 28769 Oct 9 2014 [ 175973 00] odc.module -rw-r--r-- 1 0 0 2192 Oct 9 2014 [ 175988 00] offsetio.mod -rw-r--r-- 1 0 0 19203 Oct 9 2014 [ 175990 00] offsetio.module -rw-r--r-- 1 0 0 16256 Oct 9 2014 [ 176000 00] ohci.mod -rw-r--r-- 1 0 0 96886 Oct 9 2014 [ 176008 00] ohci.module -rw-r--r-- 1 0 0 111 Oct 9 2014 [ 176056 00] partmap.lst -rw-r--r-- 1 0 0 7432 Oct 9 2014 [ 176057 00] parttool.mod -rw-r--r-- 1 0 0 17 Oct 9 2014 [ 176061 00] parttool.lst -rw-r--r-- 1 0 0 42718 Oct 9 2014 [ 176062 00] parttool.module -rw-r--r-- 1 0 0 26817 Oct 9 2014 [ 176083 00] part_bsd.module -rw-r--r-- 1 0 0 19470 Oct 9 2014 [ 176097 00] part_msdos.module -rw-r--r-- 1 0 0 17853 Oct 9 2014 [ 176107 00] part_dvh.module -rw-r--r-- 1 0 0 2272 Oct 9 2014 [ 176116 00] part_acorn.mod -rw-r--r-- 1 0 0 18035 Oct 9 2014 [ 176118 00] part_sunpc.module -rw-r--r-- 1 0 0 18002 Oct 9 2014 [ 176127 00] part_dfly.module -rw-r--r-- 1 0 0 2200 Oct 9 2014 [ 176136 00] part_sun.mod -rw-r--r-- 1 0 0 20573 Oct 9 2014 [ 176138 00] part_apple.module -rw-r--r-- 1 0 0 17956 Oct 9 2014 [ 176149 00] part_plan.module -rw-r--r-- 1 0 0 3256 Oct 9 2014 [ 176158 00] part_gpt.mod -rw-r--r-- 1 0 0 2448 Oct 9 2014 [ 176160 00] part_sunpc.mod -rw-r--r-- 1 0 0 21036 Oct 9 2014 [ 176162 00] part_amiga.module -rw-r--r-- 1 0 0 19443 Oct 9 2014 [ 176173 00] part_acorn.module -rw-r--r-- 1 0 0 2552 Oct 9 2014 [ 176183 00] part_amiga.mod -rw-r--r-- 1 0 0 3032 Oct 9 2014 [ 176185 00] part_apple.mod -rw-r--r-- 1 0 0 4168 Oct 9 2014 [ 176187 00] part_bsd.mod -rw-r--r-- 1 0 0 2648 Oct 9 2014 [ 176190 00] part_dfly.mod -rw-r--r-- 1 0 0 2152 Oct 9 2014 [ 176192 00] part_dvh.mod -rw-r--r-- 1 0 0 20621 Oct 9 2014 [ 176194 00] part_gpt.module -rw-r--r-- 1 0 0 3144 Oct 9 2014 [ 176205 00] part_msdos.mod -rw-r--r-- 1 0 0 2568 Oct 9 2014 [ 176207 00] part_plan.mod -rw-r--r-- 1 0 0 18925 Oct 9 2014 [ 176209 00] part_sun.module -rw-r--r-- 1 0 0 2936 Oct 9 2014 [ 176219 00] password.mod -rw-r--r-- 1 0 0 4344 Oct 9 2014 [ 176221 00] password_pbkdf2.mod -rw-r--r-- 1 0 0 29057 Oct 9 2014 [ 176224 00] password.module -rw-r--r-- 1 0 0 35506 Oct 9 2014 [ 176239 00] password_pbkdf2.module -rw-r--r-- 1 0 0 50492 Oct 9 2014 [ 176257 00] pata.module -rw-r--r-- 1 0 0 7320 Oct 9 2014 [ 176282 00] pata.mod -rw-r--r-- 1 0 0 3480 Oct 9 2014 [ 176286 00] pbkdf2_test.mod -rw-r--r-- 1 0 0 16216 Oct 9 2014 [ 176288 00] pbkdf2.module -rw-r--r-- 1 0 0 2000 Oct 9 2014 [ 176296 00] pbkdf2.mod -rw-r--r-- 1 0 0 26539 Oct 9 2014 [ 176297 00] pbkdf2_test.module -rw-r--r-- 1 0 0 19412 Oct 9 2014 [ 176310 00] pcidump.module -rw-r--r-- 1 0 0 3608 Oct 9 2014 [ 176320 00] pcidump.mod -rw-r--r-- 1 0 0 34649 Oct 9 2014 [ 176322 00] play.module -rw-r--r-- 1 0 0 3848 Oct 9 2014 [ 176339 00] play.mod -rw-r--r-- 1 0 0 10168 Oct 9 2014 [ 176341 00] png.mod -rw-r--r-- 1 0 0 76982 Oct 9 2014 [ 176346 00] png.module -rw-r--r-- 1 0 0 18819 Oct 9 2014 [ 176384 00] priority_queue.module -rw-r--r-- 1 0 0 2192 Oct 9 2014 [ 176394 00] priority_queue.mod -rw-r--r-- 1 0 0 31486 Oct 9 2014 [ 176396 00] probe.module -rw-r--r-- 1 0 0 4200 Oct 9 2014 [ 176412 00] probe.mod -rw-r--r-- 1 0 0 3416 Oct 9 2014 [ 176415 00] procfs.mod -rw-r--r-- 1 0 0 26520 Oct 9 2014 [ 176417 00] procfs.module -rw-r--r-- 1 0 0 2920 Oct 9 2014 [ 176430 00] progress.mod -rw-r--r-- 1 0 0 29379 Oct 9 2014 [ 176432 00] progress.module -rw-r--r-- 1 0 0 1992 Oct 9 2014 [ 176447 00] raid5rec.mod -rw-r--r-- 1 0 0 18835 Oct 9 2014 [ 176448 00] raid5rec.module -rw-r--r-- 1 0 0 31279 Oct 9 2014 [ 176458 00] raid6rec.module -rw-r--r-- 1 0 0 3216 Oct 9 2014 [ 176474 00] raid6rec.mod -rw-r--r-- 1 0 0 20736 Oct 9 2014 [ 176476 00] read.module -rw-r--r-- 1 0 0 2264 Oct 9 2014 [ 176487 00] read.mod -rw-r--r-- 1 0 0 1840 Oct 9 2014 [ 176489 00] reboot.mod -rw-r--r-- 1 0 0 38048 Oct 9 2014 [ 176490 00] reboot.module -rw-r--r-- 1 0 0 77176 Oct 9 2014 [ 176509 00] regexp.mod -rw-r--r-- 1 0 0 745535 Oct 9 2014 [ 176547 00] regexp.module -rw-r--r-- 1 0 0 14208 Oct 9 2014 [ 176912 00] reiserfs.mod -rw-r--r-- 1 0 0 70216 Oct 9 2014 [ 176919 00] reiserfs.module -rw-r--r-- 1 0 0 148872 Oct 9 2014 [ 176954 00] relocator.module -rw-r--r-- 1 0 0 26256 Oct 9 2014 [ 177027 00] relocator.mod -rw-r--r-- 1 0 0 5752 Oct 9 2014 [ 177040 00] romfs.mod -rw-r--r-- 1 0 0 39446 Oct 9 2014 [ 177043 00] romfs.module -rw-r--r-- 1 0 0 47326 Oct 9 2014 [ 177063 00] scsi.module -rw-r--r-- 1 0 0 7128 Oct 9 2014 [ 177087 00] scsi.mod -rw-r--r-- 1 0 0 4968 Oct 9 2014 [ 177091 00] search_fs_file.mod -rw-r--r-- 1 0 0 4904 Oct 9 2014 [ 177094 00] search_fs_uuid.mod -rw-r--r-- 1 0 0 31086 Oct 9 2014 [ 177097 00] search_fs_uuid.module -rw-r--r-- 1 0 0 29673 Oct 9 2014 [ 177113 00] search_label.module -rw-r--r-- 1 0 0 5352 Oct 9 2014 [ 177128 00] search.mod -rw-r--r-- 1 0 0 19743 Oct 9 2014 [ 177131 00] search.module -rw-r--r-- 1 0 0 30189 Oct 9 2014 [ 177141 00] search_fs_file.module -rw-r--r-- 1 0 0 4848 Oct 9 2014 [ 177156 00] search_label.mod -rw-r--r-- 1 0 0 14456 Oct 9 2014 [ 177159 00] serial.mod -rw-r--r-- 1 0 0 127881 Oct 9 2014 [ 177167 00] serial.module -rw-r--r-- 1 0 0 2099 Oct 9 2014 [ 177230 00] setjmp.module -rw-r--r-- 1 0 0 22717 Oct 9 2014 [ 177232 00] setjmp_test.module -rw-r--r-- 1 0 0 1026 Oct 9 2014 [ 177244 00] setjmp.mod -rw-r--r-- 1 0 0 2624 Oct 9 2014 [ 177245 00] setjmp_test.mod -rw-r--r-- 1 0 0 32389 Oct 9 2014 [ 177247 00] setpci.module -rw-r--r-- 1 0 0 8952 Oct 9 2014 [ 177263 00] setpci.mod -rw-r--r-- 1 0 0 48521 Oct 9 2014 [ 177268 00] sfs.module -rw-r--r-- 1 0 0 7672 Oct 9 2014 [ 177292 00] sfs.mod -rw-r--r-- 1 0 0 41508 Oct 9 2014 [ 177296 00] signature_test.module -rw-r--r-- 1 0 0 8704 Oct 9 2014 [ 177317 00] signature_test.mod -rw-r--r-- 1 0 0 3344 Oct 9 2014 [ 177322 00] sleep.mod -rw-r--r-- 1 0 0 23499 Oct 9 2014 [ 177324 00] sleep.module -rw-r--r-- 1 0 0 26756 Oct 9 2014 [ 177336 00] sleep_test.module -rw-r--r-- 1 0 0 3424 Oct 9 2014 [ 177350 00] sleep_test.mod -rw-r--r-- 1 0 0 3240 Oct 9 2014 [ 177352 00] spkmodem.mod -rw-r--r-- 1 0 0 25461 Oct 9 2014 [ 177354 00] spkmodem.module -rw-r--r-- 1 0 0 59790 Oct 9 2014 [ 177367 00] squash4.module -rw-r--r-- 1 0 0 9616 Oct 9 2014 [ 177397 00] squash4.mod -rw-r--r-- 1 0 0 30048 Oct 9 2014 [ 177402 00] syslinuxcfg.mod -rw-r--r-- 1 0 0 152569 Oct 9 2014 [ 177417 00] syslinuxcfg.module -rw-r--r-- 1 0 0 4848 Oct 9 2014 [ 177492 00] tar.mod -rw-r--r-- 1 0 0 32414 Oct 9 2014 [ 177495 00] tar.module -rw-r--r-- 1 0 0 84328 Oct 9 2014 [ 177511 00] terminfo.module -rw-r--r-- 1 0 0 33774 Oct 9 2014 [ 177553 00] terminal.module -rw-r--r-- 1 0 0 162 Oct 9 2014 [ 177570 00] terminal.lst -rw-r--r-- 1 0 0 6800 Oct 9 2014 [ 177571 00] terminal.mod -rw-r--r-- 1 0 0 19744 Oct 9 2014 [ 177575 00] terminfo.mod -rw-r--r-- 1 0 0 37953 Oct 9 2014 [ 177585 00] test.module -rw-r--r-- 1 0 0 7640 Oct 9 2014 [ 177604 00] test.mod -rw-r--r-- 1 0 0 3816 Oct 9 2014 [ 177608 00] testload.mod -rw-r--r-- 1 0 0 30492 Oct 9 2014 [ 177610 00] testload.module -rw-r--r-- 1 0 0 30071 Oct 9 2014 [ 177625 00] testspeed.module -rw-r--r-- 1 0 0 3432 Oct 9 2014 [ 177640 00] testspeed.mod -rw-r--r-- 1 0 0 2040 Oct 9 2014 [ 177642 00] test_blockarg.mod -rw-r--r-- 1 0 0 14402 Oct 9 2014 [ 177643 00] test_blockarg.module -rw-r--r-- 1 0 0 8320 Oct 9 2014 [ 177651 00] tftp.mod -rw-r--r-- 1 0 0 49833 Oct 9 2014 [ 177656 00] tftp.module -rw-r--r-- 1 0 0 49329 Oct 9 2014 [ 177681 00] tga.module -rw-r--r-- 1 0 0 6432 Oct 9 2014 [ 177706 00] tga.mod -rw-r--r-- 1 0 0 2344 Oct 9 2014 [ 177710 00] time.mod -rw-r--r-- 1 0 0 14904 Oct 9 2014 [ 177712 00] time.module -rw-r--r-- 1 0 0 3624 Oct 9 2014 [ 177720 00] tr.mod -rw-r--r-- 1 0 0 17980 Oct 9 2014 [ 177722 00] tr.module -rw-r--r-- 1 0 0 2083 Oct 9 2014 [ 177731 00] trig.mod -rw-r--r-- 1 0 0 9052 Oct 9 2014 [ 177733 00] trig.module -rw-r--r-- 1 0 0 13214 Oct 9 2014 [ 177738 00] true.module -rw-r--r-- 1 0 0 1856 Oct 9 2014 [ 177745 00] true.mod -rw-r--r-- 1 0 0 69028 Oct 9 2014 [ 177746 00] udf.module -rw-r--r-- 1 0 0 11184 Oct 9 2014 [ 177780 00] udf.mod -rw-r--r-- 1 0 0 44072 Oct 9 2014 [ 177786 00] ufs1.module -rw-r--r-- 1 0 0 7816 Oct 9 2014 [ 177808 00] ufs1.mod -rw-r--r-- 1 0 0 52123 Oct 9 2014 [ 177812 00] ufs1_be.module -rw-r--r-- 1 0 0 7960 Oct 9 2014 [ 177838 00] ufs1_be.mod -rw-r--r-- 1 0 0 7816 Oct 9 2014 [ 177842 00] ufs2.mod -rw-r--r-- 1 0 0 43841 Oct 9 2014 [ 177846 00] ufs2.module -rw-r--r-- 1 0 0 66015 Oct 9 2014 [ 177868 00] uhci.module -rw-r--r-- 1 0 0 10240 Oct 9 2014 [ 177901 00] uhci.mod -rw-r--r-- 1 0 0 16088 Oct 9 2014 [ 177906 00] usb.mod -rw-r--r-- 1 0 0 120424 Oct 9 2014 [ 177914 00] usb.module -rw-r--r-- 1 0 0 10896 Oct 9 2014 [ 177973 00] usbms.mod -rw-r--r-- 1 0 0 53300 Oct 9 2014 [ 177979 00] usbms.module -rw-r--r-- 1 0 0 29443 Oct 9 2014 [ 178006 00] usbserial_usbdebug.module -rw-r--r-- 1 0 0 3472 Oct 9 2014 [ 178021 00] usbserial_ftdi.mod -rw-r--r-- 1 0 0 2320 Oct 9 2014 [ 178023 00] usbserial_usbdebug.mod -rw-r--r-- 1 0 0 3008 Oct 9 2014 [ 178025 00] usbserial_common.mod -rw-r--r-- 1 0 0 30965 Oct 9 2014 [ 178027 00] usbserial_common.module -rw-r--r-- 1 0 0 35180 Oct 9 2014 [ 178043 00] usbserial_pl2303.module -rw-r--r-- 1 0 0 34994 Oct 9 2014 [ 178061 00] usbserial_ftdi.module -rw-r--r-- 1 0 0 3784 Oct 9 2014 [ 178079 00] usbserial_pl2303.mod -rw-r--r-- 1 0 0 5544 Oct 9 2014 [ 178081 00] usbtest.mod -rw-r--r-- 1 0 0 30342 Oct 9 2014 [ 178084 00] usbtest.module -rw-r--r-- 1 0 0 5880 Oct 9 2014 [ 178099 00] usb_keyboard.mod -rw-r--r-- 1 0 0 42834 Oct 9 2014 [ 178102 00] usb_keyboard.module -rw-r--r-- 1 0 0 85196 Oct 9 2014 [ 178123 00] verify.module -rw-r--r-- 1 0 0 19648 Oct 9 2014 [ 178165 00] verify.mod -rw-r--r-- 1 0 0 41 Oct 9 2014 [ 178175 00] video.lst -rw-r--r-- 1 0 0 53576 Oct 9 2014 [ 178176 00] video.module -rw-r--r-- 1 0 0 5720 Oct 9 2014 [ 178203 00] videoinfo.mod -rw-r--r-- 1 0 0 30352 Oct 9 2014 [ 178206 00] video_fb.mod -rw-r--r-- 1 0 0 9672 Oct 9 2014 [ 178221 00] video_cirrus.mod -rw-r--r-- 1 0 0 50497 Oct 9 2014 [ 178226 00] videotest.module -rw-r--r-- 1 0 0 41359 Oct 9 2014 [ 178251 00] video_colors.module -rw-r--r-- 1 0 0 5672 Oct 9 2014 [ 178272 00] videotest.mod -rw-r--r-- 1 0 0 57644 Oct 9 2014 [ 178275 00] video_bochs.module -rw-r--r-- 1 0 0 3808 Oct 9 2014 [ 178304 00] videotest_checksum.mod -rw-r--r-- 1 0 0 8992 Oct 9 2014 [ 178306 00] video.mod -rw-r--r-- 1 0 0 33904 Oct 9 2014 [ 178311 00] videoinfo.module -rw-r--r-- 1 0 0 33082 Oct 9 2014 [ 178328 00] videotest_checksum.module -rw-r--r-- 1 0 0 9216 Oct 9 2014 [ 178345 00] video_bochs.mod -rw-r--r-- 1 0 0 75960 Oct 9 2014 [ 178350 00] video_cirrus.module -rw-r--r-- 1 0 0 10064 Oct 9 2014 [ 178388 00] video_colors.mod -rw-r--r-- 1 0 0 253526 Oct 9 2014 [ 178393 00] video_fb.module -rw-r--r-- 1 0 0 9744 Oct 9 2014 [ 178517 00] xfs.mod -rw-r--r-- 1 0 0 69152 Oct 9 2014 [ 178522 00] xfs.module -rw-r--r-- 1 0 0 42168 Oct 9 2014 [ 178556 00] xnu.mod -rw-r--r-- 1 0 0 254781 Oct 9 2014 [ 178577 00] xnu.module -rw-r--r-- 1 0 0 3264 Oct 9 2014 [ 178702 00] xnu_uuid.mod -rw-r--r-- 1 0 0 22604 Oct 9 2014 [ 178704 00] xnu_uuid.module -rw-r--r-- 1 0 0 24376 Oct 9 2014 [ 178716 00] xnu_uuid_test.module -rw-r--r-- 1 0 0 3280 Oct 9 2014 [ 178728 00] xnu_uuid_test.mod -rw-r--r-- 1 0 0 129467 Oct 9 2014 [ 178730 00] xzio.module -rw-r--r-- 1 0 0 20800 Oct 9 2014 [ 178794 00] xzio.mod -rw-r--r-- 1 0 0 327006 Oct 9 2014 [ 178805 00] zfs.module -rw-r--r-- 1 0 0 57488 Oct 9 2014 [ 178965 00] zfs.mod -rw-r--r-- 1 0 0 8488 Oct 9 2014 [ 178994 00] zfscrypt.mod -rw-r--r-- 1 0 0 72758 Oct 9 2014 [ 178999 00] zfscrypt.module -rw-r--r-- 1 0 0 10640 Oct 9 2014 [ 179035 00] zfsinfo.mod -rw-r--r-- 1 0 0 43290 Oct 9 2014 [ 179041 00] zfsinfo.module Directory listing of /boot/x86_64/loader/ drwxr-xr-x 2 0 0 14336 Dec 9 2015 [ 74 02] . drwxr-xr-x 3 0 0 2048 Dec 9 2015 [ 73 02] .. -rw-r--r-- 1 0 0 134192 Oct 25 2014 [ 179211 00] 16x16.fnt -rw-r--r-- 1 0 0 11869 Oct 25 2014 [ 179277 00] af.hlp -rw-r--r-- 1 0 0 1745 Oct 25 2014 [ 179283 00] af.tr -rw-r--r-- 1 0 0 18744 Oct 25 2014 [ 179284 00] ar.hlp -rw-r--r-- 1 0 0 4103 Oct 25 2014 [ 179294 00] ar.tr -rw-r--r-- 1 0 0 15916 Oct 25 2014 [ 179297 00] back.jpg -rw-r--r-- 1 0 0 3397 Oct 25 2014 [ 179305 00] bg.tr -rw-r--r-- 1 0 0 102912 Oct 25 2014 [ 179307 00] bootlogo -rw-r--r-- 1 0 0 12281 Oct 25 2014 [ 179358 00] ca.hlp -rw-r--r-- 1 0 0 2111 Oct 25 2014 [ 179364 00] ca.tr -rw-r--r-- 1 0 0 20192 Oct 10 2014 [ 179366 00] chain.c32 -rw-r--r-- 1 0 0 13541 Oct 25 2014 [ 179376 00] cs.hlp -rw-r--r-- 1 0 0 2269 Oct 25 2014 [ 179383 00] cs.tr -rw-r--r-- 1 0 0 13065 Oct 25 2014 [ 179385 00] da.hlp -rw-r--r-- 1 0 0 1804 Oct 25 2014 [ 179392 00] da.tr -rw-r--r-- 1 0 0 13448 Oct 25 2014 [ 179393 00] de.hlp -rw-r--r-- 1 0 0 1991 Oct 25 2014 [ 179400 00] de.tr -rw-r--r-- 1 0 0 14430 Oct 25 2014 [ 179401 00] el.hlp -rw-r--r-- 1 0 0 3431 Oct 25 2014 [ 179409 00] el.tr -rw-r--r-- 1 0 0 11662 Oct 25 2014 [ 179411 00] en.hlp -rw-r--r-- 1 0 0 2634128 Oct 25 2014 [ 179417 00] en.tlk -rw-r--r-- 1 0 0 1631 Oct 25 2014 [ 180704 00] en.tr -rw-r--r-- 1 0 0 13956 Oct 25 2014 [ 180705 00] es.hlp -rw-r--r-- 1 0 0 2211 Oct 25 2014 [ 180712 00] es.tr -rw-r--r-- 1 0 0 11877 Oct 25 2014 [ 180714 00] et.hlp -rw-r--r-- 1 0 0 1917 Oct 25 2014 [ 180720 00] et.tr -rw-r--r-- 1 0 0 12362 Oct 25 2014 [ 180721 00] fi.hlp -rw-r--r-- 1 0 0 1972 Oct 25 2014 [ 180728 00] fi.tr -rw-r--r-- 1 0 0 14859 Oct 25 2014 [ 180729 00] fr.hlp -rw-r--r-- 1 0 0 2249 Oct 25 2014 [ 180737 00] fr.tr -rw-r--r-- 1 0 0 21308 Oct 10 2014 [ 180739 00] gfxboot.c32 -rw-r--r-- 1 0 0 5628 Dec 9 2015 [ 180750 00] gfxboot.cfg -rw-r--r-- 1 0 0 2123 Oct 25 2014 [ 180753 00] gl.tr -rw-r--r-- 1 0 0 14174 Oct 25 2014 [ 180755 00] gu.hlp -rw-r--r-- 1 0 0 3566 Oct 25 2014 [ 180762 00] gu.tr -rw-r--r-- 1 0 0 9204 Oct 25 2014 [ 180764 00] hapysuse.mod -rw-r--r-- 1 0 0 3743 Oct 25 2014 [ 180769 00] hi.tr -rw-r--r-- 1 0 0 11991 Oct 25 2014 [ 180771 00] hr.hlp -rw-r--r-- 1 0 0 2114 Oct 25 2014 [ 180777 00] hr.tr -rw-r--r-- 1 0 0 14194 Oct 25 2014 [ 180779 00] hu.hlp -rw-r--r-- 1 0 0 2393 Oct 25 2014 [ 180786 00] hu.tr -rw-r--r-- 1 0 0 1636 Oct 25 2014 [ 180788 00] id.tr -rw-r--r-- 1 0 0 66720868 Dec 9 2015 [ 180789 00] initrd -rw-r--r-- 1 0 0 24576 Dec 9 2015 [ 213368 00] isolinux.bin -rw-r--r-- 1 0 0 582 Dec 9 2015 [ 213380 00] isolinux.cfg -rw-r--r-- 1 0 0 128 Dec 9 2015 [ 213381 00] isolinux.msg -rw-r--r-- 1 0 0 13592 Oct 25 2014 [ 213382 00] it.hlp -rw-r--r-- 1 0 0 2114 Oct 25 2014 [ 213389 00] it.tr -rw-r--r-- 1 0 0 17007 Oct 25 2014 [ 213391 00] ja.hlp -rw-r--r-- 1 0 0 2779 Oct 25 2014 [ 213400 00] ja.tr -rw-r--r-- 1 0 0 3682 Oct 25 2014 [ 213402 00] ka.tr -rw-r--r-- 1 0 0 14572 Oct 25 2014 [ 213404 00] ko.hlp -rw-r--r-- 1 0 0 2170 Oct 25 2014 [ 213412 00] ko.tr -rw-r--r-- 1 0 0 16384 Oct 25 2014 [ 213414 00] kroete.dat -rw-r--r-- 1 0 0 21689 Oct 25 2014 [ 213422 00] ky.hlp -rw-r--r-- 1 0 0 2977 Oct 25 2014 [ 213433 00] ky.tr -rw-r--r-- 1 0 0 5425352 Dec 9 2015 [ 213435 00] linux -rw-r--r-- 1 0 0 12689 Oct 25 2014 [ 216085 00] lt.hlp -rw-r--r-- 1 0 0 2114 Oct 25 2014 [ 216092 00] lt.tr -rw-r--r-- 1 0 0 33756 Oct 10 2014 [ 216094 00] mboot.c32 -rw-r--r-- 1 0 0 55012 Oct 10 2014 [ 216111 00] menu.c32 -rw-r--r-- 1 0 0 424448 Dec 9 2015 [ 216138 00] message -rw-r--r-- 1 0 0 14408 Oct 25 2014 [ 216346 00] mr.hlp -rw-r--r-- 1 0 0 3741 Oct 25 2014 [ 216354 00] mr.tr -rw-r--r-- 1 0 0 12149 Oct 25 2014 [ 216356 00] nb.hlp -rw-r--r-- 1 0 0 1858 Oct 25 2014 [ 216362 00] nb.tr -rw-r--r-- 1 0 0 12999 Oct 25 2014 [ 216363 00] nl.hlp -rw-r--r-- 1 0 0 1960 Oct 25 2014 [ 216370 00] nl.tr -rw-r--r-- 1 0 0 18173 Oct 25 2014 [ 216371 00] pa.hlp -rw-r--r-- 1 0 0 3502 Oct 25 2014 [ 216380 00] pa.tr -rw-r--r-- 1 0 0 229 Oct 25 2014 [ 216382 00] pabout.txt -rw-r--r-- 1 0 0 39431 Oct 25 2014 [ 216383 00] panim.jpg -rw-r--r-- 1 0 0 29857 Oct 25 2014 [ 216403 00] panim_a.jpg -rw-r--r-- 1 0 0 87451 Oct 25 2014 [ 216418 00] pback.jpg -rw-r--r-- 1 0 0 2124 Oct 25 2014 [ 216461 00] phead.jpg -rw-r--r-- 1 0 0 12878 Oct 25 2014 [ 216463 00] pl.hlp -rw-r--r-- 1 0 0 2076 Oct 25 2014 [ 216470 00] pl.tr -rw-r--r-- 1 0 0 12206 Oct 25 2014 [ 216472 00] pt.hlp -rw-r--r-- 1 0 0 2060 Oct 25 2014 [ 216478 00] pt.tr -rw-r--r-- 1 0 0 13501 Oct 25 2014 [ 216480 00] pt_BR.hlp -rw-r--r-- 1 0 0 2069 Oct 25 2014 [ 216487 00] pt_BR.tr -rw-r--r-- 1 0 0 13091 Oct 25 2014 [ 216489 00] ro.hlp -rw-r--r-- 1 0 0 2020 Oct 25 2014 [ 216496 00] ro.tr -rw-r--r-- 1 0 0 21476 Oct 25 2014 [ 216497 00] ru.hlp -rw-r--r-- 1 0 0 3584 Oct 25 2014 [ 216508 00] ru.tr -rw-r--r-- 1 0 0 12107 Oct 25 2014 [ 216510 00] sk.hlp -rw-r--r-- 1 0 0 2166 Oct 25 2014 [ 216516 00] sk.tr -rw-r--r-- 1 0 0 1866 Oct 25 2014 [ 216518 00] sl.tr -rw-r--r-- 1 0 0 2781 Oct 25 2014 [ 216519 00] sr.tr -rw-r--r-- 1 0 0 12601 Oct 25 2014 [ 216521 00] sv.hlp -rw-r--r-- 1 0 0 1893 Oct 25 2014 [ 216528 00] sv.tr -rw-r--r-- 1 0 0 4383 Oct 25 2014 [ 216529 00] ta.tr -rw-r--r-- 1 0 0 12838 Oct 25 2014 [ 216532 00] text.jpg -rw-r--r-- 1 0 0 2251 Oct 25 2014 [ 216539 00] tg.tr -rw-r--r-- 1 0 0 32845 Oct 25 2014 [ 216541 00] th.hlp -rw-r--r-- 1 0 0 4738 Oct 25 2014 [ 216558 00] th.tr -rw-r--r-- 1 0 0 1719 Oct 25 2014 [ 216561 00] timer_a.jpg -rw-r--r-- 1 0 0 2001 Oct 25 2014 [ 216562 00] tr.tr -rw-r--r-- 1 0 0 21458 Oct 25 2014 [ 216563 00] uk.hlp -rw-r--r-- 1 0 0 3404 Oct 25 2014 [ 216574 00] uk.tr -rw-r--r-- 1 0 0 2153 Oct 25 2014 [ 216576 00] wa.tr -rw-r--r-- 1 0 0 82533 Oct 25 2014 [ 216578 00] welcome.jpg -rw-r--r-- 1 0 0 12745 Oct 25 2014 [ 216619 00] xh.hlp -rw-r--r-- 1 0 0 2305 Oct 25 2014 [ 216626 00] xh.tr -rw-r--r-- 1 0 0 10470 Oct 25 2014 [ 216628 00] zh_CN.hlp -rw-r--r-- 1 0 0 1697 Oct 25 2014 [ 216634 00] zh_CN.tr -rw-r--r-- 1 0 0 10644 Oct 25 2014 [ 216635 00] zh_TW.hlp -rw-r--r-- 1 0 0 1740 Oct 25 2014 [ 216641 00] zh_TW.tr -rw-r--r-- 1 0 0 2005 Oct 25 2014 [ 216642 00] zu.tr Directory listing of /boot/grub2/themes/openSUSE/ drwxr-xr-x 3 0 0 4096 Dec 9 2015 [ 70 02] . drwxr-xr-x 3 0 0 2048 Dec 9 2015 [ 69 02] .. -rwxr-xr-x 1 0 0 1567 Oct 25 2014 [ 179063 00] activate-theme -rw-r--r-- 1 0 0 4213 Oct 25 2014 [ 179064 00] ascii.pf2 -rw-r--r-- 1 0 0 31992 Dec 9 2015 [ 179067 00] background.png -rw-r--r-- 1 0 0 19890 Oct 25 2014 [ 179083 00] COPYING.CC-BY-SA-3.0 -rw-r--r-- 1 0 0 4684 Oct 25 2014 [ 179093 00] DejaVuSans10.pf2 -rw-r--r-- 1 0 0 5679 Oct 25 2014 [ 179096 00] DejaVuSans-Bold14.pf2 -rw-r--r-- 1 0 0 5062 Oct 25 2014 [ 179099 00] DejaVuSans12.pf2 drwxr-xr-x 2 0 0 2048 Dec 9 2015 [ 72 02] icons -rw-r--r-- 1 0 0 318 Oct 25 2014 [ 179102 00] README -rw-r--r-- 1 0 0 287 Oct 25 2014 [ 179103 00] select_c.png -rw-r--r-- 1 0 0 197 Oct 25 2014 [ 179104 00] slider_c.png -rw-r--r-- 1 0 0 265 Oct 25 2014 [ 179105 00] slider_n.png -rw-r--r-- 1 0 0 269 Oct 25 2014 [ 179106 00] slider_s.png -rw-r--r-- 1 0 0 101 Oct 25 2014 [ 179107 00] terminal_box_s.png -rw-r--r-- 1 0 0 97 Oct 25 2014 [ 179108 00] terminal_box_w.png -rw-r--r-- 1 0 0 210 Oct 25 2014 [ 179109 00] terminal_box_nw.png -rw-r--r-- 1 0 0 194 Oct 25 2014 [ 179110 00] terminal_box_n.png -rw-r--r-- 1 0 0 126 Oct 25 2014 [ 179111 00] terminal_box_se.png -rw-r--r-- 1 0 0 123 Oct 25 2014 [ 179112 00] terminal_box_sw.png -rw-r--r-- 1 0 0 94 Oct 25 2014 [ 179113 00] terminal_box_e.png -rw-r--r-- 1 0 0 128 Oct 25 2014 [ 179114 00] terminal_box_ne.png -rw-r--r-- 1 0 0 178 Oct 25 2014 [ 179115 00] terminal_box_c.png -rw-r--r-- 1 0 0 976 Oct 25 2014 [ 179116 00] theme.txt Directory listing of /boot/grub2/themes/openSUSE/icons/ drwxr-xr-x 2 0 0 2048 Dec 9 2015 [ 72 02] . drwxr-xr-x 3 0 0 4096 Dec 9 2015 [ 70 02] .. -rw-r--r-- 1 0 0 3355 Oct 25 2014 [ 179117 00] debian.png -rw-r--r-- 1 0 0 11234 Oct 25 2014 [ 179119 00] fedora.png -rw-r--r-- 1 0 0 11173 Oct 25 2014 [ 179125 00] gentoo.png -rw-r--r-- 1 0 0 3914 Oct 25 2014 [ 179131 00] kubuntu.png -rw-r--r-- 1 0 0 14154 Oct 25 2014 [ 179133 00] linuxmint.png -rw-r--r-- 1 0 0 9765 Oct 25 2014 [ 179140 00] macosx.png -rw-r--r-- 1 0 0 36083 Oct 25 2014 [ 179145 00] opensuse.png -rw-r--r-- 1 0 0 71858 Oct 25 2014 [ 179163 00] recovery.png -rw-r--r-- 1 0 0 4972 Oct 25 2014 [ 179199 00] sabayon.png -rw-r--r-- 1 0 0 5169 Oct 25 2014 [ 179202 00] ubuntu.png -rw-r--r-- 1 0 0 10301 Oct 25 2014 [ 179205 00] windows.png ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7608454 kiwi-11.1.8/test/data/isoboot/example-distribution/config.xml0000644000000000000000000001546115273675667021237 0ustar00 Marcus Schaefer ms@novell.com boot/initrd image used for LiveDVD media 2.1.2 zypper false ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7608454 kiwi-11.1.8/test/data/isoboot/example-distribution-no-delete-section/config.xml0000644000000000000000000001313115273675667024543 0ustar00 Marcus Schaefer ms@novell.com boot/initrd image used for LiveDVD media 2.1.2 zypper false ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7608454 kiwi-11.1.8/test/data/key_value0000644000000000000000000000005615273675667013323 0ustar00foo='bar' bar="xxx" name=bob strange="$a_foo" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7608454 kiwi-11.1.8/test/data/kiwi.yml0000644000000000000000000000027115273675667013101 0ustar00xz: options: -a -b xxx shasum: size: "512" bundle: shasum_size: "256" runtime_checks: disable: - check_container_tool_chain_installed - check_repositories_configured ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7608454 kiwi-11.1.8/test/data/kiwi.yml.d/mapper.yml0000644000000000000000000000003515273675667015405 0ustar00mapper: part_mapper: partx ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7611444 kiwi-11.1.8/test/data/kiwi_config/broken/.config/kiwi/config.yml0000644000000000000000000000001515273675667021435 0ustar00foo: - bar ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.761215 kiwi-11.1.8/test/data/kiwi_config/defaults/.config/kiwi/config.yml0000644000000000000000000000003415273675667021765 0ustar00# use for fetching defaults ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7612996 kiwi-11.1.8/test/data/kiwi_config/invalid/.config/kiwi/config.yml0000644000000000000000000000011415273675667021603 0ustar00iso: tool_category: foo media_tag_tool: foo container: compress: foo ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7613897 kiwi-11.1.8/test/data/kiwi_config/ok/.config/kiwi/config.yml0000644000000000000000000000073715273675667020601 0ustar00xz: options: -a -b xxx sync: sparse: true bundle: compress: true obs: download_url: http://example.com api_url: https://api.example.com public: true user: user_name: user_credentials iso: tool_category: xorriso media_tag_tool: isomd5sum oci: archive_tool: umoci mapper: part_mapper: partx container: compress: none runtime_checks: disable: - check_dracut_module_for_oem_install_in_package_list - check_container_tool_chain_installed ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7614875 kiwi-11.1.8/test/data/kiwi_config/other/.config/kiwi/config.yml0000644000000000000000000000017315273675667021303 0ustar00bundle: has_package_changes: true sync: sparse: false container: compress: true iso: media_tag_tool: checkmedia ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7614875 kiwi-11.1.8/test/data/kiwi_merge_invalid_dict.yml0000644000000000000000000000003015273675667016762 0ustar00shasum: - size: "512" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7614875 kiwi-11.1.8/test/data/kiwi_merge_invalid_list.yml0000644000000000000000000000010015273675667017010 0ustar00runtime_checks: disable: check_container_tool_chain_installed ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7614875 kiwi-11.1.8/test/data/kiwi_merge_ok.yml0000644000000000000000000000030715273675667014751 0ustar00xz: options: --foo shasum: size: "256" bundle: shasum_size: "256" compress: false runtime_checks: disable: - check_container_tool_chain_installed - check_boot_description_exists ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7614875 kiwi-11.1.8/test/data/kiwi_merge_recursive.yml0000644000000000000000000000003715273675667016347 0ustar00xz: &anchor options: *anchor ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7614875 kiwi-11.1.8/test/data/metalink0000644000000000000000000006012315273675667013144 0ustar00 1619174877 6285 6d3f3d3b3489e7c3e63203a4accfec52 8865764f043de7527533f07c530205d2f68ae4d4 4e48e3e6131dd6956141407656318bde5ff226fa07164a015968133feaa154df 30e6cab1ceeed36bf0ad111be66daf2e438bcb79ff420fd090b6c6418bd8d265178e0e5d6515b173834125a30bd4ade60956817efccff86da5f6529a4739ef20 http://mirror.dogado.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.dogado.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://ftp.plusline.net/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp.plusline.net/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.plusline.net/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.speedpartner.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://ftp-stud.hs-esslingen.de/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror2.hs-esslingen.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror2.hs-esslingen.de/fedora-linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp-stud.hs-esslingen.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp-stud.hs-esslingen.de/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp.halifax.rwth-aachen.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.halifax.rwth-aachen.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://ftp.halifax.rwth-aachen.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.netzwerge.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.netzwerge.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.netzwerge.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.fau.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://ftp.fau.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp.fau.de/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.23m.com/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.23m.com/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.23m.com/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirrors.xtom.de/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirrors.xtom.de/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirrors.xtom.de/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://fedora.tu-chemnitz.de/ftp/pub/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://fedora.tu-chemnitz.de/pub/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.telepoint.bg/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.telepoint.bg/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.telepoint.bg/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml http://fedora.mirror.wearetriple.com/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://fedora.mirror.wearetriple.com/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://fedora.mirror.wearetriple.com/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://rsync.nic.funet.fi/ftp/pub/mirrors/fedora.redhat.com/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://www.nic.funet.fi/pub/mirrors/fedora.redhat.com/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.serverion.com/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.serverion.com/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.serverion.com/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml http://fedora.mirror.garr.it/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://fedora.mirror.garr.it/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.tudelft.nl/download.fedora.redhat.com/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.karneval.cz/pub/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.karneval.cz/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.karneval.cz/pub/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://fedora.ip-connect.info/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://fedora.ip-connect.info/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://fedora.ip-connect.info/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirrors.xtom.ee/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirrors.xtom.ee/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirrors.xtom.ee/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml https://ftp.lysator.liu.se/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.lysator.liu.se/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp.lysator.liu.se/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirrors.up.pt/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirrors.up.pt/pub/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.vpsnet.com/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.vpsnet.com/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.ihost.md/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.ihost.md/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.ihost.md/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.netsite.dk/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.netsite.dk/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.netsite.dk/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://ftp.upjs.sk/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.upjs.sk/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp.upjs.sk/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://fedora.mirror.liteserver.nl/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.liteserver.nl/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://fedora.mirror.liteserver.nl/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.easyspeedy.com/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.easyspeedy.com/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.byfly.by/pub/fedoraproject.org/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://ftp.byfly.by/pub/fedoraproject.org/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp.byfly.by/fedora-linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.yandex.ru/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.yandex.ru/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.yandex.ru/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://ftp.acc.umu.se/mirror/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.acc.umu.se/mirror/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp.acc.umu.se/mirror/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://www.mirrorservice.org/sites/dl.fedoraproject.org/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://www.mirrorservice.org/sites/dl.fedoraproject.org/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://rsync.mirrorservice.org/dl.fedoraproject.org/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://fedora.astra.in.ua/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://fedora.astra.in.ua/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml https://fedora.astra.in.ua/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.linux-ia64.org/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://rsync.mirror.linux-ia64.org/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.linux-ia64.org/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://fedora.mirror.root.lu/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp.fi.muni.cz/pub/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.fi.muni.cz/pub/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://fedora.ipacct.com/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://fedora.ipacct.com/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://fedora.ipacct.com/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.init7.net/fedora/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.init7.net/fedora/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.in2p3.fr/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.in2p3.fr/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://distrib-coffee.ipsl.jussieu.fr/pub/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://distrib-coffee.ipsl.jussieu.fr/pub/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://fr2.rpmfind.net/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://fr2.rpmfind.net/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://fr2.rpmfind.net/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.nl.leaseweb.net/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.nl.leaseweb.net/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.veriteknik.net.tr/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.veriteknik.net.tr/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://fedora.ip-connect.vn.ua/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://fedora.ip-connect.vn.ua/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://fedora.ip-connect.vn.ua/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp.cc.uoc.gr/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.cc.uoc.gr/pub/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://ftp.cc.uoc.gr/pub/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp.nluug.nl/Fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.nluug.nl/pub/os/Linux/distr/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.etf.bg.ac.rs/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://fedora.mirrors.telekom.ro/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://fedora.mirrors.telekom.ro/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.dei.uc.pt/pub/linux/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml http://ftp.lip6.fr/ftp/pub/linux/distributions/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://ftp.lip6.fr/Fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml https://ftp.lip6.fr/ftp/pub/linux/distributions/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.library.ucy.ac.cy/linux/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.library.ucy.ac.cy/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.datacenter.by/fedora-linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.datacenter.by/pub/fedoraproject.org/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.datacenter.by/pub/fedoraproject.org/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml https://mirror.szerverem.hu/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.szerverem.hu/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.szerverem.hu/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.slu.cz/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.slu.cz/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirrors.ircam.fr/pub/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirrors.ircam.fr/fedora-linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.bytemark.co.uk/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://mirror.bytemark.co.uk/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml rsync://repo.fedora.md/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://repo.fedora.md/fedora/linux/releases/34/Everything/x86_64/os/repodata/repomd.xml http://mirror.isoc.org.il/pub/fedora/releases/34/Everything/x86_64/os/repodata/repomd.xml ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7614875 kiwi-11.1.8/test/data/my_plugin.rnc0000644000000000000000000000115015273675667014117 0ustar00namespace rng = "http://relaxng.org/ns/structure/1.0" namespace xsi = "http://www.w3.org/2001/XMLSchema-instance" datatypes xsd = "http://www.w3.org/2001/XMLSchema-datatypes" namespace my_plugin = "http://www.my_plugin.com" start = k.my_feature div { k.my_feature.attlist = empty k.my_feature = element my_plugin:my_feature { k.my_feature.attlist & k.title } } div { k.title.name.attribute = attribute name { text } k.title.attlist = k.title.name.attribute k.title = element my_plugin:title { k.title.attlist } } ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7614875 kiwi-11.1.8/test/data/my_plugin.rng0000644000000000000000000000152015273675667014124 0ustar00
././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7614875 kiwi-11.1.8/test/data/nested_include.xml0000644000000000000000000000010415273675667015115 0ustar00 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7618206 kiwi-11.1.8/test/data/oemboot/example-distribution/config.xml0000644000000000000000000001647615273675667021234 0ustar00 Marcus Schaefer ms@novell.com boot/initrd image used on OEM VMX disk 2.7.1 zypper false ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7618206 kiwi-11.1.8/test/data/repomd.xml0000644000000000000000000000362515273675667013431 0ustar00 1478351022 obsproduct://build.opensuse.org/openSUSE:Leap:42.2/openSUSE/42.2/ftp/x86_64 15b3d98843efb0bd51d59917018bf8228a728f56274305d35b3b763047e34858 1478352191 19330267 269260530 3fa65cebc5f58c1f92eb369180dac3a396e0f76a76957e5a1208aa4f09c6ee43 d62ed932df26f29968f17d3ed780a617ce116e651d4b0042495bbec4182671ac 1478352191 88624493 434990650 80a8f395483b70b68b5a9fd95b8752c46fb557eae77b0ade087aabdd39d988c0 55f95a93 1478352191 9476542 71277866 b64f1faece62f5d6d07f52b15b4c419c6644957142f526a76eff6b8289764f88 d62ed932df26f29968f17d3ed780a617ce116e651d4b0042495bbec4182671ac 1478352191 88624493 434990650 80a8f395483b70b68b5a9fd95b8752c46fb557eae77b0ade087aabdd39d988c0 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7619214 kiwi-11.1.8/test/data/root-dir/boot/unicode.pf20000644000000000000000000000000015273675667016142 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7619214 kiwi-11.1.8/test/data/root-dir/image/config.xml0000644000000000000000000002576415273675667016241 0ustar00 Marcus ms@suse.com Testing various configuration states en_US,de_DE true 15.3 1.13.2 zypper en_US us.map.gz Europe/Berlin true true openSUSE openSUSE 1 2048 true 42 swap false false false 10 2048 true false 4 numvcpus = "4" cpuid.coresPerSocket = "2" SIGINT This is a comment ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7620053 kiwi-11.1.8/test/data/root-dir/image/exclude_files.yaml0000644000000000000000000000012515273675667017731 0ustar00exclude: - /usr/bin/qemu-binfmt - /usr/bin/qemu-x86_64-binfmt - /usr/bin/qemu-x86_64 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7620053 kiwi-11.1.8/test/data/root-dir/image/exclude_files_efifatimage.yaml0000644000000000000000000000005415273675667022253 0ustar00exclude: - BOOT/fbia32.efi - BOOT/fbx64.efi ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7620053 kiwi-11.1.8/test/data/runtime_checker_metadata.yml0000644000000000000000000000045215273675667017146 0ustar00package_names: dracut_oem_dump: - dracut-kiwi-oem-dump - kiwi-dracut-oem-dump dracut_oem_repart: - dracut-kiwi-oem-repart - kiwi-dracut-oem-repart dracut_live: - dracut-kiwi-live - kiwi-dracut-live dracut_overlay: - dracut-kiwi-overlay - kiwi-dracut-overlay ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7620053 kiwi-11.1.8/test/data/signing_key.asc0000644000000000000000000000012315273675667014405 0ustar00-----BEGIN PGP PUBLIC KEY BLOCK----- mQENBFake -----END PGP PUBLIC KEY BLOCK----- ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7620053 kiwi-11.1.8/test/data/signing_key.gpg0000644000000000000000000000002315273675667014413 0ustar00 fake-binary-key././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7620053 kiwi-11.1.8/test/data/some.env0000644000000000000000000000002715273675667013067 0ustar00ZYPP_MODALIAS_SYSFS="" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7620053 kiwi-11.1.8/test/data/some_broken.env0000644000000000000000000000000515273675667014423 0ustar00xxxx ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7623093 kiwi-11.1.8/test/data/stackbuild/image-root/image/config.xml0000644000000000000000000000176315273675667020663 0ustar00 Marcus Schaefer ms@suse.com Some Image us en_US zypper Europe/Berlin 1.99.1 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7622097 kiwi-11.1.8/test/data/stackbuild/image-root-invalid-name/image/config.xml0000644000000000000000000000176715273675667023231 0ustar00 Marcus Schaefer ms@suse.com Some Image us en_US zypper Europe/Berlin 1.99.1 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7623093 kiwi-11.1.8/test/data/sysconfig_example.txt0000644000000000000000000000006315273675667015672 0ustar00# some name name = "Marcus" some_key = some-value ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7623093 kiwi-11.1.8/test/data/sysconfig_proxy0000644000000000000000000000027315273675667014605 0ustar00## Path: Network/Proxy ## Description: PROXY_ENABLED="yes" HTTP_PROXY="http://sysconfig-proxy:3128" HTTPS_PROXY="http://sysconfig-proxy:3129" FTP_PROXY="" NO_PROXY="localhost, 127.0.0.1" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7623093 kiwi-11.1.8/test/data/sysconfig_proxy_disabled0000644000000000000000000000007415273675667016433 0ustar00PROXY_ENABLED="no" HTTP_PROXY="http://sysconfig-proxy:3128" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7623093 kiwi-11.1.8/test/data/systemd-id128.out0000644000000000000000000000470415273675667014466 0ustar00NAME ID root-x86 44479540f29741b29af7d131d5f0458a root-x86-verity d13c5d3bb5d1422ab29f9454fdc89d76 root-x86-64 4f68bce3e8cd4db196e7fbcaf984b709 root-x86-64-verity 2c7357edebd246d9aec123d437ec2bf5 root-arm 69dad7102ce44e3cb16c21a1d49abed3 root-arm-verity 7386cdf2203c47a9a498f2ecce45a2d6 root-arm64 b921b0451df041c3af444c6f280d3fae root-arm64-verity df3300ced69f4c92978c9bfb0f38d820 root-ia64 993d8d3df80e4225855a9daf8ed7ea97 root-ia64-verity 86ed10d5b60745bb8957d350f23d0571 root-riscv32 60d5a7fe8e7d435cb7143dd8162144e1 root-riscv32-verity ae0253be11674007ac6843926c14c5de root-riscv64 72ec70a6cf7440e6bd494bda08e8f224 root-riscv64-verity b6ed5582440b4209b8da5ff7c419ea3d root 4f68bce3e8cd4db196e7fbcaf984b709 root-verity 2c7357edebd246d9aec123d437ec2bf5 root-secondary 44479540f29741b29af7d131d5f0458a root-secondary-verity d13c5d3bb5d1422ab29f9454fdc89d76 usr-x86 75250d768cc6458ebd66bd47cc81a812 usr-x86-verity 8f461b0d14ee4e819aa9049b6fb97abd usr-x86-64 8484680c952148c69c11b0720656f69e usr-x86-64-verity 77ff5f63e7b64633acf41565b864c0e6 usr-arm 7d0359a302b34f0a865c654403e70625 usr-arm-verity c215d7517bcd4649be906627490a4c05 usr-arm64 b0e01050ee5f4390949a9101b17104e9 usr-arm64-verity 6e11a4e7fbca4dedb9e9e1a512bb664e usr-ia64 4301d2a64e3b4b2abb949e0b2c4225ea usr-ia64-verity 6a491e033be745458e3883320e0ea880 usr-riscv32 b933fb225c3f4f91af90e2bb0fa50702 usr-riscv32-verity cb1ee4e38cd04136a0a4aa61a32e8730 usr-riscv64 beaec34b8442439ba40b984381ed097d usr-riscv64-verity 8f1056be9b0547c481d6be53128e5b54 usr 8484680c952148c69c11b0720656f69e usr-verity 77ff5f63e7b64633acf41565b864c0e6 usr-secondary 75250d768cc6458ebd66bd47cc81a812 usr-secondary-verity 8f461b0d14ee4e819aa9049b6fb97abd esp c12a7328f81f11d2ba4b00a0c93ec93b xbootldr bc13c2ff59e64262a352b275fd6f7172 swap 0657fd6da4ab43c484e50933c84b4f4f home 933ac7e12eb44f13b8440e14e2aef915 srv 3b8f842520e04f3b907f1a25a76f98e8 var 4d21b016b53445c2a9fb5c16e091fd2d tmp 7ec6f5573bc54acab29316ef5df639d1 user-home 773f91ef66d449b5bd83d683bf40ad16 linux-generic 0fc63daf848347728e793d69d8477de4 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7623093 kiwi-11.1.8/test/data/vagrant_virtualbox.ovf0000644000000000000000000001321715273675667016054 0ustar00 List of the virtual disks used in the package Logical networks used in the package Logical network used by this appliance. A virtual machine The kind of installed guest operating system OpenSUSE Leap 15.0 Linux_64 Virtual hardware requirements for a virtual machine Virtual Hardware Family 0 OpenSUSE-Leap-15.0 virtualbox-2.2 1 virtual CPU Number of virtual CPUs 1 virtual CPU(s) 1 3 1 MegaBytes 1024 MB of memory Memory Size 1024 MB of memory 2 4 1024 0 ideController0 IDE Controller ideController0 3 PIIX4 5 1 ideController1 IDE Controller ideController1 4 PIIX4 5 0 sataController0 SATA Controller sataController0 5 AHCI 20 3 false sound Sound Card sound 6 ensoniq1371 35 0 disk1 Disk Image disk1 /disk/vmdisk1 7 5 17 true Ethernet adapter on 'NAT' NAT Ethernet adapter on 'NAT' 8 E1000 10 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7623093 kiwi-11.1.8/test/data/xz_data.xz0000644000000000000000000000004015273675667013422 0ustar007zXZִFD!}YZ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7623093 kiwi-11.1.8/test/scripts/__init__.py0000644000000000000000000000000015273675667014270 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7625732 kiwi-11.1.8/test/scripts/conftest.py0000644000000000000000000000125215273675667014370 0ustar00from pytest_container import auto_container_parametrize, DerivedContainer FUNCTIONS_COPY_CONTAINERFILE = """COPY kiwi/config/functions.sh /bin/functions.sh """ CONTAINERS = [ DerivedContainer(base=url, containerfile=FUNCTIONS_COPY_CONTAINERFILE) for url in [ "registry.opensuse.org/opensuse/leap:15.5", "registry.opensuse.org/opensuse/tumbleweed:latest", "registry.fedoraproject.org/fedora:latest" ] ] ( LEAP_15_5, TUMBLEWEED, FEDORA ) = CONTAINERS CONTAINERS_WITH_ZYPPER = [ LEAP_15_5, TUMBLEWEED ] CONTAINERS_WITH_DNF = [ FEDORA ] def pytest_generate_tests(metafunc): auto_container_parametrize(metafunc) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7625732 kiwi-11.1.8/test/scripts/test_baseVagrantSetup.py0000644000000000000000000000611715273675667017065 0ustar00from pytest_container.container import DerivedContainer from .conftest import ( CONTAINERS_WITH_ZYPPER, CONTAINERS_WITH_DNF ) import pytest VAGRANT_SETUP_CONTAINERFILE = r"""RUN groupadd vagrant && useradd -g vagrant vagrant RUN echo $'#!/bin/bash \n\ printf "%s " "$@" >> /systemctl_params \n\ echo >> /systemctl_params \n\ '> /usr/bin/systemctl && chmod +x /usr/bin/systemctl """ ZYPPER_IN_CMD_CONTAINERFILE = ( """RUN zypper -n in openssh sudo && /usr/sbin/sshd-gen-keys-start """ + VAGRANT_SETUP_CONTAINERFILE ) DNF_IN_CMD_CONTAINERFILE = ( """RUN dnf -y install openssh-server && /usr/libexec/openssh/sshd-keygen ed25519 """ + VAGRANT_SETUP_CONTAINERFILE ) @pytest.mark.parametrize( "container_per_test", [ DerivedContainer(base=cont, containerfile=ZYPPER_IN_CMD_CONTAINERFILE) for cont in CONTAINERS_WITH_ZYPPER ] + [ DerivedContainer(base=cont, containerfile=DNF_IN_CMD_CONTAINERFILE) for cont in CONTAINERS_WITH_DNF ], indirect=["container_per_test"], ) def test_configures_system_for_vagrant(container_per_test): container_per_test.connection.run_expect( [0], ". /bin/functions.sh && baseVagrantSetup" ) # check vagrant user's ssh config dot_ssh = container_per_test.connection.file("/home/vagrant/.ssh") assert dot_ssh.is_directory assert dot_ssh.group == "vagrant" assert dot_ssh.user == "vagrant" assert dot_ssh.mode == 0o700 authorized_keys = container_per_test.connection.file( "/home/vagrant/.ssh/authorized_keys" ) assert authorized_keys.is_file assert authorized_keys.group == "vagrant" assert authorized_keys.user == "vagrant" assert authorized_keys.mode == 0o600 assert "vagrant insecure public key" in authorized_keys.content_string # check the sshd config sshd_config = container_per_test.connection.run_expect([0], "sshd -T").stdout assert "UseDNS no".lower() in sshd_config.lower() assert "GSSAPIAuthentication no".lower() in sshd_config.lower() # check that the shared /vagrant folder is present and has the correct permissions vagrant_shared_dir = container_per_test.connection.file("/vagrant") assert vagrant_shared_dir.is_directory assert vagrant_shared_dir.group == "vagrant" assert vagrant_shared_dir.user == "vagrant" vagrant_sudoers = container_per_test.connection.file( "/etc/sudoers.d/vagrant" ) if vagrant_sudoers.exists and vagrant_sudoers.is_file: assert ( vagrant_sudoers.content_string.strip() == "vagrant ALL=(ALL) NOPASSWD: ALL" ) assert vagrant_sudoers.mode == 0o440 assert vagrant_sudoers.user == "root" assert vagrant_sudoers.group == "root" else: sudoers = container_per_test.connection.file("/etc/sudoers") assert sudoers.exists and sudoers.is_file assert "vagrant ALL=(ALL) NOPASSWD: ALL" in sudoers.content_string # check that systemctl was called enabling sshd assert ( "enable sshd" in container_per_test.connection.file( "/systemctl_params" ).content_string ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7625732 kiwi-11.1.8/test/scripts/test_suseSetupProduct.py0000644000000000000000000000575315273675667017155 0ustar00import pytest from .conftest import ( LEAP_15_5, TUMBLEWEED, ) CONTAINER_IMAGES = [TUMBLEWEED] def test_does_nothing_when_product_correct(auto_container_per_test): previous_contents = auto_container_per_test.connection.file( "/etc/products.d" ).listdir() auto_container_per_test.connection.run_expect( [0], ". /bin/functions.sh && suseSetupProduct" ) assert auto_container_per_test.connection.file("/etc/products.d").listdir() == previous_contents @pytest.mark.parametrize( "container_per_test,product_name", ( (TUMBLEWEED, "openSUSE.prod"), (LEAP_15_5, "Leap.prod"), ), indirect=["container_per_test"], ) def test_sets_baseproduct_from_etc_os_release(container_per_test, product_name): assert not container_per_test.connection.file("/etc/SuSE-brand").exists container_per_test.connection.run_expect([0], "rm /etc/products.d/baseproduct") container_per_test.connection.run_expect( [0], ". /bin/functions.sh && suseSetupProduct" ) assert container_per_test.connection.file("/etc/products.d/baseproduct").exists assert container_per_test.connection.file("/etc/products.d/baseproduct").is_symlink assert container_per_test.connection.file("/etc/products.d/baseproduct").linked_to == "/etc/products.d/" + product_name def test_sets_baseproduct_with_weird_os_release(auto_container_per_test): assert not auto_container_per_test.connection.file( "/etc/SuSE-brand" ).exists auto_container_per_test.connection.run_expect( [0], "rm /etc/products.d/baseproduct" ) auto_container_per_test.connection.run_expect( [0], """cat < /etc/os-release NAME=openSUSE Tumbleweed ID="opensuse-tumbleweed" ID_LIKE="opensuse suse" EOF """, ) auto_container_per_test.connection.run_expect( [0], ". /bin/functions.sh && suseSetupProduct" ) assert auto_container_per_test.connection.file( "/etc/products.d/baseproduct" ).exists assert auto_container_per_test.connection.file( "/etc/products.d/baseproduct" ).is_symlink assert ( auto_container_per_test.connection.file( "/etc/products.d/baseproduct" ).linked_to == "/etc/products.d/openSUSE.prod" ) def test_sets_baseproduct_from_prod_files(auto_container_per_test): auto_container_per_test.connection.run_expect( [0], """rm /etc/products.d/baseproduct rm /etc/products.d/openSUSE.prod touch /etc/products.d/10.prod touch /etc/products.d/20.prod """, ) auto_container_per_test.connection.run_expect( [0], ". /bin/functions.sh && suseSetupProduct" ) assert auto_container_per_test.connection.file( "/etc/products.d/baseproduct" ).exists assert auto_container_per_test.connection.file( "/etc/products.d/baseproduct" ).is_symlink assert ( auto_container_per_test.connection.file( "/etc/products.d/baseproduct" ).linked_to == "/etc/products.d/20.prod" ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7625732 kiwi-11.1.8/test/unit/.coveragerc0000644000000000000000000000017215273675667013602 0ustar00[run] omit = */app.py */kiwi.py */xml_parse.py [report] omit = */app.py */kiwi.py */xml_parse.py ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7625732 kiwi-11.1.8/test/unit/__init__.py0000644000000000000000000000000015273675667013560 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7626996 kiwi-11.1.8/test/unit/api_helper_test.py0000644000000000000000000000152615273675667015206 0ustar00from pytest import raises from unittest.mock import patch from kiwi.api_helper import obsolete, decommissioned @decommissioned def method_decommissioned(): # Implementation has been deleted pass @obsolete(decommission_at='2025-01-28', version="1.2.3") def method_obsolete(): return 'I still exist' class TestApiHelpers: def test_method_decommissioned(self): with raises(DeprecationWarning): method_decommissioned() @patch('warnings.warn') def test_method_obsolete(self, mock_warnings_warn): warning_message = ( "Function 'method_obsolete' is marked obsolete " "since version '1.2.3' and will be decommissioned " "at: 2025-01-28" ) assert method_obsolete() == 'I still exist' mock_warnings_warn.assert_called_once_with(warning_message) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7626996 kiwi-11.1.8/test/unit/archive/__init__.py0000644000000000000000000000000015273675667015201 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7627819 kiwi-11.1.8/test/unit/archive/cpio_test.py0000644000000000000000000000235215273675667015447 0ustar00from unittest.mock import patch from kiwi.archive.cpio import ArchiveCpio class TestArchiveCpio: def setup(self): self.archive = ArchiveCpio('foo.cpio') def setup_method(self, cls): self.setup() @patch('kiwi.archive.cpio.Command.run') def test_create(self, mock_command): self.archive.create('source-dir', ['/boot', '/var/cache']) find_command = ( 'find . -path ./boot -prune -or -path ./var/cache -prune -o -print' ) cpio_command = 'cpio --quiet -o -H newc' mock_command.assert_called_once_with( [ 'bash', '-c', ''.join( [ 'cd source-dir && ', find_command, ' | ', cpio_command, ' > foo.cpio', ] ), ] ) @patch('kiwi.archive.cpio.Command.run') def test_extract(self, mock_command): self.archive.extract('dest-dir') bash_command = ( 'cd dest-dir && cat foo.cpio | cpio -i --make-directories' ) mock_command.assert_called_once_with(['bash', '-c', bash_command]) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7627819 kiwi-11.1.8/test/unit/archive/tar_test.py0000644000000000000000000002072415273675667015306 0ustar00from unittest.mock import patch, call from pytest import raises import unittest.mock as mock from kiwi.archive.tar import ArchiveTar from kiwi.exceptions import KiwiCommandCapabilitiesError class TestArchiveTar: @patch('kiwi.archive.tar.Command.run') def setup(self, mock_command): command = mock.Mock() command.output = 'version 1.27.0' mock_command.return_value = command self.archive = ArchiveTar('foo.tar') @patch('kiwi.archive.tar.Command.run') def setup_method(self, cls, mock_command): self.setup() @patch('kiwi.archive.tar.Command.run') def test_invalid_tar_command_version(self, mock_command): command = mock.Mock() command.output = 'version cannot be parsed' mock_command.return_value = command with raises(KiwiCommandCapabilitiesError): self.archive = ArchiveTar('foo.tar') @patch('kiwi.archive.tar.Command.run') def test_extract(self, mock_command): self.archive.extract('destination') mock_command.assert_called_once_with( ['tar', '-C', 'destination', '-x', '-v', '-f', 'foo.tar'] ) @patch('kiwi.archive.tar.Command.run') @patch('os.listdir') def test_create(self, mock_os_dir, mock_command): mock_os_dir.return_value = ['foo', 'bar'] assert self.archive.create('source-dir') == 'foo.tar' mock_command.assert_called_once_with( [ 'tar', '-C', 'source-dir', '--xattrs', '--xattrs-include=*', '-c', '-f', 'foo.tar', 'bar', 'foo', ] ) @patch('kiwi.archive.tar.Command.run') def test_append_files(self, mock_command): assert ( self.archive.append_files('source-dir', ['foo', 'bar']) == 'foo.tar' ) mock_command.assert_called_once_with( [ 'tar', '-C', 'source-dir', '-r', '--file=' + self.archive.filename, '--xattrs', '--xattrs-include=*', 'foo', 'bar', ] ) @patch('kiwi.archive.tar.Command.run') @patch('os.listdir') def test_create_with_options(self, mock_os_dir, mock_command): mock_os_dir.return_value = ['foo', 'bar'] assert ( self.archive.create( 'source-dir', options=['--fake-option', 'fake_arg'] ) == 'foo.tar' ) mock_command.assert_called_once_with( [ 'tar', '-C', 'source-dir', '--fake-option', 'fake_arg', '--xattrs', '--xattrs-include=*', '-c', '-f', 'foo.tar', 'bar', 'foo', ] ) @patch('kiwi.archive.tar.Command.run') @patch('os.listdir') def test_create_with_old_tar_version(self, mock_os_dir, mock_command): command = mock.Mock() command.output = 'version 1.26.1' mock_command.return_value = command archive = ArchiveTar('foo.tar') mock_os_dir.return_value = ['foo', 'bar'] assert archive.create('source-dir') == 'foo.tar' calls = [ call(['tar', '--version']), call( ['tar', '-C', 'source-dir', '-c', '-f', 'foo.tar', 'bar', 'foo'] ), ] mock_command.assert_has_calls(calls) assert mock_command.call_count == 2 @patch('kiwi.archive.tar.Command.run') def test_create_from_dir_with_excludes(self, mock_command): command = mock.Mock() command.output = 'version 1.27.0' mock_command.return_value = command archive = ArchiveTar('foo.tar', False) assert archive.create('source-dir', ['foo', 'bar']) == 'foo.tar' calls = [ call(['tar', '--version']), call( [ 'tar', '-C', 'source-dir', '--xattrs', '--xattrs-include=*', '-c', '-f', 'foo.tar', '--exclude', './foo', '--exclude', './bar', '.', ] ), ] mock_command.assert_has_calls(calls) assert mock_command.call_count == 2 @patch('kiwi.archive.tar.Command.run') def test_create_from_dir_without_excludes(self, mock_command): command = mock.Mock() command.output = 'version 1.27.0' mock_command.return_value = command archive = ArchiveTar('foo.tar', False) assert archive.create('source-dir') == 'foo.tar' assert mock_command.call_args_list[1] == call( [ 'tar', '-C', 'source-dir', '--xattrs', '--xattrs-include=*', '-c', '-f', 'foo.tar', '.', ] ) @patch('kiwi.archive.tar.Command.run') @patch('os.listdir') def test_create_xz_compressed(self, mock_os_dir, mock_command): mock_os_dir.return_value = ['foo', 'bar'] assert self.archive.create_xz_compressed('source-dir') == 'foo.tar.xz' mock_command.assert_called_once_with( [ 'bash', '-c', ' '.join( [ 'tar', '-C', 'source-dir', '--xattrs', '--xattrs-include=*', '-c', '--to-stdout', 'bar', 'foo', '|', 'xz', '-f', '--threads=0', '>', 'foo.tar.xz', ] ), ] ) @patch('kiwi.archive.tar.Command.run') @patch('os.listdir') def test_create_xz_compressed_with_custom_xz_options( self, mock_os_dir, mock_command ): mock_os_dir.return_value = ['foo', 'bar'] assert ( self.archive.create_xz_compressed( 'source-dir', xz_options=['-a', '-b'] ) == 'foo.tar.xz' ) mock_command.assert_called_once_with( [ 'bash', '-c', ' '.join( [ 'tar', '-C', 'source-dir', '--xattrs', '--xattrs-include=*', '-c', '--to-stdout', 'bar', 'foo', '|', 'xz', '-f', '-a', '-b', '>', 'foo.tar.xz', ] ), ] ) @patch('kiwi.archive.tar.Command.run') @patch('os.listdir') def test_create_gnu_gzip_compressed(self, mock_os_dir, mock_command): mock_os_dir.return_value = ['foo', 'bar'] assert ( self.archive.create_gnu_gzip_compressed('source-dir') == 'foo.tar.gz' ) mock_command.assert_called_once_with( [ 'tar', '-C', 'source-dir', '--format=gnu', '-cSz', '-f', 'foo.tar.gz', 'bar', 'foo', ] ) @patch('kiwi.archive.tar.Command.run') @patch('os.listdir') def test_create_exclude(self, mock_os_dir, mock_command): mock_os_dir.return_value = ['foo', 'bar'] assert self.archive.create('source-dir', ['foo']) == 'foo.tar' mock_command.assert_called_once_with( [ 'tar', '-C', 'source-dir', '--xattrs', '--xattrs-include=*', '-c', '-f', 'foo.tar', 'bar', ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7627819 kiwi-11.1.8/test/unit/boot/__init__.py0000644000000000000000000000000015273675667014523 0ustar00././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.762898 kiwi-11.1.8/test/unit/boot/image/__init__.py0000644000000000000000000000000015273675667015605 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7629266 kiwi-11.1.8/test/unit/boot/image/base_test.py0000644000000000000000000002730015273675667016033 0ustar00import io from collections import namedtuple from unittest.mock import patch, Mock, MagicMock from pytest import raises from kiwi.boot.image.base import BootImageBase from kiwi.defaults import Defaults from kiwi.exceptions import ( KiwiTargetDirectoryNotFound, KiwiConfigFileNotFound, KiwiDiskBootImageError, ) class TestBootImageBase: @patch('kiwi.boot.image.base.os.path.exists') def setup(self, mock_exists): Defaults.set_platform_name('x86_64') self.boot_names_type = namedtuple( 'boot_names_type', ['kernel_name', 'initrd_name', 'kernel_version', 'kernel_filename'], ) self.kernel = Mock() kernel_info = Mock kernel_info.name = 'kernel_name' kernel_info.version = 'kernel_version' kernel_info.filename = 'kernel_filename' self.kernel.get_kernel.return_value = kernel_info self.boot_xml_state = Mock() self.xml_state = Mock() self.xml_state.get_initrd_system = Mock(return_value='dracut') self.xml_state.xml_data.get_name = Mock(return_value='some-image') self.xml_state.get_image_version = Mock(return_value='1.2.3') self.xml_state.build_type.get_boot = Mock( return_value='oemboot/suse-13.2' ) mock_exists.return_value = True self.boot_image = BootImageBase( self.xml_state, 'some-target-dir', 'system-directory' ) @patch('kiwi.boot.image.base.os.path.exists') def setup_method(self, cls, mock_exists): self.setup() def test_boot_image_raises(self): with raises(KiwiTargetDirectoryNotFound): BootImageBase( self.xml_state, 'target-dir-does-not-exist', 'some-root-dir' ) def test_prepare(self): with raises(NotImplementedError): self.boot_image.prepare() def test_create_initrd(self): with raises(NotImplementedError): self.boot_image.create_initrd() def test_create_uki(self): with raises(NotImplementedError): self.boot_image.create_uki('some_cmdline') @patch('os.listdir') def test_is_prepared(self, mock_listdir): mock_listdir.return_value = [] assert self.boot_image.is_prepared() is False mock_listdir.return_value = ['a', 'b', 'c'] assert self.boot_image.is_prepared() is True @patch('kiwi.boot.image.base.XMLState.copy_strip_sections') def test_import_system_description_elements(self, mock_strip): self.boot_image.import_system_description_elements() assert self.xml_state.copy_displayname.called assert self.xml_state.copy_name.called assert self.xml_state.copy_repository_sections.called assert self.xml_state.copy_drivers_sections.called assert mock_strip.called assert self.xml_state.copy_strip_sections.called assert self.xml_state.copy_preferences_subsections.called assert self.xml_state.copy_bootincluded_packages.called assert self.xml_state.copy_bootincluded_archives.called assert self.xml_state.copy_bootdelete_packages.called assert self.xml_state.copy_build_type_attributes.called assert self.xml_state.copy_systemdisk_section.called assert self.xml_state.copy_machine_section.called assert self.xml_state.copy_oemconfig_section.called def test_get_boot_description_directory(self): assert ( self.boot_image.get_boot_description_directory() == '/usr/share/kiwi/custom_boot/oemboot/suse-13.2' ) @patch('kiwi.boot.image.base.BootImageBase.get_boot_description_directory') def test_load_boot_xml_description(self, mock_boot_dir): mock_boot_dir.return_value = None with raises(KiwiConfigFileNotFound): self.boot_image.load_boot_xml_description() @patch('kiwi.boot.image.base.Kernel') def test_get_boot_names_raises(self, mock_Kernel): kernel = Mock() mock_Kernel.return_value = kernel kernel.get_kernel.return_value = None with raises(KiwiDiskBootImageError): self.boot_image.get_boot_names() kernel.get_kernel.assert_called_once_with(flavor='') @patch('kiwi.boot.image.base.Kernel') def test_get_boot_names_of_flavor_raises(self, mock_Kernel): kernel = Mock() mock_Kernel.return_value = kernel kernel.get_kernel.return_value = None with raises(KiwiDiskBootImageError) as issue: self.boot_image.get_boot_names(flavor='rt') assert 'No kernel of flavor rt in boot image tree' in str(issue.value) kernel.get_kernel.assert_called_once_with(flavor='rt') @patch('kiwi.boot.image.base.Kernel') def test_get_boot_names_with_initrd_system_set_to_none(self, mock_Kernel): kernel = Mock() mock_Kernel.return_value = kernel kernel.get_kernel.return_value = None self.xml_state.get_initrd_system.return_value = 'none' boot_names = self.boot_image.get_boot_names() assert boot_names.kernel_name == 'none' assert boot_names.initrd_name == 'none' assert boot_names.kernel_version == 'none' @patch('kiwi.boot.image.base.Kernel') @patch('kiwi.boot.image.base.Path.which') @patch('kiwi.boot.image.base.log.warning') @patch('glob.iglob') @patch('kiwi.boot.image.base.CommandCapabilities.has_option_in_help') def test_get_boot_names_default( self, mock_CommandCapabilities_has_option_in_help, mock_iglob, mock_warning, mock_Path_which, mock_Kernel, ): mock_CommandCapabilities_has_option_in_help.return_value = False mock_iglob.return_value = [] mock_Path_which.return_value = None mock_Kernel.return_value = self.kernel self.xml_state.get_initrd_system.return_value = 'kiwi' assert self.boot_image.get_boot_names() == self.boot_names_type( kernel_name='kernel_name', initrd_name='initrd-kernel_version', kernel_version='kernel_version', kernel_filename='kernel_filename', ) self.xml_state.get_initrd_system.return_value = 'dracut' assert self.boot_image.get_boot_names() == self.boot_names_type( kernel_name='kernel_name', initrd_name='initramfs-kernel_version.img', kernel_version='kernel_version', kernel_filename='kernel_filename', ) @patch('kiwi.boot.image.base.Kernel') @patch('kiwi.boot.image.base.Path.which') @patch('kiwi.boot.image.base.log.warning') @patch('glob.iglob') @patch('os.path.islink') def test_get_boot_names_from_file( self, mock_islink, mock_iglob, mock_warning, mock_Path_which, mock_Kernel, ): mock_islink.return_value = False # the initrd of a kernel which is not installed anymore does # not tell the format, its name has no installed version mock_iglob.return_value = [ '/boot/initrd.img-other_kernel_version', '/boot/initrd-gone_version', ] mock_Path_which.return_value = None mock_Kernel.return_value = self.kernel self.kernel.get_version_in_name.side_effect = lambda name: { 'initrd.img-other_kernel_version': 'other_kernel_version' }.get(name) self.xml_state.get_initrd_system.return_value = 'dracut' assert self.boot_image.get_boot_names() == self.boot_names_type( kernel_name='kernel_name', initrd_name='initrd.img-kernel_version', kernel_version='kernel_version', kernel_filename='kernel_filename', ) @patch('kiwi.boot.image.base.Kernel') @patch('kiwi.boot.image.base.Path.which') @patch('kiwi.boot.image.base.log.warning') @patch('glob.iglob') def test_get_boot_names_from_dracut( self, mock_iglob, mock_warning, mock_Path_which, mock_Kernel ): mock_iglob.return_value = [] mock_Path_which.return_value = 'dracut' mock_Kernel.return_value = self.kernel self.xml_state.get_initrd_system.return_value = 'dracut' with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = 'outfile="/boot/initrd-$kernel"' assert self.boot_image.get_boot_names() == self.boot_names_type( kernel_name='kernel_name', initrd_name='initrd-kernel_version', kernel_version='kernel_version', kernel_filename='kernel_filename', ) file_handle.read.return_value = 'outfile="/boot/initrd-${kernel}"' assert self.boot_image.get_boot_names() == self.boot_names_type( kernel_name='kernel_name', initrd_name='initrd-kernel_version', kernel_version='kernel_version', kernel_filename='kernel_filename', ) @patch('kiwi.boot.image.base.Kernel') @patch.object( BootImageBase, '_get_boot_image_output_file_format_from_existing_file' ) @patch.object( BootImageBase, '_get_boot_image_output_file_format_from_dracut_code' ) @patch('kiwi.boot.image.base.CommandCapabilities.has_option_in_help') @patch('kiwi.boot.image.base.Command.run') @patch('kiwi.boot.image.base.MountManager') def test_get_boot_names_from_dracut_config( self, mock_MountManager, mock_Command_run, mock_CommandCapabilities_has_option_in_help, mock_get_boot_image_output_file_format_from_dracut_code, mock_get_boot_image_output_file_format_from_existing_file, mock_Kernel, ): mock_Kernel.return_value = self.kernel mock_get_boot_image_output_file_format_from_existing_file.return_value = ( None ) mock_get_boot_image_output_file_format_from_dracut_code.return_value = ( None ) self.xml_state.get_initrd_system.return_value = 'dracut' mock_CommandCapabilities_has_option_in_help.return_value = True with open('../data/dracut_config') as config: dracut_config = config.read() dracut_call = Mock() dracut_call.output = dracut_config mock_Command_run.return_value = dracut_call assert self.boot_image.get_boot_names() == self.boot_names_type( kernel_name='kernel_name', initrd_name='initrd-kernel_version', kernel_version='kernel_version', kernel_filename='kernel_filename', ) mock_MountManager.assert_called_once_with( device='tmpfs', mountpoint='system-directory/var/tmp' ) mock_CommandCapabilities_has_option_in_help.assert_called_once_with( 'dracut', '--printconfig', ['--help'], root='system-directory', raise_on_error=False, ) mock_Command_run.assert_called_once_with( ['chroot', 'system-directory', 'dracut', '--printconfig'] ) def test_noop_methods(self): self.boot_image.include_module('module') self.boot_image.omit_module('module') self.boot_image.set_static_modules(['module']) self.boot_image.include_driver('driver') self.boot_image.omit_driver('driver') self.boot_image.write_system_config_file({'config_key': 'value'}) self.boot_image.cleanup() def test_has_initrd_support(self): assert self.boot_image.has_initrd_support() is False def test_add_argument(self): assert self.boot_image.add_argument('some') is None ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7629266 kiwi-11.1.8/test/unit/boot/image/builtin_kiwi_test.py0000644000000000000000000001637415273675667017623 0ustar00import sys from unittest.mock import patch, call, Mock, MagicMock from pytest import raises import kiwi from ...test_helper import argv_kiwi_tests from kiwi.defaults import Defaults from kiwi.boot.image.builtin_kiwi import BootImageKiwi from kiwi.xml_description import XMLDescription from kiwi.xml_state import XMLState from kiwi.exceptions import KiwiConfigFileNotFound class TestBootImageKiwi: @patch('kiwi.boot.image.builtin_kiwi.Temporary') @patch('kiwi.boot.image.builtin_kiwi.os.path.exists') @patch('kiwi.defaults.Defaults.get_boot_image_description_path') def setup(self, mock_boot_path, mock_exists, mock_Temporary): mock_Temporary.return_value.new_dir.return_value.name = ( 'boot-root-directory' ) mock_boot_path.return_value = '../data' Defaults.set_platform_name('x86_64') mock_exists.return_value = True description = XMLDescription('../data/example_config.xml') self.xml_state = XMLState(description.load()) self.setup = Mock() self.profile = Mock() self.profile.dot_profile = dict() kiwi.boot.image.builtin_kiwi.SystemSetup = Mock(return_value=self.setup) kiwi.boot.image.builtin_kiwi.Profile = Mock(return_value=self.profile) self.boot_image = BootImageKiwi(self.xml_state, 'some-target-dir') @patch('kiwi.boot.image.builtin_kiwi.Temporary') @patch('kiwi.boot.image.builtin_kiwi.os.path.exists') @patch('kiwi.defaults.Defaults.get_boot_image_description_path') def setup_method(self, cls, mock_boot_path, mock_exists, mock_Temporary): self.setup() def test_include_file(self): # is a nop for builtin kiwi initrd and does nothing self.boot_image.include_file('/root/a') @patch('kiwi.defaults.Defaults.get_boot_image_description_path') @patch('kiwi.boot.image.builtin_kiwi.Temporary') @patch('kiwi.boot.image.builtin_kiwi.SystemPrepare') def test_prepare(self, mock_SystemPrepare, mock_Temporary, mock_boot_path): system_prepare = Mock() manager = MagicMock() system_prepare.setup_repositories = Mock(return_value=manager) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare mock_Temporary.return_value.new_dir.return_value.name = ( 'boot-root-directory' ) mock_boot_path.return_value = '../data' self.boot_image.prepare() system_prepare.setup_repositories.assert_called_once_with( signing_keys=None, target_arch=None ) system_prepare.install_bootstrap.assert_called_once_with( manager.__enter__.return_value ) system_prepare.install_system.assert_called_once_with( manager.__enter__.return_value ) assert self.profile.add.call_args_list[0] == call( 'kiwi_initrdname', 'initrd-oemboot-suse-13.2' ) self.profile.create.assert_called_once_with( 'boot-root-directory/.profile' ) self.setup.import_description.assert_called_once_with() self.setup.import_overlay_files.assert_called_once_with( follow_links=True ) self.setup.call_config_script.assert_called_once_with() system_prepare.pinch_system.assert_called_once_with( manager=manager.__enter__.return_value, force=True ) self.setup.call_image_script.assert_called_once_with() @patch('os.path.exists') @patch('kiwi.boot.image.builtin_kiwi.Temporary') def test_prepare_no_boot_description_found( self, mock_Temporary, mock_os_path ): mock_Temporary.return_value.new_dir.return_value.name = ( 'boot-root-directory' ) mock_os_path.return_value = False with raises(KiwiConfigFileNotFound): self.boot_image.post_init() @patch('kiwi.boot.image.builtin_kiwi.ArchiveCpio') @patch('kiwi.boot.image.builtin_kiwi.Compress') @patch('kiwi.boot.image.builtin_kiwi.Path.create') @patch('kiwi.boot.image.builtin_kiwi.Path.wipe') @patch('kiwi.boot.image.builtin_kiwi.DataSync') @patch('kiwi.boot.image.base.BootImageBase.is_prepared') @patch('kiwi.boot.image.builtin_kiwi.os.chmod') @patch('kiwi.boot.image.builtin_kiwi.Temporary') def test_create_initrd( self, mock_Temporary, mock_os_chmod, mock_prepared, mock_sync, mock_wipe, mock_create, mock_compress, mock_cpio, ): data = Mock() mock_sync.return_value = data mock_Temporary.return_value.new_dir.return_value.name = ( 'temp-boot-directory' ) mock_prepared.return_value = True self.boot_image.boot_root_directory = 'boot-root-directory' mbrid = Mock() mbrid.write = Mock() cpio = Mock() compress = Mock() mock_cpio.return_value = cpio mock_compress.return_value = compress self.boot_image.create_initrd(mbrid) mock_sync.assert_called_once_with( 'boot-root-directory/', 'temp-boot-directory' ) mock_os_chmod.assert_called_once_with('temp-boot-directory', 0o755) data.sync_data.assert_called_once_with( options=[ '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', ] ) mock_cpio.assert_called_once_with( ''.join( [self.boot_image.target_dir, '/LimeJeOS.x86_64-1.13.2.initrd'] ) ) mock_compress.assert_called_once_with( ''.join( [self.boot_image.target_dir, '/LimeJeOS.x86_64-1.13.2.initrd'] ) ) mock_wipe.assert_called_once_with('temp-boot-directory/boot') mock_create.assert_called_once_with('temp-boot-directory/boot') mbrid.write.assert_called_once_with('temp-boot-directory/boot/mbrid') cpio.create.assert_called_once_with( source_dir='temp-boot-directory', exclude=[ '/var/cache/kiwi', '/image', '/usr/lib/grub*', '/usr/share/doc', '/usr/share/man', '/home', '/media', '/srv', ], ) compress.xz.assert_called_once_with( ['--check=crc32', '--lzma2=dict=1MiB', '--threads=0'] ) mock_cpio.reset_mock() mock_compress.reset_mock() self.boot_image.create_initrd(mbrid, 'foo') mock_cpio.assert_called_once_with(self.boot_image.target_dir + '/foo') mock_compress.assert_called_once_with( self.boot_image.target_dir + '/foo' ) @patch('kiwi.boot.image.builtin_kiwi.Path.wipe') @patch('os.path.exists') def test_cleanup(self, mock_path, mock_wipe): mock_path.return_value = True self.boot_image.temp_directories.append('boot-root-directory') self.boot_image.cleanup() mock_wipe.assert_called_once_with('boot-root-directory') def test_has_initrd_support(self): assert self.boot_image.has_initrd_support() is True def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7629266 kiwi-11.1.8/test/unit/boot/image/dracut_test.py0000644000000000000000000004345115273675667016410 0ustar00import logging from unittest.mock import patch, call, Mock from pytest import fixture from collections import namedtuple from kiwi.defaults import Defaults from kiwi.boot.image.dracut import BootImageDracut from kiwi.xml_description import XMLDescription from kiwi.xml_state import XMLState from kiwi.boot.image.base import boot_names_type class TestBootImageKiwi: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.boot.image.dracut.Command.run') @patch('kiwi.boot.image.dracut.Kernel') @patch('kiwi.boot.image.base.os.path.exists') def setup(self, mock_exists, mock_kernel_class, mock_cmd): Defaults.set_platform_name('x86_64') mock_exists.return_value = True kernel_type = namedtuple('kernel_type', ['version']) mock_kernel_instance = mock_kernel_class.return_value mock_kernel_instance.get_kernel.return_value = kernel_type( version='1.0.0-kernel' ) command_type = namedtuple('command', ['output']) mock_cmd.side_effect = [ command_type( output='foo\nfoobar\nmodule' ), # for dracut --list-modules command_type( output=''' kernel/drivers/net/ethernet/intel/driver2/driver2.ko: kernel/drivers/net/driver1.ko kernel/drivers/gpu/drm/i915/driver3.ko: kernel/drivers/video/other_driver/core/other_driver.ko kernel/drivers/usb/host/driver1.ko: ''' ), # for cat modules.dep ] description = XMLDescription('../data/example_config.xml') self.xml_state = XMLState(description.load()) self.boot_image = BootImageDracut( self.xml_state, 'some-target-dir', 'system-directory' ) assert mock_cmd.call_args_list == [ call( [ 'chroot', 'system-directory', 'dracut', '--list-modules', '--no-kernel', ] ), call( [ 'chroot', 'system-directory', 'cat', '/lib/modules/1.0.0-kernel/modules.dep', ] ), ] @patch('kiwi.boot.image.dracut.Command.run') @patch('kiwi.boot.image.base.os.path.exists') def setup_method(self, cls, mock_exists, mock_cmd): self.setup() @patch('kiwi.boot.image.dracut.SystemSetup') def test_prepare(self, mock_setup): setup = Mock() mock_setup.return_value = setup self.boot_image.prepare() setup.setup_machine_id.assert_called_once_with() assert self.boot_image.dracut_options == ['--install', '/.profile'] def test_include_file(self): self.boot_image.include_file(filename='foo', delete_after_include=True) assert self.boot_image.included_files == ['--install', 'foo'] assert self.boot_image.delete_after_include_files == ['foo'] def test_include_module(self): self.boot_image.include_module('foobar') assert self.boot_image.add_modules == ['foobar'] self.boot_image.include_module('foobar') self.boot_image.include_module('not_available') assert self.boot_image.add_modules == ['foobar'] def test_omit_module(self): self.boot_image.omit_module('foobar') assert self.boot_image.omit_modules == ['foobar'] self.boot_image.omit_module('foobar') assert self.boot_image.omit_modules == ['foobar'] def test_set_static_modules(self): modules = ['foobar', 'module'] self.boot_image.set_static_modules(modules) assert self.boot_image.modules == modules def test_include_driver(self): self.boot_image.include_driver('driver2') assert self.boot_image.add_drivers == ['driver2'] self.boot_image.include_driver('driver2') self.boot_image.include_driver('not_available') assert self.boot_image.add_drivers == ['driver2'] def test_omit_driver(self): self.boot_image.omit_driver('driver2') assert self.boot_image.omit_drivers == ['driver2'] self.boot_image.omit_driver('driver2') assert self.boot_image.omit_drivers == ['driver2'] def test_write_system_config_file(self): with patch('builtins.open', create=True) as mock_write: self.boot_image.write_system_config_file( config={ 'modules': ['module'], 'omit_modules': ['foobar'], 'install_items': ['foo', 'bar'], 'drivers': ['driver3', 'driver2'], 'omit_drivers': ['driver1'], }, config_file='/root/dir/my_dracut_conf.conf', ) assert ( call() .__enter__() .writelines( [ 'add_dracutmodules+=" module "\n', 'omit_dracutmodules+=" foobar "\n', 'install_items+=" foo bar "\n', 'add_drivers+=" driver3 driver2 "\n', 'omit_drivers+=" driver1 "\n', ] ) in mock_write.mock_calls ) assert ( call('/root/dir/my_dracut_conf.conf', 'w') in mock_write.mock_calls ) with patch('builtins.open', create=True) as mock_write: self.boot_image.write_system_config_file( config={ 'modules': ['module'], 'omit_modules': ['foobar'], 'drivers': ['driver1', 'driver2'], 'omit_drivers': ['driver3'], }, ) assert ( call() .__enter__() .writelines( [ 'add_dracutmodules+=" module "\n', 'omit_dracutmodules+=" foobar "\n', 'add_drivers+=" driver1 driver2 "\n', 'omit_drivers+=" driver3 "\n', ] ) in mock_write.mock_calls ) assert ( call('system-directory/etc/dracut.conf.d/02-kiwi.conf', 'w') in mock_write.mock_calls ) def test_include_file_install(self): self.boot_image.include_file('foo') assert self.boot_image.included_files == ['--install', 'foo'] @patch('kiwi.boot.image.dracut.Kernel') @patch('kiwi.boot.image.dracut.Command.run') @patch('kiwi.boot.image.base.BootImageBase.is_prepared') @patch('kiwi.boot.image.dracut.Profile') @patch('kiwi.boot.image.dracut.MountManager') @patch('os.unlink') def test_create_uki( self, mock_os_unlink, mock_MountManager, mock_Profile, mock_prepared, mock_command, mock_kernel, ): profile = Mock() profile.dot_profile = dict() mock_Profile.return_value = profile kernel = Mock() kernel_details = Mock() kernel_details.version = '1.2.3' kernel.get_kernel = Mock(return_value=kernel_details) mock_kernel.return_value = kernel self.boot_image.include_file( filename='system-directory/etc/foo', delete_after_include=True ) self.boot_image.include_module('foo') self.boot_image.omit_module('bar') self.boot_image.include_driver('driver1') self.boot_image.include_driver('driver2') self.boot_image.omit_driver('driver3') self.boot_image.get_boot_names = Mock( return_value=boot_names_type( kernel_name='kernel_name', initrd_name='initrd-kernel_version', kernel_version='kernel_version', kernel_filename='kernel_filename', ) ) mock_prepared.return_value = False assert self.boot_image.create_uki('some_cmdline') == '' mock_prepared.return_value = True assert ( self.boot_image.create_uki('some_cmdline') == 'some-target-dir/kiwi.efi' ) profile.create.assert_called_once_with('system-directory/.profile') assert mock_MountManager.call_args_list == [ call(device='/dev', mountpoint='system-directory/dev'), call(device='/proc', mountpoint='system-directory/proc'), ] assert mock_command.call_args_list == [ call( [ 'chroot', 'system-directory', 'dracut', '--no-hostonly', '--no-hostonly-cmdline', '--force', '--verbose', '--reproducible', '--kver', '1.2.3', '--uefi', '--kernel-cmdline', 'some_cmdline', '--add', ' foo ', '--omit', ' bar ', '--drivers', ' driver1 driver2 ', '--omit-drivers', ' driver3 ', '--install', 'system-directory/etc/foo', 'vmlinuz-kernel_version.efi', ], stderr_to_stdout=True, ), call( [ 'mv', 'system-directory/vmlinuz-kernel_version.efi', 'some-target-dir/kiwi.efi', ] ), ] mock_os_unlink.assert_called_once_with( 'system-directory/system-directory/etc/foo' ) @patch('kiwi.boot.image.dracut.Kernel') @patch('kiwi.boot.image.dracut.Command.run') @patch('kiwi.boot.image.base.BootImageBase.is_prepared') @patch('kiwi.boot.image.dracut.Profile') @patch('kiwi.boot.image.dracut.MountManager') @patch('os.unlink') def test_create_initrd( self, mock_os_unlink, mock_MountManager, mock_Profile, mock_prepared, mock_command, mock_kernel, ): profile = Mock() profile.dot_profile = dict() mock_Profile.return_value = profile kernel = Mock() kernel_details = Mock() kernel_details.version = '1.2.3' kernel.get_kernel = Mock(return_value=kernel_details) mock_kernel.return_value = kernel self.boot_image.include_file( filename='system-directory/etc/foo', delete_after_include=True ) self.boot_image.include_module('foo') self.boot_image.omit_module('bar') self.boot_image.include_driver('driver1') self.boot_image.omit_driver('driver2') self.boot_image.omit_driver('driver3') self.boot_image.create_initrd() profile.create.assert_called_once_with('system-directory/.profile') assert mock_MountManager.call_args_list == [ call(device='/dev', mountpoint='system-directory/dev'), call(device='/proc', mountpoint='system-directory/proc'), ] assert mock_command.call_args_list == [ call( [ 'chroot', 'system-directory', 'dracut', '--verbose', '--reproducible', '--no-hostonly', '--no-hostonly-cmdline', '--add', ' foo ', '--omit', ' bar ', '--drivers', ' driver1 ', '--omit-drivers', ' driver2 driver3 ', '--install', 'system-directory/etc/foo', 'LimeJeOS.x86_64-1.13.2.initrd', '1.2.3', ], stderr_to_stdout=True, ), call( [ 'mv', 'system-directory/' 'LimeJeOS.x86_64-1.13.2.initrd', 'some-target-dir', ] ), call( [ 'chmod', '644', 'some-target-dir/LimeJeOS.x86_64-1.13.2.initrd', ] ), ] mock_os_unlink.assert_called_once_with( 'system-directory/system-directory/etc/foo' ) kernel.get_kernel.assert_called_once_with( raise_on_not_found=True, flavor='' ) kernel.get_kernel.reset_mock() mock_os_unlink.reset_mock() with self._caplog.at_level(logging.INFO): self.boot_image.create_initrd( flavor='rt', delete_included_files=False ) assert ( 'Creating generic dracut initrd archive for kernel flavor rt' in self._caplog.text ) kernel.get_kernel.assert_called_once_with( raise_on_not_found=True, flavor='rt' ) # the included file is kept for the initrd of another flavor assert not mock_os_unlink.called mock_command.reset_mock() self.boot_image.create_initrd(basename='foo') assert mock_command.call_args_list == [ call( [ 'chroot', 'system-directory', 'dracut', '--verbose', '--reproducible', '--no-hostonly', '--no-hostonly-cmdline', '--add', ' foo ', '--omit', ' bar ', '--drivers', ' driver1 ', '--omit-drivers', ' driver2 driver3 ', '--install', 'system-directory/etc/foo', 'foo', '1.2.3', ], stderr_to_stdout=True, ), call(['mv', 'system-directory/foo', 'some-target-dir']), call(['chmod', '644', 'some-target-dir/foo']), ] def test_has_initrd_support(self): assert self.boot_image.has_initrd_support() is True def test_add_argument(self): self.boot_image.add_argument('option', 'value') assert self.boot_image.dracut_options == ['option', 'value'] @patch('kiwi.boot.image.dracut.Command.run') @patch('kiwi.boot.image.dracut.Kernel') def test_get_drivers(self, mock_kernel_class, mock_command): kernel_type = namedtuple('kernel_type', ['version']) mock_kernel_instance = mock_kernel_class.return_value mock_kernel_instance.get_kernel.return_value = kernel_type( version='1.0.0-kernel' ) mock_command.reset_mock() command_type = namedtuple('command', ['output']) mock_command.return_value = command_type( output=''' kernel/drivers/net/ethernet/intel/driver2/driver2.ko: kernel/drivers/net/driver1.ko kernel/drivers/gpu/drm/i915/driver3.ko: kernel/drivers/video/fbdev/core/fb.ko kernel/drivers/usb/host/driver1.ko: kernel/drivers/vhost/driver_4.ko: ''' ) drivers = self.boot_image._get_drivers() mock_kernel_class.assert_called_once_with('system-directory') mock_kernel_instance.get_kernel.assert_called_once() mock_command.assert_called_once_with( [ 'chroot', 'system-directory', 'cat', '/lib/modules/1.0.0-kernel/modules.dep', ] ) assert sorted(drivers) == sorted( ['driver_4', 'driver3', 'driver2', 'driver1'] ) @patch('kiwi.boot.image.dracut.log.warning') @patch('kiwi.boot.image.dracut.Command.run') @patch('kiwi.boot.image.dracut.Kernel') @patch('kiwi.boot.image.base.os.path.exists') def test_get_drivers_no_kernel( self, mock_exists, mock_kernel_class, mock_command, mock_log_warning ): mock_exists.return_value = True mock_kernel_instance = mock_kernel_class.return_value mock_kernel_instance.get_kernel.return_value = None drivers = self.boot_image._get_drivers() assert drivers == [] # Should return empty list when no kernel found mock_kernel_class.assert_called_once_with('system-directory') mock_kernel_instance.get_kernel.assert_called_once() mock_command.assert_not_called() mock_log_warning.assert_called_once_with( "No kernel found in boot directory" ) @patch('kiwi.boot.image.dracut.log.warning') @patch('kiwi.boot.image.dracut.Command.run') @patch('kiwi.boot.image.dracut.Kernel') def test_get_drivers_with_exception( self, mock_kernel_class, mock_command, mock_log_warning ): kernel_type = namedtuple('kernel_type', ['version']) mock_kernel_instance = mock_kernel_class.return_value mock_kernel_instance.get_kernel.return_value = kernel_type( version='1.0.0-kernel' ) mock_command.side_effect = Exception("Failed to read modules") drivers = self.boot_image._get_drivers() assert drivers == [] # Should return empty list on exception mock_kernel_class.assert_called_once_with('system-directory') mock_kernel_instance.get_kernel.assert_called_once() mock_command.assert_called_once_with( [ 'chroot', 'system-directory', 'cat', '/lib/modules/1.0.0-kernel/modules.dep', ] ) mock_log_warning.assert_called_once_with( "Error reading drivers: Failed to read modules" ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7629266 kiwi-11.1.8/test/unit/boot/image/init_test.py0000644000000000000000000000234315273675667016064 0ustar00from unittest.mock import Mock, patch from pytest import raises from kiwi.exceptions import KiwiBootImageSetupError from kiwi.boot.image import BootImage class TestBootImage: def setup(self): self.xml_state = Mock() self.xml_state.get_initrd_system = Mock(return_value='kiwi') def setup_method(self, cls): self.setup() def test_boot_image_not_implemented(self): self.xml_state.get_initrd_system.return_value = 'foo' with raises(KiwiBootImageSetupError): BootImage.new(self.xml_state, 'target_dir') @patch('kiwi.boot.image.builtin_kiwi.BootImageKiwi') def test_boot_image_task_kiwi(self, mock_kiwi): self.xml_state.get_initrd_system.return_value = 'kiwi' BootImage.new(self.xml_state, 'target_dir') mock_kiwi.assert_called_once_with( self.xml_state, 'target_dir', None, None ) @patch('kiwi.boot.image.dracut.BootImageDracut') def test_boot_image_task_dracut(self, mock_dracut): self.xml_state.get_initrd_system.return_value = 'dracut' BootImage.new(self.xml_state, 'target_dir', 'root_dir') mock_dracut.assert_called_once_with( self.xml_state, 'target_dir', 'root_dir', None ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7629266 kiwi-11.1.8/test/unit/bootloader/__init__.py0000644000000000000000000000000015273675667015712 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7631629 kiwi-11.1.8/test/unit/bootloader/config/__init__.py0000644000000000000000000000000015273675667017157 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7631934 kiwi-11.1.8/test/unit/bootloader/config/base_test.py0000644000000000000000000005035515273675667017413 0ustar00import logging from unittest.mock import patch, call, Mock, MagicMock from pytest import raises, fixture from kiwi.defaults import Defaults from kiwi.xml_state import XMLState from kiwi.xml_description import XMLDescription from kiwi.exceptions import KiwiBootLoaderTargetError from kiwi.bootloader.config.base import BootLoaderConfigBase from kiwi.storage.mapped_device import MappedDevice from kiwi.storage.disk import ptable_entry_type class BootLoaderConfigTestImpl(BootLoaderConfigBase): def setup_install_image_config(self, mbrid, hypervisor, kernel, initrd): return super().setup_install_image_config( mbrid, hypervisor, kernel, initrd ) def setup_disk_image_config( self, boot_uuid=None, root_uuid=None, hypervisor=None, kernel=None, initrd=None, boot_options=..., ): return super().setup_disk_image_config( boot_uuid, root_uuid, hypervisor, kernel, initrd, boot_options ) def write(self): return super().write() def setup_live_image_config(self, mbrid, hypervisor, kernel, initrd): return super().setup_live_image_config( mbrid, hypervisor, kernel, initrd ) def setup_install_boot_images(self, mbrid, lookup_path=None): return super().setup_install_boot_images(mbrid, lookup_path) def setup_disk_boot_images(self, boot_uuid, lookup_path=None): return super().setup_disk_boot_images(boot_uuid, lookup_path) def setup_live_boot_images(self, mbrid, lookup_path=None): return super().setup_live_boot_images(mbrid, lookup_path) def setup_sysconfig_bootloader(self): return super().setup_sysconfig_bootloader() class TestBootLoaderConfigBase: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): Defaults.set_platform_name('x86_64') description = XMLDescription('../data/example_config.xml') self.state = XMLState(description.load()) self.bootloader = BootLoaderConfigTestImpl(self.state, 'root_dir') def setup_method(self, cls): self.setup() @patch('kiwi.path.Path.create') def test_create_efi_path(self, mock_path): self.bootloader.create_efi_path() mock_path.assert_called_once_with('root_dir/boot/efi/EFI/BOOT') @patch('kiwi.path.Path.create') def test_create_efi_path_with_prefix(self, mock_path): self.bootloader.create_efi_path('') mock_path.assert_called_once_with('root_dir/EFI/BOOT') def test_get_boot_theme(self): assert self.bootloader.get_boot_theme() == 'openSUSE' def test_get_boot_timeout_seconds_default_applies(self): assert self.bootloader.get_boot_timeout_seconds() == 10 @patch('kiwi.xml_parse.type_.get_bootloader') def test_get_boot_timeout_seconds(self, mock_get_bootloader): bootloader = Mock() bootloader.get_timeout.return_value = 0 mock_get_bootloader.return_value = [bootloader] assert self.bootloader.get_boot_timeout_seconds() == 0 @patch('kiwi.xml_parse.type_.get_installprovidefailsafe') def test_failsafe_boot_entry_requested(self, mock_installprovidefailsafe): mock_installprovidefailsafe.return_value = True assert self.bootloader.failsafe_boot_entry_requested() is True mock_installprovidefailsafe.return_value = False assert self.bootloader.failsafe_boot_entry_requested() is False def test_get_boot_cmdline(self): assert self.bootloader.get_boot_cmdline(None) == 'splash' @patch('kiwi.xml_parse.type_.get_kernelcmdline') def test_get_boot_cmdline_custom_root(self, mock_cmdline): mock_cmdline.return_value = 'root=/dev/myroot' with self._caplog.at_level(logging.WARNING): assert ( self.bootloader.get_boot_cmdline('/dev/myroot') == 'root=/dev/myroot' ) assert ( 'Kernel root device explicitly set via kernelcmdline' in self._caplog.text ) @patch('kiwi.xml_parse.type_.get_kernelcmdline') @patch('kiwi.bootloader.config.base.BlockID') def test_get_boot_cmdline_custom_root_overlay_write( self, mock_BlockID, mock_cmdline ): block_operation = Mock() block_operation.get_blkid.return_value = 'mock' mock_BlockID.return_value = block_operation mock_cmdline.return_value = 'rd.root.overlay.write=/dev/myrw' self.state.build_type.get_overlayroot = Mock(return_value=True) self.state.get_luks_credentials = Mock(return_value=None) with self._caplog.at_level(logging.WARNING): assert ( self.bootloader.get_boot_cmdline('/dev/myroot') == 'rd.root.overlay.write=/dev/myrw root=overlay:PARTUUID=mock' ) assert ( 'Overlay write device explicitly set via kernelcmdline' in self._caplog.text ) @patch('kiwi.xml_parse.type_.get_kernelcmdline') def test_get_boot_cmdline_root_overlay_luks(self, mock_cmdline): mock_cmdline.return_value = '' self.state.build_type.get_overlayroot = Mock(return_value=True) self.state.get_luks_credentials = Mock(return_value='some') assert ( self.bootloader.get_boot_cmdline('/dev/myroot') == 'root=overlay:MAPPER=luks' ) @patch('kiwi.xml_parse.type_.get_kernelcmdline') def test_get_boot_cmdline_root_overlay_verity(self, mock_cmdline): mock_cmdline.return_value = '' self.state.build_type.get_overlayroot = Mock(return_value=True) self.state.build_type.get_verity_blocks = Mock(return_value=42) self.state.get_luks_credentials = Mock(return_value=None) assert ( self.bootloader.get_boot_cmdline('/dev/myroot') == 'root=overlay:MAPPER=verityroot' ) @patch('kiwi.xml_parse.type_.get_initrd_system') @patch('kiwi.bootloader.config.base.BlockID') def test_get_boot_cmdline_initrd_system_is_dracut( self, mock_BlockID, mock_initrd ): block_operation = Mock() block_operation.get_blkid.return_value = 'uuid' mock_BlockID.return_value = block_operation mock_initrd.return_value = 'dracut' assert ( self.bootloader.get_boot_cmdline('uuid') == 'splash root=UUID=uuid' ) @patch('kiwi.xml_parse.type_.get_initrd_system') @patch('kiwi.bootloader.config.base.BlockID') def test_get_boot_cmdline_initrd_system_is_dracut_partuuid( self, mock_BlockID, mock_initrd ): block_operation = Mock() block_operation.get_blkid.return_value = 'uuid' mock_BlockID.return_value = block_operation mock_initrd.return_value = 'dracut' self.bootloader.xml_state.build_type.set_devicepersistency( 'by-partuuid' ) assert ( self.bootloader.get_boot_cmdline('uuid') == 'splash root=PARTUUID=uuid' ) @patch('kiwi.xml_parse.type_.get_initrd_system') @patch('kiwi.bootloader.config.base.BlockID') def test_get_boot_cmdline_initrd_system_is_dracut_label( self, mock_BlockID, mock_initrd ): block_operation = Mock() block_operation.get_blkid.return_value = 'label' mock_BlockID.return_value = block_operation mock_initrd.return_value = 'dracut' self.bootloader.xml_state.build_type.set_devicepersistency('by-label') assert ( self.bootloader.get_boot_cmdline('uuid') == 'splash root=LABEL=label' ) @patch('kiwi.xml_parse.type_.get_initrd_system') @patch('kiwi.bootloader.config.base.BlockID') def test_get_boot_cmdline_initrd_system_is_dracut_with_overlay( self, mock_BlockID, mock_initrd ): block_operation = Mock() block_operation.get_blkid.return_value = 'mock' mock_BlockID.return_value = block_operation mock_initrd.return_value = 'dracut' self.state.build_type.get_overlayroot = Mock(return_value=True) self.state.get_luks_credentials = Mock(return_value=None) assert ( self.bootloader.get_boot_cmdline('/dev/ro', '/dev/rw') == 'splash rd.root.overlay.write=/dev/disk/by-uuid/mock root=overlay:PARTUUID=mock' ) @patch('kiwi.xml_parse.type_.get_installboot') def test_get_install_image_boot_default(self, mock_installboot): mock_installboot.return_value = None assert self.bootloader.get_install_image_boot_default() == '0' mock_installboot.return_value = 'failsafe-install' assert self.bootloader.get_install_image_boot_default() == '2' mock_installboot.return_value = 'install' assert self.bootloader.get_install_image_boot_default() == '1' # one install entry per kernel flavor, failsafe follows them with patch.object( self.bootloader.xml_state, 'get_build_type_bootloader_kernel_flavors', return_value=['rt', 'default'], ): assert self.bootloader.get_install_image_boot_default() == '1' mock_installboot.return_value = 'failsafe-install' assert self.bootloader.get_install_image_boot_default() == '3' @patch('kiwi.xml_parse.type_.get_installboot') @patch('kiwi.xml_parse.type_.get_installprovidefailsafe') def test_get_install_image_boot_default_failsafe_but_no_failsafe_entry( self, mock_installprovidefailsafe, mock_installboot ): mock_installprovidefailsafe.return_value = False mock_installboot.return_value = 'failsafe-install' with self._caplog.at_level(logging.WARNING): assert self.bootloader.get_install_image_boot_default() == '1' assert 'Failsafe install requested but failsafe ' 'menu entry is disabled' in self._caplog.text assert 'Switching to standard install' in self._caplog.text def test_get_boot_path_raises(self): with raises(KiwiBootLoaderTargetError): self.bootloader.get_boot_path('foo') @patch('kiwi.bootloader.config.base.DiskSetup') @patch('kiwi.xml_parse.type_.get_filesystem') @patch('kiwi.xml_parse.type_.get_btrfs_root_is_snapper_snapshot') @patch('kiwi.xml_state.XMLState.get_volumes') def test_get_boot_path_btrfs_no_snapshot( self, mock_volumes, mock_snapshot, mock_fs, mock_disk_setup ): volume = Mock() volume.name = 'some-volume' mock_volumes.return_value = [volume] mock_fs.return_value = 'btrfs' mock_snapshot.return_value = False disk_setup = Mock() disk_setup.need_boot_partition = Mock(return_value=False) mock_disk_setup.return_value = disk_setup assert self.bootloader.get_boot_path() == '/boot' @patch('kiwi.bootloader.config.base.DiskSetup') @patch('kiwi.xml_parse.type_.get_filesystem') @patch('kiwi.xml_parse.type_.get_btrfs_root_is_snapper_snapshot') @patch('kiwi.xml_state.XMLState.get_volumes') def test_get_boot_path_btrfs_snapshot( self, mock_volumes, mock_snapshot, mock_fs, mock_disk_setup ): volume = Mock() volume.name = 'some-volume' mock_volumes.return_value = [volume] mock_fs.return_value = 'btrfs' mock_snapshot.return_value = True disk_setup = Mock() disk_setup.need_boot_partition = Mock(return_value=False) mock_disk_setup.return_value = disk_setup assert self.bootloader.get_boot_path() == '/boot' def test_get_boot_path_iso(self): assert ( self.bootloader.get_boot_path(target='iso') == '/boot/x86_64/loader' ) def test_quote_title(self): assert self.bootloader.quote_title('aaa bbb [foo]') == 'aaa_bbb_(foo)' @patch('kiwi.xml_parse.image.get_displayname') def test_get_menu_entry_title(self, mock_displayname): mock_displayname.return_value = None assert self.bootloader.get_menu_entry_title() == 'LimeJeOS [ OEM ]' @patch('kiwi.xml_parse.image.get_displayname') def test_get_menu_entry_title_plain(self, mock_displayname): mock_displayname.return_value = None assert self.bootloader.get_menu_entry_title(plain=True) == 'LimeJeOS' @patch('kiwi.xml_parse.image.get_displayname') def test_get_menu_entry_title_by_displayname(self, mock_displayname): mock_displayname.return_value = 'my_title' assert self.bootloader.get_menu_entry_title() == 'my_title' @patch('kiwi.xml_parse.image.get_displayname') def test_get_menu_entry_install_title(self, mock_displayname): mock_displayname.return_value = None assert self.bootloader.get_menu_entry_install_title() == 'LimeJeOS' def test_get_kernel_flavors(self): assert self.bootloader.get_kernel_flavors() == [''] with patch.object( self.bootloader.xml_state, 'get_build_type_bootloader_kernel_flavors', return_value=['rt', 'default'], ): assert self.bootloader.get_kernel_flavors() == ['rt', 'default'] def test_get_kernel_flavor_title(self): assert self.bootloader.get_kernel_flavor_title('title', '') == 'title' assert ( self.bootloader.get_kernel_flavor_title('title', 'rt') == 'title (rt)' ) # kernels without flavor keep the title assert self.bootloader.get_kernel_flavor_title('title', 'none') == ( 'title' ) @patch('kiwi.bootloader.config.base.MountManager') def test_mount_system_s390(self, mock_MountManager): tmp_mount = MagicMock() etc_kernel_mount = MagicMock() proc_mount = MagicMock() sys_mount = MagicMock() dev_mount = MagicMock() root_mount = MagicMock() root_mount.mountpoint = 'root_mount_point' root_mount.device = 'rootdev' boot_mount = MagicMock() boot_mount.device = 'bootdev' mount_managers = [ proc_mount, sys_mount, dev_mount, tmp_mount, etc_kernel_mount, boot_mount, root_mount, ] def mount_managers_effect(**args): return mount_managers.pop() self.bootloader.arch = 's390x' self.bootloader.bootloader = 'grub2_s390x_emu' mock_MountManager.side_effect = mount_managers_effect self.bootloader._mount_system({}, 'rootdev', 'bootdev') assert mock_MountManager.call_args_list == [ call(device='rootdev'), call(device='bootdev', mountpoint='root_mount_point/boot/zipl'), call(device='/dev', mountpoint='root_mount_point/dev'), call(device='/proc', mountpoint='root_mount_point/proc'), call(device='/sys', mountpoint='root_mount_point/sys'), ] @patch('kiwi.bootloader.config.base.MountManager') def test_mount_system_readonly_root(self, mock_MountManager): root_mount = mock_MountManager.return_value readonly_device = Mock() readonly_device.get_device.return_value = '/dev/readonly-root-device' self.bootloader._mount_system( {'readonly': readonly_device}, '/dev/readonly-root-device', '/dev/readonly-root-device', ) root_mount.mount.assert_called_once_with(options=['ro']) @patch('kiwi.bootloader.config.base.MountManager') @patch('kiwi.bootloader.config.base.SystemSetup') @patch('os.path.exists') def test_mount_system_overlay_without_efi_device( self, mock_os_path_exists, mock_SystemSetup, mock_MountManager ): # without an ESP etc/kernel is not mapped mock_os_path_exists.return_value = True mock_MountManager.return_value.mountpoint = 'root_mount_point' bootloader = BootLoaderConfigTestImpl(self.state, 'root_dir') bootloader.root_filesystem_is_overlay = True bootloader._mount_system(None, 'rootdev', 'bootdev') assert ( call(device=None, mountpoint='root_mount_point/etc/kernel') not in mock_MountManager.call_args_list ) assert bootloader.etc_kernel_mount is None @patch('kiwi.bootloader.config.base.MountManager') @patch('kiwi.bootloader.config.base.SystemSetup') @patch('os.path.exists') def test_mount_system( self, mock_os_path_exists, mock_SystemSetup, mock_MountManager ): mock_os_path_exists.return_value = True setup = Mock() mock_SystemSetup.return_value = setup tmp_mount = MagicMock() etc_kernel_mount = MagicMock() proc_mount = MagicMock() sys_mount = MagicMock() dev_mount = MagicMock() root_mount = MagicMock() root_mount.mountpoint = 'root_mount_point' root_mount.device = 'rootdev' boot_mount = MagicMock() boot_mount.device = 'bootdev' efi_mount = MagicMock() efi_mount.device = 'efidev' volume_mount = MagicMock() partition_mount = MagicMock() mount_managers = [ proc_mount, sys_mount, dev_mount, tmp_mount, etc_kernel_mount, partition_mount, volume_mount, efi_mount, boot_mount, root_mount, ] def mount_managers_effect(**args): return mount_managers.pop() mock_MountManager.side_effect = mount_managers_effect with BootLoaderConfigTestImpl(self.state, 'root_dir') as bootloader: bootloader.root_filesystem_is_overlay = True bootloader._mount_system( {'var': MappedDevice('/dev/var-device', Mock())}, 'rootdev', 'bootdev', 'efidev', { 'boot/grub2': { 'volume_options': 'subvol=@/boot/grub2', 'volume_device': 'device', } }, 'root', { 'var': ptable_entry_type( mbsize=100, clone=1, partition_name='p.lxvar', partition_type='t.linux', partition_id=None, mountpoint='/var', filesystem='ext3', label='var', ) }, ) assert mock_MountManager.call_args_list == [ call(device='rootdev'), call(device='bootdev', mountpoint='root_mount_point/boot'), call(device='efidev', mountpoint='root_mount_point/boot/efi'), call(device='device', mountpoint='root_mount_point/boot/grub2'), call( device='/dev/var-device', mountpoint='root_mount_point/var' ), call(device='/tmp', mountpoint='root_mount_point/tmp'), call(device='efidev', mountpoint='root_mount_point/etc/kernel'), call(device='/dev', mountpoint='root_mount_point/dev'), call(device='/proc', mountpoint='root_mount_point/proc'), call(device='/sys', mountpoint='root_mount_point/sys'), ] root_mount.mount.assert_called_once_with(options=['subvol=root']) boot_mount.mount.assert_called_once_with() efi_mount.mount.assert_called_once_with() partition_mount.mount.assert_called_once_with() volume_mount.mount.assert_called_once_with( options=['subvol=@/boot/grub2'] ) proc_mount.bind_mount.assert_called_once_with() sys_mount.bind_mount.assert_called_once_with() dev_mount.bind_mount.assert_called_once_with() setup.setup_selinux_file_contexts.assert_called_once_with() volume_mount.umount.assert_called_once_with() tmp_mount.umount.assert_called_once_with() etc_kernel_mount.umount.assert_called_once_with() dev_mount.umount.assert_called_once_with() proc_mount.umount.assert_called_once_with() sys_mount.umount.assert_called_once_with() efi_mount.umount.assert_called_once_with() boot_mount.umount.assert_called_once_with() root_mount.umount.assert_called_once_with() def test_write_meta_data(self): # just pass self.bootloader.write_meta_data() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7631934 kiwi-11.1.8/test/unit/bootloader/config/bootloader_spec_base_test.py0000644000000000000000000001535315273675667022636 0ustar00from unittest.mock import patch, Mock from pytest import raises, fixture from kiwi.defaults import Defaults from kiwi.xml_state import XMLState from kiwi.xml_description import XMLDescription from kiwi.bootloader.config.bootloader_spec_base import BootLoaderSpecBase from kiwi.exceptions import KiwiKernelLookupError class TestBootLoaderSpecBase: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.bootloader.config.bootloader_spec_base.FirmWare') def setup(self, mock_FirmWare): Defaults.set_platform_name('x86_64') description = XMLDescription('../data/example_config.xml') self.state = XMLState(description.load()) self.bootloader = BootLoaderSpecBase(self.state, 'root_dir') @patch('kiwi.bootloader.config.bootloader_spec_base.FirmWare') def setup_method(self, cls, mock_FirmWare): self.setup() @patch.object(BootLoaderSpecBase, 'setup_loader') def test_setup_disk_image_config(self, mock_setup_loader): self.bootloader.get_boot_cmdline = Mock(return_value='') self.bootloader.setup_disk_image_config( 'boot_uuid', 'root_uuid', 'hypervisor', 'kernel', 'initrd', boot_options={'root_device': 'rootdev', 'boot_device': 'bootdev'}, ) mock_setup_loader.assert_called_once_with('disk') def test_setup_install_image_config(self): # just pass self.bootloader.setup_install_image_config( 'mbrid', 'hypervisor', 'kernel', 'initrd' ) def test_setup_live_image_config(self): # just pass self.bootloader.setup_live_image_config( 'mbrid', 'hypervisor', 'kernel', 'initrd' ) @patch.object(BootLoaderSpecBase, 'create_loader_image') def test_setup_disk_boot_images(self, mock_create_loader_image): self.bootloader.setup_disk_boot_images('uuid') mock_create_loader_image.assert_called_once_with('disk') @patch.object(BootLoaderSpecBase, 'create_loader_image') def test_setup_install_boot_images(self, mock_create_loader_image): self.bootloader.setup_install_boot_images('mbrid') mock_create_loader_image.assert_called_once_with('install(iso)') @patch.object(BootLoaderSpecBase, 'create_loader_image') def test_setup_live_boot_images(self, mock_create_loader_image): self.bootloader.setup_live_boot_images('mbrid') mock_create_loader_image.assert_called_once_with('live(iso)') def test_setup_loader(self): with raises(NotImplementedError): self.bootloader.setup_loader('target') def test_set_loader_entry(self): with raises(NotImplementedError): self.bootloader.set_loader_entry('root_dir', 'target') def test_create_loader_image(self): with raises(NotImplementedError): self.bootloader.create_loader_image('target') def test_write(self): # just pass self.bootloader.write() def test_setup_sysconfig_bootloader(self): # just pass self.bootloader.setup_sysconfig_bootloader() def test_write_meta_data(self): # just pass self.bootloader.write_meta_data() def _setup_root_tree(self, root_dir, kernel_versions, entries): for kernel_version in kernel_versions: modules_dir = root_dir / 'lib' / 'modules' / kernel_version modules_dir.mkdir(parents=True) (modules_dir / 'vmlinuz').touch() entries_dir = root_dir / self.bootloader.entries_dir.lstrip('/') entries_dir.mkdir(parents=True) for entry in entries: (entries_dir / entry).touch() self.bootloader.root_dir = str(root_dir) @patch('kiwi.bootloader.config.bootloader_spec_base.OsRelease') def test_get_entry_name_kernel_lookup_raises( self, mock_OsRelease, tmp_path ): self._setup_root_tree(tmp_path, [], []) with raises(KiwiKernelLookupError): self.bootloader.get_entry_name() @patch('kiwi.bootloader.config.bootloader_spec_base.OsRelease') def test_get_entry_name_kiwi_policy(self, mock_OsRelease, tmp_path): # the entry belongs to the latest kernel, not to the first # one by name self._setup_root_tree( tmp_path, ['5.3.18-59.10-default', '5.3.18-59.9-default'], [] ) os_release = Mock() os_release.get.return_value = 'opensuse-leap' mock_OsRelease.return_value = os_release assert ( self.bootloader.get_entry_name() == 'opensuse-leap-5.3.18-59.10-default.conf' ) @patch('kiwi.bootloader.config.bootloader_spec_base.OsRelease') def test_get_entry_name_os_policy(self, mock_OsRelease, tmp_path): self._setup_root_tree( tmp_path, ['5.3.18-59.10-default', '5.3.18-59.9-default'], [ 'bc8499a-5.3.18-59.9-default.conf', 'bc8499a-5.3.18-59.10-default.conf', ], ) assert ( self.bootloader.get_entry_name() == 'bc8499a-5.3.18-59.10-default.conf' ) @patch('kiwi.bootloader.config.bootloader_spec_base.OsRelease') def test_get_entry_name_os_policy_of_other_kernel( self, mock_OsRelease, tmp_path ): # only the entry of an earlier kernel exists, its naming # policy is applied to the latest kernel self._setup_root_tree( tmp_path, ['5.3.18-59.10-default', '5.3.18-59.9-default'], ['bc8499a-5.3.18-59.9-default.conf'], ) assert ( self.bootloader.get_entry_name() == 'bc8499a-5.3.18-59.10-default.conf' ) @patch('kiwi.bootloader.config.bootloader_spec_base.OsRelease') def test_get_entry_name_of_flavor(self, mock_OsRelease, tmp_path): # the entry belongs to the latest kernel of the flavor, the # entry of the latest kernel of another flavor is not used self._setup_root_tree( tmp_path, ['6.4.0-9-default', '6.4.0-3-rt', '6.4.0-1-rt'], ['bc8499a-6.4.0-9-default.conf'], ) assert self.bootloader.get_entry_name('rt') == ( 'bc8499a-6.4.0-3-rt.conf' ) assert self.bootloader.get_entry_name('default') == ( 'bc8499a-6.4.0-9-default.conf' ) with raises(KiwiKernelLookupError): self.bootloader.get_entry_name('64kb') @patch('kiwi.bootloader.config.bootloader_spec_base.OsRelease') def test_get_entry_name_os_policy_without_version( self, mock_OsRelease, tmp_path ): self._setup_root_tree( tmp_path, ['5.3.18-59.10-default'], ['default.conf'] ) assert self.bootloader.get_entry_name() == 'default.conf' ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7631934 kiwi-11.1.8/test/unit/bootloader/config/custom_test.py0000644000000000000000000000417115273675667020006 0ustar00# Copyright (c) 2024 SUSE Software Solutions Germany GmbH. All rights reserved. # # This file is part of kiwi. # # kiwi is free software: you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # # kiwi is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with kiwi. If not, see # from pytest import raises from unittest.mock import Mock from kiwi.bootloader.config.custom import BootLoaderConfigCustom class TestBootLoaderConfigCustom: def setup(self): self.bootloader = BootLoaderConfigCustom(Mock(), 'root_dir') def setup_method(self, cls): self.setup() def test_setup_disk_boot_images(self): with raises(NotImplementedError): self.bootloader.setup_disk_boot_images('0815') def test_setup_disk_image_config(self): with raises(NotImplementedError): self.bootloader.setup_disk_image_config(Mock()) def test_setup_install_boot_images(self): with raises(NotImplementedError): self.bootloader.setup_install_boot_images('0815') def test_setup_install_image_config(self): with raises(NotImplementedError): self.bootloader.setup_install_image_config(Mock()) def test_setup_live_boot_images(self): with raises(NotImplementedError): self.bootloader.setup_live_boot_images('0815') def test_setup_live_image_config(self): with raises(NotImplementedError): self.bootloader.setup_live_image_config(Mock()) def test_setup_sysconfig_bootloader(self): with raises(NotImplementedError): self.bootloader.setup_sysconfig_bootloader() def test_write(self): with raises(NotImplementedError): self.bootloader.write() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7631934 kiwi-11.1.8/test/unit/bootloader/config/grub2_test.py0000644000000000000000000032342415273675667017522 0ustar00import io import os import re import logging from collections import namedtuple from textwrap import dedent from unittest.mock import patch, call, MagicMock, Mock from pytest import raises, fixture import pytest import kiwi from kiwi.defaults import Defaults from kiwi.defaults import grub_loader_type from kiwi.xml_state import XMLState from kiwi.xml_description import XMLDescription from kiwi.bootloader.config.grub2 import BootLoaderConfigGrub2 from kiwi.bootloader.template.grub2 import BootLoaderTemplateGrub2 from kiwi.utils.sysconfig import SysConfig from kiwi.xml_state import DracutT from kiwi.exceptions import ( KiwiBootLoaderGrubPlatformError, KiwiBootLoaderGrubSecureBootError, KiwiFileNotFound, KiwiTemplateError, KiwiBootLoaderGrubDataError, KiwiBootLoaderGrubFontError, KiwiBootLoaderGrubMenuEntryError, KiwiBootLoaderGrubModulesError, KiwiDiskGeometryError, KiwiCommandNotFound, ) class TestBootLoaderConfigGrub2: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.bootloader.config.grub2.FirmWare') @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_theme') def setup(self, mock_theme, mock_firmware): Defaults.set_platform_name('x86_64') self.command_type = namedtuple('command_return_type', ['output']) self.find_grub = {} self.os_exists = { 'root_dir/boot/grub2/fonts/unicode.pf2': True, 'root_dir/boot/x86_64/loader/grub2/fonts/unicode.pf2': True, 'root_dir/boot/grub2/themes/some-theme/background.png': True, 'root_dir/usr/share/grub2': True, 'root_dir/usr/share/grub': False, 'root_dir/boot/grub2/themes': False, 'root_dir/boot/grub/themes': False, 'root_dir/boot/grub/fonts/unicode.pf2': False, 'root_dir/usr/lib/grub2': True, 'root_dir/usr/lib/grub': False, 'root_dir/boot/grub2/x86_64-efi': False, 'root_dir/boot/grub2/i386-pc': False, 'root_dir/boot/grub2/x86_64-xen': False, 'root_dir/usr/lib64/efi/shim.efi': True, 'root_dir/usr/lib64/efi/grub.efi': True, 'root_dir/usr/lib64/efi/does-not-exist': False, 'root_dir/boot/efi/': True, 'root_dir/usr/share/grub2/powerpc-ieee1275': True, } self.glob_iglob_shim_fallback = [ # get_mok_manager [], [], [], ['root_dir/usr/lib64/efi/MokManager.efi'], # get_shim_loader [], [], [], [], [], [], [], [], [], [], [], ['root_dir/usr/lib64/efi/shim.efi'], # get_signed_grub_loader(disk) [], [], [], [], [], [], [], ['root_dir/usr/lib64/efi/grub.efi'], ] self.glob_iglob_noshim_fallback = [ # get_mok_manager [], [], [], ['root_dir/usr/lib64/efi/MokManager.efi'], # get_signed_grub_loader(disk) [], [], [], [], [], [], [], ['root_dir/usr/lib64/efi/grub.efi'], ] self.glob_iglob_shim_iso = [ # get_mok_manager [], [], [], ['root_dir/usr/lib64/efi/MokManager.efi'], # get_shim_loader [], [], [], [], [], [], [], [], [], [], [], ['root_dir/usr/lib64/efi/shim.efi'], # get_signed_grub_loader(iso) [], [], [], [], [], [], [], [], [], [], ['root_dir/usr/lib64/efi/grub.efi'], ] mock_theme.return_value = None kiwi.bootloader.config.grub2.Path = Mock() kiwi.bootloader.config.base.Path = Mock() self.firmware = Mock() self.firmware.ec2_mode = Mock(return_value=None) self.firmware.efi_mode = Mock(return_value='') mock_firmware.return_value = self.firmware self.mbrid = Mock() self.mbrid.get_id = Mock(return_value='0xffffffff') self.grub2 = Mock() kiwi.bootloader.config.grub2.BootLoaderTemplateGrub2 = Mock( return_value=self.grub2 ) self.state = XMLState( XMLDescription('../data/example_config.xml').load() ) self.state.is_xen_server = Mock(return_value=False) self.state.is_xen_guest = Mock(return_value=False) self.state.get_build_type_bootloader_serial_line_setup = Mock( return_value='serial --speed=38400' ) self.state.get_build_type_bootloader_timeout_style = Mock( return_value='countdown' ) self.bootloader = BootLoaderConfigGrub2( self.state, 'root_dir', None, { 'grub_directory_name': 'grub2', 'grub_load_command': 'source', 'boot_is_crypto': True, 'crypto_disk': True, 'targetbase': 'rootdev', 'config_options': ['--set-trusted-boot'], }, ) self.bootloader.cmdline = 'some-cmdline root=UUID=foo' self.bootloader.cmdline_failsafe = ' '.join( [self.bootloader.cmdline, 'failsafe-options'] ) @patch('kiwi.bootloader.config.grub2.FirmWare') @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_theme') def setup_method(self, cls, mock_theme, mock_firmware): self.setup() def test_setup_sysconfig_bootloader_not_impl(self): xml_state = MagicMock() xml_state.build_type.get_firmware = Mock(return_value=None) with pytest.raises(NotImplementedError): BootLoaderConfigGrub2( xml_state=xml_state, root_dir='root_dir' ).setup_sysconfig_bootloader() @patch('kiwi.bootloader.config.grub2.Path.which') def test_post_init_grub2_boot_directory(self, mock_which): Defaults.set_platform_name('i686') xml_state = MagicMock() xml_state.build_type.get_firmware = Mock(return_value=None) mock_which.return_value = None bootloader = BootLoaderConfigGrub2(xml_state, 'root_dir') assert bootloader.boot_directory_name == 'grub' @patch('kiwi.bootloader.config.grub2.Path.which') def test_post_init_grub2_load_command(self, mock_which): Defaults.set_platform_name('i686') xml_state = MagicMock() xml_state.build_type.get_firmware = Mock(return_value=None) mock_which.return_value = None bootloader = BootLoaderConfigGrub2(xml_state, 'root_dir') assert bootloader.grub_load == 'source' def test_post_init_invalid_platform(self): Defaults.set_platform_name('unsupported-arch') with raises(KiwiBootLoaderGrubPlatformError): BootLoaderConfigGrub2(Mock(), 'root_dir') @patch('kiwi.defaults.Defaults.get_shim_loader') @patch('kiwi.defaults.Defaults.get_signed_grub_loader') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.DataSync') @patch('kiwi.bootloader.config.grub2.Path.which') @patch('os.path.exists') @patch('shutil.copy2') @patch('os.path.isfile') def test_setup_install_boot_images_raises_no_efigrub( self, mock_os_path_isfile, mock_shutil_copy2, mock_exists, mock_Path_which, mock_sync, mock_command, mock_grub, mock_shim, ): # Defaults.set_platform_name('x86_64') self.firmware.efi_mode = Mock(return_value='uefi') mock_os_path_isfile.return_value = False mock_Path_which.return_value = '/path/to/grub2-mkimage' mock_shim.return_value = 'shim.efi' mock_grub.return_value = None self.bootloader.theme = 'some-theme' self.os_exists['root_dir/usr/share/grub2/themes/some-theme'] = False self.os_exists['root_dir/boot/grub2/themes/some-theme'] = False self.os_exists['root_dir/usr/lib/grub2/themes/some-theme'] = True self.os_exists['root_dir/usr/lib/grub/themes/some-theme'] = False self.os_exists['root_dir/boot/grub2/themes/some-theme'] = False self.os_exists['root_dir/usr/share/grub2/i386-pc'] = True self.os_exists['/usr/share/grub2/i386-pc'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-efi'] = True self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = True def os_path_exists(arg): return self.os_exists[arg] mock_exists.side_effect = os_path_exists with patch('builtins.open'): with raises(KiwiBootLoaderGrubSecureBootError): self.bootloader.setup_install_boot_images(self.mbrid) def test_post_init_ix86_platform(self): Defaults.set_platform_name('i686') xml_state = MagicMock() xml_state.get_initrd_system = Mock(return_value='dracut') xml_state.build_type.get_firmware = Mock(return_value=None) bootloader = BootLoaderConfigGrub2(xml_state, 'root_dir') assert bootloader.arch == 'ix86' def test_post_init_ppc_platform(self): Defaults.set_platform_name('ppc64') xml_state = MagicMock() xml_state.build_type.get_firmware = Mock(return_value=None) bootloader = BootLoaderConfigGrub2(xml_state, 'root_dir') assert bootloader.arch == 'ppc64' def test_post_init_s390_platform(self): Defaults.set_platform_name('s390x') xml_state = MagicMock() xml_state.build_type.get_firmware = Mock(return_value=None) bootloader = BootLoaderConfigGrub2(xml_state, 'root_dir') assert bootloader.arch == 's390x' def test_post_init_arm64_platform(self): Defaults.set_platform_name('arm64') xml_state = MagicMock() xml_state.build_type.get_firmware = Mock(return_value=None) bootloader = BootLoaderConfigGrub2(xml_state, 'root_dir') assert bootloader.arch == 'arm64' def test_post_init_riscv64_platform(self): Defaults.set_platform_name('riscv64') xml_state = MagicMock() xml_state.build_type.get_firmware = Mock(return_value=None) bootloader = BootLoaderConfigGrub2(xml_state, 'root_dir') assert bootloader.arch == 'riscv64' def test_post_init_loongarch64_platform(self): Defaults.set_platform_name('loongarch64') xml_state = MagicMock() xml_state.build_type.get_firmware = Mock(return_value=None) bootloader = BootLoaderConfigGrub2(xml_state, 'root_dir') assert bootloader.arch == 'loongarch64' @patch('os.path.exists') def test_post_init_dom0(self, mock_exists): Defaults.set_platform_name('x86_64') self.state.is_xen_server = Mock(return_value=True) self.state.is_xen_guest = Mock(return_value=False) mock_exists.return_value = True self.bootloader.post_init(None) assert self.bootloader.multiboot is True assert self.bootloader.xen_guest is False @patch('os.path.exists') def test_post_init_domU(self, mock_exists): Defaults.set_platform_name('x86_64') self.state.is_xen_server = Mock(return_value=False) self.state.is_xen_guest = Mock(return_value=True) mock_exists.return_value = True self.bootloader.post_init(None) assert self.bootloader.multiboot is False assert self.bootloader.xen_guest is True @patch.object(BootLoaderConfigGrub2, '_setup_default_grub') def test_write_meta_data(self, mock_setup_default_grub): self.bootloader.write_meta_data() mock_setup_default_grub.assert_called_once_with() @patch.object(BootLoaderConfigGrub2, '_setup_default_grub') @patch.object(BootLoaderConfigGrub2, '_setup_zipl2grub_conf') def test_write_meta_data_s390( self, mock_setup_zipl2grub_conf, mock_setup_default_grub ): self.bootloader.arch = 's390x' self.bootloader.write_meta_data() mock_setup_default_grub.assert_called_once_with() mock_setup_zipl2grub_conf.assert_called_once_with() @patch('os.path.exists') @patch.object(BootLoaderConfigGrub2, '_copy_grub_config_to_efi_path') def test_write(self, mock_copy_grub_config_to_efi_path, mock_exists): mock_exists.return_value = True self.bootloader.config = 'some-data' self.bootloader.iso_boot = True self.firmware.efi_mode = Mock(return_value='uefi') with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader.write() mock_open.assert_called_once_with( 'root_dir/boot/grub2/grub.cfg', 'w' ) file_handle.write.assert_called_once_with('some-data') @patch('kiwi.bootloader.config.grub2.DataSync.sync_data') @patch('kiwi.bootloader.config.grub2.Temporary.new_dir') @patch('kiwi.bootloader.config.grub2.SparseFile.create') @patch('kiwi.bootloader.config.grub2.Command.run') def test_create_embedded_fat_efi_image( self, mock_command, mock_sparse_file_create, mock_tmpdir, mock_syncdata ): tmpdir = Mock() tmpdir.name = 'tmpdir' mock_tmpdir.return_value = tmpdir self.bootloader._create_embedded_fat_efi_image('tmp-esp-image') mock_sparse_file_create.assert_called_once_with('tmp-esp-image', '20M') assert mock_command.call_args_list == [ call(['mkdosfs', '-n', 'BOOT', 'tmp-esp-image']), call( ['mcopy', '-Do', '-s', '-i', 'tmp-esp-image', 'tmpdir', '::EFI'] ), ] @patch('glob.iglob') @patch('shutil.copy2') @patch('kiwi.bootloader.config.grub2.Path.create') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.Defaults.get_signed_grub_loader') @patch('kiwi.bootloader.config.grub2.Path.which') def test_copy_grub_config_to_efi_path( self, mock_Path_which, mock_get_signed_grub_loader, mock_Command, mock_Path_create, mock_shutil_copy2, mock_glob, ): mock_get_signed_grub_loader.return_value = [] mock_glob.return_value = [] # 1. run: check strings command not found mock_Path_which.return_value = '' mock_get_signed_grub_loader.return_value = [ grub_loader_type( 'some-loader', 'some-binaryname', 'some-targetname' ) ] with raises(KiwiCommandNotFound): self.bootloader._copy_grub_config_to_efi_path( 'root_dir', 'config_file' ) # 2. run: check default handling mock_get_signed_grub_loader.return_value = [] mock_Path_which.return_value = '/usr/bin/strings' self.bootloader._copy_grub_config_to_efi_path('root_dir', 'config_file') mock_Path_create.assert_called_once_with('root_dir/EFI/BOOT') mock_shutil_copy2.assert_called_once_with( 'config_file', 'root_dir/EFI/BOOT/grub.cfg' ) # 3. run: check with vendor directory read from grub binary mock_shutil_copy2.reset_mock() mock_Path_create.reset_mock() strings_out = Mock() strings_out.output = '/EFI/ubuntu' mock_get_signed_grub_loader.return_value = [ grub_loader_type( 'some-loader', 'some-binaryname', 'some-targetname' ) ] mock_Command.return_value = strings_out self.bootloader._copy_grub_config_to_efi_path('root_dir', 'config_file') mock_Path_create.assert_called_once_with('root_dir/EFI/ubuntu') mock_shutil_copy2.assert_called_once_with( 'config_file', 'root_dir/EFI/ubuntu/grub.cfg' ) # 4. run: check with installed vendor directory mock_shutil_copy2.reset_mock() mock_Path_create.reset_mock() mock_get_signed_grub_loader.return_value = [] mock_glob.return_value = ['root_dir/EFI/fedora/shim.efi'] self.bootloader._copy_grub_config_to_efi_path('root_dir', 'config_file') mock_Path_create.assert_called_once_with('root_dir/EFI/fedora') mock_shutil_copy2.assert_called_once_with( 'config_file', 'root_dir/EFI/fedora/grub.cfg' ) @patch('shutil.copy2') @patch('os.path.exists') @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_zipl2grub_conf_512_byte_target( self, mock_Command_run, mock_exists, mock_shutil_copy2 ): path_return_values = [True, False] def path_exists(arg): return path_return_values.pop(0) command = Mock() command.output = ' 2048' self.bootloader.target_table_type = 'msdos' mock_Command_run.return_value = command mock_exists.side_effect = path_exists xml_state = MagicMock() xml_state.get_build_type_bootloader_targettype = Mock( return_value='FBA' ) xml_state.build_type.get_target_blocksize = Mock(return_value=None) self.bootloader.xml_state = xml_state with open('../data/etc/default/zipl2grub.conf.in') as zipl_grub: zipl_config = zipl_grub.read() with patch('builtins.open', create=True) as mock_open: file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = zipl_config self.bootloader._setup_zipl2grub_conf() assert ( ' targettype = FBA\n' ' targetbase = rootdev\n' ' targetblocksize = 512\n' ' targetoffset = 2048' in file_handle.write.call_args[0][0] ) mock_shutil_copy2.assert_called_once_with( 'root_dir/etc/default/zipl2grub.conf.in', 'root_dir/etc/default/zipl2grub.conf.in.orig', ) path_return_values = [True, True] mock_shutil_copy2.reset_mock() with patch('builtins.open', create=True) as mock_open: file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = zipl_config self.bootloader._setup_zipl2grub_conf() mock_shutil_copy2.assert_called_once_with( 'root_dir/etc/default/zipl2grub.conf.in.orig', 'root_dir/etc/default/zipl2grub.conf.in', ) @patch('shutil.copy2') @patch('os.path.exists') @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_zipl2grub_conf_4096_byte_target( self, mock_Command_run, mock_exists, mock_shutil_copy2 ): path_return_values = [True, False] command_return_values = [ self.command_type(output=' blocks per track .....: 12\n'), self.command_type( output=' /dev/loop01 2 6401 6400 1 Linux native\n' ), self.command_type(output=' cylinders ............: 10017\n'), self.command_type(output=' tracks per cylinder ..: 15\n'), self.command_type(output=' blocks per track .....: 12\n'), ] def path_exists(arg): return path_return_values.pop(0) def command_run(arg): return command_return_values.pop(0) self.bootloader.target_table_type = 'dasd' mock_Command_run.side_effect = command_run mock_exists.side_effect = path_exists xml_state = MagicMock() xml_state.get_build_type_bootloader_targettype = Mock( return_value='CDL' ) xml_state.build_type.get_target_blocksize = Mock(return_value=4096) self.bootloader.xml_state = xml_state with open('../data/etc/default/zipl2grub.conf.in') as zipl_grub: zipl_config = zipl_grub.read() with patch('builtins.open', create=True) as mock_open: file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = zipl_config self.bootloader._setup_zipl2grub_conf() assert ( ' targettype = CDL\n' ' targetbase = rootdev\n' ' targetblocksize = 4096\n' ' targetoffset = 24\n' ' targetgeometry = 10017,15,12' in file_handle.write.call_args[0][0] ) assert mock_Command_run.call_args_list == [ call( ['bash', '-c', 'fdasd -f -p rootdev | grep "blocks per track"'] ), call( [ 'bash', '-c', 'fdasd -f -s -p rootdev | grep "^ " | ' 'head -n 1 | tr -s " "', ] ), call(['bash', '-c', 'fdasd -f -p rootdev | grep "cylinders"']), call( [ 'bash', '-c', 'fdasd -f -p rootdev | grep "tracks per cylinder"', ] ), call( ['bash', '-c', 'fdasd -f -p rootdev | grep "blocks per track"'] ), ] @patch('kiwi.bootloader.config.grub2.Command.run') @patch.object(BootLoaderConfigGrub2, '_get_dasd_disk_geometry_element') def test_get_partition_start_raises( self, mock_get_dasd_disk_geometry_element, mock_Command_run ): self.bootloader.target_table_type = 'dasd' mock_Command_run.return_value = self.command_type(output='bogus data') with raises(KiwiDiskGeometryError): self.bootloader._get_partition_start('/dev/disk') @patch('kiwi.bootloader.config.grub2.Command.run') def test_get_dasd_disk_geometry_element_raises(self, mock_Command_run): self.bootloader.target_table_type = 'dasd' mock_Command_run.return_value = self.command_type(output='bogus data') with raises(KiwiDiskGeometryError): self.bootloader._get_dasd_disk_geometry_element( '/dev/disk', 'tracks per cylinder' ) @patch('os.path.exists') @patch('kiwi.bootloader.config.grub2.SysConfig') @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_default_grub_s390_secure_execution( self, mock_Command_run, mock_sysconfig, mock_exists ): grep_grub_option = Mock() grep_grub_option.returncode = 0 mock_Command_run.return_value = grep_grub_option mock_exists.return_value = False grub_default = SysConfig('some-file') grub_default.write = Mock() mock_sysconfig.return_value = grub_default mock_exists.return_value = True self.bootloader.bls = True self.bootloader.terminal_input = 'serial' self.bootloader.terminal_output = 'gfxterm' self.bootloader.gfxmode = '800x600' self.bootloader.theme = 'openSUSE' self.bootloader.displayname = 'Bob' self.bootloader.arch = 's390x' self.bootloader.host_key_certificates = [ { 'hkd_cert': ['/path/to/host.crt'], 'hkd_revocation_list': ['some1.crl', 'some2.crl'], 'hkd_ca_cert': '/path/to/DigiCertCA.crt', 'hkd_sign_cert': '/path/to/ibm-z-host-key-signing.crt', } ] self.firmware.efi_mode.return_value = 'efi' self.bootloader._setup_default_grub() mock_sysconfig.assert_called_once_with('root_dir/etc/default/grub') grub_default.write.assert_called_once_with() assert grub_default.data_dict == { 'GRUB_BACKGROUND': '/boot/grub2/themes/openSUSE/background.png', 'GRUB_CMDLINE_LINUX_DEFAULT': '"some-cmdline"', 'GRUB_DISTRIBUTOR': '"Bob"', 'GRUB_ENABLE_BLSCFG': 'true', 'GRUB_ENABLE_CRYPTODISK': 'y', 'GRUB_GFXMODE': '800x600', 'GRUB_SERIAL_COMMAND': '"serial --speed=38400"', 'GRUB_TERMINAL_INPUT': '"serial"', 'GRUB_TERMINAL_OUTPUT': '"gfxterm"', 'GRUB_THEME': '/boot/grub2/themes/openSUSE/theme.txt', 'GRUB_TIMEOUT': '10', 'GRUB_TIMEOUT_STYLE': 'countdown', 'SUSE_BTRFS_SNAPSHOT_BOOTING': 'true', 'SUSE_S390_SE_CA_CERT': '/path/to/DigiCertCA.crt', 'SUSE_S390_SE_ENABLE': 'true', 'SUSE_S390_SE_HOST_KEY': '/path/to/host.crt', 'SUSE_S390_SE_HOST_KEY_SIGNING_KEY': '/path/to/ibm-z-host-key-signing.crt', 'SUSE_S390_SE_REVOCATION_LIST': 'some1.crl,some2.crl', 'GRUB_DEFAULT': 'saved', } @patch('os.path.exists') @patch('kiwi.bootloader.config.grub2.SysConfig') @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_default_grub( self, mock_Command_run, mock_sysconfig, mock_exists ): grep_grub_option = Mock() grep_grub_option.returncode = 0 mock_Command_run.return_value = grep_grub_option mock_exists.return_value = False grub_default = SysConfig('some-file') grub_default.write = Mock() mock_sysconfig.return_value = grub_default mock_exists.return_value = True self.bootloader.bls = True self.bootloader.terminal_input = 'serial' self.bootloader.terminal_output = 'gfxterm' self.bootloader.gfxmode = '800x600' self.bootloader.theme = 'openSUSE' self.bootloader.displayname = 'Bob' self.firmware.efi_mode.return_value = 'efi' self.bootloader._setup_default_grub() mock_sysconfig.assert_called_once_with('root_dir/etc/default/grub') grub_default.write.assert_called_once_with() assert grub_default.data_dict == { 'GRUB_BACKGROUND': '/boot/grub2/themes/openSUSE/background.png', 'GRUB_CMDLINE_LINUX_DEFAULT': '"some-cmdline"', 'GRUB_DISTRIBUTOR': '"Bob"', 'GRUB_ENABLE_BLSCFG': 'true', 'GRUB_ENABLE_CRYPTODISK': 'y', 'GRUB_GFXMODE': '800x600', 'GRUB_SERIAL_COMMAND': '"serial --speed=38400"', 'GRUB_TERMINAL_INPUT': '"serial"', 'GRUB_TERMINAL_OUTPUT': '"gfxterm"', 'GRUB_THEME': '/boot/grub2/themes/openSUSE/theme.txt', 'GRUB_TIMEOUT': '10', 'GRUB_TIMEOUT_STYLE': 'countdown', 'SUSE_BTRFS_SNAPSHOT_BOOTING': 'true', 'GRUB_DEFAULT': 'saved', } @patch('os.path.exists') @patch('kiwi.bootloader.config.grub2.SysConfig') @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_default_grub_empty_kernelcmdline( self, mock_Command_run, mock_sysconfig, mock_exists ): grep_grub_option = Mock() grep_grub_option.returncode = 0 mock_Command_run.return_value = grep_grub_option grub_default = MagicMock() mock_sysconfig.return_value = grub_default mock_exists.return_value = True self.bootloader.bls = True self.bootloader.terminal_input = 'serial' self.bootloader.terminal_output = 'serial' self.bootloader.gfxmode = '800x600' self.bootloader.theme = 'openSUSE' self.bootloader.displayname = 'Bob' self.bootloader.cmdline = 'root=LABEL=some-label' self.bootloader.persistency_type = 'by-label' self.bootloader._setup_default_grub() # Must not contain GRUB_CMDLINE_LINUX_DEFAULT assert grub_default.__setitem__.call_args_list == [ call( 'GRUB_BACKGROUND', '/boot/grub2/themes/openSUSE/background.png' ), call('GRUB_CMDLINE_LINUX', '"root=LABEL=some-label"'), call('GRUB_DISABLE_LINUX_UUID', 'true'), call('GRUB_DISTRIBUTOR', '"Bob"'), call('GRUB_ENABLE_BLSCFG', 'true'), call('GRUB_ENABLE_CRYPTODISK', 'y'), call('GRUB_ENABLE_LINUX_LABEL', 'true'), call('GRUB_GFXMODE', '800x600'), call('GRUB_SERIAL_COMMAND', '"serial --speed=38400"'), call('GRUB_TERMINAL_INPUT', '"serial"'), call('GRUB_TERMINAL_OUTPUT', '"serial"'), call('GRUB_THEME', '/boot/grub2/themes/openSUSE/theme.txt'), call('GRUB_TIMEOUT', 10), call('GRUB_TIMEOUT_STYLE', 'countdown'), call('SUSE_BTRFS_SNAPSHOT_BOOTING', 'true'), call('SUSE_REMOVE_LINUX_ROOT_PARAM', 'true'), ] @patch('os.path.exists') @patch('kiwi.bootloader.config.grub2.SysConfig') @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_default_grub_use_of_by_partuuid( self, mock_Command_run, mock_sysconfig, mock_exists ): grep_grub_option = Mock() grep_grub_option.returncode = 0 mock_Command_run.return_value = grep_grub_option grub_default = MagicMock() mock_sysconfig.return_value = grub_default mock_exists.return_value = True self.bootloader.bls = True self.bootloader.terminal_input = 'serial' self.bootloader.terminal_output = 'serial' self.bootloader.gfxmode = '800x600' self.bootloader.theme = 'openSUSE' self.bootloader.displayname = 'Bob' self.bootloader.cmdline = 'root=UUID=foo' self.bootloader.persistency_type = 'by-partuuid' self.bootloader._setup_default_grub() assert grub_default.__setitem__.call_args_list == [ call( 'GRUB_BACKGROUND', '/boot/grub2/themes/openSUSE/background.png' ), call('GRUB_DISABLE_LINUX_PARTUUID', 'false'), call('GRUB_DISABLE_LINUX_UUID', 'true'), call('GRUB_DISTRIBUTOR', '"Bob"'), call('GRUB_ENABLE_BLSCFG', 'true'), call('GRUB_ENABLE_CRYPTODISK', 'y'), call('GRUB_GFXMODE', '800x600'), call('GRUB_SERIAL_COMMAND', '"serial --speed=38400"'), call('GRUB_TERMINAL_INPUT', '"serial"'), call('GRUB_TERMINAL_OUTPUT', '"serial"'), call('GRUB_THEME', '/boot/grub2/themes/openSUSE/theme.txt'), call('GRUB_TIMEOUT', 10), call('GRUB_TIMEOUT_STYLE', 'countdown'), call('SUSE_BTRFS_SNAPSHOT_BOOTING', 'true'), ] @patch('os.path.exists') @patch('kiwi.bootloader.config.grub2.SysConfig') @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_default_grub_use_of_by_label( self, mock_Command_run, mock_sysconfig, mock_exists ): grep_grub_option = Mock() grep_grub_option.returncode = 0 mock_Command_run.return_value = grep_grub_option grub_default = MagicMock() mock_sysconfig.return_value = grub_default mock_exists.return_value = True self.bootloader.terminal_input = 'serial' self.bootloader.terminal_output = 'serial' self.bootloader.gfxmode = '800x600' self.bootloader.theme = 'openSUSE' self.bootloader.displayname = 'Bob' self.bootloader.cmdline = 'abcd root=LABEL=foo console=tty0' self.bootloader.persistency_type = 'by-label' self.bootloader.bls = True self.bootloader._setup_default_grub() assert grub_default.__setitem__.call_args_list == [ call( 'GRUB_BACKGROUND', '/boot/grub2/themes/openSUSE/background.png' ), call('GRUB_CMDLINE_LINUX', '"root=LABEL=foo"'), call('GRUB_CMDLINE_LINUX_DEFAULT', '"abcd console=tty0"'), call('GRUB_DISABLE_LINUX_UUID', 'true'), call('GRUB_DISTRIBUTOR', '"Bob"'), call('GRUB_ENABLE_BLSCFG', 'true'), call('GRUB_ENABLE_CRYPTODISK', 'y'), call('GRUB_ENABLE_LINUX_LABEL', 'true'), call('GRUB_GFXMODE', '800x600'), call('GRUB_SERIAL_COMMAND', '"serial --speed=38400"'), call('GRUB_TERMINAL_INPUT', '"serial"'), call('GRUB_TERMINAL_OUTPUT', '"serial"'), call('GRUB_THEME', '/boot/grub2/themes/openSUSE/theme.txt'), call('GRUB_TIMEOUT', 10), call('GRUB_TIMEOUT_STYLE', 'countdown'), call('SUSE_BTRFS_SNAPSHOT_BOOTING', 'true'), call('SUSE_REMOVE_LINUX_ROOT_PARAM', 'true'), ] @patch('os.path.exists') @patch('kiwi.bootloader.config.grub2.SysConfig') @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_default_grub_use_of_bls( self, mock_Command_run, mock_sysconfig, mock_exists ): grep_grub_option = Mock() grep_grub_option.returncode = 0 mock_Command_run.return_value = grep_grub_option mock_exists.return_value = False grub_default = SysConfig('some-file') grub_default.write = Mock() mock_sysconfig.return_value = grub_default mock_exists.return_value = True self.bootloader.terminal_input = 'serial' self.bootloader.terminal_output = 'gfxterm' self.bootloader.gfxmode = '800x600' self.bootloader.theme = 'openSUSE' self.bootloader.displayname = 'Bob' self.bootloader.bls = True self.firmware.efi_mode.return_value = 'efi' self.bootloader._setup_default_grub() mock_sysconfig.assert_called_once_with('root_dir/etc/default/grub') grub_default.write.assert_called_once_with() assert grub_default.data_dict == { 'GRUB_BACKGROUND': '/boot/grub2/themes/openSUSE/background.png', 'GRUB_CMDLINE_LINUX_DEFAULT': '"some-cmdline"', 'GRUB_DISTRIBUTOR': '"Bob"', 'GRUB_ENABLE_BLSCFG': 'true', 'GRUB_ENABLE_CRYPTODISK': 'y', 'GRUB_GFXMODE': '800x600', 'GRUB_SERIAL_COMMAND': '"serial --speed=38400"', 'GRUB_TERMINAL_INPUT': '"serial"', 'GRUB_TERMINAL_OUTPUT': '"gfxterm"', 'GRUB_THEME': '/boot/grub2/themes/openSUSE/theme.txt', 'GRUB_TIMEOUT': '10', 'GRUB_TIMEOUT_STYLE': 'countdown', 'SUSE_BTRFS_SNAPSHOT_BOOTING': 'true', 'GRUB_DEFAULT': 'saved', } @patch('os.path.exists') def test_setup_live_image_config_custom_template(self, mock_exists): bootloader = Mock() bootloader.get_grub_template.return_value = "example.template" bootloader.get_kernel_flavor.return_value = None self.bootloader.xml_state.build_type.bootloader.append(bootloader) mock_exists.return_value = True self.bootloader.multiboot = False with patch('builtins.open') as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = "example template contents" self.bootloader.setup_live_image_config(self.mbrid) assert self.bootloader.config == "example template contents" @patch('os.path.exists') def test_setup_live_image_config_custom_template_file_does_not_exist( self, mock_exists ): bootloader = Mock() bootloader.get_grub_template.return_value = "example.template" bootloader.get_kernel_flavor.return_value = None self.bootloader.xml_state.build_type.bootloader.append(bootloader) mock_exists.return_value = False self.bootloader.multiboot = False with raises(KiwiFileNotFound): self.bootloader.setup_live_image_config(self.mbrid) def test_setup_live_image_config_custom_template_not_set(self): bootloader = Mock() bootloader.get_grub_template.return_value = "" bootloader.get_kernel_flavor.return_value = None self.bootloader.xml_state.build_type.bootloader.append(bootloader) self.bootloader.multiboot = False self.bootloader.setup_live_image_config(self.mbrid) self.grub2.get_iso_template.assert_called_once() @patch('os.path.exists') def test_setup_install_image_config_custom_template(self, mock_exists): bootloader = Mock() bootloader.get_grub_template.return_value = "example.template" bootloader.get_kernel_flavor.return_value = None self.bootloader.xml_state.build_type.bootloader.append(bootloader) mock_exists.return_value = True self.bootloader.multiboot = False with patch('builtins.open') as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = "example template contents" self.bootloader.setup_install_image_config(self.mbrid) assert self.bootloader.config == "example template contents" @patch('os.path.exists') def test_setup_install_image_config_custom_template_file_does_not_exist( self, mock_exists ): bootloader = Mock() bootloader.get_grub_template.return_value = "example.template" bootloader.get_kernel_flavor.return_value = None self.bootloader.xml_state.build_type.bootloader.append(bootloader) mock_exists.return_value = False self.bootloader.multiboot = False with raises(KiwiFileNotFound): self.bootloader.setup_install_image_config(self.mbrid) def test_setup_install_image_config_custom_template_not_set(self): bootloader = Mock() bootloader.get_grub_template.return_value = "" bootloader.get_kernel_flavor.return_value = None self.bootloader.xml_state.build_type.bootloader.append(bootloader) self.bootloader.multiboot = False self.bootloader.setup_install_image_config(self.mbrid) self.grub2.get_install_template.assert_called_once() def test_setup_live_image_config_multiboot(self): self.bootloader.multiboot = True self.state.build_type.get_btrfs_set_default_volume = Mock( return_value=False ) self.state.build_type.get_btrfs_root_is_snapper_snapshot = Mock( return_value=False ) self.bootloader.setup_live_image_config(self.mbrid) self.grub2.get_multiboot_iso_template.assert_called_once_with( True, False, False, None, False, kernel_count=1 ) @patch.object(BootLoaderConfigGrub2, '_copy_grub_config_to_efi_path') def test_setup_live_image_config_standard( self, mock_copy_grub_config_to_efi_path ): self.firmware.efi_mode = Mock(return_value='uefi') self.bootloader.terminal_input = 'serial' self.bootloader.terminal_output = 'gfxterm' self.bootloader.early_boot_script_efi = 'earlyboot.cfg' self.bootloader.multiboot = False self.bootloader.setup_live_image_config(self.mbrid) self.grub2.get_iso_template.assert_called_once_with( True, True, True, None, True, kernel_count=1 ) mock_copy_grub_config_to_efi_path.assert_called_once_with( 'root_dir', 'earlyboot.cfg', 'iso' ) @staticmethod def _get_menu_entries(config): """ Titles of the menu entries in the given grub config, each along with the names of the kernel and initrd file it loads """ menu_entries = [] for line in config.splitlines(): line = line.strip() title = re.match(r'(?:menuentry|hiddenentry) "([^"]+)"', line) if title: menu_entries.append((title.group(1),)) elif re.match(r'(linux|initrd|module) ', line): menu_entries[-1] += (os.path.basename(line.split()[1]),) return menu_entries @patch.object(BootLoaderConfigGrub2, '_copy_grub_config_to_efi_path') def test_setup_live_image_config_with_kernel_flavors( self, mock_copy_grub_config_to_efi_path ): self.bootloader.grub2 = BootLoaderTemplateGrub2() self.bootloader.multiboot = False self.bootloader.xml_state.get_build_type_bootloader_kernel_flavors = ( Mock(return_value=['rt', 'default']) ) self.bootloader.setup_live_image_config(self.mbrid) # the entry of the first flavor is the default entry, failsafe # uses the kernel of the first flavor assert 'set default=0' in self.bootloader.config assert self._get_menu_entries(self.bootloader.config) == [ ('If OK, run snapper rollback and reboot.',), ('Bob (rt)', 'linux', 'initrd'), ('Bob (default)', 'linux-default', 'initrd-default'), ('Failsafe -- Bob (rt)', 'linux', 'initrd'), ('Boot from Hard Disk',), ] @patch.object(BootLoaderConfigGrub2, '_copy_grub_config_to_efi_path') def test_setup_install_image_config_with_kernel_flavors( self, mock_copy_grub_config_to_efi_path ): self.bootloader.grub2 = BootLoaderTemplateGrub2() self.bootloader.multiboot = True self.bootloader.xml_state.get_build_type_bootloader_kernel_flavors = ( Mock(return_value=['rt', 'default']) ) self.bootloader.xml_state.build_type.get_installboot = Mock( return_value='failsafe-install' ) self.bootloader.setup_install_image_config(self.mbrid) # the failsafe install entry follows the install entries assert 'set default=3' in self.bootloader.config assert self._get_menu_entries(self.bootloader.config) == [ ('If OK, run snapper rollback and reboot.',), ('Boot from Hard Disk',), ('Install -- Bob (rt)', 'linux', 'initrd'), ('Install -- Bob (default)', 'linux-default', 'initrd-default'), ('Failsafe -- Install Bob (rt)', 'linux', 'initrd'), ] def test_setup_install_image_config_multiboot(self): self.bootloader.terminal_input = 'serial' self.bootloader.terminal_output = 'gfxterm' self.bootloader.multiboot = True self.bootloader.setup_install_image_config(self.mbrid) self.grub2.get_multiboot_install_template.assert_called_once_with( True, True, True, True, True, kernel_count=1 ) grub_config_with_submenu = dedent( ''' } set default="${saved_entry}" function load_video { insmod all_video } menuentry 'openSUSE' --class opensuse $menuentry_id_option 'gnulinux-simple-UUID' { \tload_video \tlinux\t/boot/vmlinuz-6.4.0-9-default root=UUID=x \tinitrd\t/boot/initrd-6.4.0-9-default } submenu 'Advanced options for openSUSE' $menuentry_id_option 'gnulinux-advanced-UUID' { \tmenuentry 'openSUSE, with Linux 6.4.0-9-default' $menuentry_id_option 'gnulinux-6.4.0-9-default-advanced-UUID' { \t\tlinux\t/boot/vmlinuz-6.4.0-9-default root=UUID=x \t} \tmenuentry 'openSUSE, with Linux 6.4.0-3-rt (recovery mode)' $menuentry_id_option 'gnulinux-6.4.0-3-rt-recovery-UUID' { \t\tlinux\t/boot/vmlinuz-6.4.0-3-rt root=UUID=x single \t} \tmenuentry 'openSUSE, with Linux 6.4.0-3-rt' $menuentry_id_option 'gnulinux-6.4.0-3-rt-advanced-UUID' { \t\tlinuxefi\t/vmlinuz-6.4.0-3-rt root=UUID=x \t} } ''' ) grub_config_without_submenu = dedent( ''' menuentry 'openSUSE' $menuentry_id_option 'gnulinux-simple-UUID' { \tlinux\t/boot/vmlinuz-6.4.0-9-default root=UUID=x } menuentry 'openSUSE, with Linux 6.4.0-3-rt' $menuentry_id_option 'gnulinux-6.4.0-3-rt-advanced-UUID' { \tlinux\t/boot/vmlinuz-6.4.0-3-rt root=UUID=x } menuentry 'openSUSE, with Linux 6.4.0-1-rt' $menuentry_id_option 'gnulinux-6.4.0-1-rt-advanced-UUID' { \tlinux\t/boot/vmlinuz-6.4.0-1-rt root=UUID=x } ''' ) def test_get_menu_entry_id(self, tmp_path): config_file = tmp_path / 'grub.cfg' config_file.write_text(self.grub_config_with_submenu) # the entry of the version in the submenu is preferred over # the top level entry and recovery entries are skipped assert BootLoaderConfigGrub2._get_menu_entry_id( str(config_file), '6.4.0-3-rt' ) == ('gnulinux-advanced-UUID>gnulinux-6.4.0-3-rt-advanced-UUID') assert BootLoaderConfigGrub2._get_menu_entry_id( str(config_file), '6.4.0-9-default' ) == ('gnulinux-advanced-UUID>gnulinux-6.4.0-9-default-advanced-UUID') # a version which only starts another version does not match assert ( BootLoaderConfigGrub2._get_menu_entry_id( str(config_file), '6.4.0-3' ) == '' ) config_file.write_text(self.grub_config_without_submenu) assert ( BootLoaderConfigGrub2._get_menu_entry_id( str(config_file), '6.4.0-3-rt' ) == 'gnulinux-6.4.0-3-rt-advanced-UUID' ) def _setup_kernel_flavor_root(self, root_dir, entries=()): for version in ['6.4.0-9-default', '6.4.0-3-rt', '6.4.0-1-rt']: modules_dir = root_dir / 'lib' / 'modules' / version modules_dir.mkdir(parents=True) (modules_dir / 'vmlinuz').touch() entries_dir = root_dir / 'boot' / 'loader' / 'entries' entries_dir.mkdir(parents=True) for entry in entries: (entries_dir / entry).touch() self.bootloader.root_mount = Mock() self.bootloader.root_mount.mountpoint = str(root_dir) self.bootloader.xml_state.get_build_type_bootloader_kernel_flavors = ( Mock(return_value=['rt', 'default']) ) @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_kernel_flavor_default_entry( self, mock_Command_run, tmp_path ): self._setup_kernel_flavor_root(tmp_path) config_file = tmp_path / 'grub.cfg' config_file.write_text(self.grub_config_with_submenu) (tmp_path / 'etc' / 'default').mkdir(parents=True) (tmp_path / 'etc' / 'default' / 'grub').write_text( 'GRUB_DEFAULT=saved\n' ) with self._caplog.at_level(logging.WARNING): self.bootloader._setup_kernel_flavor_default_entry(str(config_file)) assert 'GRUB_DEFAULT' not in self._caplog.text mock_Command_run.assert_called_once_with( [ 'chroot', str(tmp_path), 'grub2-editenv', '-', 'set', 'saved_entry=gnulinux-advanced-UUID>' 'gnulinux-6.4.0-3-rt-advanced-UUID', ] ) (tmp_path / 'etc' / 'default' / 'grub').write_text('GRUB_DEFAULT=0\n') with self._caplog.at_level(logging.WARNING): self.bootloader._setup_kernel_flavor_default_entry(str(config_file)) assert 'GRUB_DEFAULT=0 is set' in self._caplog.text @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_kernel_flavor_default_entry_from_loader_entries( self, mock_Command_run, tmp_path ): # with menu entries according to the boot loader specification # the default entry is selected by the name of its file self._setup_kernel_flavor_root( tmp_path, [ 'bc8499a-6.4.0-9-default.conf', 'bc8499a-6.4.0-1-rt.conf', 'bc8499a-6.4.0-3-rt.conf', ], ) config_file = tmp_path / 'grub.cfg' config_file.write_text('blscfg\n') self.bootloader._setup_kernel_flavor_default_entry(str(config_file)) mock_Command_run.assert_called_once_with( [ 'chroot', str(tmp_path), 'grub2-editenv', '-', 'set', 'saved_entry=bc8499a-6.4.0-3-rt', ] ) @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_kernel_flavor_default_entry_raises( self, mock_Command_run, tmp_path ): self._setup_kernel_flavor_root(tmp_path, ['bc8499a-6.4.0-1-rt.conf']) config_file = tmp_path / 'grub.cfg' config_file.write_text('blscfg\n') with raises(KiwiBootLoaderGrubMenuEntryError): self.bootloader._setup_kernel_flavor_default_entry(str(config_file)) assert not mock_Command_run.called @patch('kiwi.bootloader.config.grub2.Command.run') def test_setup_kernel_flavor_default_entry_without_flavors( self, mock_Command_run ): self.bootloader._setup_kernel_flavor_default_entry('grub.cfg') assert not mock_Command_run.called @patch.object(BootLoaderConfigGrub2, '_mount_system') @patch.object(BootLoaderConfigGrub2, '_copy_grub_config_to_efi_path') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.Path.which') @patch('kiwi.bootloader.config.grub2.Path.create') @patch('kiwi.defaults.Defaults.get_vendor_grubenv') @patch('glob.iglob') def test_setup_disk_image_config( self, mock_iglob, mock_get_vendor_grubenv, mock_Path_create, mock_Path_which, mock_Command_run, mock_copy_grub_config_to_efi_path, mock_mount_system, ): self.state.get_dracut_config = Mock( return_value=DracutT(uefi=False, modules=[], drivers=[]) ) mock_iglob.return_value = ['some_entry.conf'] mock_get_vendor_grubenv.return_value = 'grubenv' mock_Path_which.return_value = '/path/to/grub2-mkconfig' self.firmware.efi_mode = Mock(return_value='uefi') self.bootloader.root_filesystem_is_overlay = True self.bootloader.root_reference = 'root=overlay:UUID=ID' self.bootloader.root_mount = Mock() self.bootloader.root_mount.mountpoint = 'root_mount_point' self.bootloader.efi_mount = Mock() self.bootloader.efi_mount.mountpoint = 'efi_mount_point' self.bootloader.early_boot_script_efi = 'earlyboot.cfg' with patch('builtins.open', create=True) as mock_open: mock_open_grub = MagicMock(spec=io.IOBase) mock_open_menu = MagicMock(spec=io.IOBase) def open_file(filename, mode=None): if filename == 'root_mount_point/boot/grub2/grub.cfg': return mock_open_grub.return_value elif filename == 'some_entry.conf': return mock_open_menu.return_value mock_open.side_effect = open_file file_handle_grub = ( mock_open_grub.return_value.__enter__.return_value ) file_handle_menu = ( mock_open_menu.return_value.__enter__.return_value ) file_handle_grub.read.return_value = ( 'root=rootdev nomodeset console=ttyS0 console=tty0\n' 'root=PARTUUID=xx' ) file_handle_menu.read.return_value = 'options foo\nlinux unexpected/boot/vmlinuz\ninitrd /boot/initrd' self.bootloader.xml_state.get_build_type_bootloader_environment_variables = Mock( return_value=['menu_auto_hide=1'] ) self.bootloader.setup_disk_image_config( boot_options={ 'root_device': 'rootdev', 'boot_device': 'bootdev', } ) mock_mount_system.assert_called_once_with( None, 'rootdev', 'bootdev', None, None, None, None ) os.environ.update({'GRUB_DISABLE_OS_PROBER': 'true'}) assert mock_Command_run.call_args_list == [ call( [ 'chroot', self.bootloader.root_mount.mountpoint, 'grub2-editenv', '-', 'set', 'menu_auto_hide=1', ] ), call( [ 'chroot', self.bootloader.root_mount.mountpoint, 'grub2-mkconfig', '-o', '/boot/grub2/grub.cfg', ], os.environ, ), call( [ 'bash', '-c', 'cd root_mount_point/boot && rm -f boot && ln -s . boot', ], raise_on_error=False, ), call( [ 'chroot', self.bootloader.root_mount.mountpoint, 'grub2-editenv', '-', 'set', 'root=overlay:UUID=ID', ] ), ] mock_copy_grub_config_to_efi_path.assert_called_once_with( 'efi_mount_point', 'earlyboot.cfg' ) file_handle_grub.write.assert_called_once_with == ( 'root=overlay:UUID=ID nomodeset console=ttyS0 console=tty0' '\n' 'root=overlay:UUID=ID' ) assert ( 'options some-cmdline root=UUID=foo' in file_handle_menu.write.call_args_list[0][0][0].split( os.linesep ) ) assert ( 'linux /boot/vmlinuz' in file_handle_menu.write.call_args_list[1][0][0].split( os.linesep ) ) assert ( 'initrd /boot/initrd' in file_handle_menu.write.call_args_list[1][0][0].split( os.linesep ) ) self.bootloader.bootpartition = True file_handle_menu.reset_mock() self.bootloader.setup_disk_image_config( boot_options={ 'root_device': 'rootdev', 'boot_device': 'bootdev', } ) assert 'linux /vmlinuz' in file_handle_menu.write.call_args_list[1][ 0 ][0].split(os.linesep) assert 'initrd /initrd' in file_handle_menu.write.call_args_list[1][ 0 ][0].split(os.linesep) # test UKI setup self.state.get_dracut_config.return_value = DracutT( uefi=True, modules=[], drivers=[] ) boot_image = Mock() self.bootloader.setup_disk_image_config( boot_options={ 'root_device': 'rootdev', 'boot_device': 'bootdev', 'boot_image': boot_image, } ) boot_image.create_uki.assert_called_once_with( 'some-cmdline root=UUID=foo' ) # test read-only device file_handle_grub.write.side_effect = OSError('readonly system') file_handle_menu.write.side_effect = OSError('readonly system') with self._caplog.at_level(logging.INFO): self.bootloader.setup_disk_image_config( boot_options={ 'root_device': 'rootdev', 'boot_device': 'bootdev', } ) assert 'readonly system' in self._caplog.text @patch.object(BootLoaderConfigGrub2, '_copy_grub_config_to_efi_path') def test_setup_install_image_config_standard( self, mock_copy_grub_config_to_efi_path ): self.firmware.efi_mode = Mock(return_value='uefi') self.bootloader.early_boot_script_efi = 'earlyboot.cfg' self.bootloader.multiboot = False self.bootloader.setup_install_image_config(self.mbrid) self.grub2.get_install_template.assert_called_once_with( True, False, False, True, True, kernel_count=1 ) mock_copy_grub_config_to_efi_path.assert_called_once_with( 'root_dir', 'earlyboot.cfg', 'iso' ) def test_setup_iso_image_config_substitute_error(self): self.bootloader.multiboot = True template = Mock() template.substitute = Mock() template.substitute.side_effect = Exception self.grub2.get_multiboot_iso_template = Mock(return_value=template) with raises(KiwiTemplateError): self.bootloader.setup_live_image_config(self.mbrid) def test_setup_install_image_config_substitute_error(self): self.bootloader.multiboot = True template = Mock() template.substitute = Mock() template.substitute.side_effect = Exception self.grub2.get_multiboot_install_template = Mock(return_value=template) with raises(KiwiTemplateError): self.bootloader.setup_install_image_config(self.mbrid) @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_path') @patch('os.path.exists') def test_no_grub_installation_found( self, mock_exists, mock_get_boot_path, mock_command ): mock_get_boot_path.return_value = '/boot' self.os_exists['root_dir/usr/share/grub2/i386-pc'] = False self.os_exists['root_dir/usr/lib/grub2/i386-pc'] = False self.os_exists['root_dir/usr/share/grub/i386-pc'] = False self.os_exists['root_dir/usr/lib/grub/i386-pc'] = False self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = True def side_effect(arg): return self.os_exists[arg] mock_exists.side_effect = side_effect with raises(KiwiBootLoaderGrubDataError): self.bootloader.setup_disk_boot_images('0815') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_path') @patch('os.path.exists') @patch('kiwi.defaults.Defaults.get_grub_path') def test_setup_disk_boot_images_raises_font_does_not_exist( self, mock_get_grub_path, mock_exists, mock_get_boot_path, mock_command ): mock_get_boot_path.return_value = '/boot' self.bootloader.theme = 'some-theme' self.os_exists['root_dir/boot/grub2/fonts/unicode.pf2'] = False self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = False self.os_exists['root_dir/usr/share/grub/unicode.pf2'] = False self.os_exists['root_dir/usr/lib/grub2/unicode.pf2'] = False self.os_exists['root_dir/usr/lib/grub/unicode.pf2'] = False def side_effect(arg): return self.os_exists[arg] mock_exists.side_effect = side_effect mock_command.side_effect = Exception with raises(KiwiBootLoaderGrubFontError): self.bootloader.setup_disk_boot_images('0815') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('os.path.exists') @patch.object(BootLoaderConfigGrub2, '_copy_theme_data_to_boot_directory') def test_setup_disk_boot_images_raises_grub_modules_does_not_exist( self, mock_copy_theme_data, mock_exists, mock_command ): Defaults.set_platform_name('x86_64') mock_exists.return_value = True self.firmware.efi_mode = Mock(return_value=False) mock_command.side_effect = Exception with raises(KiwiBootLoaderGrubModulesError): self.bootloader.setup_disk_boot_images('0815') @patch('kiwi.bootloader.config.grub2.Defaults.get_unsigned_grub_loader') @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_path') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.Path.which') @patch('kiwi.bootloader.config.grub2.DataSync') @patch('os.path.exists') def test_setup_disk_boot_images_xen_guest_efi_image_needs_multiboot( self, mock_exists, mock_sync, mock_Path_which, mock_command, mock_get_boot_path, mock_get_unsigned_grub_loader, ): Defaults.set_platform_name('x86_64') mock_Path_which.return_value = '/path/to/grub2-mkimage' mock_get_boot_path.return_value = '/boot' mock_get_unsigned_grub_loader.return_value = [] self.firmware.efi_mode = Mock(return_value='efi') self.bootloader.xen_guest = True self.os_exists['root_dir/boot/grub2/fonts/unicode.pf2'] = False self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-efi'] = True self.os_exists['root_dir/usr/share/grub2/i386-efi'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-xen'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-efi/linuxefi.mod'] = ( True ) def side_effect(arg): return self.os_exists[arg] mock_exists.side_effect = side_effect with patch('builtins.open'): self.bootloader.setup_disk_boot_images('0815') assert mock_command.call_args_list == [ call( [ 'chroot', 'root_dir', 'grub2-mkimage', '-O', 'x86_64-efi', '-o', '/boot/efi/EFI/BOOT/bootx64.efi', '-c', '/boot/efi/EFI/BOOT/earlyboot.cfg', '-p', '/boot/grub2', '-d', '/usr/share/grub2/x86_64-efi', 'ext2', 'iso9660', 'linux', 'echo', 'configfile', 'search_label', 'search_fs_file', 'search', 'search_fs_uuid', 'ls', 'normal', 'gzio', 'png', 'fat', 'gettext', 'font', 'minicmd', 'gfxterm', 'gfxmenu', 'all_video', 'xfs', 'btrfs', 'squash4', 'lvm', 'luks', 'gcry_rijndael', 'gcry_sha256', 'gcry_sha512', 'crypto', 'cryptodisk', 'test', 'true', 'loadenv', 'multiboot', 'part_gpt', 'part_msdos', 'efi_gop', 'linuxefi', ] ) ] @patch('kiwi.bootloader.config.grub2.Defaults.get_unsigned_grub_loader') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.Path.which') @patch('kiwi.bootloader.config.grub2.DataSync') @patch('os.path.exists') @patch('kiwi.bootloader.config.base.DiskSetup') def test_setup_disk_boot_images_bios_plus_efi( self, mock_DiskSetup, mock_exists, mock_sync, mock_Path_which, mock_command, mock_get_unsigned_grub_loader, ): mock_DiskSetup.return_value.need_boot_partition.return_value = True Defaults.set_platform_name('x86_64') mock_Path_which.return_value = '/path/to/grub2-mkimage' mock_get_unsigned_grub_loader.return_value = [] data = Mock() mock_sync.return_value = data self.firmware.efi_mode = Mock(return_value='efi') self.os_exists['root_dir/grub2/fonts/unicode.pf2'] = False self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = True self.os_exists['root_dir/usr/share/grub2/i386-pc'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-efi'] = True self.os_exists['root_dir/usr/share/grub2/i386-efi'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-efi/linuxefi.mod'] = ( True ) def side_effect(arg): return self.os_exists[arg] mock_exists.side_effect = side_effect with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader.setup_disk_boot_images('0815') mock_open.assert_called_once_with( 'root_dir/boot/efi/EFI/BOOT/earlyboot.cfg', 'w' ) assert file_handle.write.call_args_list == [ call('set btrfs_relative_path="yes"\n'), call('insmod cryptodisk\n'), call('insmod luks\n'), call('cryptomount -u 0815\n'), call('set root="cryptouuid/0815"\n'), call('search --fs-uuid --set=root 0815\n'), call('set prefix=($root)/grub2\n'), call('source ($root)/grub2/grub.cfg\n'), ] assert mock_command.call_args_list == [ call( [ 'chroot', 'root_dir', 'grub2-mkimage', '-O', 'x86_64-efi', '-o', '/boot/efi/EFI/BOOT/bootx64.efi', '-c', '/boot/efi/EFI/BOOT/earlyboot.cfg', '-p', '/grub2', '-d', '/usr/share/grub2/x86_64-efi', 'ext2', 'iso9660', 'linux', 'echo', 'configfile', 'search_label', 'search_fs_file', 'search', 'search_fs_uuid', 'ls', 'normal', 'gzio', 'png', 'fat', 'gettext', 'font', 'minicmd', 'gfxterm', 'gfxmenu', 'all_video', 'xfs', 'btrfs', 'squash4', 'lvm', 'luks', 'gcry_rijndael', 'gcry_sha256', 'gcry_sha512', 'crypto', 'cryptodisk', 'test', 'true', 'loadenv', 'part_gpt', 'part_msdos', 'efi_gop', 'linuxefi', ] ) ] assert mock_sync.call_args_list == [ call( 'root_dir/usr/share/grub2/i386-pc/', 'root_dir/boot/grub2/i386-pc', ), call( 'root_dir/usr/share/grub2/x86_64-efi/', 'root_dir/boot/grub2/x86_64-efi', ), call( 'root_dir/usr/share/grub2/i386-efi/', 'root_dir/boot/grub2/i386-efi', ), ] assert data.sync_data.call_args_list == [ call(exclude=['*.module'], options=['-a']), call(exclude=['*.module'], options=['-a']), call(exclude=['*.module'], options=['-a']), ] mock_get_unsigned_grub_loader.return_value = [ grub_loader_type( 'custom_grub_image', 'some-binaryname', 'bootx64.efi' ) ] mock_command.reset_mock() with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader.setup_disk_boot_images('0815') assert file_handle.write.call_args_list == [ call('set btrfs_relative_path="yes"\n'), call('insmod cryptodisk\n'), call('insmod luks\n'), call('cryptomount -u 0815\n'), call('set root="cryptouuid/0815"\n'), call('search --fs-uuid --set=root 0815\n'), call('set prefix=($root)/grub2\n'), call('source ($root)/grub2/grub.cfg\n'), ] mock_open.assert_called_once_with( 'root_dir/boot/efi/EFI/BOOT/grub.cfg', 'w' ) assert mock_command.call_args_list == [ call( [ 'cp', 'custom_grub_image', 'root_dir/boot/efi/EFI/BOOT/bootx64.efi', ] ) ] self.state.get_dracut_config = Mock( return_value=DracutT(uefi=True, modules=[], drivers=[]) ) with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader.setup_disk_boot_images('0815', '0815') assert file_handle.write.call_args_list == [ call('search --no-floppy --set=root --fs-uuid 0815\n'), call('chainloader ($root)/EFI/Linux/kiwi.efi\n'), call('boot\n'), ] mock_open.assert_called_once_with( 'root_dir/boot/efi/EFI/BOOT/grub.cfg', 'w' ) @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_path') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.DataSync') @patch('os.path.exists') def test_setup_disk_boot_images_xen_guest( self, mock_exists, mock_sync, mock_command, mock_get_boot_path ): Defaults.set_platform_name('x86_64') mock_get_boot_path.return_value = '/boot' self.firmware.efi_mode = Mock(return_value='') self.bootloader.xen_guest = True self.os_exists['root_dir/boot/grub2/fonts/unicode.pf2'] = False self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-xen'] = True def side_effect(arg): return self.os_exists[arg] mock_exists.side_effect = side_effect self.bootloader.setup_disk_boot_images('0815') assert not mock_command.called mock_sync.assert_called_once_with( 'root_dir/usr/share/grub2/x86_64-xen/', 'root_dir/boot/grub2/x86_64-xen', ) @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_path') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.DataSync') @patch('os.path.exists') def test_setup_disk_boot_images_ppc( self, mock_exists, mock_sync, mock_command, mock_get_boot_path ): Defaults.set_platform_name('ppc64le') mock_get_boot_path.return_value = '/boot' self.bootloader.arch = 'ppc64le' self.firmware.efi_mode = Mock(return_value='') self.bootloader.xen_guest = False self.os_exists['root_dir/boot/grub2/fonts/unicode.pf2'] = False self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = True def side_effect(arg): return self.os_exists[arg] mock_exists.side_effect = side_effect self.bootloader.setup_disk_boot_images('0815') assert not mock_command.called @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_path') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.DataSync') @patch('os.path.exists') def test_setup_disk_boot_images_s390( self, mock_exists, mock_sync, mock_command, mock_get_boot_path ): Defaults.set_platform_name('s390x') mock_get_boot_path.return_value = '/boot' self.bootloader.arch = 's390x' self.firmware.efi_mode = Mock(return_value='') self.bootloader.xen_guest = False self.os_exists['root_dir/boot/grub2/fonts/unicode.pf2'] = False self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = True def side_effect(arg): return self.os_exists[arg] mock_exists.side_effect = side_effect self.bootloader.setup_disk_boot_images('0815') assert not mock_command.called @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_path') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('os.path.exists') @patch('os.chmod') @patch('os.stat') def test_setup_disk_boot_images_bios_plus_efi_secure_boot( self, mock_stat, mock_chmod, mock_exists, mock_command, mock_get_boot_path, ): Defaults.set_platform_name('x86_64') mock_get_boot_path.return_value = '/boot' self.firmware.efi_mode = Mock(return_value='uefi') self.os_exists['root_dir/usr/share/grub2/i386-pc'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-efi'] = True self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = True def side_effect(arg): return self.os_exists[arg] mock_exists.side_effect = side_effect self.bootloader.setup_disk_boot_images('uuid') with self._caplog.at_level(logging.INFO): assert mock_command.call_args_list == [ call( [ 'rsync', '-a', '--exclude', '/*.module', 'root_dir/usr/share/grub2/i386-pc/', 'root_dir/boot/grub2/i386-pc', ] ) ] @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_path') @patch('kiwi.bootloader.config.grub2.Path.which') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('os.path.exists') @patch('glob.iglob') @patch('os.chmod') @patch('os.stat') @patch('os.path.isfile') def test_setup_disk_boot_images_bios_plus_efi_secure_boot_no_shim_install( self, mock_isfile, mock_stat, mock_chmod, mock_glob, mock_exists, mock_command, mock_which, mock_get_boot_path, ): # we expect the copy of shim.efi and grub.efi from the fallback # code if no shim_install was found for building the disk image Defaults.set_platform_name('x86_64') mock_get_boot_path.return_value = '/boot' mock_which.return_value = None mock_isfile.return_value = False self.firmware.efi_mode = Mock(return_value='uefi') self.os_exists['root_dir/usr/share/grub2/i386-pc'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-efi'] = True self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = True def side_effect(arg): return self.os_exists[arg] def side_effect_glob(arg): return self.glob_iglob_shim_fallback.pop() mock_glob.side_effect = side_effect_glob mock_exists.side_effect = side_effect with self._caplog.at_level(logging.WARNING): with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader.setup_disk_boot_images('uuid') assert file_handle.write.call_args_list == [ call('set btrfs_relative_path="yes"\n'), call('insmod cryptodisk\n'), call('insmod luks\n'), call('cryptomount -u uuid\n'), call('set root="cryptouuid/uuid"\n'), call('search --fs-uuid --set=root uuid\n'), call('set prefix=($root)/boot/grub2\n'), call('source ($root)/boot/grub2/grub.cfg\n'), ] mock_open.assert_called_once_with( 'root_dir/boot/efi/EFI/BOOT/grub.cfg', 'w' ) assert mock_command.call_args_list == [ call( [ 'rsync', '-a', '--exclude', '/*.module', 'root_dir/usr/share/grub2/i386-pc/', 'root_dir/boot/grub2/i386-pc', ] ), call( [ 'cp', 'root_dir/usr/lib64/efi/grub.efi', 'root_dir/boot/efi/EFI/BOOT/grub.efi', ] ), call( [ 'cp', 'root_dir/usr/lib64/efi/shim.efi', 'root_dir/boot/efi/EFI/BOOT/bootx64.efi', ] ), call( [ 'cp', 'root_dir/usr/lib64/efi/MokManager.efi', 'root_dir/boot/efi/EFI/BOOT', ] ), ] @patch('kiwi.bootloader.config.grub2.Defaults.get_shim_loader') @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_path') @patch('kiwi.bootloader.config.grub2.Path.which') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('os.path.exists') @patch('glob.iglob') @patch('os.chmod') @patch('os.stat') @patch('os.path.isfile') def test_setup_disk_boot_images_bios_plus_efi_secure_boot_no_shim_at_all( self, mock_isfile, mock_stat, mock_chmod, mock_glob, mock_exists, mock_command, mock_which, mock_get_boot_path, mock_get_shim_loader, ): # we expect the copy of grub.efi from the fallback # code if no shim was found at all mock_get_shim_loader.return_value = [] Defaults.set_platform_name('x86_64') mock_get_boot_path.return_value = '/boot' mock_which.return_value = None mock_isfile.return_value = False self.firmware.efi_mode = Mock(return_value='uefi') self.os_exists['root_dir/usr/share/grub2/i386-pc'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-efi'] = True self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = True def side_effect(arg): return self.os_exists[arg] def side_effect_glob(arg): return self.glob_iglob_noshim_fallback.pop() mock_glob.side_effect = side_effect_glob mock_exists.side_effect = side_effect with self._caplog.at_level(logging.WARNING): with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader.setup_disk_boot_images('uuid') assert file_handle.write.call_args_list == [ call('set btrfs_relative_path="yes"\n'), call('insmod cryptodisk\n'), call('insmod luks\n'), call('cryptomount -u uuid\n'), call('set root="cryptouuid/uuid"\n'), call('search --fs-uuid --set=root uuid\n'), call('set prefix=($root)/boot/grub2\n'), call('source ($root)/boot/grub2/grub.cfg\n'), ] mock_open.assert_called_once_with( 'root_dir/boot/efi/EFI/BOOT/grub.cfg', 'w' ) assert mock_command.call_args_list == [ call( [ 'rsync', '-a', '--exclude', '/*.module', 'root_dir/usr/share/grub2/i386-pc/', 'root_dir/boot/grub2/i386-pc', ] ), call( [ 'cp', 'root_dir/usr/lib64/efi/grub.efi', 'root_dir/boot/efi/EFI/BOOT/bootx64.efi', ] ), ] @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_path') @patch('kiwi.bootloader.config.grub2.Defaults.get_unsigned_grub_loader') @patch( 'kiwi.bootloader.config.grub2.Defaults.get_grub_platform_core_loader' ) @patch('kiwi.bootloader.config.grub2.Defaults.get_grub_chrp_loader') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.Path.which') @patch('kiwi.bootloader.config.grub2.Path.create') @patch('kiwi.bootloader.config.grub2.DataSync') @patch('os.path.exists') @patch('shutil.copy2') def test_setup_install_boot_images_ppc( self, mock_shutil_copy2, mock_exists, mock_sync, mock_Path_create, mock_Path_which, mock_command, mock_get_grub_chrp_loader, mock_get_grub_platform_core_loader, mock_get_unsigned_grub_loader, mock_get_boot_path, ): Defaults.set_platform_name('ppc64le') mock_get_grub_chrp_loader.return_value = 'grub.elf' mock_get_grub_platform_core_loader.return_value = None mock_Path_which.return_value = '/path/to/grub2-mkimage' mock_get_boot_path.return_value = '/boot' self.bootloader.arch = 'ppc64le' data = Mock() mock_sync.return_value = data self.firmware.efi_mode = Mock(return_value='') # simulate alternative boot directory to reach all code paths self.bootloader.boot_dir = 'boot_dir' self.os_exists['lookup_dir/usr/share/grub2/powerpc-ieee1275'] = True self.os_exists['lookup_dir/usr/share/grub2/unicode.pf2'] = True self.os_exists['boot_dir/boot/grub2/fonts/unicode.pf2'] = False self.os_exists['boot_dir/usr/share/grub2/unicode.pf2'] = True def side_effect(arg): return self.os_exists[arg] mock_exists.side_effect = side_effect with open('../data/bootinfo.txt') as chrp: grub2_test_chrp_boot = chrp.read() with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader.setup_install_boot_images( mbrid=self.mbrid, lookup_path="lookup_dir" ) assert mock_open.call_args_list == [ call('boot_dir/boot/grub2/earlyboot.cfg', 'w'), call('boot_dir/boot/grub2/powerpc-ieee1275/grub.cfg', 'w'), call('boot_dir/ppc/bootinfo.txt', 'w'), call('boot_dir/boot/grub2/loopback.cfg', 'w'), ] assert file_handle.write.call_args_list == [ call('set btrfs_relative_path="yes"\n'), call('search --file --set=root /boot/0xffffffff\n'), call('set prefix=($root)/boot/grub2\n'), call('source ($root)/boot/grub2/grub.cfg\n'), call('set btrfs_relative_path="yes"\n'), call('search --file --set=root /boot/0xffffffff\n'), call('set prefix=($root)/boot/grub2\n'), call('source ($root)/boot/grub2/grub.cfg\n'), call(grub2_test_chrp_boot), call('source /boot/grub2/grub.cfg\n'), ] assert mock_command.call_args_list == [ call( [ 'chroot', 'root_dir', 'grub2-mkimage', '-O', 'powerpc-ieee1275', '-o', '/usr/share/grub2/powerpc-ieee1275/grub.elf', '-c', '/boot/grub2/earlyboot.cfg', '-p', '/boot/grub2', '-d', '/usr/share/grub2/powerpc-ieee1275', 'ext2', 'iso9660', 'linux', 'echo', 'configfile', 'search_label', 'search_fs_file', 'search', 'search_fs_uuid', 'ls', 'normal', 'gzio', 'png', 'fat', 'gettext', 'font', 'minicmd', 'gfxterm', 'gfxmenu', 'all_video', 'xfs', 'btrfs', 'squash4', 'lvm', 'luks', 'gcry_rijndael', 'gcry_sha256', 'gcry_sha512', 'crypto', 'cryptodisk', 'test', 'true', 'loadenv', 'part_gpt', 'part_msdos', 'boot', ] ) ] @patch('kiwi.bootloader.config.base.BootLoaderConfigBase.get_boot_path') @patch('kiwi.bootloader.config.grub2.Defaults.get_unsigned_grub_loader') @patch( 'kiwi.bootloader.config.grub2.Defaults.get_grub_platform_core_loader' ) @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.Path.which') @patch('kiwi.bootloader.config.grub2.Path.create') @patch('kiwi.bootloader.config.grub2.DataSync') @patch('os.path.exists') @patch('shutil.copy2') def test_setup_install_boot_images_efi( self, mock_shutil_copy2, mock_exists, mock_sync, mock_Path_create, mock_Path_which, mock_command, mock_get_grub_platform_core_loader, mock_get_unsigned_grub_loader, mock_get_boot_path, ): Defaults.set_platform_name('x86_64') mock_Path_which.return_value = '/path/to/grub2-mkimage' mock_get_boot_path.return_value = '/boot' mock_get_unsigned_grub_loader.return_value = [] mock_get_grub_platform_core_loader.return_value = None data = Mock() mock_sync.return_value = data self.firmware.efi_mode = Mock(return_value='efi') # simulate alternative boot directory to reach all code paths self.bootloader.boot_dir = 'boot_dir' self.os_exists['boot_dir/boot/grub2/fonts/unicode.pf2'] = False self.os_exists['boot_dir/usr/share/grub2/unicode.pf2'] = True self.os_exists['root_dir/usr/share/grub2/i386-pc'] = True self.os_exists['boot_dir/usr/share/grub2/i386-pc'] = True self.os_exists['boot_dir/usr/share/grub2/i386-efi'] = True self.os_exists['/usr/share/grub2/i386-pc'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-efi'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-efi/linuxefi.mod'] = ( True ) self.os_exists['root_dir/boot/efi/'] = False self.os_exists['boot_dir/boot/efi/'] = False self.os_exists['lookup_dir/usr/share/grub2/x86_64-efi'] = True self.os_exists['lookup_dir/usr/share/grub2/i386-efi'] = True self.os_exists['lookup_dir/usr/share/grub2/i386-pc'] = True self.os_exists['lookup_dir/usr/share/grub2/unicode.pf2'] = True self.os_exists['lookup_dir/boot/efi/'] = False self.os_exists['boot_dir/usr/share/grub2/x86_64-efi'] = True def side_effect(arg): return self.os_exists[arg] mock_exists.side_effect = side_effect with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader.setup_install_boot_images( mbrid=self.mbrid, lookup_path="lookup_dir" ) assert mock_open.call_args_list == [ call('boot_dir/boot/grub2/earlyboot.cfg', 'w'), call('boot_dir/EFI/BOOT/earlyboot.cfg', 'w'), call('boot_dir/boot/grub2/loopback.cfg', 'w'), ] assert file_handle.write.call_args_list == [ call('set btrfs_relative_path="yes"\n'), call('search --file --set=root /boot/0xffffffff\n'), call('set prefix=($root)/boot/grub2\n'), call('source ($root)/boot/grub2/grub.cfg\n'), call('set btrfs_relative_path="yes"\n'), call('search --file --set=root /boot/0xffffffff\n'), call('set prefix=($root)/boot/grub2\n'), call('source ($root)/boot/grub2/grub.cfg\n'), call('source /boot/grub2/grub.cfg\n'), ] assert mock_Path_create.call_args_list == [ call('boot_dir/boot/grub2'), call('boot_dir/boot/grub2/i386-pc'), call('root_dir/boot/grub2'), call('lookup_dir/usr/share/grub2/i386-pc'), call('root_dir/boot/efi/EFI/BOOT/'), call('boot_dir/EFI/BOOT'), call('boot_dir/boot/grub2/x86_64-efi'), call('boot_dir/boot/grub2/i386-efi'), ] assert mock_command.call_args_list == [ call( [ 'chroot', 'root_dir', 'grub2-mkimage', '-O', 'i386-pc', '-o', '/usr/share/grub2/i386-pc/core.img', '-c', '/boot/grub2/earlyboot.cfg', '-p', '/boot/grub2', '-d', '/usr/share/grub2/i386-pc', 'ext2', 'iso9660', 'linux', 'echo', 'configfile', 'search_label', 'search_fs_file', 'search', 'search_fs_uuid', 'ls', 'normal', 'gzio', 'png', 'fat', 'gettext', 'font', 'minicmd', 'gfxterm', 'gfxmenu', 'all_video', 'xfs', 'btrfs', 'squash4', 'lvm', 'luks', 'gcry_rijndael', 'gcry_sha256', 'gcry_sha512', 'crypto', 'cryptodisk', 'test', 'true', 'loadenv', 'part_gpt', 'part_msdos', 'biosdisk', 'vga', 'vbe', 'chain', 'boot', ] ), call( [ 'bash', '-c', 'cat lookup_dir/usr/share/grub2/i386-pc/' 'cdboot.img lookup_dir/usr/share/grub2/i386-pc/core.img > ' 'lookup_dir/usr/share/grub2/i386-pc/eltorito.img', ] ), call( [ 'chroot', 'root_dir', 'grub2-mkimage', '-O', 'x86_64-efi', '-o', '/boot/efi/EFI/BOOT/bootx64.efi', '-c', '/boot/efi/EFI/BOOT/earlyboot.cfg', '-p', '/boot/grub2', '-d', '/usr/share/grub2/x86_64-efi', 'ext2', 'iso9660', 'linux', 'echo', 'configfile', 'search_label', 'search_fs_file', 'search', 'search_fs_uuid', 'ls', 'normal', 'gzio', 'png', 'fat', 'gettext', 'font', 'minicmd', 'gfxterm', 'gfxmenu', 'all_video', 'xfs', 'btrfs', 'squash4', 'lvm', 'luks', 'gcry_rijndael', 'gcry_sha256', 'gcry_sha512', 'crypto', 'cryptodisk', 'test', 'true', 'loadenv', 'part_gpt', 'part_msdos', 'efi_gop', 'linuxefi', ] ), ] assert mock_sync.call_args_list == [ call( 'lookup_dir/usr/share/grub2/i386-pc/', 'boot_dir/boot/grub2/i386-pc', ), call( 'lookup_dir/usr/share/grub2/x86_64-efi/', 'boot_dir/boot/grub2/x86_64-efi', ), call( 'lookup_dir/usr/share/grub2/i386-efi/', 'boot_dir/boot/grub2/i386-efi', ), ] assert data.sync_data.call_args_list == [ call(exclude=['*.module'], options=['-a']), call(exclude=['*.module'], options=['-a']), call(exclude=['*.module'], options=['-a']), ] assert mock_shutil_copy2.call_args_list == [ call( 'boot_dir/boot/grub2/earlyboot.cfg', 'root_dir/boot/grub2/earlyboot.cfg', ), call( 'root_dir/usr/share/grub2/i386-pc/core.img', 'lookup_dir/usr/share/grub2/i386-pc/core.img', ), call( 'boot_dir/EFI/BOOT/earlyboot.cfg', 'root_dir/boot/efi/EFI/BOOT/earlyboot.cfg', ), call( 'root_dir/boot/efi/EFI/BOOT/bootx64.efi', 'boot_dir/EFI/BOOT/bootx64.efi', ), ] mock_get_unsigned_grub_loader.return_value = [ grub_loader_type( 'custom_grub_image', 'some-binaryname', 'bootx64.efi' ) ] mock_get_grub_platform_core_loader.return_value = ( 'custom_bios_grub_image' ) mock_command.reset_mock() with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader.setup_install_boot_images(self.mbrid) assert file_handle.write.call_args_list == [ call('set btrfs_relative_path="yes"\n'), call('search --file --set=root /boot/0xffffffff\n'), call('set prefix=($root)/boot/grub2\n'), call('source ($root)/boot/grub2/grub.cfg\n'), call('source /boot/grub2/grub.cfg\n'), ] assert mock_open.call_args_list == [ call('boot_dir/EFI/BOOT/grub.cfg', 'w'), call('boot_dir/boot/grub2/loopback.cfg', 'w'), ] assert mock_command.call_args_list == [ call( [ 'bash', '-c', 'cat boot_dir/usr/share/grub2/i386-pc/' 'cdboot.img custom_bios_grub_image > ' 'boot_dir/usr/share/grub2/i386-pc/eltorito.img', ] ), call(['cp', 'custom_grub_image', 'boot_dir/EFI/BOOT/bootx64.efi']), ] with patch('builtins.open', create=True) as mock_open: # Test fallback search for earlyboot if UUID and MBR ID are missing mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader._setup_efi_image(uuid=None, mbrid=None) assert file_handle.write.call_args_list == [ call('set btrfs_relative_path="yes"\n'), call('search --file --set=root /boot/mbrid\n'), call('set prefix=($root)/boot/grub2\n'), call('source ($root)/boot/grub2/grub.cfg\n'), ] mock_get_unsigned_grub_loader.return_value = [] self.state.get_dracut_config = Mock( return_value=DracutT(uefi=True, modules=[], drivers=[]) ) with patch('builtins.open', create=True) as mock_open: # Test UKI chainloader for earlyboot mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader._setup_efi_image(efi_uuid='0815') assert file_handle.write.call_args_list == [ call('search --no-floppy --set=root --fs-uuid 0815\n'), call('chainloader ($root)/EFI/Linux/kiwi.efi\n'), call('boot\n'), ] @patch.object(BootLoaderConfigGrub2, '_supports_platform_modules') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('os.path.exists') @patch('glob.iglob') @patch('os.chmod') @patch('os.stat') @patch('os.path.isfile') def test_setup_install_boot_images_efi_secure_boot( self, mock_isfile, mock_stat, mock_chmod, mock_glob, mock_exists, mock_command, mock_supports_platform_modules, ): Defaults.set_platform_name('x86_64') mock_supports_platform_modules.return_value = False mock_isfile.return_value = False self.os_exists['root_dir'] = True self.firmware.efi_mode = Mock(return_value='uefi') self.os_exists['root_dir/usr/share/grub2/i386-pc'] = True self.os_exists['root_dir/usr/share/grub2/x86_64-efi'] = True self.os_exists['root_dir/usr/share/grub2/unicode.pf2'] = True def side_effect_exists(arg): return self.os_exists[arg] def side_effect_glob(arg): return self.glob_iglob_shim_iso.pop() mock_glob.side_effect = side_effect_glob mock_exists.side_effect = side_effect_exists with self._caplog.at_level(logging.INFO): with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader.setup_install_boot_images( self.mbrid, 'root_dir' ) assert file_handle.write.call_args_list == [ call('set btrfs_relative_path="yes"\n'), call('search --file --set=root /boot/0xffffffff\n'), call('set prefix=($root)/boot/grub2\n'), call('source ($root)/boot/grub2/grub.cfg\n'), call('source /boot/grub2/grub.cfg\n'), ] assert mock_open.call_args_list == [ call('root_dir/EFI/BOOT/grub.cfg', 'w'), call('root_dir/boot/grub2/loopback.cfg', 'w'), ] assert mock_command.call_args_list == [ call(['rsync', '-a', 'root_dir/boot/efi/', 'root_dir']), call( [ 'cp', 'root_dir/usr/lib64/efi/grub.efi', 'root_dir/EFI/BOOT/grubx64.efi', ] ), call( [ 'cp', 'root_dir/usr/lib64/efi/shim.efi', 'root_dir/EFI/BOOT/bootx64.efi', ] ), call( [ 'cp', 'root_dir/usr/lib64/efi/MokManager.efi', 'root_dir/EFI/BOOT', ] ), ] @patch('kiwi.defaults.Defaults.get_grub_efi_font_directory') @patch.object(BootLoaderConfigGrub2, '_supports_platform_modules') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.DataSync') @patch('os.path.exists') @patch('glob.iglob') def test_setup_install_boot_images_with_theme_from_usr_share( self, mock_glob, mock_exists, mock_sync, mock_command, mock_supports_platform_modules, mock_get_grub_efi_font_directory, ): Defaults.set_platform_name('x86_64') mock_get_grub_efi_font_directory.return_value = ( 'root_dir/boot/efi/EFI/DIST/fonts' ) mock_supports_platform_modules.return_value = False mock_glob.return_value = [ 'root_dir/boot/grub2/themes/some-theme/background.png' ] data = Mock() mock_sync.return_value = data self.bootloader.theme = 'some-theme' self.os_exists['lookup_path/usr/share/grub2'] = True self.os_exists['lookup_path/usr/lib/grub2'] = True self.os_exists['lookup_path/usr/share/grub2/i386-pc'] = True self.os_exists['lookup_path/usr/share/grub2/themes/some-theme'] = True self.os_exists['lookup_path/boot/grub2/themes/some-theme'] = True self.os_exists['root_dir/boot/grub2/themes/some-theme'] = True self.os_exists['lookup_path/usr/share/grub2/unicode.pf2'] = True def side_effect(arg): return self.os_exists[arg] mock_exists.side_effect = side_effect with patch('builtins.open'): self.bootloader.setup_install_boot_images( self.mbrid, lookup_path='lookup_path' ) assert mock_command.call_args_list == [ call( [ 'cp', 'lookup_path/usr/share/grub2/unicode.pf2', 'root_dir/boot/efi/EFI/DIST/fonts', ] ), call( [ 'cp', 'root_dir/boot/grub2/themes/some-theme/background.png', 'root_dir/background.png', ] ), call( [ 'mv', 'root_dir/background.png', 'root_dir/boot/grub2/themes/some-theme', ] ), ] assert mock_sync.call_args_list[0] == call( 'lookup_path/usr/share/grub2/themes/some-theme', 'root_dir/boot/grub2/themes', ) assert data.sync_data.call_args_list[0] == call(options=['-a']) @patch('kiwi.defaults.Defaults.get_grub_efi_font_directory') @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.DataSync') @patch('os.path.exists') @patch('glob.iglob') @patch('kiwi.defaults.Defaults.get_grub_path') def test_setup_install_boot_images_with_theme_from_boot( self, mock_get_grub_path, mock_glob, mock_exists, mock_sync, mock_command, mock_get_grub_efi_font_directory, ): Defaults.set_platform_name('x86_64') mock_get_grub_efi_font_directory.return_value = None mock_glob.return_value = [ 'lookup_path/boot/grub2/themes/some-theme/background.png' ] data = Mock() mock_sync.return_value = data self.bootloader.theme = 'some-theme' self.os_exists['root_dir/boot/grub2/themes/some-theme'] = True self.os_exists['some-theme'] = False self.find_grub['themes/some-theme'] = 'some-theme' self.find_grub['i386-pc'] = 'i386-pc' self.find_grub['unicode.pf2'] = True def find_grub_data_side_effect( root_path, filename, raise_on_error=True ): return self.find_grub[filename] def side_effect(arg): return self.os_exists[arg] mock_get_grub_path.side_effect = find_grub_data_side_effect mock_exists.side_effect = side_effect with patch('builtins.open'): self.bootloader.setup_install_boot_images( self.mbrid, lookup_path='lookup_path' ) assert mock_sync.call_args_list[0] == call( 'lookup_path/boot/grub2/themes/some-theme', 'root_dir/boot/grub2/themes', ) assert data.sync_data.call_args_list[0] == call(options=['-a']) @patch('kiwi.bootloader.config.grub2.Command.run') @patch('kiwi.bootloader.config.grub2.Path.which') @patch('kiwi.bootloader.config.grub2.DataSync') @patch('os.path.exists') @patch('kiwi.defaults.Defaults.get_grub_path') @patch('shutil.copy2') @patch('os.path.isfile') def test_setup_install_boot_images_with_theme_not_existing( self, mock_os_path_isfile, mock_shutil_copy2, mock_get_grub_path, mock_exists, mock_sync, mock_Path_which, mock_command, ): Defaults.set_platform_name('x86_64') mock_os_path_isfile.return_value = False mock_Path_which.return_value = '/path/to/grub2-mkimage' self.bootloader.theme = 'some-theme' mock_get_grub_path.return_value = 'theme-dir' self.os_exists['theme-dir'] = False self.os_exists['root_dir/boot/grub2/themes/some-theme'] = False def os_path_exists(arg): return bool(self.os_exists.get(arg)) mock_exists.side_effect = os_path_exists with patch('builtins.open'): with self._caplog.at_level(logging.WARNING): self.bootloader.setup_install_boot_images(self.mbrid) assert self.bootloader.terminal_input == 'console' assert self.bootloader.terminal_output == 'console' @patch.object(BootLoaderConfigGrub2, 'setup_install_boot_images') def test_setup_live_boot_images(self, mock_setup_install_boot_images): self.bootloader.setup_live_boot_images(self.mbrid) mock_setup_install_boot_images.assert_called_once_with(self.mbrid, None) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7631934 kiwi-11.1.8/test/unit/bootloader/config/init_test.py0000644000000000000000000000467615273675667017451 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.exceptions import KiwiBootLoaderConfigSetupError from kiwi.bootloader.config import create_boot_loader_config class TestBootLoaderConfig: def test_bootloader_config_not_implemented(self): with raises(KiwiBootLoaderConfigSetupError): create_boot_loader_config( name='foo', xml_state=Mock(), root_dir='root_dir' ) @patch('kiwi.bootloader.config.grub2.BootLoaderConfigGrub2') def test_bootloader_config_grub2(self, mock_grub2): xml_state = Mock() for name in ("grub2", "grub2_s390x_emu"): create_boot_loader_config( name=name, xml_state=xml_state, root_dir='root_dir' ) mock_grub2.assert_called_once_with(xml_state, 'root_dir', None, {}) mock_grub2.reset_mock() # given custom arguments are passed as they are custom_args = {'grub_load_command': 'configfile'} create_boot_loader_config( name='grub2', xml_state=xml_state, root_dir='root_dir', custom_args=custom_args, ) assert mock_grub2.call_args[0][3] is custom_args @patch('kiwi.bootloader.config.systemd_boot.BootLoaderSystemdBoot') def test_bootloader_config_systemd_boot(self, mock_systemd_boot): xml_state = Mock() create_boot_loader_config( name='systemd_boot', xml_state=xml_state, root_dir='root_dir', boot_dir='boot_dir', ) mock_systemd_boot.assert_called_once_with( xml_state, 'root_dir', 'boot_dir', {} ) @patch('kiwi.bootloader.config.zipl.BootLoaderZipl') @patch('kiwi.bootloader.config.bootloader_spec_base.FirmWare') def test_bootloader_config_zipl(self, mock_FirmWare, mock_zipl): xml_state = Mock() create_boot_loader_config( name='zipl', xml_state=xml_state, root_dir='root_dir', boot_dir='boot_dir', ) mock_zipl.assert_called_once_with(xml_state, 'root_dir', 'boot_dir', {}) @patch('kiwi.bootloader.config.custom.BootLoaderConfigCustom') def test_bootloader_config_custom(self, mock_custom): xml_state = Mock() create_boot_loader_config( name='custom', xml_state=xml_state, root_dir='root_dir' ) mock_custom.assert_called_once_with(xml_state, 'root_dir', None, {}) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7631934 kiwi-11.1.8/test/unit/bootloader/config/systemd_boot_test.py0000644000000000000000000003426515273675667021216 0ustar00import io from pytest import raises from unittest.mock import Mock, patch, call, MagicMock from kiwi.bootloader.config.systemd_boot import BootLoaderSystemdBoot from kiwi.xml_state import DracutT from kiwi.exceptions import ( KiwiTemplateError, KiwiBootLoaderTargetError, KiwiKernelLookupError, ) class TestBootLoaderSystemdBoot: @patch('kiwi.bootloader.config.bootloader_spec_base.FirmWare') def setup(self, mock_FirmWare): self.state = Mock() self.boot_image = Mock() self.state.xml_data.get_name.return_value = 'image-name' self.state.get_image_version.return_value = 'image-version' self.state.get_dracut_config.return_value = DracutT( uefi=False, modules=[], drivers=[] ) self.state.build_type.get_efifatimagesize.return_value = None self.state.get_build_type_bootloader_kernel_flavors.return_value = [] self.bootloader = BootLoaderSystemdBoot(self.state, 'root_dir') self.bootloader.custom_args['kernel'] = None self.bootloader.custom_args['initrd'] = None self.bootloader.custom_args['boot_options'] = { 'boot_image': self.boot_image } self.bootloader.root_mount = Mock(mountpoint='system_root_mount') self.bootloader._mount_system = Mock() self.bootloader.create_efi_path = Mock() self.bootloader.get_boot_path = Mock(return_value='bootpath') self.bootloader.get_menu_entry_title = Mock(return_value='title') @patch('kiwi.bootloader.config.bootloader_spec_base.FirmWare') def setup_method(self, cls, mock_FirmWare): self.setup() def test_setup_loader_raises_invalid_target(self): with raises(KiwiBootLoaderTargetError): self.bootloader.setup_loader('iso') @patch('os.path.exists') @patch('kiwi.bootloader.config.systemd_boot.OsRelease') @patch('kiwi.bootloader.config.systemd_boot.Kernel') @patch('kiwi.bootloader.config.systemd_boot.BootImageBase.get_boot_names') @patch('kiwi.bootloader.config.systemd_boot.Path.wipe') @patch('kiwi.bootloader.config.systemd_boot.Path.create') @patch('kiwi.bootloader.config.systemd_boot.Command.run') @patch('kiwi.bootloader.config.systemd_boot.BootLoaderTemplateSystemdBoot') @patch.object(BootLoaderSystemdBoot, '_write_config_file') @patch.object(BootLoaderSystemdBoot, '_get_template_parameters') @patch.object(BootLoaderSystemdBoot, '_write_kernel_cmdline_file') def test_setup_loader( self, mock_write_kernel_cmdline_file, mock_get_template_parameters, mock_write_config_file, mock_BootLoaderTemplateSystemdBoot, mock_Command_run, mock_Path_create, mock_Path_wipe, mock_BootImageBase_get_boot_names, mock_Kernel, mock_OsRelease, mock_os_path_exists, ): mock_Kernel.return_value.get_kernel.return_value.version = ( '5.3.18-59.10-default' ) os_release = Mock() os_release.get.return_value = 'opensuse-leap' mock_OsRelease.return_value = os_release kernel_info = Mock() kernel_info.kernel_version = 'kernel-version' kernel_info.kernel_filename = 'kernel-filename' kernel_info.initrd_name = 'initrd-name' mock_os_path_exists.return_value = True mock_BootImageBase_get_boot_names.return_value = kernel_info self.bootloader.setup_loader('disk') assert mock_write_config_file.call_args_list == [ call( mock_BootLoaderTemplateSystemdBoot.return_value.get_loader_template.return_value, 'system_root_mount/boot/efi/loader/loader.conf', mock_get_template_parameters.return_value, ), call( mock_BootLoaderTemplateSystemdBoot.return_value.get_entry_template.return_value, 'system_root_mount/boot/efi/loader/entries/' 'opensuse-leap-5.3.18-59.10-default.conf', mock_get_template_parameters.return_value, ), ] assert self.bootloader._mount_system.called mock_write_kernel_cmdline_file.assert_called_once_with( 'system_root_mount' ) assert mock_Command_run.call_args_list == [ call( [ 'chroot', 'system_root_mount', 'bootctl', 'install', '--esp-path=/boot/efi', '--no-variables', '--entry-token', 'os-id', ] ), call(['cp', 'kernel-filename', 'system_root_mount/boot/efi/os']), call( [ 'cp', 'system_root_mount/boot/initrd-name', 'system_root_mount/boot/efi/os', ] ), ] mock_Command_run.reset_mock() self.state.get_dracut_config.return_value = DracutT( uefi=True, modules=[], drivers=[] ) self.bootloader.setup_loader('disk') assert mock_Command_run.call_args_list == [ call( [ 'chroot', 'system_root_mount', 'bootctl', 'install', '--esp-path=/boot/efi', '--no-variables', '--entry-token', 'os-id', ] ), call( [ 'mv', self.boot_image.create_uki.return_value, 'system_root_mount/boot/efi/EFI/Linux/', ] ), ] @patch('kiwi.bootloader.config.systemd_boot.OsRelease') @patch('kiwi.bootloader.config.systemd_boot.Kernel') @patch('kiwi.bootloader.config.systemd_boot.BootImageBase') @patch('kiwi.bootloader.config.systemd_boot.Path.create') @patch('kiwi.bootloader.config.systemd_boot.Command.run') @patch.object(BootLoaderSystemdBoot, '_write_config_file') @patch.object(BootLoaderSystemdBoot, '_write_kernel_cmdline_file') def test_setup_loader_with_kernel_flavors( self, mock_write_kernel_cmdline_file, mock_write_config_file, mock_Command_run, mock_Path_create, mock_BootImageBase, mock_Kernel, mock_OsRelease, ): self.state.get_build_type_bootloader_kernel_flavors.return_value = [ 'rt', 'default', ] versions = {'rt': '6.4.0-3-rt', 'default': '6.4.0-9-default'} def get_kernel(raise_on_not_found, flavor): return Mock(version=versions[flavor]) def get_boot_names(flavor): return Mock( kernel_filename=f'system_root_mount/boot/vmlinuz-{versions[flavor]}', initrd_name=f'initrd-{versions[flavor]}', ) mock_Kernel.return_value.get_kernel.side_effect = get_kernel mock_BootImageBase.return_value.get_boot_names.side_effect = ( get_boot_names ) mock_OsRelease.return_value.get.return_value = 'opensuse' self.bootloader.timeout = 10 self.bootloader.setup_loader('disk') assert mock_Command_run.call_args_list[1:] == [ call( [ 'cp', 'system_root_mount/boot/vmlinuz-6.4.0-3-rt', 'system_root_mount/boot/efi/os', ] ), call( [ 'cp', 'system_root_mount/boot/initrd-6.4.0-3-rt', 'system_root_mount/boot/efi/os', ] ), call( [ 'cp', 'system_root_mount/boot/vmlinuz-6.4.0-9-default', 'system_root_mount/boot/efi/os', ] ), call( [ 'cp', 'system_root_mount/boot/initrd-6.4.0-9-default', 'system_root_mount/boot/efi/os', ] ), ] # the loader config selects the entry of the first flavor loader_template, loader_file, loader_parameters = ( mock_write_config_file.call_args_list[0][0] ) assert loader_file == 'system_root_mount/boot/efi/loader/loader.conf' assert loader_template.substitute(loader_parameters).endswith( 'timeout 10\ndefault opensuse-6.4.0-3-rt.conf\n' ) entries = [ (entry_call[0][1], entry_call[0][0].substitute(entry_call[0][2])) for entry_call in mock_write_config_file.call_args_list[1:] ] assert entries == [ ( 'system_root_mount/boot/efi/loader/entries/' 'opensuse-6.4.0-3-rt.conf', 'title title (rt)\n' 'options \n' 'linux os/vmlinuz-6.4.0-3-rt\n' 'initrd os/initrd-6.4.0-3-rt\n', ), ( 'system_root_mount/boot/efi/loader/entries/' 'opensuse-6.4.0-9-default.conf', 'title title (default)\n' 'options \n' 'linux os/vmlinuz-6.4.0-9-default\n' 'initrd os/initrd-6.4.0-9-default\n', ), ] @patch('kiwi.bootloader.config.systemd_boot.OsRelease') @patch('kiwi.bootloader.config.systemd_boot.Kernel') @patch.object(BootLoaderSystemdBoot, '_write_config_file') def test_set_loader_entry( self, mock_write_config_file, mock_Kernel, mock_OsRelease ): mock_Kernel.return_value.get_kernel.return_value.version = ( '5.3.18-59.10-default' ) os_release = Mock() os_release.get.return_value = 'opensuse-leap' mock_OsRelease.return_value = os_release self.bootloader.set_loader_entry('root_dir', 'disk') mock_Kernel.assert_called_once_with('root_dir') mock_Kernel.return_value.get_kernel.assert_called_once_with( raise_on_not_found=True, flavor='' ) assert ( mock_write_config_file.call_args[0][1] == 'root_dir/boot/efi/loader/entries/' 'opensuse-leap-5.3.18-59.10-default.conf' ) @patch('kiwi.bootloader.config.systemd_boot.OsRelease') @patch('kiwi.bootloader.config.systemd_boot.Kernel') def test_set_loader_entry_kernel_lookup_raises( self, mock_Kernel, mock_OsRelease ): mock_Kernel.return_value.get_kernel.side_effect = KiwiKernelLookupError( 'no kernel' ) with raises(KiwiKernelLookupError): self.bootloader.set_loader_entry('root_dir', 'disk') def test_create_loader_image(self): self.bootloader.create_loader_image('disk') self.bootloader.create_efi_path.assert_called_once_with() def test_get_template_parameters(self): self.bootloader.timeout = 0 assert self.bootloader._get_template_parameters() == { 'kernel_file': 'vmlinuz', 'initrd_file': 'initrd', 'boot_options': '', 'boot_timeout': 0, 'bootpath': 'bootpath', 'title': 'title', 'default_entry': 'main.conf', } @patch('kiwi.bootloader.config.systemd_boot.Path.create') def test_write_config_file(self, mock_Path_create): template = Mock() template.substitute.return_value = 'data' with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader._write_config_file(template, 'path/some-file', {}) mock_Path_create.assert_called_once_with('path') mock_open.assert_called_once_with('path/some-file', 'w') file_handle.write.assert_called_once_with('data') def test_write_config_file_raises(self): template = Mock() template.substitute.side_effect = Exception with raises(KiwiTemplateError): self.bootloader._write_config_file(template, 'some-file', {}) def test_write_kernel_cmdline_file(self, tmp_path): self.bootloader.cmdline = 'root=LABEL=root console=ttyS0' self.bootloader._write_kernel_cmdline_file(str(tmp_path)) assert (tmp_path / 'etc' / 'kernel' / 'cmdline').read_text() == ( 'root=LABEL=root console=ttyS0' ) @patch('kiwi.bootloader.config.systemd_boot.Path.create') @patch('kiwi.bootloader.config.systemd_boot.SparseFile.create') @patch('kiwi.bootloader.config.systemd_boot.Command.run') @patch('kiwi.bootloader.config.systemd_boot.LoopDevice') @patch('kiwi.bootloader.config.systemd_boot.Disk') @patch('kiwi.bootloader.config.systemd_boot.MountManager') @patch.object(BootLoaderSystemdBoot, '_run_bootctl') @patch.object(BootLoaderSystemdBoot, 'set_loader_entry') def test_create_embedded_fat_efi_image( self, mock_set_loader_entry, mock_run_bootctl, mock_MountManager, mock_Disk, mock_LoopDevice, mock_Command_run, mock_sparse_file_create, mock_Path_create, ): target = Mock() self.bootloader.target = target mock_Disk.return_value.__enter__.return_value.partition_map = { 'efi': 'efi_device' } self.bootloader._create_embedded_fat_efi_image('ESP') mock_sparse_file_create.assert_called_once_with('ESP', '20M') assert mock_MountManager.call_args_list == [ call(device='efi_device', mountpoint='root_dir/boot/efi'), call(device='/dev', mountpoint='root_dir/dev'), call(device='/proc', mountpoint='root_dir/proc'), call(device='/sys', mountpoint='root_dir/sys'), ] assert mock_Command_run.call_args_list == [ call(['sgdisk', '-n', ':1.0', '-t', '1:EF00', 'ESP']), call(['mkdosfs', '-n', 'BOOT', 'efi_device']), call(['dd', 'if=efi_device', 'of=ESP.img']), call(['mv', 'ESP.img', 'ESP']), ] mock_run_bootctl.assert_called_once_with('root_dir') mock_set_loader_entry.assert_called_once_with('root_dir', target.live) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7631934 kiwi-11.1.8/test/unit/bootloader/config/zipl_test.py0000644000000000000000000004323115273675667017452 0ustar00import io from pytest import raises from unittest.mock import Mock, patch, call, MagicMock from kiwi.bootloader.config.zipl import BootLoaderZipl from kiwi.bootloader.config.bootloader_spec_base import BootLoaderSpecBase from kiwi.command import CommandT from kiwi.exceptions import ( KiwiTemplateError, KiwiBootLoaderTargetError, KiwiDiskGeometryError, ) class TestBootLoaderZipl: @patch('kiwi.bootloader.config.bootloader_spec_base.FirmWare') def setup(self, mock_FirmWare): self.firmware = Mock() mock_FirmWare.return_value = self.firmware self.state = Mock() self.state.get_host_key_certificates.return_value = [ { 'hkd_cert': ['/path/to/host.crt'], 'hkd_revocation_list': ['/path/to/revocation-list.crl'], 'hkd_ca_cert': '/path/to/DigiCertCA.crt', 'hkd_sign_cert': '/path/to/ibm-z-host-key-signing.crt', } ] self.state.get_build_type_bootloader_targettype.return_value = 'CDL' self.state.build_type.get_target_blocksize.return_value = 4096 self.state.xml_data.get_name.return_value = 'image-name' self.state.get_image_version.return_value = 'image-version' self.state.build_type.get_efifatimagesize.return_value = None self.state.get_build_type_bootloader_kernel_flavors.return_value = [] self.bootloader = BootLoaderZipl(self.state, 'root_dir') self.bootloader.cmdline = 'options' self.bootloader.custom_args['kernel'] = None self.bootloader.custom_args['initrd'] = None self.bootloader.custom_args['boot_options'] = {} self.bootloader.custom_args['targetbase'] = '/dev/disk' self.bootloader.custom_args['target_dir'] = 'target_dir' self.bootloader.sys_mount = Mock(mountpoint='sys_mount') self.bootloader.root_mount = Mock(mountpoint='system_root_mount') self.bootloader._mount_system = Mock() self.bootloader.create_efi_path = Mock() self.bootloader.get_boot_path = Mock(return_value='bootpath') self.bootloader.get_menu_entry_title = Mock(return_value='title') self.bootloader.arch = 's390x' @patch('kiwi.bootloader.config.bootloader_spec_base.FirmWare') def setup_method(self, cls, mock_FirmWare): self.setup() @patch('os.unlink') def test_setup_loader_raises_invalid_target(self, mock_os_unlink): with raises(KiwiBootLoaderTargetError): self.bootloader.setup_loader('iso') @patch('shutil.move') @patch('os.unlink') @patch('os.path.exists') @patch('kiwi.bootloader.config.zipl.BootImageBase.get_boot_names') @patch('kiwi.bootloader.config.zipl.Path.wipe') @patch('kiwi.bootloader.config.zipl.Path.create') @patch('kiwi.bootloader.config.zipl.Command.run') @patch('kiwi.bootloader.config.zipl.BootLoaderTemplateZipl') @patch('kiwi.bootloader.config.zipl.Temporary.new_file') @patch.object(BootLoaderZipl, '_write_config_file') @patch.object(BootLoaderZipl, '_get_template_parameters') @patch.object(BootLoaderSpecBase, 'get_entry_name') def test_setup_loader( self, mock_get_entry_name, mock_get_template_parameters, mock_write_config_file, mock_Temporary_new_file, mock_BootLoaderTemplateZipl, mock_Command_run, mock_Path_create, mock_Path_wipe, mock_BootImageBase_get_boot_names, mock_os_path_exists, mock_os_unlink, mock_shutil_move, ): temporary = Mock() temporary.name = 'system_root_mount/kiwi_zipl.conf_' mock_Temporary_new_file.return_value.__enter__.return_value = temporary mock_get_entry_name.return_value = ( 'opensuse-leap-5.3.18-59.10-default.conf' ) mock_get_template_parameters.return_value = {'targetbase': '/dev/loop'} kernel_info = Mock() kernel_info.kernel_version = 'kernel-version' kernel_info.kernel_filename = 'kernel-filename' kernel_info.initrd_name = 'initrd-name' mock_os_path_exists.return_value = True mock_BootImageBase_get_boot_names.return_value = kernel_info with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader.setup_loader('disk') file_handle.write.assert_called_once_with('options\n') assert mock_write_config_file.call_args_list == [ call( mock_BootLoaderTemplateZipl.return_value.get_loader_template.return_value, 'system_root_mount/kiwi_zipl.conf_', mock_get_template_parameters.return_value, ), call( mock_BootLoaderTemplateZipl.return_value.get_entry_template.return_value, 'system_root_mount/boot/loader/entries/' 'opensuse-leap-5.3.18-59.10-default.conf', mock_get_template_parameters.return_value, ), ] assert self.bootloader._mount_system.called assert self.bootloader.sys_mount.umount.called assert mock_Command_run.call_args_list == [ call( [ 'chroot', 'system_root_mount', 'genprotimg', '--offline', '--verbose', '-o', 'bootpath/kernel-filename.cc', '-i', 'bootpath/kernel-filename', '-r', 'bootpath/initrd-name', '-p', temporary.name.replace('system_root_mount', ''), '--cert', '/path/to/DigiCertCA.crt', '--cert', '/path/to/ibm-z-host-key-signing.crt', '-k', '/path/to/host.crt', '--crl', '/path/to/revocation-list.crl', ] ), call( [ 'chroot', 'system_root_mount', 'genprotimg', '--offline', '--verbose', '-o', 'bootpath/kernel-filename.cc', '-i', 'bootpath/kernel-filename', '-r', 'bootpath/initrd-name', '-p', temporary.name.replace('system_root_mount', ''), '--no-verify', '-k', '/path/to/host.crt', '--crl', '/path/to/revocation-list.crl', ] ), call( [ 'chroot', 'system_root_mount', 'pvextract-hdr', '-o', 'secure_execution_header.bin', 'bootpath/kernel-filename.cc', ] ), call( [ 'chroot', 'system_root_mount', 'pvattest', 'create', '--no-verify', '--verbose', '-o', 'attestation_request.bin', '--arpk', 'attestation_response.key', '-k', '/path/to/host.crt', ] ), call( [ 'chroot', 'system_root_mount', 'zipl', '--noninteractive', '--config', '/kiwi_zipl.conf_', '--blsdir', '/boot/loader/entries', '--verbose', ] ), ] assert mock_shutil_move.call_args_list == [ call( 'system_root_mount/secure_execution_header.bin', 'target_dir/image-name.s390x-image-version.' 'secure_execution_header.bin', ), call( 'system_root_mount/attestation_request.bin', 'target_dir/image-name.s390x-image-version.' 'attestation_request.bin', ), call( 'system_root_mount/attestation_response.key', 'target_dir/image-name.s390x-image-version.' 'attestation_response.key', ), ] assert mock_os_unlink.call_args_list == [ call('system_root_mount/bootpath/kernel-filename.cc'), call('system_root_mount/bootpath/kernel-filename'), call('system_root_mount/bootpath/initrd-name'), ] @patch('kiwi.bootloader.config.zipl.BootImageBase') @patch('kiwi.bootloader.config.zipl.Command.run') @patch('kiwi.bootloader.config.zipl.Temporary.new_file') @patch('kiwi.bootloader.config.zipl.Path.create') @patch.object(BootLoaderSpecBase, 'get_entry_name') @patch.object(BootLoaderZipl, '_get_disk_geometry') @patch.object(BootLoaderZipl, '_get_partition_start') def test_setup_loader_with_kernel_flavors( self, mock_get_partition_start, mock_get_disk_geometry, mock_get_entry_name, mock_Path_create, mock_Temporary_new_file, mock_Command_run, mock_BootImageBase, ): self.state.get_host_key_certificates.return_value = [] self.state.get_build_type_bootloader_kernel_flavors.return_value = [ 'rt', 'default', ] versions = {'rt': '6.4.0-3-rt', 'default': '6.4.0-9-default'} mock_get_entry_name.side_effect = ( lambda flavor: f'opensuse-{versions[flavor]}.conf' ) def get_boot_names(flavor): return Mock( kernel_filename=f'system_root_mount/boot/image-{versions[flavor]}', initrd_name=f'initrd-{versions[flavor]}', ) mock_BootImageBase.return_value.get_boot_names.side_effect = ( get_boot_names ) mock_get_partition_start.return_value = '42' mock_get_disk_geometry.return_value = '123,53,9' self.bootloader.timeout = 10 temporary = Mock() temporary.name = 'system_root_mount/kiwi_zipl.conf_' mock_Temporary_new_file.return_value.__enter__.return_value = temporary with patch('builtins.open', create=True) as mock_open: file_handle = mock_open.return_value.__enter__.return_value self.bootloader.setup_loader('disk') assert [open_call[0][0] for open_call in mock_open.call_args_list] == [ 'system_root_mount/kiwi_zipl.conf_', 'system_root_mount/boot/loader/entries/opensuse-6.4.0-3-rt.conf', 'system_root_mount/boot/loader/entries/' 'opensuse-6.4.0-9-default.conf', ] zipl_config, rt_entry, default_entry = [ write_call[0][0] for write_call in file_handle.write.call_args_list ] # the section of the first flavor entry is the default section assert zipl_config.endswith( 'timeout=10\nsecure=auto\ndefault=title (rt)\n' ) assert rt_entry == ( 'title title (rt)\n' 'options options\n' 'linux bootpath/image-6.4.0-3-rt\n' 'initrd bootpath/initrd-6.4.0-3-rt\n' ) assert default_entry == ( 'title title (default)\n' 'options options\n' 'linux bootpath/image-6.4.0-9-default\n' 'initrd bootpath/initrd-6.4.0-9-default\n' ) mock_Command_run.assert_called_once_with( [ 'chroot', 'system_root_mount', 'zipl', '--noninteractive', '--config', '/kiwi_zipl.conf_', '--blsdir', '/boot/loader/entries', '--verbose', ] ) @patch.object(BootLoaderZipl, '_get_disk_geometry') @patch.object(BootLoaderZipl, '_get_partition_start') def test_get_template_parameters( self, mock_get_partition_start, mock_get_disk_geometry ): mock_get_partition_start.return_value = '42' mock_get_disk_geometry.return_value = '123,53,9' self.bootloader.timeout = 0 self.bootloader.disk_type = 'CDL' self.bootloader.disk_blocksize = 4096 self.bootloader.custom_args['secure_image_file'] = ( 'bootpath/kernel-filename.cc' ) assert self.bootloader._get_template_parameters() == { 'secure_image_file': 'bootpath/kernel-filename.cc', 'kernel_file': 'vmlinuz', 'initrd_file': 'initrd', 'boot_options': 'options', 'boot_timeout': 0, 'bootpath': 'bootpath', 'targetbase': 'targetbase=/dev/disk', 'targettype': 'CDL', 'targetblocksize': '4096', 'targetoffset': '42', 'targetgeometry': 'targetgeometry=123,53,9', 'title': 'title', 'default_entry': '', } @patch('kiwi.bootloader.config.zipl.Path.create') @patch.object(BootLoaderZipl, '_get_template_parameters') def test_write_config_file( self, mock_get_template_parameters, mock_Path_create ): template = Mock() template.substitute.return_value = 'data' with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.bootloader._write_config_file(template, 'path/some-file', {}) mock_Path_create.assert_called_once_with('path') mock_open.assert_called_once_with('path/some-file', 'w') file_handle.write.assert_called_once_with('data') def test_write_config_file_raises(self): template = Mock() template.substitute.side_effect = Exception with raises(KiwiTemplateError): self.bootloader._write_config_file(template, 'some-file', {}) @patch('kiwi.bootloader.config.zipl.Command.run') def test_get_disk_geometry(self, mock_Command_run): command_return_values = [ CommandT( output=' cylinders ............: 10017\n', error='', returncode=0, ), CommandT( output=' tracks per cylinder ..: 15\n', error='', returncode=0 ), CommandT( output=' blocks per track .....: 12\n', error='', returncode=0 ), ] def command_run(arg): return command_return_values.pop(0) self.firmware.get_partition_table_type.return_value = 'dasd' mock_Command_run.side_effect = command_run assert self.bootloader._get_disk_geometry() == '10017,15,12' @patch('kiwi.bootloader.config.zipl.Command.run') def test_get_partition_start_dasd(self, mock_Command_run): self.firmware.get_partition_table_type.return_value = 'dasd' command_return_values = [ CommandT( output=' blocks per track .....: 12\n', error='', returncode=0 ), CommandT( output=' /dev/loop01 2 6401 6400 1 Linux native\n', error='', returncode=0, ), ] def command_run(arg): return command_return_values.pop(0) mock_Command_run.side_effect = command_run assert self.bootloader._get_partition_start() == '24' assert mock_Command_run.call_args_list == [ call( [ 'bash', '-c', 'fdasd -f -p /dev/disk | grep "blocks per track"', ] ), call( [ 'bash', '-c', 'fdasd -f -s -p /dev/disk | grep "^ " |' ' head -n 1 | tr -s " "', ] ), ] @patch('kiwi.bootloader.config.zipl.Command.run') def test_get_partition_start_not_dasd(self, mock_Command_run): self.firmware.get_partition_table_type.return_value = 'msdos' command = Mock() command.output = ' 2048' mock_Command_run.return_value = command assert self.bootloader._get_partition_start() == '2048' mock_Command_run.assert_called_once_with( [ 'bash', '-c', 'sfdisk --dump /dev/disk | grep "1 :" |' ' cut -f1 -d, | cut -f2 -d=', ] ) @patch('kiwi.bootloader.config.zipl.Command.run') @patch.object(BootLoaderZipl, '_get_dasd_disk_geometry_element') def test_get_partition_start_raises( self, mock_get_dasd_disk_geometry_element, mock_Command_run ): self.firmware.get_partition_table_type.return_value = 'dasd' mock_Command_run.return_value = CommandT( output='bogus data', error='', returncode=0 ) with raises(KiwiDiskGeometryError): self.bootloader._get_partition_start() @patch('kiwi.bootloader.config.zipl.Command.run') def test_get_dasd_disk_geometry_element_raises(self, mock_Command_run): self.bootloader.target_table_type = 'dasd' mock_Command_run.return_value = CommandT( output='bogus data', error='', returncode=0 ) with raises(KiwiDiskGeometryError): self.bootloader._get_dasd_disk_geometry_element( '/dev/disk', 'tracks per cylinder' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7631934 kiwi-11.1.8/test/unit/bootloader/install/__init__.py0000644000000000000000000000000015273675667017360 0ustar00././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.763723 kiwi-11.1.8/test/unit/bootloader/install/base_test.py0000644000000000000000000000142215273675667017603 0ustar00from unittest.mock import Mock from pytest import raises from kiwi.bootloader.install.base import BootLoaderInstallBase class TestBootLoaderInstallBase: def setup(self): self.bootloader = BootLoaderInstallBase(Mock(), 'root_dir', Mock()) def setup_method(self, cls): self.setup() def test_install(self): with raises(NotImplementedError): self.bootloader.install() def test_install_required(self): with raises(NotImplementedError): self.bootloader.install_required() def test_secure_boot_install(self): with raises(NotImplementedError): self.bootloader.secure_boot_install() def test_set_disk_password(self): # just pass self.bootloader.set_disk_password('some') ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.763723 kiwi-11.1.8/test/unit/bootloader/install/grub2_test.py0000644000000000000000000005171615273675667017725 0ustar00import io from unittest.mock import patch, call, MagicMock, Mock from pytest import raises import unittest.mock as mock from kiwi.storage.mapped_device import MappedDevice from kiwi.storage.disk import ptable_entry_type from kiwi.bootloader.install.grub2 import BootLoaderInstallGrub2 from kiwi.defaults import Defaults from kiwi.exceptions import ( KiwiBootLoaderGrubInstallError, KiwiBootLoaderGrubDataError, KiwiBootLoaderGrubPlatformError, KiwiBootLoaderDiskPasswordError, ) class TestBootLoaderInstallGrub2: @patch('os.path.exists') def setup(self, mock_os_path_exists): mock_os_path_exists.return_value = True Defaults.set_platform_name('x86_64') self.firmware = mock.Mock() self.firmware.efi_mode = mock.Mock(return_value=None) self.device_map = {'var': MappedDevice('/dev/var-device', Mock())} self.custom_args = { 'device_map': self.device_map, 'boot_device': '/dev/mapper/loop0p2', 'root_device': '/dev/mapper/loop0p1', 'efi_device': '/dev/mapper/loop0p3', 'prep_device': '/dev/mapper/loop0p2', 'system_root_volume': 'root', 'system_volumes': { 'boot/grub2': { 'volume_options': 'subvol=@/boot/grub2', 'volume_device': 'device', } }, 'system_partitions': { 'var': ptable_entry_type( mbsize=100, clone=1, partition_name='p.lxvar', partition_type='t.linux', partition_id=None, mountpoint='/var', filesystem='ext3', label='var', ) }, 'firmware': self.firmware, 'target_removable': None, 'install_options': [], 'shim_options': [], } self.root_mount = mock.Mock() self.root_mount.device = self.custom_args['root_device'] self.root_mount.mountpoint = 'tmp_root' self.volume_mount = mock.Mock() self.volume_mount.device = self.custom_args['root_device'] self.volume_mount.mountpoint = 'tmp_volume' self.partition_mount = mock.Mock() self.partition_mount.device = self.custom_args['root_device'] self.partition_mount.mountpoint = 'tmp_partition' self.boot_mount = mock.Mock() self.boot_mount.device = self.custom_args['boot_device'] self.boot_mount.mountpoint = 'tmp_boot' self.efi_mount = mock.Mock() self.efi_mount.device = self.custom_args['efi_device'] self.efi_mount.mountpoint = 'tmp_efi' self.device_mount = mock.Mock() self.device_mount.device = 'devtmpfs' self.device_mount.mountpoint = 'dev' self.proc_mount = mock.Mock() self.proc_mount.device = 'proc' self.proc_mount.mountpoint = 'proc' self.sysfs_mount = mock.Mock() self.sysfs_mount.device = 'sysfs' self.sysfs_mount.mountpoint = 'sys' # the order of mount manager is reverse the order in the code self.mount_managers = [ self.sysfs_mount, self.proc_mount, self.device_mount, self.partition_mount, self.volume_mount, self.efi_mount, self.boot_mount, self.root_mount, ] device_provider = mock.Mock() device_provider.get_device = mock.Mock(return_value='/dev/some-device') self.bootloader = BootLoaderInstallGrub2( Mock(), 'root_dir', device_provider, self.custom_args ) def setup_method(self, cls): self.setup() @patch('kiwi.bootloader.install.grub2.Defaults.get_grub_path') def test_post_init_ppc_no_prep_device(self, mock_grub_path): self.bootloader.arch = 'ppc64' del self.custom_args['prep_device'] with raises(KiwiBootLoaderGrubInstallError): self.bootloader.install() @patch('kiwi.bootloader.install.grub2.Command.run') @patch('kiwi.bootloader.install.grub2.MountManager') @patch('kiwi.bootloader.install.grub2.Defaults.get_grub_path') def test_grub2_bootloader_not_installed( self, mock_grub_path, mock_mount_manager, mock_command ): mock_grub_path.return_value = None self.bootloader.arch = 'x86_64' with raises(KiwiBootLoaderGrubDataError): self.bootloader.install() @patch('kiwi.bootloader.install.grub2.Defaults.get_grub_path') def test_unsupported_platform(self, mock_grub_path): self.bootloader.arch = 'unsupported' with raises(KiwiBootLoaderGrubPlatformError): self.bootloader.install() def test_post_init_no_boot_device(self): with raises(KiwiBootLoaderGrubInstallError): self.bootloader.post_init({}) def test_post_init_no_root_device(self): with raises(KiwiBootLoaderGrubInstallError): self.bootloader.post_init({'boot_device': 'a'}) def test_post_init_secure_boot_no_efi_device(self): self.firmware.efi_mode.return_value = 'uefi' del self.custom_args['efi_device'] with raises(KiwiBootLoaderGrubInstallError): self.bootloader.post_init(self.custom_args) def test_install_required(self): assert self.bootloader.install_required() is True def test_install_required_ppc_opal(self): self.bootloader.arch = 'ppc64' self.bootloader.firmware = mock.Mock() self.bootloader.firmware.opal_mode = mock.Mock(return_value=True) assert self.bootloader.install_required() is False def test_install_required_efi_no_csm(self): self.bootloader.arch = 'x86_64' self.bootloader.firmware = mock.Mock() self.bootloader.firmware.efi_mode = mock.Mock(return_value='efi') self.bootloader.firmware.legacy_bios_mode = mock.Mock( return_value=False ) assert self.bootloader.install_required() is False def test_install_required_arm64(self): self.bootloader.arch = 'arm64' assert self.bootloader.install_required() is False def test_install_required_riscv64(self): self.bootloader.arch = 'riscv64' assert self.bootloader.install_required() is False @patch('kiwi.bootloader.install.grub2.Path.wipe') @patch('kiwi.bootloader.install.grub2.Path.which') @patch('kiwi.bootloader.install.grub2.Command.run') @patch('kiwi.bootloader.install.grub2.MountManager') @patch('kiwi.bootloader.install.grub2.Defaults.get_grub_path') @patch('kiwi.bootloader.install.grub2.SystemSetup') def test_install_with_extra_boot_partition( self, mock_SystemSetup, mock_grub_path, mock_mount_manager, mock_command, mock_which, mock_wipe, ): setup = Mock() mock_SystemSetup.return_value = setup mock_grub_path.return_value = ( self.root_mount.mountpoint + '/usr/lib/grub2/i386-pc' ) def side_effect(device, mountpoint=None): return self.mount_managers.pop() mock_mount_manager.side_effect = side_effect self.bootloader.install() self.bootloader.root_mount.mount.assert_called_once_with( options=['subvol=root'] ) self.boot_mount.mount.assert_called_once_with() mock_which.assert_called_once_with( root_dir='tmp_root', filename='grub2-install' ) mock_command.assert_called_once_with( [ 'chroot', 'tmp_root', 'grub2-install', '--skip-fs-probe', '--directory', '/usr/lib/grub2/i386-pc', '--boot-directory', '/boot', '--target', 'i386-pc', '--modules', ' '.join(Defaults.get_grub_platform_modules(multiboot=True)), '/dev/some-device', ] ) setup.setup_selinux_file_contexts.assert_called_once_with() @patch('kiwi.bootloader.install.grub2.Path.wipe') @patch('kiwi.bootloader.install.grub2.Path.which') @patch('kiwi.bootloader.install.grub2.Command.run') @patch('kiwi.bootloader.install.grub2.MountManager') @patch('kiwi.bootloader.install.grub2.Defaults.get_grub_path') @patch('os.path.exists') def test_install_on_dasd_disk( self, mock_os_path_exists, mock_grub_path, mock_mount_manager, mock_command, mock_which, mock_wipe, ): mock_os_path_exists.return_value = True self.firmware.get_partition_table_type = mock.Mock(return_value='dasd') def side_effect(device, mountpoint=None): return self.mount_managers.pop() mock_mount_manager.side_effect = side_effect self.bootloader.install() self.bootloader.root_mount.mount.assert_called_once_with( options=['subvol=root'] ) self.boot_mount.mount.assert_called_once_with() self.bootloader.sysfs_mount.umount.assert_called_once_with() assert mock_command.call_args_list == [ call(['chroot', 'tmp_root', 'grub2-zipl-setup', '--keep']), call( [ 'mv', 'tmp_root/etc/default/zipl2grub.conf.in.orig', 'tmp_root/etc/default/zipl2grub.conf.in', ] ), call( [ 'mv', 'tmp_root/boot/zipl/config', 'tmp_root/boot/zipl/config.kiwi', ] ), ] @patch('kiwi.bootloader.install.grub2.Path.wipe') @patch('kiwi.bootloader.install.grub2.Path.which') @patch('kiwi.bootloader.install.grub2.Command.run') @patch('kiwi.bootloader.install.grub2.MountManager') @patch('kiwi.bootloader.install.grub2.Defaults.get_grub_path') @patch('kiwi.bootloader.install.grub2.SystemSetup') def test_install_ppc_ieee1275( self, mock_SystemSetup, mock_grub_path, mock_mount_manager, mock_command, mock_which, mock_wipe, ): setup = Mock() mock_SystemSetup.return_value = setup mock_grub_path.return_value = ( self.root_mount.mountpoint + '/usr/lib/grub2/powerpc-ieee1275' ) self.bootloader.arch = 'ppc64' def side_effect(device, mountpoint=None): return self.mount_managers.pop() mock_mount_manager.side_effect = side_effect self.bootloader.install() self.root_mount.mount.assert_called_once_with(options=['subvol=root']) self.boot_mount.mount.assert_called_once_with() mock_command.assert_called_once_with( [ 'chroot', 'tmp_root', 'grub2-install', '--skip-fs-probe', '--no-nvram', '--directory', '/usr/lib/grub2/powerpc-ieee1275', '--boot-directory', '/boot', '--target', 'powerpc-ieee1275', '--modules', ' '.join(Defaults.get_grub_ofw_modules()), self.custom_args['prep_device'], ] ) setup.setup_selinux_file_contexts.assert_called_once_with() @patch('kiwi.bootloader.install.grub2.Path.wipe') @patch('kiwi.bootloader.install.grub2.Path.which') @patch('kiwi.bootloader.install.grub2.Command.run') @patch('kiwi.bootloader.install.grub2.MountManager') @patch('kiwi.bootloader.install.grub2.Defaults.get_grub_path') @patch('kiwi.bootloader.install.grub2.SystemSetup') def test_install_s390_emu( self, mock_SystemSetup, mock_grub_path, mock_mount_manager, mock_command, mock_which, mock_wipe, ): setup = Mock() mock_SystemSetup.return_value = setup mock_grub_path.return_value = ( self.root_mount.mountpoint + '/usr/lib/grub2/s390x-emu' ) self.bootloader.arch = 's390x' def side_effect(device, mountpoint=None): return self.mount_managers.pop() mock_mount_manager.side_effect = side_effect self.bootloader.install() self.root_mount.mount.assert_called_once_with(options=['subvol=root']) self.boot_mount.mount.assert_called_once_with() mock_command.assert_called_once_with( [ 'chroot', 'tmp_root', 'grub2-install', '--skip-fs-probe', '--no-nvram', '--directory', '/usr/lib/grub2/s390x-emu', '--boot-directory', '/boot', '--target', 's390x-emu', '--modules', ' '.join(Defaults.get_grub_s390_modules()), '/dev/some-device', ] ) setup.setup_selinux_file_contexts.assert_called_once_with() @patch('kiwi.bootloader.install.grub2.Path.wipe') @patch('kiwi.bootloader.install.grub2.Path.which') @patch('kiwi.bootloader.install.grub2.Command.run') @patch('kiwi.bootloader.install.grub2.MountManager') @patch('kiwi.bootloader.install.grub2.Defaults.get_grub_path') @patch('kiwi.bootloader.install.grub2.SystemSetup') def test_install( self, mock_SystemSetup, mock_grub_path, mock_mount_manager, mock_command, mock_which, mock_wipe, ): setup = Mock() mock_SystemSetup.return_value = setup mock_which.return_value = None mock_grub_path.return_value = ( self.root_mount.mountpoint + '/usr/lib/grub2/i386-pc' ) self.boot_mount.device = self.root_mount.device def side_effect(device, mountpoint=None): return self.mount_managers.pop() mock_mount_manager.side_effect = side_effect self.bootloader.target_removable = True self.bootloader.install() self.root_mount.mount.assert_called_once_with(options=['subvol=root']) self.partition_mount.mount.assert_called_once_with() self.volume_mount.mount.assert_called_once_with( options=['subvol=@/boot/grub2'] ) mock_command.assert_called_once_with( [ 'chroot', 'tmp_root', 'grub2-install', '--removable', '--skip-fs-probe', '--directory', '/usr/lib/grub2/i386-pc', '--boot-directory', '/boot', '--target', 'i386-pc', '--modules', ' '.join(Defaults.get_grub_platform_modules(multiboot=True)), '/dev/some-device', ] ) setup.setup_selinux_file_contexts.assert_called_once_with() @patch('kiwi.bootloader.install.grub2.Path.wipe') @patch('kiwi.bootloader.install.grub2.Path.which') @patch('kiwi.bootloader.install.grub2.Command.run') @patch('kiwi.bootloader.install.grub2.MountManager') @patch('kiwi.bootloader.install.grub2.Defaults.get_grub_path') @patch('kiwi.bootloader.install.grub2.SystemSetup') def test_install_readonly_root( self, mock_SystemSetup, mock_grub_path, mock_mount_manager, mock_command, mock_which, mock_wipe, ): mock_which.return_value = None mock_grub_path.return_value = ( self.root_mount.mountpoint + '/usr/lib/grub2/i386-pc' ) self.boot_mount.device = self.root_mount.device readonly_device = Mock() readonly_device.get_device.return_value = self.custom_args[ 'root_device' ] self.bootloader.device_map = {'readonly': readonly_device} def side_effect(device, mountpoint=None): return self.mount_managers.pop() mock_mount_manager.side_effect = side_effect self.bootloader.install() self.root_mount.mount.assert_called_once_with( options=['subvol=root', 'ro'] ) @patch('kiwi.bootloader.install.grub2.Command.run') @patch('kiwi.bootloader.install.grub2.MountManager') @patch('os.path.exists') @patch('os.access') @patch('shutil.copy2') def test_secure_boot_install( self, mock_shutil_copy2, mock_access, mock_exists, mock_mount_manager, mock_command, ): mock_access.return_value = True mock_exists.return_value = True self.firmware.efi_mode.return_value = 'uefi' self.boot_mount.device = self.root_mount.device def side_effect(device, mountpoint=None): return self.mount_managers.pop() mock_mount_manager.side_effect = side_effect self.bootloader.secure_boot_install() assert mock_shutil_copy2.call_args_list == [ call( 'tmp_root/usr/sbin/grub2-install', 'tmp_root/usr/sbin/grub2-install.orig', ), call('tmp_root/bin/true', 'tmp_root/usr/sbin/grub2-install'), ] assert mock_command.call_args_list == [ call( [ 'chroot', 'tmp_root', 'shim-install', '--removable', '/dev/some-device', ] ), call( [ 'chroot', 'tmp_root', 'mv', '/usr/sbin/grub2-install.orig', '/usr/sbin/grub2-install', ] ), ] self.root_mount.mount.assert_called_once_with(options=['subvol=root']) self.partition_mount.mount.assert_called_once_with() self.volume_mount.mount.assert_called_once_with( options=['subvol=@/boot/grub2'] ) self.device_mount.bind_mount.assert_called_once_with() self.proc_mount.bind_mount.assert_called_once_with() self.sysfs_mount.bind_mount.assert_called_once_with() self.efi_mount.mount.assert_called_once_with() @patch('kiwi.bootloader.install.grub2.Path.which') @patch('kiwi.bootloader.install.grub2.MountManager') def test_secure_boot_install_no_shim_install( self, mock_mount_manager, mock_which ): mock_which.return_value = None self.firmware.efi_mode.return_value = 'uefi' def side_effect(device, mountpoint=None): return self.mount_managers.pop() mock_mount_manager.side_effect = side_effect self.bootloader.secure_boot_install() self.root_mount.mount.assert_called_once_with(options=['subvol=root']) self.partition_mount.mount.assert_called_once_with() self.volume_mount.mount.assert_called_once_with( options=['subvol=@/boot/grub2'] ) self.device_mount.bind_mount.assert_called_once_with() self.proc_mount.bind_mount.assert_called_once_with() self.sysfs_mount.bind_mount.assert_called_once_with() self.efi_mount.mount.assert_called_once_with() mock_which.assert_called_once_with( filename='shim-install', root_dir='tmp_root' ) @patch('kiwi.bootloader.install.grub2.Command.run') @patch('kiwi.bootloader.install.grub2.MountManager') def test_set_disk_password(self, mock_mount_manager, mock_command): self.boot_mount.device = self.root_mount.device def side_effect(device, mountpoint=None): return self.mount_managers.pop() mock_mount_manager.side_effect = side_effect self.bootloader.root_mount = MagicMock() self.bootloader.root_mount.mountpoint = 'root_mountpoint' with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = 'data__cryptomount__data' self.bootloader.set_disk_password('credentials') file_handle.write.assert_called_once_with( 'data__cryptomount -p "credentials"__data' ) @patch('kiwi.bootloader.install.grub2.Command.run') @patch('kiwi.bootloader.install.grub2.MountManager') @patch('kiwi.bootloader.install.grub2.ExitStack') def test_set_disk_password_failed_to_open_grub_config( self, mock_ExitStack, mock_mount_manager, mock_command ): self.boot_mount.device = self.root_mount.device def side_effect(device, mountpoint=None): return self.mount_managers.pop() mock_mount_manager.side_effect = side_effect self.bootloader.root_mount = MagicMock() self.bootloader.root_mount.mountpoint = 'root_mountpoint' with patch('builtins.open', create=True) as mock_open: mock_open.side_effect = IOError() with raises(KiwiBootLoaderDiskPasswordError): self.bootloader.set_disk_password('credentials') ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.763723 kiwi-11.1.8/test/unit/bootloader/install/init_test.py0000644000000000000000000000137315273675667017641 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.exceptions import KiwiBootLoaderInstallSetupError from kiwi.bootloader.install import BootLoaderInstall class TestBootLoaderInstall: def test_bootloader_install_not_implemented(self): with raises(KiwiBootLoaderInstallSetupError): BootLoaderInstall.new('foo', Mock(), 'root_dir', Mock()) @patch('kiwi.bootloader.install.grub2.BootLoaderInstallGrub2') def test_bootloader_install_grub2(self, mock_grub2): device_provider = Mock() xml_state = Mock() BootLoaderInstall.new('grub2', xml_state, 'root_dir', device_provider) mock_grub2.assert_called_once_with( xml_state, 'root_dir', device_provider, None ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.763723 kiwi-11.1.8/test/unit/bootloader/install/systemd_boot_test.py0000644000000000000000000000124015273675667021402 0ustar00from unittest.mock import Mock from pytest import raises from kiwi.bootloader.install.systemd_boot import BootLoaderInstallSystemdBoot class TestBootLoaderInstallSystemdBoot: def setup(self): self.bootloader = BootLoaderInstallSystemdBoot( Mock(), 'root_dir', Mock() ) def setup_method(self, cls): self.setup() def test_install(self): with raises(NotImplementedError): self.bootloader.install() def test_install_required(self): assert self.bootloader.install_required() is False def test_secure_boot_install(self): # just pass self.bootloader.secure_boot_install() ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.763723 kiwi-11.1.8/test/unit/bootloader/install/zipl_test.py0000644000000000000000000000115515273675667017652 0ustar00from unittest.mock import Mock from pytest import raises from kiwi.bootloader.install.zipl import BootLoaderInstallZipl class TestBootLoaderInstallZipl: def setup(self): self.bootloader = BootLoaderInstallZipl(Mock(), 'root_dir', Mock()) def setup_method(self, cls): self.setup() def test_install(self): with raises(NotImplementedError): self.bootloader.install() def test_install_required(self): assert self.bootloader.install_required() is False def test_secure_boot_install(self): # just pass self.bootloader.secure_boot_install() ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.763723 kiwi-11.1.8/test/unit/bootloader/template/__init__.py0000644000000000000000000000000015273675667017525 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7639298 kiwi-11.1.8/test/unit/bootloader/template/grub2_test.py0000644000000000000000000003341215273675667020063 0ustar00from kiwi.bootloader.template.grub2 import BootLoaderTemplateGrub2 class TestBootLoaderTemplateGrub2: def setup(self): self.grub2 = BootLoaderTemplateGrub2() def setup_method(self, cls): self.setup() def test_get_multiboot_install_template(self): assert self.grub2.get_multiboot_install_template().substitute( search_params='--fs-uuid --set=root 0815', default_boot='0', kernel_file='linux.vmx', initrd_file='initrd.vmx', boot_options='splash', failsafe_boot_options='splash', gfxmode='800x600', theme='SLE', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community [ VMX ]', bootpath='/boot', boot_directory_name='grub2', hypervisor='xen.gz', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_multiboot_install_template_console(self): assert self.grub2.get_multiboot_install_template( has_graphics=False ).substitute( search_params='--fs-uuid --set=root 0815', default_boot='0', kernel_file='linux.vmx', initrd_file='initrd.vmx', boot_options='splash', failsafe_boot_options='splash', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community [ VMX ]', bootpath='/boot', hypervisor='xen.gz', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_multiboot_install_template_serial(self): assert self.grub2.get_multiboot_install_template( has_graphics=False, has_serial=True ).substitute( search_params='--fs-uuid --set=root 0815', default_boot='0', kernel_file='linux.vmx', initrd_file='initrd.vmx', boot_options='splash', failsafe_boot_options='splash', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='serial --speed=38400', title='LimeJeOS-SLE12-Community [ VMX ]', bootpath='/boot', hypervisor='xen.gz', efi_image_name='bootx64.efi', terminal_input='serial', terminal_output='serial', ) def test_get_multiboot_install_template_console_relative_btrfs(self): assert self.grub2.get_multiboot_install_template( has_graphics=False, has_btrfs_relative_path=True ).substitute( search_params='--fs-uuid --set=root 0815', default_boot='0', kernel_file='linux.vmx', initrd_file='initrd.vmx', boot_options='splash', failsafe_boot_options='splash', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community [ VMX ]', bootpath='/boot', hypervisor='xen.gz', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_install_template(self): assert self.grub2.get_install_template(has_serial=True).substitute( search_params='--file --set=root /boot/0xd305fb7d', default_boot='0', kernel_file='boot/linux.vmx', initrd_file='boot/initrd.vmx', boot_options='cdinst=1 splash', failsafe_boot_options='cdinst=1 splash', gfxmode='800x600', theme='SLE', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community [ VMX ]', bootpath='/boot', boot_directory_name='grub2', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_install_template_supports_iso_scan(self): template = self.grub2.get_install_template().substitute( search_params='--file --set=root /boot/0xd305fb7d', default_boot='0', kernel_file='boot/linux.vmx', initrd_file='boot/initrd.vmx', boot_options='splash', failsafe_boot_options='splash', gfxmode='800x600', theme='SLE', boot_timeout='10', boot_timeout_style='menu', title='LimeJeOS-SLE12-Community [ VMX ]', bootpath='/boot', boot_directory_name='grub2', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) assert 'isoboot="iso-scan/filename=${iso_path}"' in template # install and failsafe install entry assert template.count('cdinst=1 ${isoboot} splash') == 2 def test_get_install_template_relative_btrfs(self): assert self.grub2.get_install_template( has_serial=True, has_btrfs_relative_path=True ).substitute( search_params='--file --set=root /boot/0xd305fb7d', default_boot='0', kernel_file='boot/linux.vmx', initrd_file='boot/initrd.vmx', boot_options='cdinst=1 splash', failsafe_boot_options='cdinst=1 splash', gfxmode='800x600', theme='SLE', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community [ VMX ]', bootpath='/boot', boot_directory_name='grub2', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_iso_template(self): assert self.grub2.get_iso_template(has_serial=True).substitute( search_params='--file --set=root /boot/0xd305fb7d', default_boot='0', kernel_file='boot/linux.vmx', initrd_file='boot/initrd.vmx', boot_options='splash', failsafe_boot_options='splash', gfxmode='800x600', theme='SLE', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community', bootpath='/boot', boot_directory_name='grub2', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_iso_template_checkiso(self): assert self.grub2.get_iso_template(checkiso=True).substitute( search_params='--file --set=root /boot/0xd305fb7d', default_boot='0', kernel_file='boot/linux.vmx', initrd_file='boot/initrd.vmx', boot_options='splash', failsafe_boot_options='splash', gfxmode='800x600', theme='SLE', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community', bootpath='/boot', boot_directory_name='grub2', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_iso_template_checkiso_relative_btrfs(self): assert self.grub2.get_iso_template( checkiso=True, has_btrfs_relative_path=True ).substitute( search_params='--file --set=root /boot/0xd305fb7d', default_boot='0', kernel_file='boot/linux.vmx', initrd_file='boot/initrd.vmx', boot_options='splash', failsafe_boot_options='splash', gfxmode='800x600', theme='SLE', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community', bootpath='/boot', boot_directory_name='grub2', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_multiboot_iso_template(self): assert self.grub2.get_multiboot_iso_template().substitute( search_params='--fs-uuid --set=root 0815', default_boot='0', kernel_file='linux.vmx', initrd_file='initrd.vmx', boot_options='splash', failsafe_boot_options='splash', gfxmode='800x600', theme='SLE', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community', bootpath='/boot', boot_directory_name='grub2', hypervisor='xen.gz', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_multiboot_iso_template_console(self): assert self.grub2.get_multiboot_iso_template( has_graphics=False ).substitute( search_params='--fs-uuid --set=root 0815', default_boot='0', kernel_file='linux.vmx', initrd_file='initrd.vmx', boot_options='splash', failsafe_boot_options='splash', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community', bootpath='/boot', hypervisor='xen.gz', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_multiboot_iso_template_serial(self): assert self.grub2.get_multiboot_iso_template( has_graphics=False, has_serial=True ).substitute( search_params='--fs-uuid --set=root 0815', default_boot='0', kernel_file='linux.vmx', initrd_file='initrd.vmx', boot_options='splash', failsafe_boot_options='splash', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community', bootpath='/boot', hypervisor='xen.gz', efi_image_name='bootx64.efi', terminal_input='serial', terminal_output='serial', ) def test_get_multiboot_iso_template_checkiso(self): assert self.grub2.get_multiboot_iso_template(checkiso=True).substitute( search_params='--fs-uuid --set=root 0815', default_boot='0', kernel_file='linux.vmx', initrd_file='initrd.vmx', boot_options='splash', failsafe_boot_options='splash', gfxmode='800x600', theme='SLE', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community', bootpath='/boot', boot_directory_name='grub2', hypervisor='xen.gz', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_multiboot_iso_template_checkiso_relative_btrfs(self): assert self.grub2.get_multiboot_iso_template( checkiso=True, has_btrfs_relative_path=True ).substitute( search_params='--fs-uuid --set=root 0815', default_boot='0', kernel_file='linux.vmx', initrd_file='initrd.vmx', boot_options='splash', failsafe_boot_options='splash', gfxmode='800x600', theme='SLE', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='LimeJeOS-SLE12-Community', bootpath='/boot', boot_directory_name='grub2', hypervisor='xen.gz', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) def test_get_kernel_menu_entries(self): # the main entry of the live and the install entry of the # install templates is repeated once per kernel parameters = dict( search_params='--fs-uuid --set=root 0815', default_boot='0', kernel_file='linux', initrd_file='initrd', kernel_file_1='linux-default', initrd_file_1='initrd-default', boot_options='splash', failsafe_boot_options='splash', gfxmode='800x600', theme='SLE', boot_timeout='10', boot_timeout_style='menu', serial_line_setup='', title='Bob (rt)', title_1='Bob (default)', bootpath='/boot', boot_directory_name='grub2', hypervisor='xen.gz', efi_image_name='bootx64.efi', terminal_input='console', terminal_output='console', ) for get_template, entry_title in [ (self.grub2.get_iso_template, 'menuentry "Bob'), (self.grub2.get_multiboot_iso_template, 'menuentry "Bob'), (self.grub2.get_install_template, 'menuentry "Install Bob'), ( self.grub2.get_multiboot_install_template, 'menuentry "Install -- Bob', ), ]: config = get_template(kernel_count=2).substitute(parameters) assert config.count(f'{entry_title} (rt)"') == 1 assert config.count(f'{entry_title} (default)"') == 1 assert config.count('/linux-default') == 1 assert config.count('/initrd-default') == 1 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7639298 kiwi-11.1.8/test/unit/bootloader/template/systemd_boot_test.py0000644000000000000000000000062715273675667021557 0ustar00from kiwi.bootloader.template.systemd_boot import BootLoaderTemplateSystemdBoot class TestBootLoaderTemplateSystemdBoot: def setup(self): self.systemd_boot = BootLoaderTemplateSystemdBoot() def setup_method(self, cls): self.setup() def test_get_loader_template(self): assert self.systemd_boot.get_loader_template().substitute( boot_timeout='10' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7639298 kiwi-11.1.8/test/unit/bootloader/template/zipl_test.py0000644000000000000000000000173215273675667020020 0ustar00from kiwi.bootloader.template.zipl import BootLoaderTemplateZipl class TestBootLoaderTemplateZipl: def setup(self): self.zipl = BootLoaderTemplateZipl() def setup_method(self, cls): self.setup() def test_get_loader_template(self): assert self.zipl.get_loader_template().substitute( boot_timeout='10', bootpath='/boot', targetbase='', targettype='SCSI', targetblocksize='512', targetoffset='2048', targetgeometry='', ) def test_get_entry_template_standard(self): assert self.zipl.get_entry_template().substitute( title='title', boot_options='', kernel_file='linux', initrd_file='initrd', ) def test_get_entry_template_secure(self): assert self.zipl.get_entry_template(secure=True).substitute( title='title', boot_options='', secure_image_file='linux' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7639298 kiwi-11.1.8/test/unit/boxbuild/__init__.py0000644000000000000000000000000015273675667015370 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7640593 kiwi-11.1.8/test/unit/boxbuild/box_build_test.py0000644000000000000000000004647215273675667016666 0ustar00from unittest.mock import patch, Mock, call from pytest import raises from kiwi.boxbuild.box_build import BoxBuild import kiwi.boxbuild.defaults as defaults from kiwi.exceptions import ( KiwiBoxDownloadError, KiwiBoxVirtioFsError, KiwiBoxQEMUBinaryNotFound, KiwiBoxSSHPortInvalid, KiwiBoxSSHKeyNotFound, KiwiBoxBuildError, ) class TestBoxBuild: @patch('kiwi.boxbuild.box_build.BoxDownload') def setup(self, mock_BoxDownload): self.box = Mock() self.vm_setup = Mock() self.vm_setup.kernel = 'kernel' self.vm_setup.append = 'console=hvc0' self.vm_setup.system = 'system' self.vm_setup.initrd = 'initrd' self.vm_setup.console = 'hvc0' self.vm_setup.ram = 4096 self.vm_setup.smp = 4 self.box.fetch.return_value = self.vm_setup mock_BoxDownload.return_value = self.box self.build = BoxBuild(boxname='suse', arch='x86_64') self.build_arm = BoxBuild( boxname='universal', arch='aarch64', machine='virt', cpu='cortex-a57', console='ttyAMA0', ) @patch('kiwi.boxbuild.box_build.BoxDownload') def setup_method(self, cls, mock_BoxDownload): self.setup() @patch('os.environ') @patch('os.system') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') @patch('kiwi.boxbuild.box_build.Path.which') def test_raises_on_kiwi_error( self, mock_path_which, mock_create_build_target_dir, mock_os_system, mock_os_environ, ): mock_path_which.return_value = 'qemu-system-x86_64' with raises(KiwiBoxBuildError): self.build.run( [ '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', '../data/boxbuild/target', ] ) @patch('os.environ') @patch('os.system') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') @patch('kiwi.boxbuild.box_build.Path.which') def test_raises_on_invalid_ssh_port( self, mock_path_which, mock_create_build_target_dir, mock_os_system, mock_os_environ, ): mock_path_which.return_value = 'qemu-system-x86_64' self.build.ssh_port = 'bogus' with raises(KiwiBoxSSHPortInvalid): self.build.run( [ '--debug', '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ] ) @patch('os.environ') @patch('os.system') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') @patch('kiwi.boxbuild.box_build.Path.which') def test_raises_on_download_error( self, mock_path_which, mock_create_build_target_dir, mock_os_system, mock_os_environ, ): mock_path_which.return_value = 'qemu-system-x86_64' self.box.fetch.side_effect = Exception('error') with raises(KiwiBoxDownloadError): self.build.run( [ '--debug', '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ] ) @patch('os.environ') @patch('os.system') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') @patch('kiwi.boxbuild.box_build.Path.which') def test_run_with_9p_sharing( self, mock_path_which, mock_create_build_target_dir, mock_os_system, mock_os_environ, ): mock_path_which.return_value = 'qemu-system-x86_64' self.build.run( [ '--debug', '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ], keep_open=True, kiwi_version='9.22.1', custom_shared_path='/var/tmp/repos', ) mock_create_build_target_dir.assert_called_once_with('target') mock_os_system.assert_called_once_with( 'qemu-system-x86_64 ' '-m 4096 ' '-accel accel=kvm ' '-cpu host ' '-nographic ' '-nodefaults ' '-snapshot ' '-kernel kernel ' '-append "console=hvc0 kiwi=\\"--debug --type oem system build\\"' ' kiwi-no-halt kiwi_version=_9.22.1_' ' custom_mount=_/var/tmp/repos_' ' sharing_backend=_9p_" ' '-drive file=system,if=virtio,driver=qcow2,cache=off,snapshot=on ' '-nic user,model=virtio,hostfwd=tcp::10022-:22 ' '-device virtio-serial ' '-chardev stdio,id=virtiocon0 ' '-device virtconsole,chardev=virtiocon0 ' '-fsdev local,security_model=mapped,id=fsdev0,path=desc ' '-device virtio-9p-pci,id=fs0,fsdev=fsdev0,mount_tag=' 'kiwidescription ' '-fsdev local,security_model=mapped,id=fsdev1,path=target ' '-device virtio-9p-pci,id=fs1,fsdev=fsdev1,mount_tag=' 'kiwibundle ' '-fsdev local,security_model=mapped,id=fsdev2,path=/var/tmp/repos ' '-device virtio-9p-pci,id=fs2,fsdev=fsdev2,mount_tag=' 'custompath ' '-initrd initrd ' '-smp 4' ) @patch('os.environ') @patch('os.system') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') @patch('kiwi.boxbuild.box_build.Path.which') def test_run_cross_arch_aarch64_on_x86_64( self, mock_path_which, mock_create_build_target_dir, mock_os_system, mock_os_environ, ): mock_path_which.return_value = 'qemu-system-aarch64' self.build_arm.run( [ '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ], keep_open=True, kiwi_version='9.22.1', custom_shared_path='/var/tmp/repos', ) mock_create_build_target_dir.assert_called_once_with('target') mock_os_system.assert_called_once_with( 'qemu-system-aarch64 ' '-m 4096 ' '-machine virt ' '-accel accel=kvm ' '-cpu cortex-a57 ' '-nographic ' '-nodefaults ' '-snapshot ' '-kernel kernel ' '-append "console=ttyAMA0 kiwi=\\"--type oem system build\\"' ' kiwi-no-halt kiwi_version=_9.22.1_' ' custom_mount=_/var/tmp/repos_' ' sharing_backend=_9p_" ' '-drive file=system,if=virtio,driver=qcow2,cache=off,snapshot=on ' '-nic user,model=virtio,hostfwd=tcp::10022-:22 ' '-device virtio-serial ' '-chardev stdio,id=virtiocon0 ' '-device virtconsole,chardev=virtiocon0 ' '-fsdev local,security_model=mapped,id=fsdev0,path=desc ' '-device virtio-9p-pci,id=fs0,fsdev=fsdev0,mount_tag=' 'kiwidescription ' '-fsdev local,security_model=mapped,id=fsdev1,path=target ' '-device virtio-9p-pci,id=fs1,fsdev=fsdev1,mount_tag=' 'kiwibundle ' '-fsdev local,security_model=mapped,id=fsdev2,path=/var/tmp/repos ' '-device virtio-9p-pci,id=fs2,fsdev=fsdev2,mount_tag=' 'custompath ' '-initrd initrd ' '-smp 4' ) @patch('os.environ') @patch('os.system') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') @patch('kiwi.boxbuild.box_build.Path.which') def test_run_raises_no_qemu_binary_found( self, mock_path_which, mock_create_build_target_dir, mock_os_system, mock_os_environ, ): mock_path_which.return_value = None with raises(KiwiBoxQEMUBinaryNotFound): self.build.run( [ '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ], keep_open=True, kiwi_version='9.22.1', custom_shared_path='/var/tmp/repos', ) with raises(KiwiBoxQEMUBinaryNotFound): self.build_arm.run( [ '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ] ) @patch('os.environ') @patch('os.system') @patch('subprocess.Popen') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') @patch('kiwi.boxbuild.defaults.Path.which') def test_run_with_virtiofs_sharing_raises( self, mock_path_which, mock_create_build_target_dir, mock_subprocess_Popen, mock_os_system, mock_os_environ, ): path_which_results = [None, 'qemu-system-x86_64'] def path_which(name, lookup=None): return path_which_results.pop() mock_path_which.side_effect = path_which self.build.sharing_backend = 'virtiofs' with raises(KiwiBoxVirtioFsError): self.build.run( [ '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ] ) path_which_results = ['virtiofsd', 'qemu-system-x86_64'] mock_subprocess_Popen.side_effect = Exception with raises(KiwiBoxVirtioFsError): self.build.run( [ '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ] ) @patch('os.environ') @patch('os.system') @patch('os.path.abspath') @patch('subprocess.Popen') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') @patch('kiwi.boxbuild.defaults.Path.which') def test_run_with_virtiofs_sharing( self, mock_path_which, mock_create_build_target_dir, mock_subprocess_Popen, mock_os_path_abspath, mock_os_system, mock_os_environ, ): def abs_path(arg): return 'abspath/{0}'.format(arg) def new_process(self, **args): return Mock() def path_which(name, lookup=None): if name == 'qemu-system-x86_64': return 'qemu-system-x86_64' elif name == 'virtiofsd': return '/usr/libexec/virtiofsd' mock_path_which.side_effect = path_which mock_os_path_abspath.side_effect = abs_path mock_subprocess_Popen.side_effect = new_process self.build.sharing_backend = 'virtiofs' self.build.run( [ '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ], keep_open=True, kiwi_version='9.22.1', custom_shared_path='var/tmp/repos', ) mock_create_build_target_dir.assert_called_once_with('target') mock_os_system.assert_called_once_with( 'qemu-system-x86_64 ' '-m 4096 ' '-accel accel=kvm ' '-cpu host ' '-nographic ' '-nodefaults ' '-snapshot ' '-kernel kernel ' '-append "console=hvc0 kiwi=\\"--type oem system build\\"' ' kiwi-no-halt kiwi_version=_9.22.1_' ' custom_mount=_var/tmp/repos_' ' sharing_backend=_virtiofs_" ' '-drive file=system,if=virtio,driver=qcow2,cache=off,snapshot=on ' '-nic user,model=virtio,hostfwd=tcp::10022-:22 ' '-device virtio-serial ' '-chardev stdio,id=virtiocon0 ' '-device virtconsole,chardev=virtiocon0 ' '-chardev socket,id=char0,path=/tmp/vhostqemu_0 ' '-device vhost-user-fs-pci,queue-size=1024,chardev=char0,tag=' 'kiwidescription ' '-chardev socket,id=char1,path=/tmp/vhostqemu_1 ' '-device vhost-user-fs-pci,queue-size=1024,chardev=char1,tag=' 'kiwibundle ' '-chardev socket,id=char2,path=/tmp/vhostqemu_2 ' '-device vhost-user-fs-pci,queue-size=1024,chardev=char2,tag=' 'custompath ' '-object ' 'memory-backend-file,id=mem,size=4096,mem-path=/dev/shm,share=on ' '-numa node,memdev=mem ' '-initrd initrd ' '-smp 4' ) assert mock_subprocess_Popen.call_args_list == [ call( [ '/usr/libexec/virtiofsd', '--socket-path=/tmp/vhostqemu_0', '--shared-dir', 'abspath/desc', '--sandbox', 'namespace', '--cache', 'always', '--allow-direct-io', '--posix-acl', '--xattr', ], close_fds=True, ), call( [ '/usr/libexec/virtiofsd', '--socket-path=/tmp/vhostqemu_1', '--shared-dir', 'abspath/target', '--sandbox', 'namespace', '--cache', 'always', '--allow-direct-io', '--posix-acl', '--xattr', ], close_fds=True, ), call( [ '/usr/libexec/virtiofsd', '--socket-path=/tmp/vhostqemu_2', '--shared-dir', 'abspath/var/tmp/repos', '--sandbox', 'namespace', '--cache', 'always', '--allow-direct-io', '--posix-acl', '--xattr', ], close_fds=True, ), ] for virtiofsd_process in defaults.VIRTIOFSD_PROCESS_LIST: virtiofsd_process.terminate.assert_called_once_with() @patch('pwd.getpwuid') @patch('time.sleep') @patch('os.path.isfile') @patch('os.system') @patch('kiwi.boxbuild.box_build.Command.run') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') @patch('kiwi.boxbuild.defaults.Path.which') def test_run_with_sshfs_sharing( self, mock_path_which, mock_create_build_target_dir, mock_Command_run, mock_os_system, mock_os_path_isfile, mock_time_sleep, mock_pwd_getpwuid, ): def command_run(args, raise_on_error=True): if args[0] == 'ssh': raise Exception def path_which(name, lookup=None): if name == 'qemu-system-x86_64': return 'qemu-system-x86_64' mock_path_which.side_effect = path_which mock_Command_run.side_effect = command_run mock_pwd_getpwuid.return_value.pw_name = 'user' mock_os_path_isfile.return_value = False self.build.sharing_backend = 'sshfs' self.build.ssh_port = '10022' with raises(KiwiBoxSSHKeyNotFound): self.build.run( [ '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ], keep_open=True, kiwi_version='9.22.1', custom_shared_path='var/tmp/repos', ) mock_create_build_target_dir.reset_mock() mock_os_path_isfile.return_value = True with patch('builtins.open', create=True) as mock_open: with patch.dict('os.environ', {'HOME': '~'}): file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = 'key_type key_value' self.build.run( [ '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ], keep_open=True, kiwi_version='9.22.1', custom_shared_path='var/tmp/repos', ) mock_create_build_target_dir.assert_called_once_with('target') mock_os_system.assert_called_once_with( 'qemu-system-x86_64 ' '-m 4096 ' '-accel accel=kvm ' '-cpu host ' '-nographic ' '-nodefaults ' '-snapshot ' '-kernel kernel ' '-append "console=hvc0 kiwi=\\"--type oem system build\\"' ' kiwi-no-halt kiwi_version=_9.22.1_' ' custom_mount=_var/tmp/repos_' ' ssh_key=_key_value_' ' ssh_key_type=_key_type_' ' host_kiwidescription=_user@localhost:desc_' ' host_kiwibundle=_user@localhost:target_' ' host_custompath=_user@localhost:var/tmp/repos_' ' sharing_backend=_sshfs_" ' '-drive file=system,if=virtio,driver=qcow2,cache=off,snapshot=on ' '-nic user,model=virtio,hostfwd=tcp::10022-:22 ' '-device virtio-serial ' '-chardev stdio,id=virtiocon0 ' '-device virtconsole,chardev=virtiocon0 ' '-initrd initrd ' '-smp 4' ) assert mock_Command_run.call_args_list[0] == call( ['ssh-keygen', '-R', '[localhost]:10022'], raise_on_error=False ) assert mock_Command_run.call_args_list[1] == call( [ 'ssh', '-NT', '-o', 'StrictHostKeyChecking=no', 'root@localhost', '-p', '10022', '-R', '10000:localhost:22', ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7640593 kiwi-11.1.8/test/unit/boxbuild/box_config_test.py0000644000000000000000000000652115273675667017023 0ustar00from unittest.mock import patch from pytest import raises from kiwi.boxbuild.box_config import BoxConfig from kiwi.exceptions import ( KiwiBoxConfigError, KiwiBoxNameError, KiwiBoxArchNotFoundError, ) class TestBoxConfig: @patch('kiwi.boxbuild.defaults.BoxBuildDefaults.get_box_config_file') @patch('platform.machine') def setup(self, mock_platform_machine, mock_get_box_config_file): mock_platform_machine.return_value = 'x86_64' mock_get_box_config_file.return_value = ( '../data/boxbuild/kiwi_boxed_plugin.yml' ) self.box_config = BoxConfig('suse') @patch('kiwi.boxbuild.defaults.BoxBuildDefaults.get_box_config_file') @patch('platform.machine') def setup_method( self, cls, mock_platform_machine, mock_get_box_config_file ): self.setup() @patch('yaml.safe_load') @patch('kiwi.boxbuild.defaults.BoxBuildDefaults.get_box_config_file') def test_setup_raises_on_load_config( self, mock_get_box_config_file, mock_yaml_safe_load ): mock_get_box_config_file.return_value = ( '../data/boxbuild/kiwi_boxed_plugin.yml' ) mock_yaml_safe_load.side_effect = Exception with raises(KiwiBoxConfigError): BoxConfig('suse') @patch('kiwi.boxbuild.defaults.BoxBuildDefaults.get_box_config_file') def test_setup_raises_on_unsupported_arch(self, mock_get_box_config_file): mock_get_box_config_file.return_value = ( '../data/boxbuild/kiwi_boxed_plugin.yml' ) with raises(KiwiBoxArchNotFoundError): BoxConfig('suse', 'artificial_arch') @patch('kiwi.boxbuild.defaults.BoxBuildDefaults.get_box_config_file') def test_setup_raises_box_not_found(self, mock_get_box_config_file): mock_get_box_config_file.return_value = ( '../data/boxbuild/kiwi_boxed_plugin.yml' ) with raises(KiwiBoxNameError): self.box_config = BoxConfig('foo', 'x86_64') def test_get_box_arch(self): assert self.box_config.get_box_arch() == 'x86_64' def test_get_box_memory_mbytes(self): assert self.box_config.get_box_memory_mbytes() == '8096M' def test_get_box_console(self): assert self.box_config.get_box_console() == 'hvc0' def test_get_box_kernel_cmdline(self): assert ( self.box_config.get_box_kernel_cmdline() == 'root=/dev/vda1 rd.plymouth=0' ) def test_get_box_source(self): assert ( self.box_config.get_box_source() == 'obs://Virtualization:Appliances:SelfContained:suse/images' ) def test_get_box_packages_file(self): assert ( self.box_config.get_box_packages_file() == 'SUSE-Box.x86_64-1.42.1-System-BuildBox.report' ) def test_get_box_packages_shasum_file(self): assert ( self.box_config.get_box_packages_shasum_file() == 'SUSE-Box.x86_64-1.42.1-System-BuildBox.report.sha256' ) def test_get_box_files(self): assert self.box_config.get_box_files() == [ 'SUSE-Box.x86_64-1.42.1-Kernel-BuildBox.tar.xz', 'SUSE-Box.x86_64-1.42.1-Kernel-BuildBox.tar.xz.sha256', 'SUSE-Box.x86_64-1.42.1-System-BuildBox.qcow2', 'SUSE-Box.x86_64-1.42.1-System-BuildBox.qcow2.sha256', ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7640593 kiwi-11.1.8/test/unit/boxbuild/box_container_build_test.py0000644000000000000000000001567215273675667020726 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.boxbuild.box_container_build import BoxContainerBuild from kiwi.exceptions import KiwiBoxBuildError from kiwi.utils.temporary import Temporary class TestBoxContainerBuild: @patch('kiwi.boxbuild.box_container_build.BoxDownload') def setup(self, mock_BoxDownload): self.box = Mock() self.box.fetch_container.return_value = 'some' mock_BoxDownload.return_value = self.box self.build = BoxContainerBuild(boxname='suse', arch='x86_64') @patch('kiwi.boxbuild.box_container_build.BoxDownload') def setup_method(self, cls, mock_BoxDownload): self.setup() @patch('os.path.exists') @patch('os.environ') @patch('os.system') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') def test_run_shared_path_does_not_exist( self, mock_create_build_target_dir, mock_os_system, mock_os_environ, mock_os_path_exists, ): def exists(path): if path.endswith('/var/tmp/repos'): return False return True mock_os_path_exists.side_effect = exists target = Temporary().new_dir() with raises(KiwiBoxBuildError): self.build.run( [ '--debug', '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', target.name, ], keep_open=True, kiwi_version='9.22.1', custom_shared_path='/var/tmp/repos', ) @patch('os.path.exists') @patch('os.environ') @patch('os.system') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') def test_run_image_description_does_not_exist( self, mock_create_build_target_dir, mock_os_system, mock_os_environ, mock_os_path_exists, ): def exists(path): if path.endswith('desc'): return False return True mock_os_path_exists.side_effect = exists target = Temporary().new_dir() with raises(KiwiBoxBuildError): self.build.run( [ '--debug', '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', target.name, ], keep_open=True, kiwi_version='9.22.1', custom_shared_path='/var/tmp/repos', ) @patch('os.path.isdir') @patch('os.path.exists') @patch('os.environ') @patch('os.system') @patch('kiwi.boxbuild.box_build.BoxBuildDefaults.create_build_target_dir') @patch('kiwi.boxbuild.box_container_build.NamedTemporaryFile') def test_run_build_failed( self, mock_NamedTemporaryFile, mock_create_build_target_dir, mock_os_system, mock_os_environ, mock_os_path_exists, mock_os_path_isdir, ): def exists(path): if path.endswith('/result.code'): return True if path.endswith('/var/tmp/repos'): return True if path.endswith('desc'): return True return False mock_os_path_isdir.return_value = True mock_os_path_exists.side_effect = exists tmpfile = Mock() tmpfile.name = 'tmpfile' mock_NamedTemporaryFile.return_value = tmpfile with patch('builtins.open', create=True) as mock_open: file_handle = mock_open.return_value.__enter__.return_value file_handle.readline.return_value = '1' target = Temporary().new_dir() with raises(KiwiBoxBuildError): self.build.run( [ '--debug', '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', target.name, ], keep_open=True, kiwi_version='9.22.1', custom_shared_path='/var/tmp/repos', ) @patch('os.path.isdir') @patch('os.path.abspath') @patch('os.path.exists') @patch('os.environ') @patch('os.system') @patch('kiwi.boxbuild.box_container_build.NamedTemporaryFile') @patch('kiwi.boxbuild.box_container_build.Command.run') @patch('pathlib.Path') def test_run( self, mock_Path, mock_Command_run, mock_NamedTemporaryFile, mock_os_system, mock_os_environ, mock_os_path_exists, mock_os_abspath, mock_os_path_isdir, ): def abspath(path): return path def exists(path): if path == 'target/result.code': return True if path == '/var/tmp/repos': return True if path == 'desc': return True return False mock_os_path_isdir.return_value = False mock_os_abspath.side_effect = abspath mock_os_path_exists.side_effect = exists tmpfile = Mock() tmpfile.name = 'tmpfile' mock_NamedTemporaryFile.return_value = tmpfile with patch('builtins.open', create=True) as mock_open: file_handle = mock_open.return_value.__enter__.return_value file_handle.readline.return_value = '0' self.build.run( [ '--debug', '--type', 'oem', 'system', 'build', '--description', 'desc', '--target-dir', 'target', ], keep_open=True, kiwi_version='9.22.1', custom_shared_path='/var/tmp/repos', ) mock_Command_run.assert_called_once_with( ['sudo', 'mkdir', '-p', '/var/cache/kiwi'] ) mock_os_system.assert_called_once_with( 'sudo podman run --rm -ti ' '--privileged ' '--net host ' '--cap-add AUDIT_WRITE ' '--cap-add AUDIT_CONTROL ' '--cap-add CAP_MKNOD ' '--cap-add CAP_SYS_ADMIN ' '--volume /var/cache/kiwi:/var/cache/kiwi ' '--volume tmpfile:/container.cmdline ' '--volume target:/bundle ' '--volume desc:/description ' '--volume /dev:/dev ' '--volume /var/tmp/repos:/var/tmp/repos ' 'some' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7640593 kiwi-11.1.8/test/unit/boxbuild/box_download_test.py0000644000000000000000000002521315273675667017364 0ustar00import io from pytest import raises from unittest.mock import patch, Mock, MagicMock, call from kiwi.exceptions import KiwiBoxChecksumError from kiwi.boxbuild.box_download import BoxDownload, vm_setup_type class TestBoxDownload: @patch('kiwi.boxbuild.defaults.BoxBuildDefaults.get_box_config_file') @patch('kiwi.boxbuild.box_download.Path') @patch('kiwi.boxbuild.box_download.DirFiles') def setup(self, mock_DirFiles, mock_Path, mock_get_box_config_file): self.box_stage = Mock() self.box_stage.register.return_value = 'register_file' mock_DirFiles.return_value = self.box_stage mock_get_box_config_file.return_value = ( '../data/boxbuild/kiwi_boxed_plugin.yml' ) with patch.dict('os.environ', {'HOME': 'HOME'}): self.box = BoxDownload('suse', 'x86_64') mock_Path.create.assert_called_once_with('HOME/.kiwi_boxes/suse') self.result = vm_setup_type( system='HOME/.kiwi_boxes/suse/' 'SUSE-Box.x86_64-1.42.1-System-BuildBox.qcow2', kernel='HOME/.kiwi_boxes/suse/kernel.x86_64', initrd='HOME/.kiwi_boxes/suse/initrd.x86_64', append='console=hvc0 root=/dev/vda1 rd.plymouth=0', console='hvc0', ram='8096M', smp=4, ) @patch('kiwi.boxbuild.defaults.BoxBuildDefaults.get_box_config_file') @patch('kiwi.boxbuild.box_download.Path') @patch('kiwi.boxbuild.box_download.DirFiles') def setup_method( self, cls, mock_DirFiles, mock_Path, mock_get_box_config_file ): self.setup() @patch('kiwi.boxbuild.defaults.BoxBuildDefaults.get_box_config_file') @patch('kiwi.boxbuild.box_download.Path') @patch('kiwi.boxbuild.box_download.DirFiles') @patch('os.path.isdir') def test_custom_box_cache_dir( self, mock_os_path_isdir, mock_DirFiles, mock_Path, mock_get_box_config_file, ): mock_os_path_isdir.return_value = True mock_DirFiles.return_value = Mock().register.return_value = ( 'register_file' ) mock_get_box_config_file.return_value = ( '../data/boxbuild/kiwi_boxed_plugin.yml' ) with patch.dict( 'os.environ', {'KIWI_BOXED_CACHE_DIR': '/some/custom/dir'} ): BoxDownload('suse', 'x86_64') mock_Path.create.assert_called_once_with('/some/custom/dir/suse') @patch('kiwi.boxbuild.box_download.Command.run') @patch('kiwi.boxbuild.box_download.Uri') @patch('kiwi.boxbuild.box_download.SolverRepository.new') @patch('kiwi.boxbuild.box_download.Checksum') @patch('os.path.exists') @patch('os.chdir') @patch('kiwi.boxbuild.box_download.FetchFiles') def test_fetch_image_checksum_failed( self, mock_FetchFiles, mock_os_chdir, mock_os_path_exist, mock_Checksum, mock_SolverRepository, mock_Uri, mock_Command_run, ): def matches(shasum, filename): if filename.endswith('.qcow2.sha256'): return False return True checksum = Mock() checksum.matches.side_effect = matches checksum.sha256.return_value = 'sum' mock_Checksum.return_value = checksum with patch('builtins.open', create=True): with raises(KiwiBoxChecksumError): self.box.fetch(update_check=True) @patch('kiwi.boxbuild.box_download.Command.run') @patch('kiwi.boxbuild.box_download.Uri') @patch('kiwi.boxbuild.box_download.SolverRepository.new') @patch('kiwi.boxbuild.box_download.Checksum') @patch('os.path.exists') @patch('os.chdir') @patch('kiwi.boxbuild.box_download.FetchFiles') def test_fetch_kernel_checksum_failed( self, mock_FetchFiles, mock_os_chdir, mock_os_path_exist, mock_Checksum, mock_SolverRepository, mock_Uri, mock_Command_run, ): def matches(shasum, filename): if filename.endswith('.tar.xz.sha256'): return False return True checksum = Mock() checksum.matches.side_effect = matches checksum.sha256.return_value = 'sum' mock_Checksum.return_value = checksum with patch('builtins.open', create=True): with raises(KiwiBoxChecksumError): self.box.fetch(update_check=True) @patch('kiwi.boxbuild.box_download.Command.run') @patch('kiwi.boxbuild.box_download.Uri') @patch('kiwi.boxbuild.box_download.SolverRepository.new') @patch('kiwi.boxbuild.box_download.Checksum') @patch('os.path.exists') @patch('os.chdir') @patch('kiwi.boxbuild.box_download.FetchFiles') @patch.object(BoxDownload, '_checksum_ok') def test_fetch_sbom_checksum_did_not_match( self, mock__checksum_ok, mock_FetchFiles, mock_os_chdir, mock_os_path_exist, mock_Checksum, mock_SolverRepository, mock_Uri, mock_Command_run, ): mock__checksum_ok.return_value = True fetcher = Mock() mock_FetchFiles.return_value = fetcher checksum = Mock() checksum.matches.return_value = False checksum.sha256.return_value = 'sum' mock_Checksum.return_value = checksum repo = Mock() repo._get_mime_typed_uri.return_value = 'uri://' mock_SolverRepository.return_value = repo mock_os_path_exist.return_value = False with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value with patch.dict('os.environ', {'HOME': 'HOME'}): assert self.box.fetch(update_check=True) == self.result assert self.box_stage.register.call_args_list == [ call( 'HOME/.kiwi_boxes/suse/' 'SUSE-Box.x86_64-1.42.1-System-BuildBox.report' ), call( 'HOME/.kiwi_boxes/suse/' 'SUSE-Box.x86_64-1.42.1-System-BuildBox.report.sha256' ), call( 'HOME/.kiwi_boxes/suse/' 'SUSE-Box.x86_64-1.42.1-Kernel-BuildBox.tar.xz' ), call( 'HOME/.kiwi_boxes/suse/' 'SUSE-Box.x86_64-1.42.1-Kernel-BuildBox.tar.xz.sha256' ), call( 'HOME/.kiwi_boxes/suse/' 'SUSE-Box.x86_64-1.42.1-System-BuildBox.qcow2' ), call( 'HOME/.kiwi_boxes/suse/' 'SUSE-Box.x86_64-1.42.1-System-BuildBox.qcow2.sha256' ), ] mock_open.assert_called_once_with( self.box_stage.register.return_value, 'w' ) file_handle.write.assert_called_once_with('sum') repo.download_from_repository.assert_called_once_with( 'SUSE-Box.x86_64-1.42.1-System-BuildBox.report', self.box_stage.register.return_value, ) assert fetcher.wget.call_args_list == [ call( url='uri:///SUSE-Box.x86_64-1.42.1-Kernel-BuildBox.tar.xz', filename='register_file', ), call( url='uri:///SUSE-Box.x86_64-1.42.1-Kernel-BuildBox.tar.xz.sha256', filename='register_file', ), call( url='uri:///SUSE-Box.x86_64-1.42.1-System-BuildBox.qcow2', filename='register_file', ), call( url='uri:///SUSE-Box.x86_64-1.42.1-System-BuildBox.qcow2.sha256', filename='register_file', ), ] self.box_stage.commit.assert_called_once_with() assert mock_Command_run.call_args_list == [ call( [ 'tar', '-C', 'HOME/.kiwi_boxes/suse', '--transform', 's/.*/kernel.x86_64/', '--wildcards', '-xf', 'HOME/.kiwi_boxes/suse/' 'SUSE-Box.x86_64-1.42.1-Kernel-BuildBox.tar.xz', '*.kernel', ] ), call( [ 'tar', '-C', 'HOME/.kiwi_boxes/suse', '--transform', 's/.*/initrd.x86_64/', '--wildcards', '-xf', 'HOME/.kiwi_boxes/suse/' 'SUSE-Box.x86_64-1.42.1-Kernel-BuildBox.tar.xz', '*.initrd', ] ), ] @patch('kiwi.boxbuild.box_download.Command.run') @patch('kiwi.boxbuild.box_download.Uri') @patch('kiwi.boxbuild.box_download.SolverRepository.new') @patch('kiwi.boxbuild.box_download.Checksum') @patch('os.path.exists') def test_fetch_checksum_matches( self, mock_os_path_exist, mock_Checksum, mock_SolverRepository, mock_Uri, mock_Command_run, ): checksum = Mock() checksum.matches.return_value = True checksum.sha256.return_value = 'sum' mock_Checksum.return_value = checksum repo = Mock() mock_SolverRepository.return_value = repo mock_os_path_exist.return_value = True assert self.box.fetch(update_check=True) == self.result repo.download_from_repository.assert_called_once_with( 'SUSE-Box.x86_64-1.42.1-System-BuildBox.report', self.box_stage.register.return_value, ) @patch('kiwi.boxbuild.box_download.Command.run') @patch('kiwi.boxbuild.box_download.Uri') @patch('kiwi.boxbuild.box_download.SolverRepository.new') @patch('kiwi.boxbuild.box_download.Checksum') @patch('os.path.exists') def test_fetch_update_check_disabled( self, mock_os_path_exist, mock_Checksum, mock_SolverRepository, mock_Uri, mock_Command_run, ): mock_os_path_exist.return_value = True assert self.box.fetch(update_check=False) == self.result @patch('os.system') def test_fetch_container(self, mock_os_system): assert self.box.fetch_container() == 'some' mock_os_system.assert_called_once_with('sudo podman pull some') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7640593 kiwi-11.1.8/test/unit/boxbuild/boxes_config_test.py0000644000000000000000000001020315273675667017343 0ustar00import yaml from unittest.mock import patch from pytest import raises from kiwi.boxbuild.boxes_config import BoxesConfig from kiwi.exceptions import KiwiBoxConfigError class TestBoxesConfig: @patch('kiwi.boxbuild.defaults.BoxBuildDefaults.get_box_config_file') def setup(self, mock_get_box_config_file): mock_get_box_config_file.return_value = ( '../data/boxbuild/kiwi_boxed_plugin.yml' ) self.plugin_config = BoxesConfig() @patch('kiwi.boxbuild.defaults.BoxBuildDefaults.get_box_config_file') def setup_method(self, cls, mock_get_box_config_file): self.setup() @patch('kiwi.boxbuild.defaults.BoxBuildDefaults.get_box_config_file') def test_invalid_config(self, mock_get_box_config_file): mock_get_box_config_file.return_value = ( '../data/boxbuild/kiwi_boxed_plugin_invalid.yml' ) with raises(KiwiBoxConfigError): BoxesConfig() def test_get_config(self): assert self.plugin_config.get_config() == [ { 'name': 'suse', 'mem_mb': '8096M', 'processors': 4, 'console': 'hvc0', 'arch': [ { 'name': 'x86_64', 'cmdline': ['root=/dev/vda1', 'rd.plymouth=0'], 'source': 'obs://Virtualization:Appliances:SelfContained:' 'suse/images', 'packages_file': 'SUSE-Box.x86_64-1.42.1-System-BuildBox.report', 'boxfiles': [ 'SUSE-Box.x86_64-1.42.1-Kernel-BuildBox.tar.xz', 'SUSE-Box.x86_64-1.42.1-System-BuildBox.qcow2', ], 'container': 'some', 'use_initrd': True, } ], }, { 'name': 'universal', 'mem_mb': '8096M', 'processors': 4, 'console': 'hvc0', 'arch': [ { 'name': 'x86_64', 'cmdline': [ 'root=/dev/vda3', 'rd.plymouth=0', 'selinux=0', ], 'source': 'obs://Virtualization:Appliances:SelfContained:' 'universal/images', 'packages_file': 'Universal-Box.x86_64-1.1.2-System-BuildBox.report', 'boxfiles': [ 'Universal-Box.x86_64-1.1.2-Kernel-BuildBox.tar.xz', 'Universal-Box.x86_64-1.1.2-System-BuildBox.qcow2', ], 'container': 'some', 'use_initrd': True, }, { 'name': 'aarch64', 'cmdline': [ 'root=/dev/vda2', 'rd.plymouth=0', 'selinux=0', ], 'source': 'obs://Virtualization:Appliances:SelfContained:' 'universal/images', 'packages_file': 'Universal-Box.' 'aarch64-1.1.2-System-BuildBox.report', 'boxfiles': [ 'Universal-Box.aarch64-1.1.2-' 'Kernel-BuildBox.tar.xz', 'Universal-Box.aarch64-1.1.2-' 'System-BuildBox.qcow2', ], 'container': 'some', 'use_initrd': True, }, ], }, ] def test_dump_config(self): assert self.plugin_config.dump_config() == yaml.dump( self.plugin_config.get_config() ) @patch('yaml.safe_load') def test_setup_raises(self, mock_yaml_safe_load): mock_yaml_safe_load.side_effect = Exception with raises(KiwiBoxConfigError): BoxesConfig() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7640593 kiwi-11.1.8/test/unit/boxbuild/defaults_test.py0000644000000000000000000000650615273675667016520 0ustar00import os from unittest.mock import patch, call, Mock from pytest import raises from kiwi.boxbuild.defaults import BoxBuildDefaults from kiwi.defaults import Defaults from kiwi.exceptions import KiwiBoxTargetPathError class TestBoxBuildDefaults: @patch('pathlib.Path.home') @patch('os.path.exists') def test_get_box_config_file(self, mock_os_path_exists, mock_Path_home): mock_os_path_exists.return_value = False mock_Path_home.return_value.joinpath.return_value.exists.return_value = ( False ) assert BoxBuildDefaults.get_box_config_file() == Defaults.project_file( 'config/kiwi_boxed_plugin.yml' ) @patch('os.path.exists', lambda f: True) @patch.dict(os.environ, KIWI_BOXED_PLUGIN_CFG='aarchderwelt.conf') def test_get_box_config_file_env(self): assert BoxBuildDefaults.get_box_config_file() == 'aarchderwelt.conf' @patch.dict(os.environ, {}, clear=True) @patch('os.path.abspath', lambda f: '/highway/to/hell.conf') @patch('os.path.exists', lambda f: True) def test_get_box_config_file_currdir(self): assert BoxBuildDefaults.get_box_config_file() == '/highway/to/hell.conf' @patch.dict(os.environ, {}, clear=True) @patch('pathlib.Path.home') @patch('os.path.exists') def test_get_box_config_file_local_kiwi( self, mock_os_path_exists, mock_Path_home ): mock_os_path_exists.return_value = False config_path_home = Mock() config_path_home.exists.return_value = True config_path_home.as_posix.return_value = ( '/home/zoidberg/.config/kiwi/kiwi_boxed_plugin.yml' ) mock_Path_home.return_value.joinpath.return_value = config_path_home assert ( BoxBuildDefaults.get_box_config_file() == '/home/zoidberg/.config/kiwi/kiwi_boxed_plugin.yml' ) mock_Path_home.return_value.joinpath.assert_called_once_with( '.config/kiwi/kiwi_boxed_plugin.yml' ) @patch.dict(os.environ, {}, clear=True) @patch('pathlib.Path.home') @patch('os.path.exists', lambda f: f == '/etc/kiwi_boxed_plugin.yml') def test_get_box_config_file_etc(self, mock_Path_home): mock_Path_home.return_value.joinpath.return_value.exists.return_value = ( False ) assert ( BoxBuildDefaults.get_box_config_file() == '/etc/kiwi_boxed_plugin.yml' ) @patch('os.path.isdir') def test_get_local_box_cache_dir(self, mock_os_path_isdir): mock_os_path_isdir.return_value = True with patch.dict(os.environ, {'KIWI_BOXED_CACHE_DIR': '/var/cache'}): assert BoxBuildDefaults.get_local_box_cache_dir() == '/var/cache' with patch.dict(os.environ, {'HOME': '/home/zoidberg'}, clear=True): assert ( BoxBuildDefaults.get_local_box_cache_dir() == '/home/zoidberg/.kiwi_boxes' ) @patch('pathlib.Path') def test_create_build_target_dir(self, mock_Path): BoxBuildDefaults.create_build_target_dir('some') assert mock_Path.call_args_list == [ call('some'), call('some/result.log'), ] mock_Path.side_effect = Exception('some error') with raises(KiwiBoxTargetPathError): BoxBuildDefaults.create_build_target_dir('some') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7640593 kiwi-11.1.8/test/unit/builder/__init__.py0000644000000000000000000000000015273675667015206 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7643697 kiwi-11.1.8/test/unit/builder/archive_test.py0000644000000000000000000000623615273675667016150 0ustar00from unittest.mock import patch from pytest import raises import sys import unittest.mock as mock import kiwi from ..test_helper import argv_kiwi_tests from kiwi.defaults import Defaults from kiwi.builder.archive import ArchiveBuilder from kiwi.exceptions import KiwiArchiveSetupError class TestArchiveBuilder: def setup(self): Defaults.set_platform_name('x86_64') self.xml_state = mock.Mock() self.xml_state.profiles = None self.xml_state.get_image_version = mock.Mock(return_value='1.2.3') self.xml_state.get_build_type_name = mock.Mock(return_value='tbz') self.xml_state.xml_data.get_name = mock.Mock(return_value='myimage') self.setup = mock.Mock() kiwi.builder.archive.SystemSetup = mock.Mock(return_value=self.setup) self.archive = ArchiveBuilder(self.xml_state, 'target_dir', 'root_dir') def setup_method(self, cls): self.setup() def test_create_unknown_archive_type(self): xml_state = mock.Mock() xml_state.get_build_type_name = mock.Mock(return_value='bogus') xml_state.get_image_version = mock.Mock(return_value='1.2.3') xml_state.xml_data.get_name = mock.Mock(return_value='myimage') archive = ArchiveBuilder(xml_state, 'target_dir', 'root_dir') with raises(KiwiArchiveSetupError): archive.create() @patch('kiwi.builder.archive.ArchiveTar') def test_create_tar(self, mock_tar): Defaults.set_platform_name('x86_64') self.archive.requested_archive_type = 'tbz' archive = mock.Mock() mock_tar.return_value = archive self.archive.create() mock_tar.assert_called_once_with('target_dir/myimage.x86_64-1.2.3.tar') archive.create_xz_compressed.assert_called_once_with( 'root_dir', exclude=[ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', ], xz_options=None, ) self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) self.setup.export_package_list.assert_called_once_with('target_dir') @patch('kiwi.builder.archive.ArchiveCpio') def test_create_cpio(self, mock_cpio): Defaults.set_platform_name('x86_64') self.archive.requested_archive_type = 'cpio' archive = mock.Mock() mock_cpio.return_value = archive self.archive.create() mock_cpio.assert_called_once_with( 'target_dir/myimage.x86_64-1.2.3.cpio' ) archive.create.assert_called_once_with( 'root_dir', exclude=[ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', ], ) self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) self.setup.export_package_list.assert_called_once_with('target_dir') def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7643697 kiwi-11.1.8/test/unit/builder/container_test.py0000644000000000000000000002623015273675667016505 0ustar00from unittest.mock import patch, call, mock_open, Mock from pytest import raises import unittest.mock as mock import kiwi from kiwi.defaults import Defaults from kiwi.builder.container import ContainerBuilder from kiwi.exceptions import KiwiContainerBuilderError class TestContainerBuilder: @patch('os.path.exists') def setup(self, mock_exists): Defaults.set_platform_name('x86_64') self.runtime_config = mock.Mock() self.runtime_config.get_max_size_constraint = mock.Mock( return_value=None ) self.runtime_config.get_container_compression = mock.Mock( return_value=False ) self.shasum = Mock() self.shasum.suffix = '.sha256' self.shasum.digest.return_value = 'checksumvalue' self.runtime_config.get_checksum_handler = Mock( return_value=self.shasum ) kiwi.builder.container.RuntimeConfig = mock.Mock( return_value=self.runtime_config ) self.xml_state = mock.Mock() self.xml_state.get_derived_from_image_uri.return_value = mock.Mock() self.container_config = { 'container_name': 'my-container', 'entry_command': ["--config.cmd='/bin/bash'"], } self.xml_state.get_container_config = mock.Mock( return_value=self.container_config ) self.xml_state.get_image_version = mock.Mock(return_value='1.2.3') self.xml_state.get_build_type_name = mock.Mock(return_value='docker') self.xml_state.xml_data.get_name = mock.Mock(return_value='image_name') self.xml_state.build_type.get_delta_root = mock.Mock(return_value=False) self.setup = mock.Mock() kiwi.builder.container.SystemSetup = mock.Mock(return_value=self.setup) def side_effect(filename): if filename.endswith('.config/kiwi/config.yml'): return False elif filename.endswith('etc/kiwi.yml'): return False else: return True mock_exists.side_effect = side_effect self.container = ContainerBuilder( self.xml_state, 'target_dir', 'root_dir' ) self.container.result = mock.Mock() @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() def test_init_derived(self): assert self.container.base_image == 'root_dir/image/imported_root' @patch('os.path.exists') def test_init_derived_base_image_not_existing(self, mock_exists): mock_exists.return_value = False with raises(KiwiContainerBuilderError): ContainerBuilder(self.xml_state, 'target_dir', 'root_dir') @patch('os.path.exists') def test_init_derived_base_image_sha256_not_existing(self, mock_exists): exists_results = [False, False, True] def side_effect(self): return exists_results.pop() mock_exists.side_effect = side_effect with raises(KiwiContainerBuilderError): ContainerBuilder(self.xml_state, 'target_dir', 'root_dir') @patch('kiwi.builder.container.Checksum') @patch('kiwi.builder.container.ContainerImage') @patch('os.path.exists') def test_create_derived_checksum_match_failed( self, mock_exists, mock_image, mock_checksum ): def side_effect(filename): if filename.endswith('.config/kiwi/config.yml'): return False elif filename.endswith('etc/kiwi.yml'): return False else: return True mock_exists.side_effect = side_effect container = ContainerBuilder(self.xml_state, 'target_dir', 'root_dir') container.result = mock.Mock() checksum = mock.Mock() checksum.matches = mock.Mock(return_value=False) mock_checksum.return_value = checksum with raises(KiwiContainerBuilderError): container.create() @patch('kiwi.builder.container.ContainerSetup') @patch('kiwi.builder.container.ContainerImage') def test_create(self, mock_image, mock_setup): container_setup = mock.Mock() mock_setup.new.return_value = container_setup container_image = mock.Mock() container_image.create = mock.Mock( return_value='target_dir/image_name.x86_64-1.2.3.docker.tar' ) mock_image.new.return_value = container_image self.setup.export_package_verification.return_value = '.verified' self.setup.export_package_changes.return_value = '.changes' self.setup.export_package_list.return_value = '.packages' self.container.base_image = None self.container.create() mock_setup.new.assert_called_once_with( 'docker', 'root_dir', self.container_config ) container_setup.setup.assert_called_once_with() mock_image.new.assert_called_once_with( 'docker', 'root_dir', self.container_config ) container_image.create.assert_called_once_with( 'target_dir/image_name.x86_64-1.2.3.docker.tar', '', True, False ) assert self.container.result.add.call_args_list == [ call( key='container', filename='target_dir/image_name.x86_64-1.2.3.docker.tar', use_for_bundle=True, compress=False, shasum=True, ), call( key='image_packages', filename='.packages', use_for_bundle=True, compress=False, shasum=False, ), call( key='image_changes', filename='.changes', use_for_bundle=True, compress=True, shasum=False, ), call( key='image_verified', filename='.verified', use_for_bundle=True, compress=False, shasum=False, ), ] self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) self.setup.export_package_list.assert_called_once_with('target_dir') @patch('kiwi.builder.container.Checksum') @patch('kiwi.builder.container.ContainerImage') @patch('os.path.exists') def test_create_derived(self, mock_exists, mock_image, mock_checksum): def side_effect(filename): if filename.endswith('.config/kiwi/config.yml'): return False elif filename.endswith('etc/kiwi.yml'): return False else: return True mock_exists.side_effect = side_effect container_image = mock.Mock() container_image.create = mock.Mock( return_value='target_dir/image_name.x86_64-1.2.3.docker.tar' ) mock_image.new.return_value = container_image container = ContainerBuilder(self.xml_state, 'target_dir', 'root_dir') container.result = mock.Mock() checksum = mock.Mock() checksum.sha256 = mock.Mock(return_value='checksumvalue') mock_checksum.return_value = checksum self.setup.export_package_changes.return_value = '.changes' self.setup.export_package_verification.return_value = '.verified' self.setup.export_package_list.return_value = '.packages' container.create() mock_checksum.assert_called_once_with('root_dir/image/imported_root') checksum.matches.assert_called_once_with( 'checksumvalue', 'root_dir/image/imported_root.sha256' ) mock_image.new.assert_called_once_with( 'docker', 'root_dir', self.container_config ) container_image.create.assert_called_once_with( 'target_dir/image_name.x86_64-1.2.3.docker.tar', 'root_dir/image/imported_root', True, False, ) assert container.result.add.call_args_list == [ call( key='container', filename='target_dir/image_name.x86_64-1.2.3.docker.tar', use_for_bundle=True, compress=False, shasum=True, ), call( key='image_packages', filename='.packages', use_for_bundle=True, compress=False, shasum=False, ), call( key='image_changes', filename='.changes', use_for_bundle=True, compress=True, shasum=False, ), call( key='image_verified', filename='.verified', use_for_bundle=True, compress=False, shasum=False, ), ] self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) self.setup.export_package_list.assert_called_once_with('target_dir') @patch('kiwi.builder.container.Checksum') def test_create_derived_with_different_sha256(self, mock_sha256): sha256 = mock.Mock() sha256.sha256.return_value = 'diffchecksumvalue' mock_sha256.return_value = sha256 m_open = mock_open(read_data='checksum data\n') with patch('builtins.open', m_open, create=True): with raises(KiwiContainerBuilderError): container = ContainerBuilder( self.xml_state, 'target_dir', 'root_dir' ) container.create() @patch('kiwi.builder.container.Checksum') def test_create_derived_fail_open(self, mock_sha256): with patch('builtins.open') as m_open: m_open = mock_open() m_open.return_value.__enter__.side_effect = Exception('open failed') with raises(Exception) as e: container = ContainerBuilder( self.xml_state, 'target_dir', 'root_dir' ) container.create() assert 'open failed' in str(e) @patch('kiwi.builder.container.Checksum') @patch('kiwi.builder.container.ContainerImage') @patch('os.path.exists') def test_create_keep_tmpdirs(self, mock_exists, mock_image, mock_checksum): def side_effect(filename): if filename.endswith('.config/kiwi/config.yml'): return False elif filename.endswith('etc/kiwi.yml'): return False else: return True mock_exists.side_effect = side_effect container_image = mock.Mock() container_image.create = mock.Mock( return_value='target_dir/image_name.x86_64-1.2.3.docker.tar' ) mock_image.new.return_value = container_image self.xml_state.build_type.get_ensure_empty_tmpdirs = mock.Mock( return_value=False ) container = ContainerBuilder(self.xml_state, 'target_dir', 'root_dir') container.result = mock.Mock() container.create() container_image.create.assert_called_once_with( 'target_dir/image_name.x86_64-1.2.3.docker.tar', 'root_dir/image/imported_root', False, False, ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7643697 kiwi-11.1.8/test/unit/builder/disk_test.py0000644000000000000000000026256015273675667015465 0ustar00import logging import sys from unittest.mock import call, patch, mock_open, Mock, MagicMock, ANY from pytest import raises, fixture import kiwi.builder.disk from ..test_helper import argv_kiwi_tests from collections import OrderedDict from collections import namedtuple from builtins import bytes from kiwi.defaults import Defaults from kiwi.xml_description import XMLDescription from kiwi.xml_state import XMLState from kiwi.builder.disk import DiskBuilder from kiwi.storage.disk import ptable_entry_type from kiwi.storage.mapped_device import MappedDevice from kiwi.partitioner.gpt import PartitionerGpt from kiwi.xml_state import DracutT from kiwi.exceptions import ( KiwiDiskBootImageError, KiwiInstallMediaError, KiwiVolumeManagerSetupError, ) class TestDiskBuilder: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('os.path.exists') def setup(self, mock_exists): Defaults.set_platform_name('x86_64') def side_effect(filename): if filename.endswith('.config/kiwi/config.yml'): return False elif filename.endswith('etc/kiwi.yml'): return False else: return True mock_exists.side_effect = side_effect description = XMLDescription('../data/example_disk_config.xml') self.device_map = { 'root': MappedDevice('/dev/root-device', Mock()), 'swap': MappedDevice('/dev/swap-device', Mock()), 'readonly': MappedDevice('/dev/readonly-root-device', Mock()), 'boot': MappedDevice('/dev/boot-device', Mock()), 'prep': MappedDevice('/dev/prep-device', Mock()), 'efi': MappedDevice('/dev/efi-device', Mock()), 'spare': MappedDevice('/dev/spare-device', Mock()), 'var': MappedDevice('/dev/spare-device', Mock()), } self.id_map = {'kiwi_RootPart': 1, 'kiwi_BootPart': 1} self.id_map_sorted = OrderedDict(sorted(self.id_map.items())) self.boot_names_type = namedtuple( 'boot_names_type', ['kernel_name', 'initrd_name'] ) self.block_operation = Mock() self.block_operation.get_blkid = Mock(return_value='blkid_result') self.block_operation.get_filesystem = Mock( return_value='blkid_result_fs' ) kiwi.builder.disk.BlockID = Mock(return_value=self.block_operation) kernel_info = Mock() kernel_info.version = '1.2.3' kernel_info.name = 'vmlinuz-1.2.3-default' self.kernel = Mock() self.kernel.get_kernel = Mock(return_value=kernel_info) self.kernel.get_xen_hypervisor = Mock() self.kernel.copy_kernel = Mock() self.kernel.copy_xen_hypervisor = Mock() kiwi.builder.disk.Kernel = Mock(return_value=self.kernel) # no directory of the root tree is created on the test host kiwi.builder.disk.Path = Mock() kiwi.builder.disk.MountManager = MagicMock() self.disk_setup = Mock() self.disk_setup.get_disksize_mbytes.return_value = 1024 self.disk_setup.boot_partition_size.return_value = 0 self.disk_setup.get_efi_label = Mock(return_value='EFI') self.disk_setup.get_root_label = Mock(return_value='ROOT') self.disk_setup.get_boot_label = Mock(return_value='BOOT') self.disk_setup.need_boot_partition = Mock(return_value=True) self.bootloader_install = Mock() kiwi.builder.disk.BootLoaderInstall.new = MagicMock( return_value=self.bootloader_install ) self.bootloader_config = Mock() self.bootloader_config.use_disk_password = True self.bootloader_config.get_boot_cmdline = Mock( return_value='boot_cmdline' ) kiwi.builder.disk.create_boot_loader_config = MagicMock( return_value=self.bootloader_config ) kiwi.builder.disk.DiskSetup = MagicMock(return_value=self.disk_setup) self.runtime_config = Mock() kiwi.builder.disk.RuntimeConfig = MagicMock( return_value=self.runtime_config ) self.boot_image_task = Mock() self.boot_image_task.boot_root_directory = 'boot_dir' self.boot_image_task.kernel_filename = 'kernel' self.boot_image_task.initrd_filename = 'initrd' self.boot_image_task.xen_hypervisor_filename = 'xen_hypervisor' self.boot_image_task.get_boot_names.return_value = self.boot_names_type( kernel_name='linux.vmx', initrd_name='initrd.vmx' ) kiwi.builder.disk.BootImage.new = Mock( return_value=self.boot_image_task ) self.firmware = Mock() self.firmware.get_legacy_bios_partition_size.return_value = 0 self.firmware.get_efi_partition_size.return_value = 0 self.firmware.get_prep_partition_size.return_value = 0 self.firmware.efi_mode = Mock(return_value='efi') kiwi.builder.disk.FirmWare = Mock(return_value=self.firmware) self.setup = Mock() kiwi.builder.disk.SystemSetup = Mock(return_value=self.setup) self.install_image = Mock() kiwi.builder.disk.InstallImageBuilder = Mock( return_value=self.install_image ) self.raid_root = Mock() self.raid_root.get_device.return_value = MappedDevice( '/dev/md0', Mock() ) kiwi.builder.disk.RaidDevice = Mock(return_value=self.raid_root) self.integrity_root = Mock() self.integrity_root.get_device.return_value = MappedDevice( '/dev/integrityRoot', Mock() ) kiwi.builder.disk.IntegrityDevice = Mock( return_value=self.integrity_root ) self.luks_root = Mock() self.luks_root.passphrase = 'passphrase' kiwi.builder.disk.LuksDevice = Mock(return_value=self.luks_root) self.fstab = Mock() kiwi.builder.disk.Fstab = Mock(return_value=self.fstab) self.xml_state = XMLState(description.load()) self.disk_builder = DiskBuilder( self.xml_state, 'target_dir', 'root_dir', custom_args={'signing_keys': ['key_file_a', 'key_file_b']}, ) self.disk_builder.bundle_format = '%N' self.disk_builder.root_filesystem_is_overlay = False self.disk_builder.build_type_name = 'oem' self.disk_builder.image_format = None @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def test_setup_warn_no_initrd_support(self): self.boot_image_task.has_initrd_support = Mock(return_value=False) with self._caplog.at_level(logging.WARNING): DiskBuilder(self.xml_state, 'target_dir', 'root_dir') def test_setup_ix86(self): Defaults.set_platform_name('i686') description = XMLDescription('../data/example_disk_config.xml') disk_builder = DiskBuilder( XMLState(description.load()), 'target_dir', 'root_dir' ) assert disk_builder.arch == 'ix86' @patch('kiwi.xml_parse.type_.get_efimountoptions') def test_write_generic_fstab_efi_mount_options( self, mock_get_efimountoptions ): mock_get_efimountoptions.return_value = 'umask=0077,shortname=winnt' description = XMLDescription('../data/example_disk_config.xml') disk_builder = DiskBuilder( XMLState(description.load()), 'target_dir', 'root_dir' ) assert disk_builder.custom_efi_mount_args == [ 'umask=0077,shortname=winnt' ] disk_builder.fstab = Mock() disk_builder.volume_manager_name = None setup = Mock() disk_builder._write_generic_fstab( {'root': self.device_map['root'], 'efi': self.device_map['efi']}, setup, None, ) assert ( call( 'UUID=blkid_result /boot/efi blkid_result_fs ' 'umask=0077,shortname=winnt 0 0' ) in disk_builder.fstab.add_entry.call_args_list ) setup.create_fstab.assert_called_once_with(disk_builder.fstab) @patch('kiwi.builder.disk.Disk') def test_disk_instance_apply_dps_codes(self, mock_Disk): loop_provider = Mock() # the example description does not request the DPS type codes self.disk_builder._disk_instance(loop_provider) assert mock_Disk.call_args.kwargs['apply_dps_codes'] is False self.disk_builder.apply_dps_codes = True self.disk_builder._disk_instance(loop_provider) assert mock_Disk.call_args.kwargs['apply_dps_codes'] is True @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') def test_create_invalid_type_for_install_media(self, mock_cmd, mock_fs): self.disk_builder.build_type_name = 'kis' with patch('builtins.open'): with raises(KiwiInstallMediaError): self.disk_builder.create_disk() def test_create_disk_overlay_with_volume_setup_not_supported(self): self.disk_builder.root_filesystem_is_overlay = True self.disk_builder.volume_manager_name = 'lvm' with raises(KiwiVolumeManagerSetupError): self.disk_builder.create_disk() @patch('kiwi.builder.disk.InstallImageBuilder') def test_create_install_media(self, mock_install_image): result_instance = Mock() mock_install_image.return_value = self.install_image self.disk_builder.initrd_system = 'dracut' self.disk_builder.install_iso = True self.disk_builder.install_pxe = True self.disk_builder.create_install_media(result_instance) self.install_image.create_install_iso.assert_called_once_with() self.install_image.create_install_pxe_archive.assert_called_once_with() mock_install_image.assert_called_once_with( ANY, 'root_dir', 'target_dir', None, {'signing_keys': ['key_file_a', 'key_file_b']}, ) @patch('kiwi.builder.disk.InstallImageBuilder') def test_create_install_mediai_custom_boot(self, mock_install_image): result_instance = Mock() mock_install_image.return_value = self.install_image self.disk_builder.initrd_system = 'kiwi' self.disk_builder.install_pxe = True self.disk_builder.create_install_media(result_instance) self.install_image.create_install_pxe_archive.assert_called_once_with() mock_install_image.assert_called_once_with( ANY, 'root_dir', 'target_dir', ANY, {'signing_keys': ['key_file_a', 'key_file_b']}, ) @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.LoopDevice') @patch('kiwi.builder.disk.FileSystem.new') @patch('random.randrange') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('kiwi.builder.disk.ImageSystem') @patch('os.path.exists') def test_create_disk_standard_root_with_kiwi_initrd( self, mock_path, mock_ImageSystem, mock_grub_dir, mock_command, mock_rand, mock_fs, mock_LoopDevice, mock_Disk, mock_create_boot_loader_config, ): bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk mock_path.return_value = True mock_rand.return_value = 15 filesystem = MagicMock() mock_fs.return_value = filesystem self.firmware.get_legacy_bios_partition_size.return_value = 2 self.disk_builder.volume_manager_name = None self.disk_builder.initrd_system = 'kiwi' m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() self.setup.create_recovery_archive.assert_called_once_with() call = self.setup.export_modprobe_setup.call_args_list[0] assert self.setup.export_modprobe_setup.call_args_list[0] == call( 'boot_dir' ) self.disk_setup.get_disksize_mbytes.assert_called_once_with( root_clone=0, boot_clone=0 ) loop_provider.create.assert_called_once_with() disk.wipe.assert_called_once_with() disk.create_efi_csm_partition.assert_called_once_with( self.firmware.get_legacy_bios_partition_size(), None ) disk.create_efi_partition.assert_called_once_with( self.firmware.get_efi_partition_size(), None ) disk.create_boot_partition.assert_called_once_with( format(self.disk_setup.boot_partition_size()), 0, None ) disk.create_swap_partition.assert_called_once_with('128') disk.create_prep_partition.assert_called_once_with( self.firmware.get_prep_partition_size() ) disk.create_root_partition.assert_called_once_with('all_free', 0, None) disk.map_partitions.assert_called_once_with() bootloader_config.setup_disk_boot_images.assert_called_once_with( '0815', '0815' ) bootloader_config.write_meta_data.assert_called_once_with( root_device='/dev/readonly-root-device', write_device='/dev/root-device', boot_options='', ) bootloader_config.setup_disk_image_config.assert_called_once_with( boot_options={ 'device_map': self.device_map, 'boot_image': self.boot_image_task, 'boot_device': '/dev/boot-device', 'root_device': '/dev/readonly-root-device', 'write_device': '/dev/root-device', 'firmware': self.firmware, 'target_removable': None, 'efi_device': '/dev/efi-device', 'prep_device': '/dev/prep-device', 'install_options': [], 'shim_options': [], } ) self.setup.call_edit_boot_config_script.assert_called_once_with( 'btrfs', 1 ) self.bootloader_install.install.assert_called_once_with() self.setup.call_edit_boot_install_script.assert_called_once_with( 'target_dir/LimeJeOS-openSUSE-13.2.x86_64-1.13.2.raw', '/dev/boot-device', ) self.boot_image_task.prepare.assert_called_once_with() call = ( filesystem.__enter__.return_value.create_on_device.call_args_list[0] ) assert ( filesystem.__enter__.return_value.create_on_device.call_args_list[0] == call(label='EFI') ) call = ( filesystem.__enter__.return_value.create_on_device.call_args_list[1] ) assert ( filesystem.__enter__.return_value.create_on_device.call_args_list[1] == call(label='BOOT') ) call = filesystem.create_on_device.call_args_list[0] assert filesystem.create_on_device.call_args_list[0] == call( label='ROOT' ) call = filesystem.__enter__.return_value.sync_data.call_args_list[0] assert ( filesystem.__enter__.return_value.sync_data.call_args_list[0] == call() ) call = filesystem.__enter__.return_value.sync_data.call_args_list[1] assert filesystem.__enter__.return_value.sync_data.call_args_list[ 1 ] == call(['efi/*']) call = filesystem.sync_data.call_args_list[0] assert filesystem.sync_data.call_args_list[0] == call( [ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', 'boot/*', 'boot/.*', 'boot/efi/*', 'boot/efi/.*', ] ) assert m_open.call_args_list[0:4] == [ call('boot_dir/config.partids', 'w'), call('root_dir/boot/mbrid', 'w'), call('boot_dir/config.bootoptions', 'w'), call('/dev/some-loop', 'wb'), ] assert m_open.return_value.write.call_args_list == [ call('kiwi_BootPart="1"\n'), call('kiwi_RootPart="1"\n'), call('0x0f0f0f0f\n'), call('boot_cmdline\n'), call(bytes(b'\x0f\x0f\x0f\x0f')), ] assert mock_command.call_args_list == [ call(['cp', 'root_dir/recovery.partition.size', 'boot_dir']), call(['mv', 'initrd', 'root_dir/boot/initrd.vmx']), ] self.block_operation.get_blkid.assert_has_calls([call('PARTUUID')]) self.setup.export_package_list.assert_called_once_with('target_dir') self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.VolumeManager.new') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('os.path.exists') @patch('os.path.getsize') @patch('kiwi.builder.disk.SystemSetup') @patch('kiwi.builder.disk.ImageSystem') @patch('kiwi.builder.disk.Temporary.new_file') @patch('kiwi.builder.disk.CloneDevice') def test_create_lvm_disk_standard_root_with_clone( self, mock_CloneDevice, mock_Temporary_new_file, mock_ImageSystem, mock_SystemSetup, mock_os_path_getsize, mock_path, mock_grub_dir, mock_command, mock_fs, mock_volume_manager, mock_create_boot_loader_config, mock_Disk, ): mock_Disk.return_value.__enter__.return_value = ( self._get_disk_instance() ) bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) tempfile = Mock() tempfile.name = 'tempfile' mock_Temporary_new_file.return_value = tempfile mock_os_path_getsize.return_value = 42 self.boot_image_task.get_boot_names.return_value = self.boot_names_type( kernel_name='vmlinuz-1.2.3-default', initrd_name='initramfs-1.2.3.img', ) mock_path.return_value = True filesystem = Mock() filesystem.filename = '' mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.custom_partitions = { 'var': ptable_entry_type( mbsize=100, clone=1, partition_name='p.lxvar', partition_type='t.linux', partition_id=None, mountpoint='/var', filesystem='ext3', label='var', ) } volume_manager = Mock() volume_manager.get_device = Mock( return_value={ 'root': MappedDevice('/dev/systemVG/LVRoot', Mock()), 'swap': MappedDevice('/dev/systemVG/LVSwap', Mock()), } ) volume_manager.get_fstab = Mock(return_value=['fstab_volume_entries']) mock_volume_manager.return_value = volume_manager self.disk_builder.root_clone_count = 1 self.disk_builder.boot_clone_count = 1 self.disk_builder.volume_manager_name = 'lvm' self.disk_builder.root_filesystem_is_overlay = False self.disk_builder.initrd_system = 'dracut' disk_system = Mock() mock_SystemSetup.return_value = disk_system self.device_map['rootclone1'] = MappedDevice('/dev/root-device', Mock()) self.device_map['bootclone1'] = MappedDevice('/dev/boot-device', Mock()) self.device_map['varclone1'] = MappedDevice('/dev/var-device', Mock()) # Test in lvm mode (no root overlay) m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() volume_manager.umount_volumes.call_args_list[ 0 ].assert_called_once_with() @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('os.path.exists') @patch('os.path.getsize') @patch('kiwi.builder.disk.SystemSetup') @patch('kiwi.builder.disk.ImageSystem') @patch('kiwi.builder.disk.Temporary.new_file') @patch('kiwi.builder.disk.CloneDevice') def test_create_disk_standard_root_with_clone( self, mock_CloneDevice, mock_Temporary_new_file, mock_ImageSystem, mock_SystemSetup, mock_os_path_getsize, mock_path, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) tempfile = Mock() tempfile.name = 'tempfile' mock_Temporary_new_file.return_value = tempfile mock_os_path_getsize.return_value = 42 self.boot_image_task.get_boot_names.return_value = self.boot_names_type( kernel_name='vmlinuz-1.2.3-default', initrd_name='initramfs-1.2.3.img', ) mock_path.return_value = True filesystem = Mock() filesystem.filename = '' mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.custom_partitions = { 'var': ptable_entry_type( mbsize=100, clone=1, partition_name='p.lxvar', partition_type='t.linux', partition_id=None, mountpoint='/var', filesystem='ext3', label='var', ) } self.disk_builder.root_clone_count = 1 self.disk_builder.boot_clone_count = 1 self.disk_builder.root_filesystem_is_overlay = False self.disk_builder.volume_manager_name = None self.disk_builder.initrd_system = 'dracut' disk_system = Mock() mock_SystemSetup.return_value = disk_system self.device_map['rootclone1'] = MappedDevice('/dev/root-device', Mock()) self.device_map['bootclone1'] = MappedDevice('/dev/boot-device', Mock()) self.device_map['varclone1'] = MappedDevice('/dev/var-device', Mock()) # Test in standard mode (no root overlay) m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() disk.create_boot_partition.assert_called_once_with( format(self.disk_setup.boot_partition_size()), 1, None ) disk.create_root_partition.assert_called_once_with( 'clone:443:443', 1, None ) disk.create_custom_partitions.assert_called_once_with( self.disk_builder.custom_partitions ) assert mock_CloneDevice.return_value.clone.call_args_list == [ call([self.device_map['varclone1']]), call([self.device_map['bootclone1']]), call([self.device_map['rootclone1']]), ] # Test in spare part mode self.disk_builder.spare_part_mbsize = 42 self.disk_builder.spare_part_is_last = True disk.create_root_partition.reset_mock() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() disk.create_root_partition.assert_called_once_with( 'clone:422:422', 1, None ) # Test in overlay mode a root clone is created from # the root readonly partition and not from the root (rw) # partition. self.disk_builder.root_filesystem_is_overlay = True self.disk_builder.spare_part_mbsize = None self.disk_builder.spare_part_is_last = False disk.create_root_partition.reset_mock() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() disk.create_root_readonly_partition.assert_called_once_with(10, 1) disk.create_root_partition.assert_called_once_with('all_free', 0, None) # Test in verity mode self.disk_builder.root_filesystem_verity_blocks = 10 self.disk_builder.root_filesystem_is_overlay = False mock_CloneDevice.reset_mock() disk.create_root_partition.reset_mock() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() filesystem.create_verity_layer.assert_called_once_with(10, 'tempfile') assert mock_CloneDevice.return_value.clone.call_args_list == [ call([self.device_map['varclone1']]), call([self.device_map['bootclone1']]), call([self.device_map['rootclone1']]), ] @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('os.path.exists') @patch('os.path.getsize') @patch('kiwi.builder.disk.SystemSetup') @patch('kiwi.builder.disk.ImageSystem') @patch('kiwi.builder.disk.Temporary.new_file') def test_create_disk_standard_root_with_dm_integrity( self, mock_Temporary_new_file, mock_ImageSystem, mock_SystemSetup, mock_os_path_getsize, mock_path, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): mock_Disk.return_value.__enter__.return_value = ( self._get_disk_instance() ) bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) tempfile = Mock() tempfile.name = 'tempfile' mock_Temporary_new_file.return_value = tempfile mock_os_path_getsize.return_value = 42 self.boot_image_task.get_boot_names.return_value = self.boot_names_type( kernel_name='vmlinuz-1.2.3-default', initrd_name='initramfs-1.2.3.img', ) mock_path.return_value = True filesystem = MagicMock() mock_fs.return_value = filesystem self.disk_builder.integrity = True self.disk_builder.integrity_legacy_hmac = True self.disk_builder.root_filesystem_embed_integrity_metadata = True self.disk_builder.root_filesystem_is_overlay = False self.disk_builder.volume_manager_name = None self.disk_builder.initrd_system = 'dracut' disk_system = Mock() mock_SystemSetup.return_value = disk_system m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() self.integrity_root.create_integritytab.assert_called_once_with( 'root_dir/etc/integritytab' ) self.integrity_root.create_integrity_metadata.assert_called_once_with() self.integrity_root.sign_integrity_metadata.assert_called_once_with() self.integrity_root.write_integrity_metadata.assert_called_once_with() assert ( filesystem.__enter__.return_value.create_on_device.call_args_list == [call(label='EFI'), call(label='BOOT'), call(label='SWAP')] ) assert filesystem.create_on_device.call_args_list == [ # root must be created DM_METADATA_OFFSET smaller call(label='ROOT', size=-4096, unit='b') ] @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.LoopDevice') @patch('kiwi.builder.disk.FileSystem.new') @patch('random.randrange') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('os.path.exists') @patch('os.path.getsize') @patch('kiwi.builder.disk.SystemSetup') @patch('kiwi.builder.disk.ImageSystem') @patch('kiwi.builder.disk.VeritySetup') @patch('kiwi.builder.disk.Temporary.new_file') @patch('kiwi.builder.disk.BlockID') @patch('os.access') def test_create_disk_standard_root_with_dracut_initrd_readonly_root_squashfs( self, mock_os_access, mock_BlockID, mock_Temporary_new_file, mock_VeritySetup, mock_ImageSystem, mock_SystemSetup, mock_os_path_getsize, mock_path, mock_grub_dir, mock_command, mock_rand, mock_fs, mock_LoopDevice, mock_create_boot_loader_config, mock_Disk, ): mock_BlockID.return_value.get_filesystem.return_value = 'squashfs' mock_BlockID.return_value.get_blkid.return_value = 'some' mock_os_access.return_value = False system = Mock() system.mountpoint.return_value = 'diskroot' mock_ImageSystem.return_value.__enter__.return_value = system disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider tempfile = Mock() tempfile.name = 'tempfile' mock_Temporary_new_file.return_value = tempfile mock_os_path_getsize.return_value = 42 self.boot_image_task.get_boot_names.return_value = self.boot_names_type( kernel_name='vmlinuz-1.2.3-default', initrd_name='initramfs-1.2.3.img', ) mock_path.return_value = True mock_rand.return_value = 15 filesystem = MagicMock() mock_fs.return_value = filesystem self.firmware.get_legacy_bios_partition_size.return_value = 2 self.disk_builder.root_filesystem_verity_blocks = 10 self.disk_builder.root_filesystem_embed_verity_metadata = True self.disk_builder.root_filesystem_is_overlay = False self.disk_builder.volume_manager_name = None self.disk_builder.initrd_system = 'dracut' self.disk_builder.bootloader = 'systemd_boot' self.setup.script_exists.return_value = True disk_system = Mock() mock_SystemSetup.return_value = disk_system m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() print(mock_command.call_args_list) assert mock_command.call_args_list == [ call(['cp', 'root_dir/recovery.partition.size', 'boot_dir']), call(['mv', 'initrd', 'root_dir/boot/initramfs-1.2.3.img']), call(['blockdev', '--getsize64', '/dev/root-device']), call(['dd', 'if=tempfile', 'of=/dev/root-device']), call(['mv', 'initrd', 'root_dir/boot/initramfs-1.2.3.img']), call( [ 'cp', 'root_dir/boot/initramfs-1.2.3.img', 'diskroot/boot/efi/os/initramfs-1.2.3.img', ] ), ] @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.LoopDevice') @patch('kiwi.builder.disk.FileSystem.new') @patch('random.randrange') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('os.path.exists') @patch('os.path.getsize') @patch('kiwi.builder.disk.SystemSetup') @patch('kiwi.builder.disk.ImageSystem') @patch('kiwi.builder.disk.VeritySetup') @patch('kiwi.builder.disk.Temporary.new_file') @patch('kiwi.builder.disk.BlockID') @patch('os.access') def test_create_disk_standard_root_with_dracut_initrd_readonly_root_erofs( self, mock_os_access, mock_BlockID, mock_Temporary_new_file, mock_VeritySetup, mock_ImageSystem, mock_SystemSetup, mock_os_path_getsize, mock_path, mock_grub_dir, mock_command, mock_rand, mock_fs, mock_LoopDevice, mock_create_boot_loader_config, mock_Disk, ): mock_BlockID.return_value.get_filesystem.return_value = 'erofs' mock_BlockID.return_value.get_blkid.return_value = 'some' mock_os_access.return_value = False system = Mock() system.mountpoint.return_value = 'diskroot' mock_ImageSystem.return_value.__enter__.return_value = system disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider tempfile = Mock() tempfile.name = 'tempfile' mock_Temporary_new_file.return_value = tempfile mock_os_path_getsize.return_value = 42 self.boot_image_task.get_boot_names.return_value = self.boot_names_type( kernel_name='vmlinuz-1.2.3-default', initrd_name='initramfs-1.2.3.img', ) mock_path.return_value = True mock_rand.return_value = 15 filesystem = MagicMock() mock_fs.return_value = filesystem self.firmware.get_legacy_bios_partition_size.return_value = 2 self.disk_builder.root_filesystem_verity_blocks = 10 self.disk_builder.root_filesystem_embed_verity_metadata = True self.disk_builder.root_filesystem_is_overlay = False self.disk_builder.volume_manager_name = None self.disk_builder.initrd_system = 'dracut' self.disk_builder.bootloader = 'systemd_boot' self.setup.script_exists.return_value = True disk_system = Mock() mock_SystemSetup.return_value = disk_system m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() print(mock_command.call_args_list) assert mock_command.call_args_list == [ call(['cp', 'root_dir/recovery.partition.size', 'boot_dir']), call(['mv', 'initrd', 'root_dir/boot/initramfs-1.2.3.img']), call(['blockdev', '--getsize64', '/dev/root-device']), call(['dd', 'if=tempfile', 'of=/dev/root-device']), call(['mv', 'initrd', 'root_dir/boot/initramfs-1.2.3.img']), call( [ 'cp', 'root_dir/boot/initramfs-1.2.3.img', 'diskroot/boot/efi/os/initramfs-1.2.3.img', ] ), ] @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.LoopDevice') @patch('kiwi.builder.disk.FileSystem.new') @patch('random.randrange') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('os.path.exists') @patch('os.path.getsize') @patch('kiwi.builder.disk.SystemSetup') @patch('kiwi.builder.disk.ImageSystem') @patch('kiwi.builder.disk.VeritySetup') @patch('kiwi.builder.disk.Temporary.new_file') @patch('os.access') def test_create_disk_standard_root_with_dracut_initrd( self, mock_os_access, mock_Temporary_new_file, mock_VeritySetup, mock_ImageSystem, mock_SystemSetup, mock_os_path_getsize, mock_path, mock_grub_dir, mock_command, mock_rand, mock_fs, mock_LoopDevice, mock_create_boot_loader_config, mock_Disk, ): mock_os_access.return_value = True system = Mock() system.mountpoint.return_value = 'diskroot' mock_ImageSystem.return_value.__enter__.return_value = system disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider tempfile = Mock() tempfile.name = 'tempfile' mock_Temporary_new_file.return_value = tempfile mock_os_path_getsize.return_value = 42 self.boot_image_task.get_boot_names.return_value = self.boot_names_type( kernel_name='vmlinuz-1.2.3-default', initrd_name='initramfs-1.2.3.img', ) mock_path.return_value = True mock_rand.return_value = 15 filesystem = MagicMock() mock_fs.return_value = filesystem self.firmware.get_legacy_bios_partition_size.return_value = 2 self.disk_builder.root_filesystem_verity_blocks = 10 self.disk_builder.root_filesystem_embed_verity_metadata = True self.disk_builder.root_filesystem_is_overlay = False self.disk_builder.volume_manager_name = None self.disk_builder.initrd_system = 'dracut' self.setup.script_exists.return_value = True disk_system = Mock() mock_SystemSetup.return_value = disk_system m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() self.setup.create_recovery_archive.assert_called_once_with() self.disk_setup.get_disksize_mbytes.assert_called_once_with( root_clone=0, boot_clone=0 ) assert loop_provider.create.call_args_list == [call(), call()] disk.wipe.assert_called_once_with() disk.create_efi_csm_partition.assert_called_once_with( self.firmware.get_legacy_bios_partition_size(), None ) disk.create_efi_partition.assert_called_once_with( self.firmware.get_efi_partition_size(), None ) disk.create_boot_partition.assert_called_once_with( format(self.disk_setup.boot_partition_size()), 0, None ) disk.create_prep_partition.assert_called_once_with( self.firmware.get_prep_partition_size() ) disk.create_root_partition.assert_called_once_with('all_free', 0, None) disk.map_partitions.assert_called_once_with() bootloader_config.setup_disk_boot_images.assert_called_once_with( '0815', '0815' ) bootloader_config.write_meta_data.assert_called_once_with( root_device='/dev/readonly-root-device', write_device='/dev/root-device', boot_options='', ) bootloader_config.setup_disk_image_config.assert_called_once_with( boot_options={ 'device_map': self.device_map, 'boot_image': self.boot_image_task, 'boot_device': '/dev/boot-device', 'root_device': '/dev/readonly-root-device', 'write_device': '/dev/root-device', 'firmware': self.firmware, 'target_removable': None, 'efi_device': '/dev/efi-device', 'prep_device': '/dev/prep-device', 'install_options': [], 'shim_options': [], } ) assert self.setup.script_exists.call_args_list == [ call('pre_disk_sync.sh'), call('disk.sh'), ] disk_system.call_pre_disk_script.assert_called_once_with() disk_system.call_disk_script.assert_called_once_with() disk_system.cleanup.assert_called_once_with() self.setup.call_edit_boot_config_script.assert_called_once_with( 'btrfs', 1 ) self.bootloader_install.install.assert_called_once_with() self.setup.call_edit_boot_install_script.assert_called_once_with( 'target_dir/LimeJeOS-openSUSE-13.2.x86_64-1.13.2.raw', '/dev/boot-device', ) self.boot_image_task.prepare.assert_called_once_with() filesystem.create_on_device.assert_called_once_with(label='ROOT') assert ( filesystem.__enter__.return_value.create_on_device.call_args_list[0] == call(label='EFI') ) assert ( filesystem.__enter__.return_value.create_on_device.call_args_list[1] == call(label='BOOT') ) assert ( filesystem.__enter__.return_value.sync_data.call_args_list[0] == call() ) assert filesystem.__enter__.return_value.sync_data.call_args_list[ 1 ] == call(['efi/*']) assert filesystem.__enter__.return_value.sync_data.call_args_list[ 2 ] == call( [ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', 'boot/*', 'boot/.*', 'boot/efi/*', 'boot/efi/.*', ] ) assert m_open.call_args_list == [ call('boot_dir/config.partids', 'w'), call('root_dir/boot/mbrid', 'w'), call('boot_dir/config.bootoptions', 'w'), call('/dev/some-loop', 'wb'), call('root_dir/etc/veritytab', 'w'), ] m_open.return_value.write.assert_has_calls( [ call('kiwi_BootPart="1"\n'), call('kiwi_RootPart="1"\n'), call('0x0f0f0f0f\n'), call('boot_cmdline\n'), call(bytes(b'\x0f\x0f\x0f\x0f')), ] ) assert mock_command.call_args_list == [ call(['cp', 'root_dir/recovery.partition.size', 'boot_dir']), call(['mv', 'initrd', 'root_dir/boot/initramfs-1.2.3.img']), call(['blockdev', '--getsize64', '/dev/root-device']), call(['dd', 'if=tempfile', 'of=/dev/root-device']), call(['mv', 'initrd', 'root_dir/boot/initramfs-1.2.3.img']), call( [ 'cp', 'root_dir/boot/initramfs-1.2.3.img', 'diskroot/boot/initramfs-1.2.3.img', ] ), ] self.block_operation.get_blkid.assert_has_calls([call('PARTUUID')]) self.setup.export_package_list.assert_called_once_with('target_dir') self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) # config.partids is written but not used by the dracut initrd assert self.boot_image_task.include_file.call_args_list == [ call('/recovery.partition.size'), call(filename='/etc/veritytab', delete_after_include=True), ] self.boot_image_task.include_module.assert_called_once_with( 'kiwi-repart' ) self.boot_image_task.omit_module.assert_called_once_with('multipath') assert ( self.boot_image_task.write_system_config_file.call_args_list == [] ) filesystem.__enter__.return_value.create_verity_layer.assert_called_once_with( 10, 'tempfile' ) filesystem.__enter__.return_value.create_verification_metadata.assert_called_once_with( '/dev/root-device' ) @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.LoopDevice') @patch('kiwi.builder.disk.FileSystem.new') @patch('random.randrange') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('os.path.exists') @patch('os.path.getsize') @patch('kiwi.builder.disk.SystemSetup') @patch('kiwi.builder.disk.ImageSystem') @patch('kiwi.builder.disk.VeritySetup') @patch('kiwi.builder.disk.Temporary.new_file') @patch('os.access') def test_create_disk_standard_root_with_kernel_flavors( self, mock_os_access, mock_Temporary_new_file, mock_VeritySetup, mock_ImageSystem, mock_SystemSetup, mock_os_path_getsize, mock_path, mock_grub_dir, mock_command, mock_rand, mock_fs, mock_LoopDevice, mock_create_boot_loader_config, mock_Disk, ): # An initrd is created for the kernel of each flavor, also # when it is created again with the veritytab included mock_os_access.side_effect = lambda path, mode: path != 'diskroot/boot/' system = Mock() system.mountpoint.return_value = 'diskroot' mock_ImageSystem.return_value.__enter__.return_value = system disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) mock_LoopDevice.return_value.__enter__.return_value = Mock() tempfile = Mock() tempfile.name = 'tempfile' mock_Temporary_new_file.return_value = tempfile mock_os_path_getsize.return_value = 42 self.boot_image_task.get_boot_names.side_effect = ( lambda flavor: self.boot_names_type( kernel_name=f'vmlinuz-1.2.3-{flavor}', initrd_name=f'initrd-1.2.3-{flavor}', ) ) mock_path.return_value = True mock_rand.return_value = 15 mock_fs.return_value = MagicMock() self.firmware.get_legacy_bios_partition_size.return_value = 2 self.disk_builder.root_filesystem_verity_blocks = 10 self.disk_builder.root_filesystem_embed_verity_metadata = True self.disk_builder.root_filesystem_is_overlay = False self.disk_builder.volume_manager_name = None self.disk_builder.initrd_system = 'dracut' self.disk_builder.bootloader = 'systemd_boot' self.disk_builder.kernel_flavors = ['rt', 'default'] self.setup.script_exists.return_value = False with patch('builtins.open', mock_open(), create=True): self.disk_builder.create_disk() # files included with delete_after_include are kept until # the initrd of the last flavor is created mbrid = self.disk_builder.mbrid assert self.boot_image_task.create_initrd.call_args_list == [ call(mbrid, flavor='rt', delete_included_files=False), call(mbrid, flavor='default', delete_included_files=True), call(mbrid, flavor='rt', delete_included_files=False), call(mbrid, flavor='default', delete_included_files=True), ] initrd_commands = [ command for command in mock_command.call_args_list if 'initrd' in ' '.join(command[0][0]) ] assert initrd_commands == [ call(['mv', 'initrd', 'root_dir/boot/initrd-1.2.3-rt']), call(['mv', 'initrd', 'root_dir/boot/initrd-1.2.3-default']), call(['mv', 'initrd', 'root_dir/boot/initrd-1.2.3-rt']), call(['mv', 'initrd', 'root_dir/boot/initrd-1.2.3-default']), call( [ 'cp', 'root_dir/boot/initrd-1.2.3-rt', 'diskroot/boot/efi/os/initrd-1.2.3-rt', ] ), call( [ 'cp', 'root_dir/boot/initrd-1.2.3-default', 'diskroot/boot/efi/os/initrd-1.2.3-default', ] ), ] @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('random.randrange') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('os.path.exists') @patch('os.path.getsize') @patch('kiwi.builder.disk.SystemSetup') @patch('kiwi.builder.disk.ImageSystem') @patch('kiwi.builder.disk.Temporary.new_file') def test_create_disk_standard_root_with_fixed_rootfs_size( self, mock_Temporary_new_file, mock_ImageSystem, mock_SystemSetup, mock_os_path_getsize, mock_path, mock_grub_dir, mock_command, mock_rand, mock_fs, mock_create_boot_loader_config, mock_Disk, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk self.disk_builder.root_filesystem_embed_verity_metadata = False self.disk_builder.root_filesystem_is_overlay = False self.disk_builder.volume_manager_name = None self.setup.script_exists.return_value = False self.disk_builder.initrd_system = 'dracut' self.disk_builder.root_clone_count = 1 self.disk_builder.oem_systemsize = 1024 self.disk_builder.oem_resize = False bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() disk.create_root_partition.assert_called_once_with( 'clone:1024:1024', 1, None ) @patch('kiwi.builder.disk.Path') @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.LoopDevice') @patch('kiwi.builder.disk.DeviceProvider') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('os.path.exists') @patch('os.path.getsize') @patch('kiwi.builder.disk.Temporary.new_file') @patch('random.randrange') @patch('kiwi.builder.disk.BlockID') @patch('kiwi.builder.disk.MountManager') def test_create_disk_standard_root_is_overlay( self, mock_MountManager, mock_BlockID, mock_rand, mock_temp, mock_getsize, mock_exists, mock_grub_dir, mock_command, mock_fs, mock_DeviceProvider, mock_LoopDevice, mock_create_boot_loader_config, mock_Disk, mock_Path, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider block_operation = Mock() block_operation.get_blkid.return_value = 'partuuid' block_operation.get_filesystem.return_value = 'ext3' mock_BlockID.return_value = block_operation mock_rand.return_value = 15 self.disk_builder.dracut_setup = DracutT( uefi=True, modules=[], drivers=[] ) self.disk_builder.dracut_add_modules = ['some'] self.disk_builder.dracut_omit_modules = ['some'] self.disk_builder.dracut_add_drivers = ['driver1'] self.disk_builder.dracut_omit_drivers = ['driver2'] self.disk_builder.root_filesystem_is_overlay = True self.disk_builder.root_filesystem_has_write_partition = False self.disk_builder.root_filesystem_verity_blocks = 10 self.disk_builder.root_filesystem_embed_verity_metadata = True self.disk_builder.integrity = True self.disk_builder.root_filesystem_embed_integrity_metadata = True self.disk_builder.volume_manager_name = None fs = Mock() fs.veritysetup.verity_hash_offset = 'Some' fs.veritysetup.verity_dict = {'Roothash': 'Some'} mock_fs.return_value.__enter__.return_value = fs mock_getsize.return_value = 1048576 tempfile = Mock() tempfile.name = 'kiwi-tempname' mock_temp.return_value = tempfile mock_exists.return_value = True self.disk_builder.initrd_system = 'dracut' disk.public_partition_id_map = self.id_map disk.public_partition_id_map['kiwi_ROPart'] = 1 m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_builder.create_disk() mock_fs.assert_has_calls( [ call( 'squashfs', custom_args={'compression': None, 'create_options': []}, device_provider=mock_DeviceProvider.return_value, root_dir='root_dir', ) ] ) fs.create_on_file.assert_has_calls( [ call(exclude=['var/cache/kiwi'], filename='kiwi-tempname'), call( exclude=[ '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', 'image/*', ], filename='kiwi-tempname', ), ], any_order=True, ) fs.create_verity_layer.assert_called_once_with(10) fs.create_verification_metadata.assert_called_once_with( '/dev/integrityRoot' ) self.integrity_root.create_integrity_metadata.assert_called_once_with() self.integrity_root.sign_integrity_metadata.assert_called_once_with() self.integrity_root.write_integrity_metadata.assert_called_once_with() disk.create_root_readonly_partition.assert_called_once_with(11, 0) assert mock_command.call_args_list[2] == call( ['blockdev', '--getsize64', '/dev/integrityRoot'] ) assert mock_command.call_args_list[3] == call( ['dd', 'if=kiwi-tempname', 'of=/dev/integrityRoot'] ) m_open.return_value.write.assert_has_calls( [ # config.partids call('kiwi_BootPart="1"\n'), call('kiwi_RootPart="1"\n'), # mbrid call('0x0f0f0f0f\n'), # config.bootoptions call('boot_cmdline\n'), # some-loop call(b'\x0f\x0f\x0f\x0f'), ], any_order=True, ) assert self.boot_image_task.include_module.call_args_list == [ call('some'), call('kiwi-overlay'), call('kiwi-repart'), ] assert self.boot_image_task.omit_module.call_args_list == [ call('some'), call('multipath'), ] self.boot_image_task.include_driver.assert_called_once_with('driver1') self.boot_image_task.omit_driver.assert_called_once_with('driver2') self.boot_image_task.write_system_config_file.assert_called_once_with( config={'modules': ['kiwi-overlay']} ) @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.LoopDevice') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') def test_create_disk_standard_root_no_hypervisor_found( self, mock_command, mock_fs, mock_LoopDevice, mock_Disk ): loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider self.kernel.get_xen_hypervisor.return_value = False self.disk_builder.volume_manager_name = None self.disk_builder.xen_server = True with patch('builtins.open'): with raises(KiwiDiskBootImageError): self.disk_builder.create_disk() @patch('kiwi.mount_manager.BlockID') @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') def test_create_disk_standard_root_xen_server_boot( self, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, mock_BlockID, ): mock_BlockID.return_value.get_filesystem.return_value = 'xfs' bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = None self.disk_builder.xen_server = True self.firmware.efi_mode = Mock(return_value=False) with patch('builtins.open'): self.disk_builder.create_disk() self.kernel.copy_xen_hypervisor.assert_called_once_with( 'root_dir', '/boot/xen.gz' ) @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') def test_create_disk_standard_root_s390_boot( self, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): mock_Disk.return_value.__enter__.return_value = ( self._get_disk_instance() ) self.disk_builder.arch = 's390x' self.disk_builder.host_key_certificates = Mock() bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = None self.firmware.efi_mode = Mock(return_value=False) self.disk_builder.bootloader = 'grub2_s390x_emu' with patch('builtins.open'): self.disk_builder.create_disk() bootloader_config.write.assert_called_once_with() @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') def test_create_disk_standard_root_secure_boot( self, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): mock_Disk.return_value.__enter__.return_value = ( self._get_disk_instance() ) bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = None self.firmware.efi_mode = Mock(return_value='uefi') with patch('builtins.open'): self.disk_builder.create_disk() bootloader_config.setup_disk_boot_images.assert_called_once_with( '0815', '0815' ) @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') def test_create_disk_mdraid_root( self, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = None self.disk_builder.mdraid = 'mirroring' disk.public_partition_id_map = self.id_map with patch('builtins.open'): self.disk_builder.create_disk() disk.create_root_raid_partition.assert_called_once_with( 'all_free', 0, None ) self.raid_root.create_degraded_raid.assert_called_once_with( raid_level='mirroring' ) self.raid_root.create_raid_config.assert_called_once_with( 'boot_dir/etc/mdadm.conf' ) assert disk.public_partition_id_map == { 'kiwi_RaidPart': 1, 'kiwi_RootPart': 1, 'kiwi_BootPart': 1, 'kiwi_RaidDev': '/dev/md0', } # A custom root partition number from the image description # reaches the raid partition disk.create_root_raid_partition.reset_mock() self.disk_builder.xml_state.build_type.get_rootpart_id = Mock( return_value='128' ) with patch('builtins.open'): self.disk_builder.create_disk() disk.create_root_raid_partition.assert_called_once_with( 'all_free', 0, 128 ) @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') def test_create_disk_luks_root( self, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = None self.disk_builder.luks = 'passphrase' self.disk_setup.need_boot_partition.return_value = False self.disk_builder.root_filesystem_is_overlay = True self.disk_builder.root_filesystem_has_write_partition = False self.disk_builder.boot_is_crypto = True disk.public_partition_id_map = self.id_map disk.public_partition_id_map['kiwi_ROPart'] = 1 self.disk_builder.cmdline = 'rd.kiwi.oem.luks.reencrypt' with patch('builtins.open'): self.disk_builder.create_disk() self.luks_root.create_crypto_luks.assert_called_once_with( passphrase='passphrase', osname=None, options=[], keyfile='/root/.root.keyfile', randomize=True, root_dir='root_dir', ) self.luks_root.create_crypttab.assert_called_once_with( 'root_dir/etc/crypttab' ) assert self.boot_image_task.include_file.call_args_list == [ call('/root/.root.keyfile'), call('/config.partids'), call('/etc/crypttab'), call(filename='/root/.luks.header', delete_after_include=True), call(filename='/root/.luks.slot', delete_after_include=True), call(filename='/root/.slotpass', delete_after_include=True), ] self.boot_image_task.write_system_config_file.assert_called_once_with( config={'install_items': ['/root/.root.keyfile']}, config_file='root_dir/etc/dracut.conf.d/99-luks-boot.conf', ) @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('kiwi.builder.disk.BootLoaderInstall.new') def test_create_disk_luks_root_with_disk_password( self, mock_BootLoaderInstall, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.use_disk_password = True bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = None self.disk_builder.luks = 'passphrase' self.disk_builder.use_disk_password = True self.disk_setup.need_boot_partition.return_value = False self.disk_builder.root_filesystem_is_overlay = True self.disk_builder.root_filesystem_has_write_partition = True self.disk_builder.boot_is_crypto = True disk.public_partition_id_map = self.id_map disk.public_partition_id_map['kiwi_ROPart'] = 1 bootloader = mock_BootLoaderInstall.return_value self.disk_builder.cmdline = 'rd.kiwi.oem.luks.reencrypt' with patch('builtins.open'): self.disk_builder.create_disk() self.luks_root.create_crypto_luks.assert_called_once_with( passphrase='passphrase', osname=None, options=[], keyfile='/root/.root.keyfile', randomize=True, root_dir='root_dir', ) self.luks_root.create_crypttab.assert_called_once_with( 'root_dir/etc/crypttab' ) assert self.boot_image_task.include_file.call_args_list == [ call('/root/.root.keyfile'), call('/config.partids'), call('/etc/crypttab'), call(filename='/root/.luks.header', delete_after_include=True), call(filename='/root/.luks.slot', delete_after_include=True), call(filename='/root/.slotpass', delete_after_include=True), ] self.boot_image_task.write_system_config_file.assert_called_once_with( config={'install_items': ['/root/.root.keyfile']}, config_file='root_dir/etc/dracut.conf.d/99-luks-boot.conf', ) bootloader.set_disk_password.assert_called_once_with('passphrase') @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('os.path.exists') @patch('kiwi.builder.disk.BlockID') def test_create_disk_uses_custom_partitions( self, mock_BlockID, mock_exists, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) self.fstype_mock_list = [ 'ext3', 'squashfs', 'some_fs', 'some_fs', 'some_fs', 'some_fs', 'some_fs', 'some_fs', 'some_fs', 'some_fs', 'some_fs', 'some_fs', ] fstype = list(self.fstype_mock_list) def get_filesystem(): return fstype.pop() block_operation = Mock() block_operation.get_filesystem.side_effect = get_filesystem block_operation.get_blkid.return_value = 'blkid_result' mock_BlockID.return_value = block_operation mock_exists.return_value = True self.disk_builder.custom_partitions = { 'var': ptable_entry_type( mbsize=100, clone=0, partition_name='p.lxvar', partition_type='t.linux', partition_id=None, mountpoint='/var', filesystem='ext3', label='var', ), 'spare': ptable_entry_type( mbsize=100, clone=0, partition_name='p.lxtmp', partition_type='t.linux', partition_id=None, mountpoint='/spare', filesystem='squashfs', label='', ), } self.disk_builder.volume_manager_name = None filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem with patch('builtins.open'): self.disk_builder.create_disk() disk.persistency_type = 'by-uuid' disk.create_custom_partitions.assert_called_once_with( self.disk_builder.custom_partitions ) assert [ call('PARTUUID=blkid_result /spare squashfs defaults 0 0') ] in self.disk_builder.fstab.add_entry.call_args_list assert [ call('UUID=blkid_result /var ext3 defaults 0 0') ] in self.disk_builder.fstab.add_entry.call_args_list self.disk_builder.persistency_type = 'by-partuuid' fstype = list(self.fstype_mock_list) with patch('builtins.open'): self.disk_builder.create_disk() assert [ call('PARTUUID=blkid_result /var ext3 defaults 0 0') ] in self.disk_builder.fstab.add_entry.call_args_list self.disk_builder.persistency_type = 'by-label' fstype = list(self.fstype_mock_list) with patch('builtins.open'): self.disk_builder.create_disk() assert [ call('LABEL=blkid_result /var ext3 defaults 0 0') ] in self.disk_builder.fstab.add_entry.call_args_list @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.VolumeManager.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('kiwi.builder.disk.ImageSystem') @patch('os.path.exists') def test_create_disk_btrfs_managed_root( self, mock_exists, mock_ImageSystem, mock_grub_dir, mock_command, mock_volume_manager, mock_fs, mock_create_boot_loader_config, mock_Disk, ): mock_Disk.return_value.__enter__.return_value = ( self._get_disk_instance() ) bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) mock_exists.return_value = True volume_manager = Mock() volume_manager.get_device = Mock( return_value={'root': MappedDevice('root', Mock())} ) volume_manager.get_fstab = Mock(return_value=['fstab_volume_entries']) volume_manager.get_root_volume_name = Mock(return_value='@') mock_volume_manager.return_value = volume_manager filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = 'btrfs' self.disk_builder.btrfs_default_volume_requested = False with patch('builtins.open'): self.disk_builder.create_disk() assert [ call('UUID=blkid_result / blkid_result_fs ro,defaults,subvol=@ 0 0') ] in self.disk_builder.fstab.add_entry.call_args_list @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.VolumeManager.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('kiwi.builder.disk.ImageSystem') @patch('os.path.exists') def test_create_disk_btrfs_seed_for_partition_based_install( self, mock_exists, mock_ImageSystem, mock_grub_dir, mock_command, mock_volume_manager, mock_fs, mock_create_boot_loader_config, mock_Disk, ): mock_Disk.return_value.__enter__.return_value = ( self._get_disk_instance() ) bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) mock_exists.return_value = True volume_manager = Mock() volume_manager.get_device = Mock( return_value={'root': MappedDevice('/dev/root-device', Mock())} ) volume_manager.get_fstab = Mock(return_value=['fstab_volume_entries']) volume_manager.get_root_volume_name = Mock(return_value='@') mock_volume_manager.return_value = volume_manager filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = 'btrfs' self.disk_builder.btrfs_default_volume_requested = False self.disk_builder.install_iso = True seed_call = call(['btrfstune', '-S', '1', '/dev/root-device']) # install image without partition based mode, no seed with patch('builtins.open'): self.disk_builder.create_disk() assert seed_call not in mock_command.call_args_list # install image with partition based mode, root is seed mock_command.reset_mock() self.disk_builder.cmdline = ( 'console=ttyS0 rd.kiwi.install.partition_based' ) with patch('builtins.open'): self.disk_builder.create_disk() assert seed_call in mock_command.call_args_list def test_partition_based_install_requested(self): for cmdline, requested in [ ('', False), ('rd.kiwi.install.partition_based', True), ('rd.kiwi.install.partition_based=1', True), ('rd.kiwi.install.partition_based=0', False), ('rd.kiwi.install.partition_based=off', False), ('rd.kiwi.install.partition_based_foo', False), ( 'rd.kiwi.install.partition_based ' 'rd.kiwi.install.partition_based=no', False, ), ]: self.disk_builder.cmdline = cmdline assert ( self.disk_builder._partition_based_install_requested() is requested ) @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.VolumeManager.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') @patch('kiwi.builder.disk.ImageSystem') @patch('os.path.exists') def test_create_disk_volume_managed_root( self, mock_exists, mock_ImageSystem, mock_grub_dir, mock_command, mock_volume_manager, mock_fs, mock_create_boot_loader_config, mock_Disk, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) mock_exists.return_value = True volume_manager = Mock() volume_manager.get_device = Mock( return_value={ 'root': MappedDevice('/dev/systemVG/LVRoot', Mock()), 'swap': MappedDevice('/dev/systemVG/LVSwap', Mock()), } ) volume_manager.get_fstab = Mock(return_value=['fstab_volume_entries']) mock_volume_manager.return_value = volume_manager filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = 'lvm' with patch('builtins.open'): self.disk_builder.create_disk() disk.create_root_lvm_partition.assert_called_once_with( 'all_free', 0, None ) volume_manager.setup.assert_called_once_with('systemVG') volume_manager.create_volumes.assert_called_once_with('btrfs') volume_manager.mount_volumes.call_args_list[0].assert_called_once_with() assert volume_manager.get_fstab.call_args_list == [ call(None, 'btrfs'), call(None, 'btrfs'), ] volume_manager.sync_data.assert_called_once_with( [ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', 'boot/*', 'boot/.*', 'boot/efi/*', 'boot/efi/.*', ] ) self.setup.create_fstab.assert_called_once_with(self.disk_builder.fstab) self.boot_image_task.setup.create_fstab.assert_called_once_with( self.disk_builder.fstab ) # A custom root partition number from the image description # reaches the lvm partition disk.create_root_lvm_partition.reset_mock() self.disk_builder.xml_state.build_type.get_rootpart_id = Mock( return_value='128' ) with patch('builtins.open'): self.disk_builder.create_disk() disk.create_root_lvm_partition.assert_called_once_with( 'all_free', 0, 128 ) @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') def test_create_disk_hybrid_gpt_requested( self, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = None self.disk_builder.install_media = False self.disk_builder.hybrid_mbr = True with patch('builtins.open'): self.disk_builder.create_disk() disk.create_hybrid_mbr.assert_called_once_with() @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') def test_create_disk_force_mbr_requested( self, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = None self.disk_builder.install_media = False self.disk_builder.force_mbr = True with patch('builtins.open'): self.disk_builder.create_disk() disk.create_mbr.assert_called_once_with() @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') def test_create_disk_custom_start_sector_requested( self, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.volume_manager_name = None self.disk_builder.install_media = False self.disk_builder.disk_start_sector = 4096 self.firmware.get_partition_table_type = Mock(return_value='msdos') with patch('builtins.open'): self.disk_builder.create_disk() disk.set_start_sector.assert_called_once_with(4096) def test_create(self): result = Mock() create_disk = Mock(return_value=result) create_install_media = Mock(return_value=result) append_unpartitioned = Mock() create_disk_format = Mock(return_value=result) self.disk_builder.create_disk = create_disk self.disk_builder.create_install_media = create_install_media self.disk_builder.append_unpartitioned_space = append_unpartitioned self.disk_builder.create_disk_format = create_disk_format self.disk_builder.create() create_disk.assert_called_once_with() create_install_media.assert_called_once_with(result) append_unpartitioned.assert_called_once_with() create_disk_format.assert_called_once_with(result) @patch('kiwi.builder.disk.Disk') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.Defaults.get_grub_boot_directory_name') def test_create_disk_spare_part_requested( self, mock_grub_dir, mock_command, mock_fs, mock_create_boot_loader_config, mock_Disk, ): disk = self._get_disk_instance() mock_Disk.return_value.__enter__.return_value = disk bootloader_config = Mock() bootloader_config.get_boot_cmdline = Mock(return_value='boot_cmdline') mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) filesystem = MagicMock() mock_fs.return_value = filesystem self.disk_builder.volume_manager_name = None self.disk_builder.install_media = False self.disk_builder.spare_part_mbsize = 42 self.disk_builder.spare_part_fs = 'ext4' self.disk_builder.spare_part_mountpoint = '/var' self.disk_builder.spare_part_is_last = False with patch('builtins.open'): self.disk_builder.create_disk() disk.create_spare_partition.assert_called_once_with('42') assert mock_fs.call_args_list[0] == call( self.disk_builder.spare_part_fs, self.device_map['spare'], 'root_dir/var/', {'fs_attributes': None}, ) assert filesystem.sync_data.call_args_list.pop() == call( [ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', 'var/*', 'var/.*', 'boot/*', 'boot/.*', 'boot/efi/*', 'boot/efi/.*', ] ) assert [ call('UUID=blkid_result / blkid_result_fs ro 0 0'), call('UUID=blkid_result /boot blkid_result_fs defaults 0 0'), call('UUID=blkid_result /boot/efi blkid_result_fs defaults 0 0'), call('UUID=blkid_result /var blkid_result_fs defaults 0 0'), call('UUID=blkid_result swap blkid_result_fs defaults 0 0'), ] in self.disk_builder.fstab.add_entry.call_args_list disk.create_root_partition.reset_mock() disk.create_spare_partition.reset_mock() self.disk_builder.spare_part_is_last = True self.disk_builder.disk_resize_requested = False with patch('builtins.open'): self.disk_builder.create_disk() disk.create_spare_partition.assert_called_once_with('all_free') @patch('kiwi.builder.disk.LoopDevice') @patch('kiwi.builder.disk.Partitioner.new') @patch('kiwi.builder.disk.DiskFormat.new') def test_append_unpartitioned_space( self, mock_diskformat, mock_partitioner, mock_LoopDevice ): loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider partitioner = Mock() mock_partitioner.return_value = partitioner disk_format = Mock() mock_diskformat.return_value.__enter__.return_value = disk_format self.disk_builder.unpartitioned_bytes = 1024 self.disk_builder.append_unpartitioned_space() disk_format.resize_raw_disk.assert_called_once_with(1024, append=True) loop_provider.create.assert_called_once_with(overwrite=False) assert partitioner.resize_table.called @patch('kiwi.builder.disk.FileSystem.new') @patch('kiwi.builder.disk.Command.run') @patch('kiwi.builder.disk.DiskFormat.new') def test_create_disk_format(self, mock_DiskFormat, mock_command, mock_fs): disk_subformat = Mock() mock_DiskFormat.return_value.__enter__.return_value = disk_subformat result_instance = Mock() filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.disk_builder.install_media = False self.disk_builder.image_format = 'vmdk' with patch('builtins.open'): self.disk_builder.create_disk_format(result_instance) disk_subformat.create_image_format.assert_called_once_with() def _get_disk_instance(self) -> Mock: disk = Mock() provider = Mock() partitioner = Mock() disk.get_uuid = Mock(return_value='0815') disk.get_public_partition_id_map = Mock(return_value=self.id_map_sorted) disk.get_device = Mock(return_value=self.device_map) provider.get_device = Mock(return_value='/dev/some-loop') partitioner.get_id = Mock(return_value=1) disk.storage_provider = provider disk.partitioner = partitioner return disk def test_get_root_readonly_compression_erofs(self): self.disk_builder.root_filesystem_read_only_type = 'erofs' self.disk_builder.xml_state.build_type.get_erofscompression = Mock( return_value='lz4hc,level=12' ) assert ( self.disk_builder._get_root_readonly_compression() == 'lz4hc,level=12' ) def test_get_root_readonly_compression_squashfs(self): self.disk_builder.root_filesystem_read_only_type = 'squashfs' self.disk_builder.xml_state.build_type.get_squashfscompression = Mock( return_value='gzip' ) assert self.disk_builder._get_root_readonly_compression() == 'gzip' def test_custom_partition_id(self): assert self.disk_builder._custom_partition_id('128') == 128 assert self.disk_builder._custom_partition_id(None) is None def test_custom_partition_id_allows_the_partitioner_to_count_on(self): # The partitioner derives the next partition number from the last # one it was given. Handing it the raw string from the image # description made the next partition without an explicit number # fail with "can only concatenate str (not int) to str". partitioner = PartitionerGpt(Mock()) with patch('kiwi.partitioner.gpt.Command.run'): partitioner.create( 'p.UEFI', 20, 't.efi', partition_id=self.disk_builder._custom_partition_id('128'), ) assert partitioner.partition_id == 128 partitioner.create('p.lxlvm', 100, 't.lvm') assert partitioner.partition_id == 129 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7643697 kiwi-11.1.8/test/unit/builder/enclave_test.py0000644000000000000000000000660015273675667016137 0ustar00from collections import namedtuple from unittest.mock import patch, Mock, MagicMock from pytest import raises, fixture import kiwi from kiwi.builder.enclave import EnclaveBuilder from kiwi.defaults import Defaults from kiwi.exceptions import KiwiEnclaveBootImageError, KiwiEnclaveFormatError class TestEnclaveBuilder: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.builder.enclave.BootImage') def setup(self, mock_boot): Defaults.set_platform_name('x86_64') self.setup = Mock() self.runtime_config = Mock() self.runtime_config.get_max_size_constraint = Mock(return_value=None) kiwi.builder.enclave.RuntimeConfig = Mock( return_value=self.runtime_config ) kiwi.builder.enclave.SystemSetup = Mock(return_value=self.setup) self.boot_image_task = MagicMock() self.boot_image_task.boot_root_directory = 'initrd_dir' self.boot_image_task.initrd_filename = 'initrd_file_name' mock_boot.new.return_value = self.boot_image_task self.xml_state = Mock() self.xml_state.profiles = None self.xml_state.get_image_version = Mock(return_value='1.2.3') self.xml_state.get_initrd_system = Mock(return_value='dracut') self.xml_state.xml_data.get_name = Mock(return_value='some-image') self.xml_state.build_type = Mock() self.xml_state.build_type.get_kernelcmdline = Mock(return_value='some') kernel_type = namedtuple('kernel', ['filename', 'version']) self.kernel = Mock() self.kernel.get_kernel = Mock( return_value=kernel_type(filename='some-kernel', version='42') ) kiwi.builder.enclave.Kernel = Mock(return_value=self.kernel) self.enclave = EnclaveBuilder( self.xml_state, 'target_dir', 'root_dir', custom_args={'signing_keys': ['key_file_a', 'key_file_b']}, ) self.enclave.compressed = True @patch('kiwi.builder.enclave.BootImage') def setup_method(self, cls, mock_boot): self.setup() @patch('kiwi.builder.enclave.BootImage') def test_create_invalid_enclave_format(self, mock_boot): self.enclave.format = '' with raises(KiwiEnclaveFormatError): self.enclave.create() @patch('kiwi.builder.enclave.Command.run') def test_create_aws_nitro(self, mock_Command_run): self.enclave.format = 'aws-nitro' self.boot_image_task.required = Mock(return_value=True) self.enclave.create() self.boot_image_task.create_initrd.assert_called_once_with() self.setup.export_package_list.assert_called_once_with('target_dir') self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) mock_Command_run.assert_called_once_with( [ 'eif_build', '--kernel', 'target_dir/some-image.x86_64-1.2.3-42.kernel', '--ramdisk', 'target_dir/initrd_file_name', '--cmdline', 'some', '--output', 'target_dir/some-image.x86_64-1.2.3.eif', ] ) def test_create_no_kernel_found(self): self.kernel.get_kernel.return_value = False with raises(KiwiEnclaveBootImageError): self.enclave.create() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7643697 kiwi-11.1.8/test/unit/builder/filesystem_test.py0000644000000000000000000001511715273675667016711 0ustar00import sys from unittest.mock import patch, Mock from pytest import raises from ..test_helper import argv_kiwi_tests import kiwi from kiwi.defaults import Defaults from kiwi.exceptions import KiwiFileSystemSetupError from kiwi.builder.filesystem import FileSystemBuilder class TestFileSystemBuilder: @patch('kiwi.builder.filesystem.FileSystemSetup') def setup(self, mock_fs_setup): Defaults.set_platform_name('x86_64') self.filesystem = Mock() self.filesystem.create_on_device = Mock() self.filesystem.create_on_file = Mock() self.filesystem.sync_data = Mock() self.xml_state = Mock() self.xml_state.profiles = None self.xml_state.get_build_type_unpartitioned_bytes = Mock(return_value=0) self.xml_state.get_fs_mount_option_list = Mock(return_value=['async']) self.xml_state.get_fs_create_option_list = Mock( return_value=['-O', 'option'] ) self.xml_state.get_build_type_name = Mock(return_value='ext3') self.xml_state.get_image_version = Mock(return_value='1.2.3') self.xml_state.xml_data.get_name = Mock(return_value='myimage') self.xml_state.build_type.get_target_blocksize = Mock(return_value=4096) self.xml_state.build_type.get_squashfscompression = Mock( return_value='gzip' ) self.xml_state.build_type.get_erofscompression = Mock( return_value='zstd,level=12' ) self.fs_setup = Mock() self.fs_setup.get_size_mbytes = Mock(return_value=42) self.setup = Mock() kiwi.builder.filesystem.SystemSetup = Mock(return_value=self.setup) @patch('kiwi.builder.filesystem.FileSystemSetup') def setup_method(self, cls, mock_fs_setup): self.setup() def test_create_unknown_filesystem(self): self.xml_state.get_build_type_name = Mock(return_value='super-fs') fs = FileSystemBuilder(self.xml_state, 'target_dir', 'root_dir') with raises(KiwiFileSystemSetupError): fs.create() def test_no_filesystem_configured(self): self.xml_state.get_build_type_name = Mock(return_value='pxe') self.xml_state.build_type.get_filesystem = Mock(return_value=None) with raises(KiwiFileSystemSetupError): FileSystemBuilder(self.xml_state, 'target_dir', 'root_dir') @patch('kiwi.builder.filesystem.LoopDevice') @patch('kiwi.builder.filesystem.FileSystem.new') @patch('kiwi.builder.filesystem.FileSystemSetup') def test_create_on_loop(self, mock_fs_setup, mock_fs, mock_LoopDevice): Defaults.set_platform_name('x86_64') mock_fs_setup.return_value = self.fs_setup mock_fs.return_value.__enter__.return_value = self.filesystem loop_provider = Mock() loop_provider.get_device = Mock(return_value='/dev/loop1') mock_LoopDevice.return_value.__enter__.return_value = loop_provider fs = FileSystemBuilder(self.xml_state, 'target_dir', 'root_dir') fs.create() mock_LoopDevice.assert_called_once_with( 'target_dir/myimage.x86_64-1.2.3.ext3', 42, 4096 ) loop_provider.create.assert_called_once_with() mock_fs.assert_called_once_with( 'ext3', loop_provider, 'root_dir/', {'mount_options': ['async'], 'create_options': ['-O', 'option']}, ) self.filesystem.create_on_device.assert_called_once_with(None) self.filesystem.sync_data.assert_called_once_with( [ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', ] ) self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) self.setup.export_package_list.assert_called_once_with('target_dir') @patch('kiwi.builder.filesystem.FileSystem.new') @patch('kiwi.builder.filesystem.DeviceProvider') def test_create_on_file_erofs(self, mock_provider, mock_fs): Defaults.set_platform_name('x86_64') provider = Mock() mock_provider.return_value = provider mock_fs.return_value.__enter__.return_value = self.filesystem self.xml_state.get_build_type_name = Mock(return_value='erofs') fs = FileSystemBuilder(self.xml_state, 'target_dir', 'root_dir') fs.create() mock_fs.assert_called_once_with( 'erofs', provider, 'root_dir', { 'mount_options': ['async'], 'create_options': ['-O', 'option'], 'compression': 'zstd,level=12', }, ) self.filesystem.create_on_file.assert_called_once_with( 'target_dir/myimage.x86_64-1.2.3.erofs', None, [ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', ], ) self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) self.setup.export_package_list.assert_called_once_with('target_dir') @patch('kiwi.builder.filesystem.FileSystem.new') @patch('kiwi.builder.filesystem.DeviceProvider') def test_create_on_file_squashfs(self, mock_provider, mock_fs): Defaults.set_platform_name('x86_64') provider = Mock() mock_provider.return_value = provider mock_fs.return_value.__enter__.return_value = self.filesystem self.xml_state.get_build_type_name = Mock(return_value='squashfs') fs = FileSystemBuilder(self.xml_state, 'target_dir', 'root_dir') fs.create() mock_fs.assert_called_once_with( 'squashfs', provider, 'root_dir', { 'mount_options': ['async'], 'create_options': ['-O', 'option'], 'compression': 'gzip', }, ) self.filesystem.create_on_file.assert_called_once_with( 'target_dir/myimage.x86_64-1.2.3.squashfs', None, [ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', ], ) self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) self.setup.export_package_list.assert_called_once_with('target_dir') def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7643697 kiwi-11.1.8/test/unit/builder/init_test.py0000644000000000000000000000626515273675667015474 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.builder import ImageBuilder from kiwi.exceptions import KiwiRequestedTypeError class TestImageBuilder: @patch('kiwi.builder.filesystem.FileSystemBuilder') def test_filesystem_builder(self, mock_builder): xml_state = Mock() xml_state.get_build_type_name = Mock(return_value='ext4') ImageBuilder.new(xml_state, 'target_dir', 'root_dir') mock_builder.assert_called_once_with( xml_state, 'target_dir', 'root_dir', None ) @patch('kiwi.builder.disk.DiskBuilder') def test_disk_builder(self, mock_builder): xml_state = Mock() xml_state.get_build_type_name = Mock(return_value='oem') ImageBuilder.new(xml_state, 'target_dir', 'root_dir') mock_builder.assert_called_once_with( xml_state, 'target_dir', 'root_dir', None ) @patch('kiwi.builder.live.LiveImageBuilder') def test_live_builder(self, mock_builder): xml_state = Mock() xml_state.get_build_type_name = Mock(return_value='iso') ImageBuilder.new(xml_state, 'target_dir', 'root_dir') mock_builder.assert_called_once_with( xml_state, 'target_dir', 'root_dir', None ) @patch('kiwi.builder.kis.KisBuilder') def test_kis_builder(self, mock_builder): xml_state = Mock() xml_state.get_build_type_name = Mock(return_value='kis') ImageBuilder.new(xml_state, 'target_dir', 'root_dir') mock_builder.assert_called_once_with( xml_state, 'target_dir', 'root_dir', None ) mock_builder.reset_mock() xml_state.get_build_type_name = Mock(return_value='pxe') ImageBuilder.new(xml_state, 'target_dir', 'root_dir') mock_builder.assert_called_once_with( xml_state, 'target_dir', 'root_dir', None ) @patch('kiwi.builder.enclave.EnclaveBuilder') def test_enclave_builder(self, mock_builder): xml_state = Mock() xml_state.get_build_type_name = Mock(return_value='enclave') ImageBuilder.new(xml_state, 'target_dir', 'root_dir') mock_builder.assert_called_once_with( xml_state, 'target_dir', 'root_dir', None ) @patch('kiwi.builder.archive.ArchiveBuilder') def test_archive_builder(self, mock_builder): xml_state = Mock() xml_state.get_build_type_name = Mock(return_value='tbz') ImageBuilder.new(xml_state, 'target_dir', 'root_dir') mock_builder.assert_called_once_with( xml_state, 'target_dir', 'root_dir', None ) @patch('kiwi.builder.container.ContainerBuilder') def test_container_builder(self, mock_builder): xml_state = Mock() xml_state.get_build_type_name = Mock(return_value='docker') ImageBuilder.new(xml_state, 'target_dir', 'root_dir') mock_builder.assert_called_once_with( xml_state, 'target_dir', 'root_dir', None ) def test_unsupported_build_type(self): xml_state = Mock() xml_state.get_build_type_name = Mock(return_value='bogus') with raises(KiwiRequestedTypeError): ImageBuilder.new(xml_state, 'target_dir', 'root_dir') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7643697 kiwi-11.1.8/test/unit/builder/install_test.py0000644000000000000000000005370015273675667016173 0ustar00from unittest.mock import MagicMock, patch, call, mock_open, ANY, Mock from pytest import raises import unittest.mock as mock import kiwi.builder.install from collections import namedtuple from kiwi.bootloader.config.grub2 import BootLoaderConfigGrub2 from kiwi.defaults import Defaults from kiwi.builder.install import InstallImageBuilder from kiwi.exceptions import KiwiInstallBootImageError class TestInstallImageBuilder: @patch('kiwi.builder.install.RuntimeConfig') def setup(self, mock_RuntimeConfig): self.runtime_config = Mock() self.shasum = Mock() self.shasum.suffix = '.sha256' self.runtime_config.get_checksum_handler = Mock( return_value=self.shasum ) mock_RuntimeConfig.return_value = self.runtime_config Defaults.set_platform_name('x86_64') boot_names_type = namedtuple( 'boot_names_type', ['kernel_name', 'initrd_name'] ) self.setup = mock.Mock() kiwi.builder.install.SystemSetup = mock.Mock(return_value=self.setup) self.firmware = mock.Mock() self.firmware.efi_mode = mock.Mock(return_value='uefi') kiwi.builder.install.FirmWare = mock.Mock(return_value=self.firmware) self.mbrid = mock.Mock() self.mbrid.get_id = mock.Mock(return_value='0xffffffff') kiwi.builder.install.SystemIdentifier = mock.Mock( return_value=self.mbrid ) kiwi.builder.install.Path = mock.Mock() create_boot_loader_config_mock = mock.Mock(return_value=MagicMock()) create_boot_loader_config_mock.return_value.__enter__.return_value = ( mock.Mock() ) kiwi.builder.install.create_boot_loader_config = ( create_boot_loader_config_mock ) self.kernel = mock.Mock() self.kernel.get_kernel = mock.Mock() self.kernel.get_xen_hypervisor = mock.Mock() self.kernel.copy_kernel = mock.Mock() self.kernel.copy_xen_hypervisor = mock.Mock() kiwi.builder.install.Kernel = mock.Mock(return_value=self.kernel) self.xml_state = mock.Mock() self.xml_state.get_initrd_system = mock.Mock(return_value='kiwi') self.xml_state.get_build_type_bootloader_kernel_flavors = mock.Mock( return_value=[] ) self.xml_state.xml_data.get_name = mock.Mock( return_value='result-image' ) self.xml_state.get_image_version = mock.Mock(return_value='1.2.3') self.xml_state.build_type.get_kernelcmdline = mock.Mock( return_value='custom_kernel_options' ) self.xml_state.get_oemconfig_oem_multipath_scan = mock.Mock( return_value=False ) self.xml_state.get_installmedia_initrd_modules = mock.Mock( return_value=['module1', 'module2'] ) self.xml_state.get_installmedia_initrd_drivers = mock.Mock( return_value=['driver1', 'driver2'] ) self.boot_image_task = mock.Mock() self.boot_image_task.boot_root_directory = 'initrd_dir' self.boot_image_task.initrd_filename = 'initrd' self.boot_image_task.get_boot_names = mock.Mock( return_value=boot_names_type( kernel_name='kernel_name', initrd_name='initrd-kernel_version' ) ) self.install_image = InstallImageBuilder( self.xml_state, 'root_dir', 'target_dir', self.boot_image_task ) def setup_method(self, cls): self.setup() @patch('kiwi.builder.install.BootImage') @patch('kiwi.builder.install.RuntimeConfig') def test_init_dracut_based(self, mock_RuntimeConfig, mock_boot_image): mock_RuntimeConfig.return_value = self.runtime_config InstallImageBuilder(self.xml_state, 'root_dir', 'target_dir', None) mock_boot_image.new.assert_called_once_with( ANY, 'target_dir', 'root_dir' ) @patch('kiwi.builder.install.RuntimeConfig') def test_setup_ix86(self, mock_RuntimeConfig): Defaults.set_platform_name('i686') mock_RuntimeConfig.return_value = self.runtime_config xml_state = mock.Mock() xml_state.xml_data.get_name = mock.Mock(return_value='result-image') xml_state.get_image_version = mock.Mock(return_value='1.2.3') xml_state.build_type.get_kernelcmdline = mock.Mock( return_value='custom_kernel_options' ) xml_state.get_build_type_oemconfig_section = mock.Mock( return_value=None ) install_image = InstallImageBuilder( xml_state, 'root_dir', 'target_dir', mock.Mock() ) assert install_image.arch == 'ix86' @patch('kiwi.builder.install.FileSystemIsoFs') @patch('kiwi.builder.install.FileSystemSquashFs') @patch('kiwi.builder.install.DeviceProvider') @patch('kiwi.builder.install.create_boot_loader_config') @patch('kiwi.builder.install.IsoToolsBase.setup_media_loader_directory') @patch('kiwi.builder.install.shutil.copy') @patch('kiwi.builder.install.Temporary') @patch('kiwi.builder.install.Command.run') @patch('kiwi.builder.install.Defaults.get_grub_boot_directory_name') @patch('kiwi.builder.install.BlockID.get_ptuuid') def test_create_install_iso( self, mock_get_ptuuid, mock_grub_dir, mock_command, mock_Temporary, mock_copy, mock_setup_media_loader_directory, mock_create_boot_loader_config, mock_DeviceProvider, mock_FileSystemSquashFs, mock_FileSystemIsoFs, ): mock_get_ptuuid.return_value = 'some_PTUUID' temp_squashfs = Mock() temp_squashfs.new_dir.return_value.name = 'temp-squashfs' temp_media_dir = Mock() temp_media_dir.new_dir.return_value.name = 'temp_media_dir' temp_esp_file = Mock() temp_esp_file.new_file.return_value.name = 'temp_esp' tmp_names = [temp_esp_file, temp_squashfs, temp_media_dir] iso_image = mock_FileSystemIsoFs.return_value.__enter__.return_value iso_image.create_on_file.return_value = 42 def side_effect(prefix, path): return tmp_names.pop() bootloader_config = mock.MagicMock(spec=BootLoaderConfigGrub2) mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) mock_Temporary.side_effect = side_effect self.firmware.bios_mode.return_value = False m_open = mock_open() with patch('builtins.open', m_open, create=True): self.install_image.create_install_iso() self.setup.import_cdroot_files.assert_called_once_with('temp_media_dir') assert self.runtime_config.get_checksum_handler.call_args_list == [ call('target_dir/result-image.x86_64-1.2.3.raw'), call( source_filename='target_dir/result-image.x86_64-1.2.3.raw', target_filename='temp-squashfs/result-image.sha256', ), ] self.shasum.digest.assert_called_once_with() mock_copy.assert_called_once_with( 'root_dir/boot/initrd-kernel_version', 'temp_media_dir/initrd.system_image', ) assert m_open.call_args_list == [ call('temp_media_dir/config.isoclient', 'w'), call('initrd_dir/config.vmxsystem', 'w'), ] assert m_open.return_value.write.call_args_list == [ call('IMAGE="result-image.raw"\n'), call('IMAGE="result-image.raw"\n'), ] kiwi.builder.install.FileSystemSquashFs.assert_called_once_with( custom_args={'compression': mock.ANY}, device_provider=mock_DeviceProvider.return_value, root_dir='temp-squashfs', ) squashed_image = ( mock_FileSystemSquashFs.return_value.__enter__.return_value ) squashed_image.create_on_file.assert_called_once_with( 'target_dir/result-image.raw.squashfs' ) mock_create_boot_loader_config.assert_called_once_with( name='grub2', xml_state=self.xml_state, root_dir='root_dir', boot_dir='temp_media_dir', custom_args={ 'grub_directory_name': mock_grub_dir.return_value, 'grub_load_command': 'configfile', }, ) bootloader_config.setup_install_boot_images.assert_called_once_with( lookup_path='initrd_dir', mbrid=self.mbrid ) mock_setup_media_loader_directory.assert_called_once_with( 'initrd_dir', 'temp_media_dir', bootloader_config.get_boot_theme.return_value, ) bootloader_config.write_meta_data.assert_called_once_with() bootloader_config.setup_install_image_config.assert_called_once_with( mbrid=self.mbrid ) bootloader_config.write.assert_called_once_with() bootloader_config._create_embedded_fat_efi_image.assert_called_once_with( 'temp_esp' ) self.boot_image_task.create_initrd.assert_called_once_with( self.mbrid, 'initrd_kiwi_install', install_initrd=True, flavor='' ) self.boot_image_task.cleanup.assert_called_once_with() self.kernel.copy_kernel.assert_called_once_with( 'temp_media_dir/boot/x86_64/loader', '/linux', flavor='' ) self.kernel.copy_xen_hypervisor.assert_called_once_with( 'temp_media_dir/boot/x86_64/loader', '/xen.gz' ) assert mock_command.call_args_list == [ call( [ 'cp', '-l', 'target_dir/result-image.x86_64-1.2.3.raw', 'temp-squashfs/result-image.raw', ] ), call( ['mv', 'target_dir/result-image.raw.squashfs', 'temp_media_dir'] ), call(['mv', 'initrd', 'temp_media_dir/boot/x86_64/loader/initrd']), ] iso_image.create_on_file.assert_called_once_with( 'target_dir/result-image.x86_64-1.2.3.install.iso' ) tmp_names = [temp_esp_file, temp_squashfs, temp_media_dir] self.install_image.initrd_system = 'dracut' m_open.reset_mock() with patch('builtins.open', m_open, create=True): self.install_image.create_install_iso() self.boot_image_task.include_module.assert_any_call('kiwi-dump') self.boot_image_task.include_module.assert_any_call('kiwi-dump-reboot') self.boot_image_task.include_driver.assert_any_call('driver1') self.boot_image_task.include_driver.assert_any_call('driver2') assert self.boot_image_task.omit_module.call_args_list == [ call('kiwi-repart'), call('multipath'), call('module1'), call('module2'), ] self.boot_image_task.set_static_modules.assert_called_once_with( ['module1', 'module2'] ) assert self.boot_image_task.include_file.call_args_list == [ call('/config.bootoptions'), call('/system_identifier'), ] assert m_open.call_args_list == [ call('temp_media_dir/config.isoclient', 'w'), call('initrd_dir/system_identifier', 'w'), ] assert m_open.return_value.write.call_args_list == [ call('IMAGE="result-image.raw"\n'), call('some_PTUUID'), ] @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.install.IsoToolsBase.setup_media_loader_directory') @patch('kiwi.builder.install.Temporary') @patch('kiwi.builder.install.Command.run') def test_create_install_iso_no_kernel_found( self, mock_command, mock_Temporary, mock_setup_media_loader_directory, mock_create_boot_loader_config, ): self.firmware.bios_mode.return_value = False self.kernel.get_kernel.return_value = False with patch('builtins.open'): with raises(KiwiInstallBootImageError): self.install_image.create_install_iso() @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.install.IsoToolsBase.setup_media_loader_directory') @patch('kiwi.builder.install.Temporary') @patch('kiwi.builder.install.Command.run') def test_create_install_iso_no_hypervisor_found( self, mock_command, mock_Temporary, mock_setup_media_loader_directory, mock_create_boot_loader_config, ): self.firmware.bios_mode.return_value = False self.kernel.get_xen_hypervisor.return_value = False with patch('builtins.open'): with raises(KiwiInstallBootImageError): self.install_image.create_install_iso() @patch('kiwi.builder.install.Temporary') @patch('kiwi.builder.install.Command.run') @patch('kiwi.builder.install.Compress') def test_create_install_pxe_no_kernel_found( self, mock_compress, mock_command, mock_Temporary ): self.firmware.bios_mode.return_value = False mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' self.kernel.get_kernel.return_value = False with patch('builtins.open'): with raises(KiwiInstallBootImageError): self.install_image.create_install_pxe_archive() @patch('kiwi.builder.install.Temporary') @patch('kiwi.builder.install.Command.run') @patch('kiwi.builder.install.Compress') @patch('kiwi.builder.install.os.symlink') def test_create_install_pxe_no_hypervisor_found( self, mock_symlink, mock_compress, mock_command, mock_Temporary ): self.firmware.bios_mode.return_value = False mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' self.kernel.get_xen_hypervisor.return_value = False with patch('builtins.open'): with raises(KiwiInstallBootImageError): self.install_image.create_install_pxe_archive() @patch('kiwi.builder.install.Temporary') @patch('kiwi.builder.install.Command.run') @patch('kiwi.builder.install.ArchiveTar') @patch('kiwi.builder.install.Compress') @patch('kiwi.builder.install.shutil.copy') @patch('kiwi.builder.install.os.symlink') @patch('kiwi.builder.install.os.chmod') def test_create_install_pxe_archive( self, mock_chmod, mock_symlink, mock_copy, mock_compress, mock_archive, mock_command, mock_Temporary, ): mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' archive = mock.Mock() mock_archive.return_value = archive compress = mock.Mock() src = 'target_dir/result-image.x86_64-1.2.3.raw' compress.xz.return_value = src mock_compress.return_value = compress m_open = mock_open() with patch('builtins.open', m_open, create=True): self.install_image.create_install_pxe_archive() mock_compress.assert_called_once_with( keep_source_on_compress=True, source_filename=src ) compress.xz.assert_called_once_with(None) assert mock_command.call_args_list[0] == call( ['mv', src, 'tmpdir/result-image.x86_64-1.2.3.xz'] ) assert self.runtime_config.get_checksum_handler.call_args_list == [ call('target_dir/result-image.x86_64-1.2.3.raw'), call( source_filename='target_dir/result-image.x86_64-1.2.3.raw', target_filename='tmpdir/result-image.x86_64-1.2.3.sha256', ), ] self.shasum.digest.assert_called_once_with() assert m_open.call_args_list == [ call('initrd_dir/config.vmxsystem', 'w'), call('tmpdir/result-image.x86_64-1.2.3.append', 'w'), ] assert m_open.return_value.write.call_args_list == [ call('IMAGE="result-image.raw"\n'), call('pxe=1 custom_kernel_options\n'), ] self.kernel.copy_kernel.assert_called_once_with( 'tmpdir', 'pxeboot.result-image.x86_64-1.2.3.kernel', flavor='' ) mock_symlink.assert_called_once_with( 'pxeboot.result-image.x86_64-1.2.3.kernel', 'tmpdir/result-image.x86_64-1.2.3.kernel', ) self.kernel.copy_xen_hypervisor.assert_called_once_with( 'tmpdir', '/pxeboot.result-image.x86_64-1.2.3.xen.gz' ) self.boot_image_task.create_initrd.assert_called_once_with( self.mbrid, 'initrd_kiwi_install', install_initrd=True, flavor='' ) self.boot_image_task.cleanup.assert_called_once_with() assert mock_command.call_args_list[1] == call( ['mv', 'initrd', 'tmpdir/pxeboot.result-image.x86_64-1.2.3.initrd'] ) mock_chmod.assert_called_once_with( 'tmpdir/pxeboot.result-image.x86_64-1.2.3.initrd', 420 ) mock_archive.assert_called_once_with( 'target_dir/result-image.x86_64-1.2.3.install.tar' ) archive.create.assert_called_once_with('tmpdir') mock_chmod.reset_mock() mock_copy.reset_mock() self.install_image.initrd_system = 'dracut' m_open.reset_mock() with patch('builtins.open', m_open, create=True): self.install_image.create_install_pxe_archive() assert mock_copy.call_args_list == [ call( 'root_dir/boot/initrd-kernel_version', 'tmpdir/result-image.x86_64-1.2.3.initrd', ), call( 'root_dir/config.bootoptions', 'tmpdir/result-image.x86_64-1.2.3.config.bootoptions', ), ] assert mock_chmod.call_args_list == [ call('tmpdir/result-image.x86_64-1.2.3.initrd', 420), call('tmpdir/pxeboot.result-image.x86_64-1.2.3.initrd', 420), ] assert m_open.call_args_list == [ call('tmpdir/result-image.x86_64-1.2.3.append', 'w'), ] assert m_open.return_value.write.call_args_list == [ call( ' '.join( [ 'rd.kiwi.install.pxe', 'rd.kiwi.install.image=http://example.com/image.xz', 'custom_kernel_options\n', ] ) ) ] self.boot_image_task.include_module.assert_any_call('kiwi-dump') self.boot_image_task.include_module.assert_any_call('kiwi-dump-reboot') self.boot_image_task.include_driver.assert_any_call('driver1') self.boot_image_task.include_driver.assert_any_call('driver2') assert self.boot_image_task.omit_module.call_args_list == [ call('kiwi-repart'), call('multipath'), call('module1'), call('module2'), ] self.boot_image_task.set_static_modules.assert_called_once_with( ['module1', 'module2'] ) @patch('kiwi.builder.install.Command.run') @patch('kiwi.builder.install.shutil.copy') @patch('os.symlink') @patch('os.chmod') def test_kernel_and_initrd_of_kernel_flavors( self, mock_chmod, mock_symlink, mock_shutil_copy, mock_Command_run ): # An install initrd is created for the kernel of each flavor, # the files of the first flavor keep the standard names. The # installed system is booted with the kernel of the first flavor self.install_image.kernel_flavors = ['rt', 'default'] self.install_image.initrd_system = 'kiwi' self.install_image.media_dir = Mock() self.install_image.media_dir.name = 'temp_media_dir' self.xml_state.is_xen_server = Mock(return_value=False) self.install_image._create_iso_install_kernel_and_initrd() assert self.kernel.copy_kernel.call_args_list == [ call('temp_media_dir/boot/x86_64/loader', '/linux', flavor='rt'), call( 'temp_media_dir/boot/x86_64/loader', '/linux-default', flavor='default', ), ] assert self.boot_image_task.create_initrd.call_args_list == [ call( self.mbrid, 'initrd_kiwi_install', install_initrd=True, flavor='rt', ), call( self.mbrid, 'initrd_kiwi_install', install_initrd=True, flavor='default', ), ] assert mock_Command_run.call_args_list == [ call(['mv', 'initrd', 'temp_media_dir/boot/x86_64/loader/initrd']), call( [ 'mv', 'initrd', 'temp_media_dir/boot/x86_64/loader/initrd-default', ] ), ] self.install_image._copy_system_image_initrd_to_iso_image() self.boot_image_task.get_boot_names.assert_called_once_with('rt') # pxe uses the kernel of the first flavor self.kernel.copy_kernel.reset_mock() self.boot_image_task.create_initrd.reset_mock() self.install_image.pxe_dir = Mock() self.install_image.pxe_dir.name = 'tmpdir' self.install_image._create_pxe_install_kernel_and_initrd() self.kernel.get_kernel.assert_called_with(flavor='rt') self.kernel.copy_kernel.assert_called_once_with( 'tmpdir', 'pxeboot.result-image.x86_64-1.2.3.kernel', flavor='rt' ) self.boot_image_task.create_initrd.assert_called_once_with( self.mbrid, 'initrd_kiwi_install', install_initrd=True, flavor='rt' ) def test_create_iso_install_kernel_of_flavor_not_found(self): self.install_image.kernel_flavors = ['rt'] self.install_image.media_dir = Mock() self.install_image.media_dir.name = 'temp_media_dir' self.kernel.get_kernel.return_value = None with raises(KiwiInstallBootImageError) as issue: self.install_image._create_iso_install_kernel_and_initrd() assert 'No kernel of flavor rt in boot image tree' in str(issue.value) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7643697 kiwi-11.1.8/test/unit/builder/kis_test.py0000644000000000000000000002016715273675667015314 0ustar00import logging from collections import namedtuple from unittest.mock import patch, Mock, MagicMock, mock_open, call from pytest import raises, fixture import kiwi from kiwi.builder.kis import KisBuilder from kiwi.exceptions import KiwiKisBootImageError class TestKisBuilder: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.builder.kis.FileSystemBuilder') @patch('kiwi.builder.kis.BootImage') @patch('kiwi.builder.kis.Defaults.get_platform_name') @patch('kiwi.builder.kis.RuntimeConfig') def setup( self, mock_RuntimeConfig, mock_get_platform_name, mock_boot, mock_filesystem, ): mock_get_platform_name.return_value = 'x86_64' self.setup = Mock() self.runtime_config = Mock() self.runtime_config.get_max_size_constraint = Mock(return_value=None) self.shasum = Mock() self.shasum.suffix = '.sha256' self.runtime_config.get_checksum_handler = Mock( return_value=self.shasum ) mock_RuntimeConfig.return_value = self.runtime_config kiwi.builder.kis.SystemSetup = Mock(return_value=self.setup) self.boot_image_task = MagicMock() self.boot_image_task.boot_root_directory = 'initrd_dir' self.boot_image_task.initrd_filename = 'initrd_file_name' mock_boot.new.return_value = self.boot_image_task self.filesystem = MagicMock() self.filesystem.filename = 'myimage.fs' self.filesystem.root_uuid = 'some_uuid' mock_filesystem.return_value = self.filesystem self.xml_state = Mock() self.xml_state.profiles = None self.xml_state.get_image_version = Mock(return_value='1.2.3') self.xml_state.get_initrd_system = Mock(return_value='dracut') self.xml_state.xml_data.get_name = Mock(return_value='some-image') self.xml_state.build_type = Mock() self.xml_state.build_type.get_kernelcmdline = Mock( return_value='console=hvc0' ) kernel_type = namedtuple('kernel', ['filename', 'version']) xen_type = namedtuple('xen', ['filename', 'name']) self.kernel = Mock() self.kernel.get_kernel = Mock( return_value=kernel_type(filename='some-kernel', version='42') ) self.kernel.get_xen_hypervisor = Mock( return_value=xen_type(filename='hypervisor', name='xen.gz') ) kiwi.builder.kis.Kernel = Mock(return_value=self.kernel) self.kis = KisBuilder( self.xml_state, 'target_dir', 'root_dir', custom_args={'signing_keys': ['key_file_a', 'key_file_b']}, ) self.kis.image_name = 'target_dir/myimage' self.kis.compressed = True @patch('kiwi.builder.kis.FileSystemBuilder') @patch('kiwi.builder.kis.BootImage') def setup_method(self, cls, mock_boot, mock_filesystem): self.setup() @patch('kiwi.builder.kis.FileSystemBuilder') @patch('kiwi.builder.kis.BootImage') @patch('kiwi.builder.kis.RuntimeConfig') def test_setup_warn_no_initrd_support( self, mock_RuntimeConfig, mock_boot, mock_filesystem ): self.runtime_config = Mock() self.shasum = Mock() self.shasum.suffix = '.sha256' self.runtime_config.get_checksum_handler = Mock( return_value=self.shasum ) mock_RuntimeConfig.return_value = self.runtime_config boot_image_task = MagicMock() boot_image_task.has_initrd_support = Mock(return_value=False) mock_boot.new.return_value = boot_image_task with self._caplog.at_level(logging.WARNING): KisBuilder(self.xml_state, 'target_dir', 'root_dir') @patch('os.rename') def test_create_no_archive(self, mock_rename): self.boot_image_task.required = Mock(return_value=True) self.kis.archive = False self.kis.compressed = False m_open = mock_open() with patch('builtins.open', m_open, create=True): self.kis.create() m_open.assert_called_once_with( 'target_dir/some-image.x86_64-1.2.3.append', 'w' ) m_open.return_value.write.assert_called_once_with( 'root=UUID=some_uuid console=hvc0' ) self.filesystem.create.assert_called_once_with() mock_rename.assert_called_once_with('myimage.fs', 'target_dir/myimage') assert self.runtime_config.get_checksum_handler.call_args_list == [ call('target_dir/myimage'), call( source_filename='target_dir/myimage', target_filename='target_dir/myimage.sha256', ), call('target_dir/myimage-42.kernel'), ] self.shasum.digest.assert_called_once_with() self.boot_image_task.prepare.assert_called_once_with() self.setup.export_modprobe_setup.assert_called_once_with('initrd_dir') self.boot_image_task.create_initrd.assert_called_once_with() self.setup.export_package_list.assert_called_once_with('target_dir') self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) @patch('kiwi.builder.kis.Compress') @patch('kiwi.builder.kis.ArchiveTar') @patch('os.rename') def test_create(self, mock_rename, mock_tar, mock_compress): tar = Mock() mock_tar.return_value = tar compress = Mock() mock_compress.return_value = compress compress.xz.return_value = 'compressed-file-name' self.boot_image_task.required = Mock(return_value=True) self.kis.archive = True self.kis.compressed = True m_open = mock_open() with patch('builtins.open', m_open, create=True): self.kis.create() m_open.assert_called_once_with( 'target_dir/some-image.x86_64-1.2.3.append', 'w' ) m_open.return_value.write.assert_called_once_with( 'root=UUID=some_uuid console=hvc0' ) self.filesystem.create.assert_called_once_with() mock_rename.assert_called_once_with('myimage.fs', 'target_dir/myimage') compress.xz.assert_called_once_with(None) assert self.runtime_config.get_checksum_handler.call_args_list == [ call('compressed-file-name'), call( source_filename='compressed-file-name', target_filename='target_dir/myimage.sha256', ), call('target_dir/myimage-42.kernel'), ] self.shasum.digest.assert_called_once_with() self.boot_image_task.prepare.assert_called_once_with() self.setup.export_modprobe_setup.assert_called_once_with('initrd_dir') self.boot_image_task.create_initrd.assert_called_once_with() self.setup.export_package_list.assert_called_once_with('target_dir') self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) tar.create.assert_called_once_with('target_dir') self.kis.compressed = False m_open = mock_open() with patch('builtins.open', m_open, create=True): self.kis.create() m_open.return_value.write.assert_called_once_with( 'root=UUID=some_uuid console=hvc0' ) tar.create_xz_compressed.assert_called_once_with( 'target_dir', xz_options=['--threads=0'] ) @patch('kiwi.builder.kis.Compress') @patch('os.rename') def test_create_no_kernel_found(self, mock_rename, mock_compress): compress = Mock() mock_compress.return_value = compress compress.compressed_filename = 'compressed-file-name' self.kernel.get_kernel.return_value = False with raises(KiwiKisBootImageError): self.kis.create() @patch('kiwi.builder.kis.Compress') @patch('os.rename') def test_create_no_hypervisor_found(self, mock_rename, mock_compress): compress = Mock() mock_compress.return_value = compress compress.compressed_filename = 'compressed-file-name' self.kernel.get_xen_hypervisor.return_value = False with raises(KiwiKisBootImageError): self.kis.create() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7643697 kiwi-11.1.8/test/unit/builder/live_test.py0000644000000000000000000007330715273675667015471 0ustar00from unittest.mock import MagicMock, patch, call, Mock from pytest import raises, mark import sys from kiwi.bootloader.config.grub2 import BootLoaderConfigGrub2 import kiwi.builder.live from ..test_helper import argv_kiwi_tests from kiwi.defaults import Defaults from kiwi.builder.live import LiveImageBuilder from kiwi.exceptions import KiwiLiveBootImageError class TestLiveImageBuilder: def setup(self): Defaults.set_platform_name('x86_64') self.firmware = Mock() self.firmware.bios_mode.return_value = False self.firmware.get_partition_table_type.return_value = 'gpt' self.firmware.gpt_hybrid_mbr = False self.firmware.legacy_bios_mode = Mock(return_value=True) self.firmware.efi_mode = Mock(return_value='uefi') kiwi.builder.live.FirmWare = Mock(return_value=self.firmware) self.setup = Mock() kiwi.builder.live.SystemSetup = Mock(return_value=self.setup) self.filesystem_setup = Mock() kiwi.builder.live.FileSystemSetup = Mock( return_value=self.filesystem_setup ) self.bootloader = MagicMock(spec=BootLoaderConfigGrub2) create_boot_loader_config_mock = Mock(return_value=MagicMock()) create_boot_loader_config_mock.return_value.__enter__.return_value = ( MagicMock() ) kiwi.builder.live.create_boot_loader_config = ( create_boot_loader_config_mock ) self.boot_image_task = Mock() self.boot_image_task.boot_root_directory = 'initrd_dir' self.boot_image_task.initrd_filename = 'initrd' kiwi.builder.live.BootImageDracut = Mock( return_value=self.boot_image_task ) self.mbrid = Mock() self.mbrid.get_id = Mock(return_value='0xffffffff') kiwi.builder.live.SystemIdentifier = Mock(return_value=self.mbrid) kiwi.builder.live.Path = Mock() self.kernel = Mock() self.kernel.get_kernel = Mock() self.kernel.get_xen_hypervisor = Mock() self.kernel.copy_kernel = Mock() self.kernel.copy_xen_hypervisor = Mock() kiwi.builder.live.Kernel = Mock(return_value=self.kernel) self.xml_state = Mock() self.xml_state.build_type.get_verity_blocks = Mock(return_value=None) self.xml_state.get_fs_mount_option_list = Mock(return_value=['async']) self.xml_state.get_fs_create_option_list = Mock( return_value=['-O', 'option'] ) self.xml_state.build_type.get_application_id = Mock( return_value='0xffffffff' ) self.xml_state.build_type.get_flags = Mock(return_value=None) self.xml_state.get_build_type_bootloader_kernel_flavors = Mock( return_value=[] ) self.xml_state.build_type.get_squashfscompression = Mock( return_value='lzo' ) self.xml_state.get_image_version = Mock(return_value='1.2.3') self.xml_state.xml_data.get_name = Mock(return_value='result-image') self.xml_state.build_type.get_volid = Mock(return_value='volid') self.xml_state.build_type.get_kernelcmdline = Mock( return_value='custom_cmdline' ) self.xml_state.build_type.get_mediacheck = Mock(return_value=True) self.xml_state.build_type.get_publisher = Mock( return_value='Custom publisher' ) self.xml_state.get_luks_credentials = Mock(return_value=None) self.live_image = LiveImageBuilder( self.xml_state, 'target_dir', 'root_dir', custom_args={'signing_keys': ['key_file_a', 'key_file_b']}, ) self.result = Mock() self.live_image.result = self.result def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def test_init_for_ix86_platform(self): Defaults.set_platform_name('i686') xml_state = Mock() xml_state.xml_data.get_name = Mock(return_value='some-image') xml_state.get_image_version = Mock(return_value='1.2.3') live_image = LiveImageBuilder(xml_state, 'target_dir', 'root_dir') assert live_image.arch == 'ix86' @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.live.LoopDevice') @patch('kiwi.builder.live.Command.run') @patch('kiwi.builder.live.DeviceProvider') @patch('kiwi.builder.live.IsoToolsBase.setup_media_loader_directory') @patch('kiwi.builder.live.Temporary') @patch('kiwi.builder.live.shutil') @patch('kiwi.builder.live.Iso.set_media_tag') @patch('kiwi.builder.live.Iso') @patch('kiwi.builder.live.FileSystemIsoFs') @patch('kiwi.builder.live.FileSystem.new') @patch('kiwi.builder.live.SystemSize') @patch('kiwi.builder.live.Defaults.get_grub_boot_directory_name') @patch('os.unlink') @patch('os.path.exists') @patch('os.chmod') def test_create_overlay_structure_boot_on_systemd_boot( self, mock_chmod, mock_exists, mock_unlink, mock_grub_dir, mock_size, mock_filesystem, mock_isofs, mock_Iso, mock_tag, mock_shutil, mock_Temporary, mock_setup_media_loader_directory, mock_DeviceProvider, mock_Command_run, mock_LoopDevice, mock_create_boot_loader_config, ): boot_names = Mock() boot_names.initrd_name = 'dracut_initrd_name' self.live_image.boot_image.get_boot_names.return_value = boot_names self.live_image.boot_image.initrd_filename = 'kiwi_used_initrd_name' self.live_image.bootloader = 'systemd_boot' rootsize = Mock() rootsize.accumulate_mbyte_file_sizes = Mock(return_value=8192) mock_size.return_value = rootsize self.live_image.create() mock_Command_run.assert_called_once_with( ['mv', 'kiwi_used_initrd_name', 'root_dir/boot/dracut_initrd_name'] ) @mark.parametrize('xml_filesystem', [None, 'squashfs', 'erofs']) @patch('kiwi.builder.live.create_boot_loader_config') @patch('kiwi.builder.live.LoopDevice') @patch('kiwi.builder.live.DeviceProvider') @patch('kiwi.builder.live.IsoToolsBase.setup_media_loader_directory') @patch('kiwi.builder.live.Temporary') @patch('kiwi.builder.live.shutil') @patch('kiwi.builder.live.Iso.set_media_tag') @patch('kiwi.builder.live.Iso') @patch('kiwi.builder.live.FileSystemIsoFs') @patch('kiwi.builder.live.FileSystem.new') @patch('kiwi.builder.live.SystemSize') @patch('kiwi.builder.live.Defaults.get_grub_boot_directory_name') @patch('os.unlink') @patch('os.path.exists') @patch('os.chmod') @patch('kiwi.builder.live.BlockID') def test_create_overlay_structure_boot_verity_baked( self, mock_BlockID, mock_chmod, mock_exists, mock_unlink, mock_grub_dir, mock_size, mock_filesystem, mock_isofs, mock_Iso, mock_tag, mock_shutil, mock_Temporary, mock_setup_media_loader_directory, mock_DeviceProvider, mock_LoopDevice, mock_create_boot_loader_config, xml_filesystem, ): if not xml_filesystem or xml_filesystem == 'squashfs': mock_BlockID.return_value.get_filesystem.return_value = 'squashfs' if xml_filesystem and xml_filesystem == 'erofs': mock_BlockID.return_value.get_filesystem.return_value = 'erofs' bootloader_config = Mock() mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider mock_exists.return_value = True mock_unlink.return_value = True mock_grub_dir.return_value = 'grub2' temp_squashfs = Mock() temp_squashfs.name = 'temp-squashfs' temp_media_dir = Mock() temp_media_dir.name = 'temp_media_dir' tmpdir_name = [temp_squashfs, temp_media_dir] def side_effect(): return tmpdir_name.pop() mock_Temporary.return_value.new_dir.side_effect = side_effect mock_Temporary.return_value.new_file.return_value.name = 'kiwi-tmpfile' self.live_image.live_type = 'overlay' self.live_image.root_filesystem_verity_blocks = 'all' self.xml_state.build_type.get_filesystem = Mock( return_value=xml_filesystem ) iso_image = Mock() iso_image.create_on_file.return_value = 'offset' mock_isofs.return_value.__enter__.return_value = iso_image rootsize = Mock() rootsize.accumulate_mbyte_file_sizes = Mock(return_value=8192) mock_size.return_value = rootsize self.setup.export_package_changes.return_value = '.changes' self.setup.export_package_verification.return_value = '.verified' self.setup.export_package_list.return_value = '.packages' with patch('builtins.open', create=True): self.live_image.create() if xml_filesystem is None: mock_filesystem.return_value.__enter__.return_value.create_verity_layer.assert_called_once_with( None ) if xml_filesystem == 'squashfs': mock_filesystem.return_value.create_verity_layer.assert_called_once_with( None ) @mark.parametrize('xml_filesystem', ['xfs']) @patch('kiwi.builder.live.create_boot_loader_config') @patch('kiwi.builder.live.LoopDevice') @patch('kiwi.builder.live.DeviceProvider') @patch('kiwi.builder.live.LuksDevice') @patch('kiwi.builder.live.IsoToolsBase.setup_media_loader_directory') @patch('kiwi.builder.live.Temporary') @patch('kiwi.builder.live.shutil') @patch('kiwi.builder.live.Iso.set_media_tag') @patch('kiwi.builder.live.Iso') @patch('kiwi.builder.live.FileSystemIsoFs') @patch('kiwi.builder.live.FileSystem.new') @patch('kiwi.builder.live.SystemSize') @patch('kiwi.builder.live.Defaults.get_grub_boot_directory_name') @patch('os.unlink') @patch('os.path.exists') @patch('os.chmod') @patch('os.path.getsize') def test_create_overlay_structure_encrypted_embedded_root( self, mock_os_path_getsize, mock_chmod, mock_exists, mock_unlink, mock_grub_dir, mock_size, mock_filesystem, mock_isofs, mock_Iso, mock_tag, mock_shutil, mock_Temporary, mock_setup_media_loader_directory, mock_LuksDevice, mock_DeviceProvider, mock_LoopDevice, mock_create_boot_loader_config, xml_filesystem, ): temp_squashfs = Mock() temp_squashfs.name = 'temp-squashfs' temp_media_dir = Mock() temp_media_dir.name = 'temp_media_dir' tmpdir_name = [temp_squashfs, temp_media_dir] def side_effect(): return tmpdir_name.pop() mock_Temporary.return_value.new_dir.side_effect = side_effect mock_size.return_value.accumulate_mbyte_file_sizes.return_value = 8192 self.live_image.live_type = 'overlay' self.live_image.luks = 'encrypted' self.xml_state.build_type.get_filesystem = Mock( return_value=xml_filesystem ) self.live_image.create() mock_LuksDevice.return_value.create_crypto_luks.assert_called_once_with( passphrase='encrypted', osname=self.xml_state.build_type.get_luksOS.return_value, options=self.xml_state.get_luks_format_options.return_value, keyfile='', randomize=self.xml_state.build_type.get_luks_randomize.return_value, root_dir='root_dir', ) @mark.parametrize('xml_filesystem', ['erofs']) @patch('kiwi.builder.live.create_boot_loader_config') @patch('kiwi.builder.live.LoopDevice') @patch('kiwi.builder.live.DeviceProvider') @patch('kiwi.builder.live.LuksDevice') @patch('kiwi.builder.live.Command.run') @patch('kiwi.builder.live.IsoToolsBase.setup_media_loader_directory') @patch('kiwi.builder.live.Temporary') @patch('kiwi.builder.live.shutil') @patch('kiwi.builder.live.Iso.set_media_tag') @patch('kiwi.builder.live.Iso') @patch('kiwi.builder.live.FileSystemIsoFs') @patch('kiwi.builder.live.FileSystem.new') @patch('kiwi.builder.live.SystemSize') @patch('kiwi.builder.live.Defaults.get_grub_boot_directory_name') @patch('os.unlink') @patch('os.path.exists') @patch('os.chmod') @patch('os.path.getsize') def test_create_overlay_structure_encrypted_direct_root( self, mock_os_path_getsize, mock_chmod, mock_exists, mock_unlink, mock_grub_dir, mock_size, mock_filesystem, mock_isofs, mock_Iso, mock_tag, mock_shutil, mock_Temporary, mock_setup_media_loader_directory, mock_Command_run, mock_LuksDevice, mock_DeviceProvider, mock_LoopDevice, mock_create_boot_loader_config, xml_filesystem, ): temp_squashfs = Mock() temp_squashfs.name = 'temp-squashfs' temp_media_dir = Mock() temp_media_dir.name = 'temp_media_dir' tmpdir_name = [temp_squashfs, temp_media_dir] luks_device = mock_LuksDevice.return_value.get_device.return_value def side_effect(): return tmpdir_name.pop() mock_Temporary.return_value.new_dir.side_effect = side_effect mock_size.return_value.accumulate_mbyte_file_sizes.return_value = 8192 self.live_image.live_type = 'overlay' self.live_image.luks = 'encrypted' self.xml_state.build_type.get_filesystem = Mock( return_value=xml_filesystem ) self.live_image.create() mock_LuksDevice.return_value.create_crypto_luks.assert_called_once_with( passphrase='encrypted', osname=self.xml_state.build_type.get_luksOS.return_value, options=self.xml_state.get_luks_format_options.return_value, keyfile='', randomize=self.xml_state.build_type.get_luks_randomize.return_value, root_dir='root_dir', ) mock_Command_run.assert_called_once_with( [ 'dd', f'if={mock_Temporary.return_value.new_file.return_value.name}', f'of={luks_device.get_device.return_value}', ] ) @mark.parametrize('xml_filesystem', [None, 'squashfs']) @patch('kiwi.builder.live.create_boot_loader_config') @patch('kiwi.builder.live.LoopDevice') @patch('kiwi.builder.live.DeviceProvider') @patch('kiwi.builder.live.IsoToolsBase.setup_media_loader_directory') @patch('kiwi.builder.live.Temporary') @patch('kiwi.builder.live.shutil') @patch('kiwi.builder.live.Iso.set_media_tag') @patch('kiwi.builder.live.Iso') @patch('kiwi.builder.live.FileSystemIsoFs') @patch('kiwi.builder.live.FileSystem.new') @patch('kiwi.builder.live.SystemSize') @patch('kiwi.builder.live.Defaults.get_grub_boot_directory_name') @patch('os.unlink') @patch('os.path.exists') @patch('os.chmod') def test_create_overlay_structure_boot_on_grub( self, mock_chmod, mock_exists, mock_unlink, mock_grub_dir, mock_size, mock_filesystem, mock_isofs, mock_Iso, mock_tag, mock_shutil, mock_Temporary, mock_setup_media_loader_directory, mock_DeviceProvider, mock_LoopDevice, mock_create_boot_loader_config, xml_filesystem, ): bootloader_config = Mock() mock_create_boot_loader_config.return_value.__enter__.return_value = ( bootloader_config ) loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider mock_exists.return_value = True mock_unlink.return_value = True mock_grub_dir.return_value = 'grub2' temp_squashfs = Mock() temp_squashfs.name = 'temp-squashfs' temp_media_dir = Mock() temp_media_dir.name = 'temp_media_dir' tmpdir_name = [temp_squashfs, temp_media_dir] filesystem = Mock() mock_filesystem.return_value.__enter__.return_value = filesystem def side_effect(): return tmpdir_name.pop() mock_Temporary.return_value.new_dir.side_effect = side_effect mock_Temporary.return_value.new_file.return_value.name = 'kiwi-tmpfile' self.live_image.live_type = 'overlay' self.xml_state.build_type.get_filesystem = Mock( return_value=xml_filesystem ) iso_image = Mock() iso_image.create_on_file.return_value = 'offset' mock_isofs.return_value.__enter__.return_value = iso_image rootsize = Mock() rootsize.accumulate_mbyte_file_sizes = Mock(return_value=8192) mock_size.return_value = rootsize self.setup.export_package_changes.return_value = '.changes' self.setup.export_package_verification.return_value = '.verified' self.setup.export_package_list.return_value = '.packages' self.live_image.create() self.setup.import_cdroot_files.assert_called_once_with('temp_media_dir') assert self.setup.setup_selinux_file_contexts.call_args_list == [ call(), call(), ] if xml_filesystem == 'squashfs': assert kiwi.builder.live.FileSystem.new.call_args_list == [ call( device_provider=mock_DeviceProvider.return_value, name='squashfs', root_dir='root_dir/', custom_args={ 'mount_options': ['async'], 'create_options': ['-O', 'option'], 'compression': 'lzo', }, ) ] mock_filesystem.return_value.create_on_file.assert_called_once_with( filename='kiwi-tmpfile', exclude=[ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', ], ) assert mock_shutil.copy.call_args_list == [ call('kiwi-tmpfile', 'temp_media_dir/LiveOS/squashfs.img') ] else: assert kiwi.builder.live.FileSystem.new.call_args_list == [ call( device_provider=mock_LoopDevice.return_value, name='ext4', root_dir='root_dir/', custom_args={ 'mount_options': ['async'], 'create_options': ['-O', 'option'], }, ), call( device_provider=mock_DeviceProvider.return_value, name='squashfs', root_dir='temp-squashfs', custom_args={'compression': 'lzo'}, ), ] mock_filesystem.return_value.create_on_device.assert_called_once_with() mock_filesystem.return_value.sync_data.assert_called_once_with( [ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', ] ) filesystem.create_on_file.assert_called_once_with('kiwi-tmpfile') assert mock_shutil.copy.call_args_list == [ call('kiwi-tmpfile', 'temp-squashfs/LiveOS/rootfs.img'), call('kiwi-tmpfile', 'temp_media_dir/LiveOS/squashfs.img'), ] assert mock_chmod.call_args_list == [ call('initrd', 0o644), call('kiwi-tmpfile', 0o644), ] self.setup.call_edit_boot_config_script.assert_called_once_with( boot_part_id=1, filesystem='iso:temp_media_dir', working_directory='root_dir', ) assert self.boot_image_task.include_module.call_args_list == [ call('kiwi-live'), call('pollcdrom'), ] self.boot_image_task.write_system_config_file.assert_called_once_with( config={'modules': ['kiwi-live', 'pollcdrom']}, config_file='root_dir/etc/dracut.conf.d/02-livecd.conf', ) kiwi.builder.live.create_boot_loader_config.assert_called_once_with( name='grub2', xml_state=self.xml_state, root_dir='root_dir', boot_dir='temp_media_dir', custom_args={ 'grub_directory_name': 'grub2', 'grub_load_command': 'configfile', }, ) bootloader_config.setup_live_boot_images.assert_called_once_with( lookup_path='root_dir', mbrid=self.mbrid ) mock_setup_media_loader_directory.assert_called_once_with( 'initrd_dir', 'temp_media_dir', bootloader_config.get_boot_theme.return_value, ) bootloader_config.write_meta_data.assert_called_once_with() bootloader_config.setup_live_image_config.assert_called_once_with( mbrid=self.mbrid ) bootloader_config.write.assert_called_once_with() self.boot_image_task.prepare.assert_called_once_with() self.boot_image_task.create_initrd.assert_called_once_with( self.mbrid, basename=None, flavor='', delete_included_files=True ) self.kernel.copy_kernel.assert_called_once_with( 'temp_media_dir/boot/x86_64/loader', '/linux', flavor='' ) self.kernel.copy_xen_hypervisor.assert_called_once_with( 'temp_media_dir/boot/x86_64/loader', '/xen.gz' ) mock_shutil.move.assert_called_once_with( 'initrd', 'temp_media_dir/boot/x86_64/loader/initrd' ) mock_size.assert_called_once_with('temp_media_dir') rootsize.accumulate_mbyte_file_sizes.assert_called_once_with() mock_isofs.assert_called_once_with( custom_args={ 'meta_data': { 'mbr_id': '0xffffffff', 'application_id': '0xffffffff', 'preparer': 'KIWI - https://github.com/OSInside/kiwi', 'publisher': 'Custom publisher', 'volume_id': 'volid', 'efi_mode': 'uefi', 'efi_loader': 'kiwi-tmpfile', 'efi_partition_table': 'gpt', 'gpt_hybrid_mbr': False, 'udf': True, 'legacy_bios_mode': True, } }, device_provider=mock_DeviceProvider.return_value, root_dir='temp_media_dir', ) iso_image.create_on_file.assert_called_once_with( 'target_dir/result-image.x86_64-1.2.3.iso' ) assert self.result.add.call_args_list == [ call( key='live_image', filename='target_dir/result-image.x86_64-1.2.3.iso', use_for_bundle=True, compress=False, shasum=True, ), call( key='image_packages', filename='.packages', use_for_bundle=True, compress=False, shasum=False, ), call( key='image_changes', filename='.changes', use_for_bundle=True, compress=True, shasum=False, ), call( key='image_verified', filename='.verified', use_for_bundle=True, compress=False, shasum=False, ), ] self.setup.export_package_verification.assert_called_once_with( 'target_dir' ) self.setup.export_package_list.assert_called_once_with('target_dir') @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.live.IsoToolsBase.setup_media_loader_directory') @patch('kiwi.builder.live.Temporary') @patch('kiwi.builder.live.shutil') @patch('os.unlink') def test_create_no_kernel_found( self, mock_unlink, mock_shutil, mock_Temporary, mock_setup_media_loader_directory, mock_create_boot_loader_config, ): self.firmware.bios_mode.return_value = False mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' self.kernel.get_kernel.return_value = False with raises(KiwiLiveBootImageError): self.live_image.create() @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.live.IsoToolsBase.setup_media_loader_directory') @patch('kiwi.builder.live.Temporary') @patch('kiwi.builder.live.shutil') @patch('os.unlink') def test_create_no_hypervisor_found( self, mock_unlink, mock_shutil, mock_Temporary, mock_setup_media_loader_directory, mock_create_boot_loader_config, ): self.firmware.bios_mode.return_value = False mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' self.kernel.get_xen_hypervisor.return_value = False with raises(KiwiLiveBootImageError): self.live_image.create() @patch('kiwi.builder.disk.create_boot_loader_config') @patch('kiwi.builder.live.IsoToolsBase.setup_media_loader_directory') @patch('kiwi.builder.live.Temporary') @patch('kiwi.builder.live.shutil') @patch('os.unlink') @patch('os.path.exists') def test_create_no_initrd_found( self, mock_exists, mock_unlink, mock_shutil, mock_Temporary, mock_setup_media_loader_directory, mock_create_boot_loader_config, ): self.firmware.bios_mode.return_value = False mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' mock_exists.return_value = False mock_unlink.return_value = True with raises(KiwiLiveBootImageError): self.live_image.create() @patch('kiwi.builder.live.Temporary') @patch('kiwi.builder.live.shutil') @patch('kiwi.builder.live.Command.run') @patch('os.unlink') @patch('os.path.exists') @patch('os.chmod') def test_kernel_and_initrd_of_kernel_flavors( self, mock_chmod, mock_exists, mock_unlink, mock_Command_run, mock_shutil, mock_Temporary, ): # An initrd is created for the kernel of each flavor, the # files of the first flavor keep the standard names self.live_image.kernel_flavors = ['rt', 'default'] self.live_image.media_dir = Mock() self.live_image.media_dir.name = 'temp_media_dir' self.boot_image_task.initrd_base_name = 'image.initrd' def create_initrd(mbrid, basename, flavor, delete_included_files): self.boot_image_task.initrd_filename = f'target_dir/{basename}' self.boot_image_task.create_initrd.side_effect = create_initrd self.firmware.efi_mode.return_value = None mock_exists.return_value = True self.live_image.create_live_iso_boot_images(Mock()) assert self.boot_image_task.create_initrd.call_args_list == [ call( self.mbrid, basename='image.initrd-rt', flavor='rt', delete_included_files=False, ), call( self.mbrid, basename='image.initrd-default', flavor='default', delete_included_files=True, ), ] self.live_image._setup_live_iso_kernel_and_initrd() assert self.kernel.copy_kernel.call_args_list == [ call('temp_media_dir/boot/x86_64/loader', '/linux', flavor='rt'), call( 'temp_media_dir/boot/x86_64/loader', '/linux-default', flavor='default', ), ] assert mock_shutil.move.call_args_list == [ call( 'target_dir/image.initrd-rt', 'temp_media_dir/boot/x86_64/loader/initrd', ), call( 'target_dir/image.initrd-default', 'temp_media_dir/boot/x86_64/loader/initrd-default', ), ] # With systemd-boot the initrd is placed into the boot # directory of the root tree, named after the kernel self.live_image.bootloader = 'systemd_boot' self.boot_image_task.get_boot_names.side_effect = lambda flavor: Mock( initrd_name=f'initrd-1.2.3-{flavor}' ) self.live_image.create_live_iso_boot_images(Mock()) assert mock_Command_run.call_args_list == [ call( [ 'mv', 'target_dir/image.initrd-rt', 'root_dir/boot/initrd-1.2.3-rt', ] ), call( [ 'mv', 'target_dir/image.initrd-default', 'root_dir/boot/initrd-1.2.3-default', ] ), ] def test_setup_live_iso_kernel_of_flavor_not_found(self): self.live_image.kernel_flavors = ['rt'] self.live_image.media_dir = Mock() self.live_image.media_dir.name = 'temp_media_dir' self.kernel.get_kernel.return_value = None with raises(KiwiLiveBootImageError) as issue: self.live_image._setup_live_iso_kernel_and_initrd() assert 'No kernel of flavor rt in boot image tree' in str(issue.value) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7643697 kiwi-11.1.8/test/unit/builder/template/__init__.py0000644000000000000000000000000015273675667017021 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7650638 kiwi-11.1.8/test/unit/builder/template/container_import_test.py0000644000000000000000000000774315273675667021722 0ustar00from kiwi.builder.template.container_import import BuilderTemplateSystemdUnit class TestBuilderTemplateSystemdUnit: def setup_method(self): self.template = BuilderTemplateSystemdUnit() def test_get_container_import_template_with_container_snap_service(self): container_files = ['/var/tmp/kiwi_containers/test-app_v1.0'] load_commands = [ [ '/usr/bin/container-snap', 'load', '-i', '/var/tmp/kiwi_containers/test-app_v1.0', ] ] after_services = ['container-snap.service'] template = self.template.get_container_import_template( container_files, load_commands, after_services ) unit_content = template.substitute() expected_unit = """# kiwi generated unit file [Unit] Description=Import Local Container(s) ConditionPathExists=/var/tmp/kiwi_containers/test-app_v1.0 After=container-snap.service [Service] Type=oneshot ExecStart=/usr/bin/container-snap load -i /var/tmp/kiwi_containers/test-app_v1.0 ExecStartPost=/bin/rm -f /var/tmp/kiwi_containers/test-app_v1.0 [Install] WantedBy=multi-user.target """ assert unit_content == expected_unit def test_get_container_import_template_with_multiple_services(self): container_files = [ '/var/tmp/kiwi_containers/app1_latest', '/var/tmp/kiwi_containers/app2_v1.0', ] load_commands = [ [ '/usr/bin/docker', 'load', '-i', '/var/tmp/kiwi_containers/app1_latest', ], [ '/usr/bin/container-snap', 'load', '-i', '/var/tmp/kiwi_containers/app2_v1.0', ], ] after_services = ['docker.service', 'container-snap.service'] template = self.template.get_container_import_template( container_files, load_commands, after_services ) unit_content = template.substitute() expected_unit = """# kiwi generated unit file [Unit] Description=Import Local Container(s) ConditionPathExists=/var/tmp/kiwi_containers/app1_latest ConditionPathExists=/var/tmp/kiwi_containers/app2_v1.0 After=docker.service container-snap.service [Service] Type=oneshot ExecStart=/usr/bin/docker load -i /var/tmp/kiwi_containers/app1_latest ExecStart=/usr/bin/container-snap load -i /var/tmp/kiwi_containers/app2_v1.0 ExecStartPost=/bin/rm -f /var/tmp/kiwi_containers/app1_latest ExecStartPost=/bin/rm -f /var/tmp/kiwi_containers/app2_v1.0 [Install] WantedBy=multi-user.target """ assert unit_content == expected_unit def test_get_container_import_template_no_after_services(self): container_files = ['/var/tmp/kiwi_containers/test-app_latest'] load_commands = [ [ '/usr/bin/podman', 'load', '-i', '/var/tmp/kiwi_containers/test-app_latest', ] ] after_services = [] template = self.template.get_container_import_template( container_files, load_commands, after_services ) unit_content = template.substitute() expected_unit = """# kiwi generated unit file [Unit] Description=Import Local Container(s) ConditionPathExists=/var/tmp/kiwi_containers/test-app_latest [Service] Type=oneshot ExecStart=/usr/bin/podman load -i /var/tmp/kiwi_containers/test-app_latest ExecStartPost=/bin/rm -f /var/tmp/kiwi_containers/test-app_latest [Install] WantedBy=multi-user.target """ assert unit_content == expected_unit def test_get_container_import_template_empty_inputs(self): template = self.template.get_container_import_template([], [], []) unit_content = template.substitute() expected_unit = """# kiwi generated unit file [Unit] Description=Import Local Container(s) [Service] Type=oneshot [Install] WantedBy=multi-user.target """ assert unit_content == expected_unit ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7650638 kiwi-11.1.8/test/unit/chroot_manager_test.py0000644000000000000000000001317515273675667016071 0ustar00from unittest.mock import patch, call, Mock from pytest import raises from kiwi.chroot_manager import ChrootManager, ChrootMount from kiwi.exceptions import KiwiCommandError, KiwiUmountBusyError class TestChrootManager: @patch('kiwi.chroot_manager.MountManager') @patch('kiwi.chroot_manager.Command.run') def test_run_in_chroot_context(self, mock_run, mock_mount): mock_mntMngr = Mock() mock_mount.return_value = mock_mntMngr with ChrootManager( '/some/root', binds=[ ChrootMount('/dev'), ChrootMount('/proc'), ChrootMount('/sys'), ], ) as chroot: chroot.run(['cmd', 'arg1', 'arg2']) assert mock_mount.call_args_list == [ call(device='/dev', mountpoint='/some/root/dev'), call(device='/proc', mountpoint='/some/root/proc'), call(device='/sys', mountpoint='/some/root/sys'), ] mock_run.assert_called_once_with( ['chroot', '/some/root', 'cmd', 'arg1', 'arg2'], None, True, False, True, ) mock_mntMngr.bind_mount.assert_called() mock_mntMngr.umount.assert_called() @patch('kiwi.chroot_manager.MountManager') @patch('kiwi.chroot_manager.Command.run') def test_run_fails_in_chroot_context(self, mock_run, mock_mount): mock_mntMngr = Mock() mock_mount.return_value = mock_mntMngr mock_run.side_effect = Exception with ChrootManager( '/some/root', binds=[ ChrootMount('/dev'), ChrootMount('/proc'), ChrootMount('/sys'), ], ) as chroot: with raises(Exception): chroot.run(['cmd', 'arg1', 'arg2']) assert mock_mount.call_args_list == [ call(device='/dev', mountpoint='/some/root/dev'), call(device='/proc', mountpoint='/some/root/proc'), call(device='/sys', mountpoint='/some/root/sys'), ] mock_run.assert_called_once_with( ['chroot', '/some/root', 'cmd', 'arg1', 'arg2'], None, True, False, True, ) mock_mntMngr.bind_mount.assert_called() mock_mntMngr.umount.assert_called() @patch('kiwi.chroot_manager.MountManager') @patch('kiwi.chroot_manager.Command.run') def test_run_fails_to_enter_chroot_context(self, mock_run, mock_mount): mock_mntMngr = Mock() mock_mount.return_value = mock_mntMngr mock_mntMngr.bind_mount.side_effect = KiwiCommandError('mount error') with raises(KiwiCommandError): with ChrootManager( '/some/root', binds=[ ChrootMount('/dev'), ChrootMount('/proc'), ChrootMount('/sys'), ], ) as chroot: chroot.run(['cmd', 'arg1', 'arg2']) assert mock_mount.call_args_list == [ call(device='/dev', mountpoint='/some/root/dev'), call(device='/proc', mountpoint='/some/root/proc'), call(device='/sys', mountpoint='/some/root/sys'), ] mock_run.assert_not_called() mock_mntMngr.bind_mount.assert_called_once() mock_mntMngr.umount.assert_called() @patch('kiwi.chroot_manager.MountManager') @patch('kiwi.chroot_manager.Command.run') def test_run_fails_to_enter_and_clean_chroot_context( self, mock_run, mock_mount ): mock_mntMngr = Mock() mock_mount.return_value = mock_mntMngr mock_mntMngr.bind_mount.side_effect = KiwiCommandError('mount error') mock_mntMngr.umount.side_effect = KiwiUmountBusyError('umount error') with raises(KiwiCommandError): with ChrootManager( '/some/root', binds=[ ChrootMount('/dev'), ChrootMount('/proc'), ChrootMount('/sys'), ], ) as chroot: chroot.run(['cmd', 'arg1', 'arg2']) assert mock_mount.call_args_list == [ call(device='/dev', mountpoint='/some/root/dev'), call(device='/proc', mountpoint='/some/root/proc'), call(device='/sys', mountpoint='/some/root/sys'), ] mock_run.assert_not_called() mock_mntMngr.bind_mount.assert_called_once() mock_mntMngr.umount.assert_called() @patch('kiwi.chroot_manager.MountManager') @patch('kiwi.chroot_manager.Command.run') def test_run_fails_to_clean_chroot_context(self, mock_run, mock_mount): mock_mntMngr = Mock() mock_mount.return_value = mock_mntMngr mock_mntMngr.umount.side_effect = KiwiUmountBusyError('umount error') with raises(KiwiUmountBusyError): with ChrootManager( '/some/root', binds=[ ChrootMount('/dev'), ChrootMount('/proc'), ChrootMount('/sys'), ], ) as chroot: chroot.run(['cmd', 'arg1', 'arg2']) assert mock_mount.call_args_list == [ call(device='/dev', mountpoint='/some/root/dev'), call(device='/proc', mountpoint='/some/root/proc'), call(device='/sys', mountpoint='/some/root/sys'), ] mock_run.assert_called_once_with( ['chroot', '/some/root', 'cmd', 'arg1', 'arg2'], None, True, False, True, ) mock_mntMngr.bind_mount.assert_called() mock_mntMngr.umount.assert_called() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7650638 kiwi-11.1.8/test/unit/cli_test.py0000644000000000000000000004075115273675667013650 0ustar00import sys import logging import typer from unittest.mock import patch, Mock from pytest import raises, fixture from .test_helper import argv_kiwi_tests from kiwi.cli import Cli from kiwi.defaults import Defaults from kiwi.version import __version__ from kiwi.exceptions import ( KiwiLoadCommandUndefined, KiwiCommandNotLoaded, KiwiUnknownServiceName, KiwiLoadPluginError, ) class TestCli: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): self.expected_global_args = { 'help': False, '--type': None, 'image': False, 'system': True, '--logfile': None, '--logsocket': None, '--loglevel': None, '--color-output': False, '--debug': False, '--debug-run-scripts-in-screen': False, 'result': False, '--profile': [], '--setenv': [], '--shared-cache-dir': '/var/cache/kiwi', '--temp-dir': '/var/tmp', '--target-arch': None, '--config': None, '--kiwi-file': None, } self.command_args = { '--add-repo': [], '--add-repo-credentials': [], '--set-type-attr': [], '--set-release-version': None, '--allow-existing-root': False, '--description': 'description', '--ignore-repos': False, '--ignore-repos-used-for-build': False, '--clear-cache': False, '--root': 'directory', '--set-repo': None, '--set-repo-credentials': None, '--add-package': [], '--add-bootstrap-package': [], '--ca-cert': [], '--ca-target-distribution': None, '--delete-package': [], '--set-container-derived-from': None, '--set-container-tag': None, '--add-container-label': [], '--signing-key': [], 'help': False, 'prepare': True, 'command': 'prepare', 'system': True, } self.command_args.update(self.expected_global_args) self.cli = Cli() self.loaded_command = self.cli.load_command() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def test_get_servicename_system(self): cli = Cli() assert cli.get_servicename() == 'system' def test_get_command_args(self): with patch( 'sys.argv', [ sys.argv[0], '--temp-dir', '/var/tmp', '--shared-cache-dir', '/var/cache/kiwi', 'system', 'prepare', '--description', 'description', '--root', 'directory', ], ): cli = Cli() assert cli.get_command_args() == self.command_args with patch( 'sys.argv', [ sys.argv[0], 'system', 'prepare', '--description', 'description', '--root', 'directory', ], ): cli = Cli() assert cli.get_command_args() == self.command_args def test_warning_on_use_of_legacy_disk_type(self): with patch( 'sys.argv', [ sys.argv[0], '--type', 'vmx', 'system', 'build', '--description', 'description', '--target-dir', 'directory', ], ): cli = Cli() with self._caplog.at_level(logging.WARNING): cli.get_global_args() assert ( 'vmx type is now a subset of oem, --type set to oem' in self._caplog.text ) def test_set_target_arch(self): with patch( 'sys.argv', [ sys.argv[0], '--target-arch', 'x86_64', 'system', 'build', '--description', 'description', '--target-dir', 'directory', ], ): cli = Cli() cli.get_global_args() assert Defaults.get_platform_name() == 'x86_64' def test_get_servicename_image(self): with patch( 'sys.argv', [ sys.argv[0], 'image', 'resize', '--target-dir', 'directory', '--size', '20g', ], ): cli = Cli() assert cli.get_servicename() == 'image' def test_get_servicename_result(self): with patch( 'sys.argv', [sys.argv[0], 'result', 'list', '--target-dir', 'directory'], ): cli = Cli() assert cli.get_servicename() == 'result' def test_get_command(self): assert self.cli.get_command() == 'prepare' def test_load_command(self): assert self.cli.load_command() == self.loaded_command def test_load_command_unknown(self): self.cli.loaded = False self.cli.global_args['command'] = 'foo' with raises(KiwiCommandNotLoaded): self.cli.load_command() def test_load_command_undefined(self): self.cli.loaded = False self.cli.global_args['command'] = None with raises(KiwiLoadCommandUndefined): self.cli.load_command() def test_get_command_args_not_loaded(self): with patch( 'sys.argv', [sys.argv[0], 'system', 'command-not-implemented'] ): with patch('sys.exit'): cli = Cli() with raises(KiwiCommandNotLoaded): cli.get_command_args() @patch('builtins.print') def test_kiwi_version(self, mock_print): with patch('sys.argv', [sys.argv[0], '--version']): with patch('sys.exit'): Cli() mock_print.assert_called_once_with( f'KIWI (next generation) version {__version__}' ) def test_exit_status_without_command(self): # --version and --help end the program through typer with # status 0 and a usage error with status 2. None of them # must be turned into status 1 for arguments, status in [ (['--version'], 0), (['--help'], 0), (['--no-such-option'], 2), ]: with patch('sys.argv', [sys.argv[0]] + arguments): with raises(SystemExit) as exit_info: Cli() assert exit_info.value.code == status def test_command_help(self): # required options of the command are not needed to # request its manual page for service, command in [ ('system', 'build'), ('system', 'boxbuild'), ('result', 'list'), ('image', 'info'), ]: with patch( 'sys.argv', [sys.argv[0], '--debug', service, command, 'help'] ): cli = Cli() assert cli.get_servicename() == service assert cli.get_command() == command command_args = cli.get_command_args() assert command_args['help'] is True assert command_args[command] is True assert cli.get_global_args()['--debug'] is True assert cli.load_command() def test_command_help_not_for_unknown_command(self): with patch('sys.argv', [sys.argv[0], 'system', 'unknown', 'help']): with raises(SystemExit): Cli() def test_command_without_help(self): for arguments in [ ['system', 'update', '--root', 'directory'], [ 'system', 'create', '--root', 'directory', '--target-dir', 'directory', ], ]: with patch('sys.argv', [sys.argv[0]] + arguments): assert Cli().get_command_args()['help'] is False @patch.object(Cli, '_get_module_entries') @patch('kiwi.cli.EntryPoint') def test_load_plugin_cli(self, mock_EntryPoint, mock_get_module_entries): plugin_entry = Mock() mock_EntryPoint.return_value = plugin_entry entry = Mock( name='system_some', value='kiwi_some_plugin.tasks.system_some', group='kiwi.tasks', ) mock_get_module_entries.return_value = [entry] with patch( 'sys.argv', [ sys.argv[0], 'system', 'build', '--description', 'description', '--target-dir', 'directory', ], ): plugin_entry.load.return_value.typers = {'some': typer.Typer()} cli = Cli() plugin_entry.load.side_effect = ModuleNotFoundError cli.load_plugin_cli() plugin_entry.load.side_effect = Exception('error') with raises(KiwiLoadPluginError): cli.load_plugin_cli() @patch.object(Cli, '_get_module_entries') @patch('kiwi.cli.EntryPoint') def test_load_plugin_cli_skips_obsolete_plugin( self, mock_EntryPoint, mock_get_module_entries ): entry = Mock( value='kiwi_boxed_plugin.tasks.system_boxbuild', group='kiwi.tasks' ) mock_get_module_entries.return_value = [entry] assert self.cli.load_plugin_cli() == {} assert not mock_EntryPoint.called @patch.object(Cli, '_get_module_entries') def test_load_command_skips_obsolete_plugin(self, mock_get_module_entries): builtin_entry = Mock( value='kiwi.tasks.system_prepare', group='kiwi.tasks' ) builtin_entry.name = 'system_prepare' obsolete_entry = Mock( value='kiwi_boxed_plugin.tasks.system_prepare', group='kiwi.tasks' ) obsolete_entry.name = 'system_prepare' mock_get_module_entries.return_value = [builtin_entry, obsolete_entry] assert self.cli.load_command() == builtin_entry.load.return_value assert not obsolete_entry.load.called def test_boxbuild_command_args(self): with patch( 'sys.argv', [ sys.argv[0], 'system', 'boxbuild', '--box', 'universal', '--shared-path', '/var/tmp/shared', '--no-accel', '--9p-sharing', '--aarch64', 'kiwi', '--description', 'description', '--target-dir', 'directory', '--allow-existing-root', ], ): cli = Cli() assert cli.get_servicename() == 'system' assert cli.get_command() == 'boxbuild' command_args = cli.get_command_args() assert command_args['--box'] == 'universal' assert command_args['--shared-path'] == '/var/tmp/shared' assert command_args['--no-accel'] is True assert command_args['--9p-sharing'] is True assert command_args['--aarch64'] is True assert command_args['--x86_64'] is False assert command_args['--box-smp-cpus'] == '4' assert command_args['--ssh-port'] == '10022' assert command_args['--ssh-key'] == 'id_rsa' assert command_args['system_build'] == [ '--description', 'description', '--target-dir', 'directory', '--allow-existing-root', ] def test_boxbuild_command_args_separator(self): with patch( 'sys.argv', [ sys.argv[0], 'system', 'boxbuild', '--box', 'universal', '--', '--description', 'description', '--target-dir', 'directory', ], ): cli = Cli() assert cli.get_command_args()['system_build'] == [ '--description', 'description', '--target-dir', 'directory', ] @patch.object(Cli, '_get_module_entries') @patch('kiwi.cli.EntryPoint') def test_load_plugin_cli_skips_obsolete_stackbuild_plugin( self, mock_EntryPoint, mock_get_module_entries ): entry = Mock( value='kiwi_stackbuild_plugin.tasks.system_stackbuild', group='kiwi.tasks', ) mock_get_module_entries.return_value = [entry] assert self.cli.load_plugin_cli() == {} assert not mock_EntryPoint.called def test_stackbuild_command_args(self): with patch( 'sys.argv', [ sys.argv[0], 'system', 'stackbuild', '--stash', 'base', '--stash', 'layer', '--target-dir', 'directory', '--description', 'description', '--from-registry', 'registry.uri', 'kiwi', '--signing-key', 'some-key', ], ): cli = Cli() assert cli.get_servicename() == 'system' assert cli.get_command() == 'stackbuild' command_args = cli.get_command_args() assert command_args['--stash'] == ['base', 'layer'] assert command_args['--target-dir'] == 'directory' assert command_args['--description'] == 'description' assert command_args['--from-registry'] == 'registry.uri' assert command_args['system_build_or_create'] == [ '--signing-key', 'some-key', ] def test_stackbuild_command_args_no_kiwi_subcommand(self): with patch( 'sys.argv', [ sys.argv[0], 'system', 'stackbuild', '--stash', 'base', '--target-dir', 'directory', ], ): cli = Cli() command_args = cli.get_command_args() assert command_args['--stash'] == ['base'] assert command_args['--description'] is None assert command_args['--from-registry'] is None assert command_args['system_build_or_create'] == [] def test_stackbuild_command_args_separator(self): with patch( 'sys.argv', [ sys.argv[0], 'system', 'stackbuild', '--stash', 'base', '--target-dir', 'directory', '--', '--signing-key', 'some-key', ], ): cli = Cli() assert cli.get_command_args()['system_build_or_create'] == [ '--signing-key', 'some-key', ] def test_stash_command_args(self): with patch( 'sys.argv', [ sys.argv[0], 'system', 'stash', '--root', 'directory', '--tag', 'v1', '--container-name', 'name', ], ): cli = Cli() assert cli.get_servicename() == 'system' assert cli.get_command() == 'stash' command_args = cli.get_command_args() assert command_args['--root'] == 'directory' assert command_args['--tag'] == 'v1' assert command_args['--container-name'] == 'name' assert command_args['--list'] is False def test_get_servicename_unknown(self): self.cli.global_args['image'] = False self.cli.global_args['system'] = False self.cli.global_args['result'] = False with raises(KiwiUnknownServiceName): self.cli.get_servicename() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7650638 kiwi-11.1.8/test/unit/command_process_test.py0000644000000000000000000001430615273675667016252 0ustar00import logging from unittest.mock import patch, Mock from pytest import raises, fixture from builtins import bytes from kiwi.command_process import CommandProcess, CommandIterator from kiwi.exceptions import KiwiCommandError class TestCommandProcess: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def fake_matcher(self, item, output): return True def poll(self): return self.data_flow.pop() def outavailable(self): return True def erravailable(self): return True def outdata(self): return self.data_out.pop() def errdata(self): return self.data_err.pop() def create_flow_method(self, method): def create_method(arg=None): return method() return create_method def setup(self): self.data_flow = [True, None, None, None, None, None, None, None] self.data_out = [ bytes(b''), bytes(b''), bytes(b'\n'), bytes(b'a'), bytes(b't'), bytes(b'a'), bytes(b'd'), ] self.data_err = [ bytes(b''), bytes(b'\n'), bytes(b'r'), bytes(b'o'), bytes(b'r'), bytes(b'r'), bytes(b'e'), ] self.flow = self.create_flow_method(self.poll) self.flow_out_available = self.create_flow_method(self.outavailable) self.flow_err_available = self.create_flow_method(self.erravailable) self.flow_out = self.create_flow_method(self.outdata) self.flow_err = self.create_flow_method(self.errdata) def setup_method(self, cls): self.setup() @patch('kiwi.command.Command') def test_returncode(self, mock_command): command = Mock() mock_command.return_value = command process = CommandProcess(command) assert process.returncode() == command.process.returncode @patch('kiwi.command.Command') def test_poll_show_progress(self, mock_command): match_method = CommandProcess(mock_command).create_match_method( self.fake_matcher ) process = CommandProcess(mock_command) process.command.command.process.poll = self.flow process.command.command.output_available = self.flow_out_available process.command.command.error_available = self.flow_err_available process.command.command.output.read = self.flow_out process.command.command.error.read = self.flow_err process.command.command.process.returncode = 0 with self._caplog.at_level(logging.DEBUG): process.poll_show_progress(['a', 'b'], match_method, True) assert 'system: data' in self._caplog.text @patch('kiwi.command.Command') def test_poll_show_progress_raises(self, mock_command): match_method = CommandProcess(mock_command).create_match_method( self.fake_matcher ) process = CommandProcess(mock_command) process.command.command.process.poll = self.flow process.command.command.output_available = self.flow_out_available process.command.command.error_available = self.flow_err_available process.command.command.output.read = self.flow_out process.command.command.error.read = self.flow_err process.command.command.process.returncode = 1 with raises(KiwiCommandError): process.poll_show_progress(['a', 'b'], match_method) @patch('kiwi.command.Command') def test_poll(self, mock_command): process = CommandProcess(mock_command) process.command.command.process.poll = self.flow process.command.command.output_available = self.flow_out_available process.command.command.error_available = self.flow_err_available process.command.command.output.read = self.flow_out process.command.command.error.read = self.flow_err process.command.command.process.returncode = 0 with self._caplog.at_level(logging.DEBUG): process.poll() assert 'system: data' in self._caplog.text @patch('kiwi.command.Command') def test_poll_raises(self, mock_command): process = CommandProcess(mock_command) process.command.command.process.poll = self.flow process.command.command.output_available = self.flow_out_available process.command.command.error_available = self.flow_err_available process.command.command.output.read = self.flow_out process.command.command.error.read = self.flow_err process.command.command.output.read.return_value = 'data' process.command.command.process.returncode = 1 with raises(KiwiCommandError): process.poll() @patch('kiwi.command.Command') def test_poll_and_watch(self, mock_command): process = CommandProcess(mock_command) process.command.command.process.poll = self.flow process.command.command.output_available = self.flow_out_available process.command.command.error_available = self.flow_err_available process.command.command.output.read = self.flow_out process.command.command.error.read = self.flow_err process.command.command.process.returncode = 1 with self._caplog.at_level(logging.DEBUG): result = process.poll_and_watch() assert '--------------out start-------------' in self._caplog.text assert 'data' in self._caplog.text assert '--------------out stop--------------' in self._caplog.text assert result.stderr == 'error\n' @patch('kiwi.command.Command') def test_create_match_method(self, mock_command): match_method = CommandProcess(mock_command).create_match_method( self.fake_matcher ) assert match_method('a', 'b') is True def test_command_iterator(self): iterator = CommandIterator(Mock()) assert iterator.__iter__() == iterator def test_kill(self): iterator = CommandIterator(Mock()) iterator.kill() iterator.command.process.kill.assert_called_once_with() def test_get_pid(self): iterator = CommandIterator(Mock()) assert iterator.get_pid() == iterator.command.process.pid ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7650638 kiwi-11.1.8/test/unit/command_test.py0000644000000000000000000001176615273675667014523 0ustar00from unittest.mock import patch from collections import namedtuple from pytest import raises import unittest.mock as mock import os import pytest from kiwi.command import Command from kiwi.exceptions import KiwiCommandError, KiwiCommandNotFound class TestCommand: @patch('kiwi.path.Path.which') @patch('subprocess.Popen') def test_run_raises_error(self, mock_popen, mock_which): mock_which.return_value = 'command' mock_process = mock.Mock() mock_process.communicate = mock.Mock( return_value=[str.encode(''), str.encode('')] ) mock_process.returncode = 1 mock_popen.return_value = mock_process with raises(KiwiCommandError): Command.run(['command', 'args']) @patch('kiwi.path.Path.which') @patch('subprocess.Popen') def test_run_failure(self, mock_popen, mock_which): mock_which.return_value = 'command' mock_popen.side_effect = OSError('Run failure') with raises(KiwiCommandError): Command.run(['command', 'args']) def test_run_invalid_environment(self): with raises(KiwiCommandNotFound): Command.run(['command', 'args'], custom_env={'PATH': '/root'}) @patch('kiwi.path.Path.which') @patch('subprocess.Popen') def test_run_does_not_raise_error(self, mock_popen, mock_which): mock_which.return_value = 'command' mock_process = mock.Mock() mock_process.communicate = mock.Mock( return_value=[str.encode('stdout'), str.encode('')] ) mock_process.returncode = 1 mock_popen.return_value = mock_process result = Command.run(['command', 'args'], os.environ, False) assert result.error == '' assert result.output == 'stdout' @patch('kiwi.path.Path.which') def test_run_does_not_raise_error_if_command_not_found(self, mock_which): mock_which.return_value = None result = Command.run( ['command', 'args'], os.environ, raise_on_command_not_found=False ) assert result is None @patch('kiwi.path.Path.which') @patch('os.path.exists') @patch('subprocess.Popen') def test_run_does_not_call_which_for_abspaths( self, mock_popen, mock_exists, mock_which ): mock_exists.return_value = True proc = mock.MagicMock() proc.communicate.return_value = ( str.encode("stdout"), str.encode("stderr"), ) proc.returncode = 0 mock_popen.return_value = proc result = Command.run(['/bin/command', 'args']) mock_which.assert_not_called() assert result is not None @patch('kiwi.path.Path.which') @patch('os.path.exists') def test_run_fails_for_non_existent_abspath(self, mock_exists, mock_which): mock_exists.return_value = False with pytest.raises(KiwiCommandNotFound) as cmd_not_found_err: Command.run(['/bin/command', 'args']) mock_which.assert_not_called() assert '"/bin/command" not found' in str(cmd_not_found_err.value) @patch('os.access') @patch('os.path.exists') @patch('subprocess.Popen') def test_run(self, mock_popen, mock_exists, mock_access): mock_exists.return_value = True command_run = namedtuple('command', ['output', 'error', 'returncode']) run_result = command_run(output='stdout', error='stderr', returncode=0) mock_process = mock.Mock() mock_process.communicate = mock.Mock( return_value=[str.encode('stdout'), str.encode('stderr')] ) mock_process.returncode = 0 mock_popen.return_value = mock_process mock_access.return_value = True assert Command.run(['command', 'args']) == run_result def test_run_command_does_not_exist(self): with raises(KiwiCommandNotFound): Command.run(['does-not-exist']) def test_call_command_does_not_exist(self): with raises(KiwiCommandNotFound): Command.call(['does-not-exist'], os.environ) @pytest.mark.parametrize("available", (True, False)) @patch('kiwi.path.Path.which') @patch('subprocess.Popen') @patch('select.select') def test_call(self, mock_select, mock_popen, mock_which, available: bool): mock_which.return_value = 'command' mock_select.return_value = [True, False, not available] mock_process = mock.Mock() mock_popen.return_value = mock_process call = Command.call(['command', 'args']) assert call.output_available() == available assert call.error_available() == available assert call.output == mock_process.stdout assert call.error == mock_process.stderr assert call.process == mock_process @patch('kiwi.path.Path.which') @patch('subprocess.Popen') def test_call_failure(self, mock_popen, mock_which): mock_which.return_value = 'command' mock_popen.side_effect = KiwiCommandError('Call failure') with raises(KiwiCommandError): Command.call(['command', 'args']) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7650638 kiwi-11.1.8/test/unit/conftest.py0000644000000000000000000001350215273675667013661 0ustar00import inspect import os import sys from typing import Any, Dict, Iterator, List, Tuple import pytest import kiwi.defaults # The platform architecture as detected when the tests start, see # restore_platform_name() PLATFORM_MACHINE = kiwi.defaults.PLATFORM_MACHINE @pytest.fixture(autouse=True) def dont_use_kiwi_yml_from_host( request: pytest.FixtureRequest, monkeypatch: pytest.MonkeyPatch ) -> None: """kiwi will by default read runtime config files, which influence which utilities get chosen. The users config file leaks into the test environment, which is undesirable as certain tests assume that the default tool is XYZ and assert that. This fixture prevents the loading of the runtime config files by setting all paths to falsy values that hence are ignored. The runtime config is read once per process and kept in a module global, see RuntimeConfig. Each test starts with an empty runtime config instead, which is the result of reading no config files. Otherwise the first test of a process which creates a RuntimeConfig reads the config files of the host, and does so with the mocks of that test in place. A test which needs the config files to be read has to use RuntimeConfig(reread=True). This behavior can be turned off by adding the ``no_kiwi_yml_mock`` marker. """ if request.node.get_closest_marker("no_kiwi_yml_mock"): return monkeypatch.setattr("kiwi.defaults.ETC_RUNTIME_CONFIG_DIR", "") monkeypatch.setattr("kiwi.defaults.ETC_RUNTIME_CONFIG_FILE", "") monkeypatch.setattr("kiwi.defaults.USR_RUNTIME_CONFIG_DIR", "") monkeypatch.setattr("kiwi.defaults.USR_RUNTIME_CONFIG_FILE", "") monkeypatch.setattr("kiwi.defaults.CUSTOM_RUNTIME_CONFIG_FILE", None) monkeypatch.setattr("kiwi.runtime_config.RUNTIME_CONFIG", {}) @pytest.fixture(autouse=True) def restore_platform_name(monkeypatch: pytest.MonkeyPatch) -> None: """Defaults.set_platform_name() sets the platform architecture in a module global of kiwi.defaults. Tests set it to test architecture specific code. Each test starts with the architecture detected when the tests started and the architecture a test sets is reset after it. Otherwise a test depends on the architecture set by the test which ran before it in the same process. """ monkeypatch.setattr("kiwi.defaults.PLATFORM_MACHINE", PLATFORM_MACHINE) @pytest.fixture(autouse=True) def dont_use_proxy_setup_from_host( request: pytest.FixtureRequest, monkeypatch: pytest.MonkeyPatch ) -> None: """kiwi takes the proxy setup of the host into account for the package manager setup. The proxy setup of the host leaks into the test environment, which is undesirable as tests assert on the package manager environment and configuration. This fixture removes the proxy environment variables and points the proxy config files to non existing paths. This behavior can be turned off by adding the ``no_host_proxy_mock`` marker. """ if request.node.get_closest_marker("no_host_proxy_mock"): return for name in ("http_proxy", "https_proxy", "ftp_proxy", "no_proxy"): monkeypatch.delenv(name, raising=False) monkeypatch.delenv(name.upper(), raising=False) monkeypatch.setattr("kiwi.defaults.HOST_SYSCONFIG_PROXY", "/nonexisting") monkeypatch.setattr("kiwi.defaults.HOST_DNF_CONFIG", "/nonexisting") monkeypatch.setattr( "kiwi.utils.proxy.HostProxy.get_apt_config", staticmethod(lambda: []) ) @pytest.fixture(autouse=True) def restore_process_state() -> Iterator[None]: """Tests set the command line arguments in sys.argv, and the code under test sets environment variables, e.g GRUB_DISABLE_OS_PROBER or TMPDIR. Both are restored after each test, a test must not depend on the arguments or environment of the test which ran before it in the same process. """ argv = list(sys.argv) environment = dict(os.environ) yield sys.argv = argv if dict(os.environ) != environment: os.environ.clear() os.environ.update(environment) def _get_kiwi_namespaces() -> List[Any]: """Provide the loaded kiwi modules along with the classes defined in them, which are the namespaces tests replace attributes of """ namespaces: List[Any] = [] for name, module in list(sys.modules.items()): if module is None or not (name == 'kiwi' or name.startswith('kiwi.')): continue namespaces.append(module) for value in list(vars(module).values()): if inspect.isclass(value) and value.__module__ == name: namespaces.append(value) return namespaces @pytest.fixture(autouse=True) def restore_kiwi_namespaces() -> Iterator[None]: """Many tests replace attributes of kiwi modules and classes in their setup method without restoring them, e.g .. code:: python kiwi.builder.disk.BootImage.new = Mock() Such a replacement stays in place for all tests which run after it in the same process. Which tests that are depends on the order and on the distribution of the tests to the processes of a parallel run. The attributes of the kiwi modules and of the classes defined in them are therefore restored after each test, including the teardown of its test class. """ snapshot: List[Tuple[Any, Dict[str, Any]]] = [ (namespace, dict(vars(namespace))) for namespace in _get_kiwi_namespaces() ] yield for namespace, attributes in snapshot: current = vars(namespace) for name in [name for name in current if name not in attributes]: delattr(namespace, name) for name, value in attributes.items(): if current.get(name, _MISSING) is not value: setattr(namespace, name, value) # marker for an attribute which does not exist _MISSING = object() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7650638 kiwi-11.1.8/test/unit/container/__init__.py0000644000000000000000000000000015273675667015542 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7653565 kiwi-11.1.8/test/unit/container/appx_test.py0000644000000000000000000000667415273675667016041 0ustar00import io from pytest import raises from unittest.mock import patch, Mock, MagicMock, call from kiwi.container.appx import ContainerImageAppx from kiwi.exceptions import KiwiContainerSetupError class TestContainerImageAppx: @patch('kiwi.container.appx.RuntimeConfig') @patch('os.path.exists') def setup(self, mock_os_path_exists, mock_RuntimeConfig): mock_os_path_exists.return_value = True self.appx = ContainerImageAppx( 'root_dir', {'metadata_path': 'meta/data'} ) @patch('kiwi.container.appx.RuntimeConfig') @patch('os.path.exists') def setup_method(self, cls, mock_os_path_exists, mock_RuntimeConfig): self.setup() @patch('kiwi.container.appx.RuntimeConfig') @patch('os.path.exists') def test_init_raises(self, mock_os_path_exists, mock_RuntimeConfig): mock_os_path_exists.return_value = True with raises(KiwiContainerSetupError): ContainerImageAppx('root_dir', custom_args=None) mock_os_path_exists.return_value = False with raises(KiwiContainerSetupError): ContainerImageAppx( 'root_dir', custom_args={'metadata_path': 'meta/data'} ) @patch('kiwi.container.appx.ArchiveTar') @patch('kiwi.container.appx.Compress') @patch('kiwi.container.appx.Defaults.get_exclude_list_for_root_data_sync') @patch( 'kiwi.container.appx.Defaults.get_exclude_list_from_custom_exclude_files' ) @patch('kiwi.container.appx.Temporary.new_file') @patch('kiwi.container.appx.Command.run') @patch('os.walk') def test_create( self, mock_os_walk, mock_Command_run, mock_Temporary_new_file, mock_get_exclude_list_from_custom_exclude_files, mock_get_exclude_list_for_root_data_sync, mock_Compress, mock_ArchiveTar, ): mock_os_walk.return_value = [ ('source', ['bar', 'baz'], []), ('source/bar', [], []), ('source/baz', [], ['baz_file']), ] tempfile = Mock() tempfile.name = 'tempfile' mock_Temporary_new_file.return_value = tempfile archive = Mock() mock_ArchiveTar.return_value = archive compress = Mock() mock_Compress.return_value = compress with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.appx.create('target_dir/image.appx', '', False, True) assert file_handle.write.call_args_list == [ call('[Files]\n'), call('"source/baz/baz_file" "../../source/baz/baz_file"\n'), ] mock_ArchiveTar.assert_called_once_with('meta/data/install.tar') archive.create.assert_called_once_with( 'root_dir', exclude=mock_get_exclude_list_for_root_data_sync.return_value + mock_get_exclude_list_from_custom_exclude_files.return_value, ) assert mock_Compress.call_args_list == [ call(archive.create.return_value), call('target_dir/image.appx'), ] compress.gzip.assert_called_once_with() mock_Command_run.assert_called_once_with( ['appx', '-o', 'target_dir/image.appx', '-f', 'tempfile'] ) compress.xz.assert_called_once_with( self.appx.runtime_config.get_xz_options.return_value ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7653565 kiwi-11.1.8/test/unit/container/init_test.py0000644000000000000000000000230315273675667016015 0ustar00from unittest.mock import patch from pytest import raises from kiwi.container import ContainerImage from kiwi.exceptions import KiwiContainerImageSetupError class TestContainerImage: def test_container_image_not_implemented(self): with raises(KiwiContainerImageSetupError): ContainerImage.new('foo', 'root_dir') @patch('kiwi.container.oci.ContainerImageOCI') def test_container_image_docker(self, mock_docker): ContainerImage.new('docker', 'root_dir') mock_docker.assert_called_once_with('root_dir', 'docker-archive', None) @patch('kiwi.container.oci.ContainerImageOCI') def test_container_image_oci(self, mock_oci): ContainerImage.new('oci', 'root_dir') mock_oci.assert_called_once_with('root_dir', 'oci-archive', None) @patch('kiwi.container.appx.ContainerImageAppx') def test_container_image_appx(self, mock_appx): ContainerImage.new('appx', 'root_dir') mock_appx.assert_called_once_with('root_dir', None) @patch('kiwi.container.wsl.ContainerImageWsl') def test_container_image_wsl(self, mock_wsl): ContainerImage.new('wsl', 'root_dir') mock_wsl.assert_called_once_with('root_dir', None) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7653565 kiwi-11.1.8/test/unit/container/oci_test.py0000644000000000000000000002202115273675667015623 0ustar00import logging from pytest import fixture from unittest.mock import patch, mock_open, Mock import kiwi from kiwi.container.oci import ContainerImageOCI from kiwi.version import __version__ class TestContainerImageOCI: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.oci_tools.umoci.CommandCapabilities.has_option_in_help') @patch('kiwi.defaults.Defaults.is_buildservice_worker') def setup(self, mock_is_buildservice_worker, mock_cmd_caps): mock_is_buildservice_worker.return_value = False mock_cmd_caps.return_value = True self.runtime_config = Mock() self.runtime_config.get_container_compression = Mock(return_value=None) kiwi.container.oci.RuntimeConfig = Mock( return_value=self.runtime_config ) self.oci = ContainerImageOCI( 'root_dir', 'docker-archive', { 'container_name': 'foo/bar', 'additional_names': [':current', 'name:foobar', 'newname'], }, ) @patch('kiwi.oci_tools.umoci.CommandCapabilities.has_option_in_help') @patch('kiwi.defaults.Defaults.is_buildservice_worker') def setup_method(self, cls, mock_is_buildservice_worker, mock_cmd_caps): self.setup() @patch('kiwi.oci_tools.umoci.CommandCapabilities.has_option_in_help') @patch('kiwi.defaults.Defaults.is_buildservice_worker') def test_init_custom_args(self, mock_is_buildservice_worker, mock_cmd_caps): mock_is_buildservice_worker.return_value = False mock_cmd_caps.return_value = True custom_args = { 'container_name': 'foo', 'container_tag': '1.0', 'additional_names': ['current', 'foobar'], 'entry_command': ['/bin/bash', '-x'], 'entry_subcommand': ['ls', '-l'], 'maintainer': 'tux', 'user': 'root', 'workingdir': '/root', 'expose_ports': ['80', '42'], 'volumes': ['/var/log', '/tmp'], 'environment': {'PATH': '/bin', 'FOO': 'bar'}, 'labels': {'a': 'value', 'b': 'value'}, } container = ContainerImageOCI('root_dir', 'oci-archive', custom_args) assert container.oci_config == custom_args @patch('kiwi.oci_tools.umoci.CommandCapabilities.has_option_in_help') @patch('kiwi.defaults.Defaults.is_buildservice_worker') def test_init_without_custom_args( self, mock_is_buildservice_worker, mock_cmd_caps ): mock_is_buildservice_worker.return_value = False mock_cmd_caps.return_value = True container = ContainerImageOCI('root_dir', 'oci-archive') assert container.oci_config == { 'container_name': 'kiwi-container', 'container_tag': 'latest', 'history': {'created_by': 'KIWI {0}'.format(__version__)}, } @patch('kiwi.container.oci.RuntimeConfig') @patch('kiwi.oci_tools.umoci.CommandCapabilities.has_option_in_help') @patch('kiwi.defaults.Defaults.is_buildservice_worker') def test_init_in_buildservice( self, mock_buildservice, mock_cmd_caps, mock_RuntimeConfig ): mock_buildservice.return_value = True mock_cmd_caps.return_value = True m_open = mock_open() with patch('builtins.open', m_open, create=True): m_open.return_value.__iter__ = lambda _: iter( ['BUILD_DISTURL=obs://build.opensuse.org/some:project'] ) container = ContainerImageOCI('root_dir', 'oci-archive') m_open.assert_called_once_with('/.buildenv') assert container.oci_config['labels'] == { 'org.openbuildservice.disturl': 'obs://build.opensuse.org/some:project' } m_open = mock_open() with patch('builtins.open', m_open, create=True): m_open.return_value.__iter__ = lambda _: iter( ['BUILD_DISTURL=obs://build.opensuse.org/some:project'] ) container = ContainerImageOCI( 'root_dir', 'oci-archive', {'labels': {'label': 'value'}} ) m_open.assert_called_once_with('/.buildenv') assert container.oci_config['labels'] == { 'label': 'value', 'org.openbuildservice.disturl': 'obs://build.opensuse.org/some:project', } @patch('kiwi.container.oci.RuntimeConfig') @patch('kiwi.oci_tools.umoci.CommandCapabilities.has_option_in_help') @patch('kiwi.defaults.Defaults.is_buildservice_worker') def test_init_in_buildservice_without_disturl( self, mock_buildservice, mock_cmd_caps, mock_RuntimeConfig ): mock_buildservice.return_value = True mock_cmd_caps.return_value = True m_open = mock_open() with patch('builtins.open', m_open, create=True): m_open.return_value.__iter__ = lambda _: iter(['line content']) with self._caplog.at_level(logging.WARNING): container = ContainerImageOCI('root_dir', 'oci-archive') m_open.assert_called_once_with('/.buildenv') assert 'labels' not in container.oci_config @patch('kiwi.container.oci.OCI') @patch('kiwi.container.oci.Defaults.get_shared_cache_location') @patch('kiwi.container.oci.Compress') def test_create_oci_archive(self, mock_Compress, mock_cache, mock_OCI): compress = Mock() mock_Compress.return_value = compress mock_cache.return_value = 'var/cache/kiwi' mock_oci = Mock() mock_OCI.new.return_value.__enter__.return_value = mock_oci self.oci.archive_transport = 'oci-archive' self.oci.create('result.tar', '', True, True) mock_oci.init_container.assert_called_once_with() mock_oci.unpack.assert_called_once_with() mock_oci.sync_rootfs.assert_called_once_with( 'root_dir', [ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', 'dev/*', 'sys/*', 'proc/*', ], ) mock_oci.repack.assert_called_once_with( { 'container_name': 'foo/bar', 'additional_names': [':current', 'name:foobar', 'newname'], 'container_tag': 'latest', 'entry_subcommand': ['/bin/bash'], 'history': {'created_by': 'KIWI {0}'.format(__version__)}, } ) mock_oci.set_config.assert_called_once_with( { 'container_name': 'foo/bar', 'additional_names': [':current', 'name:foobar', 'newname'], 'container_tag': 'latest', 'entry_subcommand': ['/bin/bash'], 'history': {'created_by': 'KIWI {0}'.format(__version__)}, } ) mock_oci.post_process.assert_called_once_with() mock_oci.export_container_image.assert_called_once_with( 'result.tar', 'oci-archive', 'foo/bar:latest', [] ) compress.xz.assert_called_once_with( self.runtime_config.get_xz_options.return_value ) @patch('kiwi.container.oci.OCI') @patch('kiwi.container.oci.Defaults.get_shared_cache_location') def test_create_derived_docker_archive(self, mock_cache, mock_OCI): mock_cache.return_value = 'var/cache/kiwi' mock_oci = Mock() mock_OCI.new.return_value.__enter__.return_value = mock_oci self.runtime_config.get_container_compression.return_value = 'xz' self.oci.create('result.tar', 'root_dir/image/image_file') mock_oci.import_container_image.assert_called_once_with( 'oci-archive:root_dir/image/image_file:base_layer' ) mock_oci.unpack.assert_called_once_with() mock_oci.sync_rootfs.assert_called_once_with( 'root_dir', [ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', 'dev/*', 'sys/*', 'proc/*', ], ) mock_oci.repack.assert_called_once_with( { 'container_name': 'foo/bar', 'additional_names': [':current', 'name:foobar', 'newname'], 'container_tag': 'latest', 'history': {'created_by': 'KIWI {0}'.format(__version__)}, } ) mock_oci.set_config.assert_called_once_with( { 'container_name': 'foo/bar', 'additional_names': [':current', 'name:foobar', 'newname'], 'container_tag': 'latest', 'history': {'created_by': 'KIWI {0}'.format(__version__)}, } ) mock_oci.post_process.assert_called_once_with() mock_oci.export_container_image.assert_called_once_with( 'result.tar', 'docker-archive', 'foo/bar:latest', ['foo/bar:current', 'name:foobar', 'newname:latest'], ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7653565 kiwi-11.1.8/test/unit/container/setup/__init__.py0000644000000000000000000000000015273675667016702 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7654994 kiwi-11.1.8/test/unit/container/setup/appx_test.py0000644000000000000000000000371215273675667017167 0ustar00import io from pytest import raises from unittest.mock import patch, MagicMock from kiwi.container.setup.appx import ContainerSetupAppx from kiwi.defaults import Defaults from kiwi.exceptions import KiwiContainerSetupError class TestContainerSetupAppx: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True self.appx = ContainerSetupAppx( 'root_dir', { 'metadata_path': '../data/appx', 'image_version': '1.99.1', 'history': { 'created_by': 'SUSE', 'author': 'Marcus', 'application_id': '123', 'package_version': '2003.12.0.0', 'comment': 'Some Information', 'launcher': 'openSUSE-Tumbleweed.exe', }, }, ) @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() def test_setup_raises_no_manifest_file(self): with patch('os.path.exists', return_value=True): appx = ContainerSetupAppx( 'root_dir', {'metadata_path': 'artificial'} ) with patch('os.path.exists', return_value=False): with raises(KiwiContainerSetupError): appx.setup() @patch('lxml.etree.parse') def test_setup_raises_xml_operations(self, mock_parse): mock_parse.side_effect = Exception with raises(KiwiContainerSetupError): self.appx.setup() def test_setup(self): Defaults.set_platform_name('x86_64') with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.appx.setup() # we expect all @..@ templates to got replaced assert '@' not in file_handle.write.call_args_list ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7654994 kiwi-11.1.8/test/unit/container/setup/base_test.py0000644000000000000000000000665515273675667017142 0ustar00from unittest.mock import patch, call, mock_open from pytest import raises from kiwi.container.setup.base import ContainerSetupBase from kiwi.exceptions import KiwiContainerSetupError class TestContainerSetupBase: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True self.container = ContainerSetupBase('root_dir') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('os.path.exists') def test_container_root_dir_does_not_exist(self, mock_exists): mock_exists.return_value = False with raises(KiwiContainerSetupError): ContainerSetupBase('root_dir') def test_setup(self): with raises(NotImplementedError): self.container.setup() def test_post_init(self): self.container.custom_args == {} def test_get_container_name(self): assert self.container.get_container_name() == 'system-container' @patch('os.path.exists') def test_deactivate_bootloader_setup(self, mock_exists): mock_exists.return_value = True m_open = mock_open(read_data='LOADER_LOCATION="mylocation"') with patch('builtins.open', m_open, create=True): self.container.deactivate_bootloader_setup() assert m_open.call_args_list[0] == call( 'root_dir/etc/sysconfig/bootloader', 'r' ) assert m_open.return_value.write.call_args_list == [ call('LOADER_LOCATION="none"\nLOADER_TYPE="none"\n') ] @patch('os.path.exists') def test_deactivate_root_filesystem_check(self, mock_exists): mock_exists.return_value = True m_open = mock_open(read_data=None) with patch('builtins.open', m_open, create=True): self.container.deactivate_root_filesystem_check() assert m_open.call_args_list[0] == call( 'root_dir/etc/sysconfig/boot', 'r' ) assert m_open.return_value.write.call_args_list == [ call('\nROOTFS_BLKDEV="/dev/null"\n') ] @patch('os.path.exists') @patch('kiwi.container.setup.base.Command.run') def test_deactivate_systemd_service(self, mock_command, mock_exists): mock_exists.return_value = True self.container.deactivate_systemd_service('my.service') mock_command.assert_called_once_with( [ 'ln', '-s', '-f', '/dev/null', 'root_dir/usr/lib/systemd/system/my.service', ] ) @patch('os.path.exists') @patch('kiwi.container.setup.base.Command.run') def test_deactivate_systemd_service_failed(self, mock_command, mock_exists): mock_exists.return_value = True mock_command.side_effect = Exception with raises(KiwiContainerSetupError): self.container.deactivate_systemd_service('my.service') @patch('os.path.exists') def test_setup_root_console(self, mock_exists): mock_exists.return_value = False m_open = mock_open(read_data=None) with patch('builtins.open', m_open, create=True): self.container.setup_root_console() assert m_open.call_args_list == [ call('root_dir/etc/securetty', 'w'), call('root_dir/etc/securetty', 'r'), call('root_dir/etc/securetty', 'w'), ] assert m_open.return_value.write.call_args_list == [call('\nconsole\n')] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7654994 kiwi-11.1.8/test/unit/container/setup/docker_test.py0000644000000000000000000000062715273675667017470 0ustar00from unittest.mock import patch from kiwi.container.setup.docker import ContainerSetupDocker class TestContainerSetupDocker: @patch('os.path.exists') def test_init(self, mock_exists): mock_exists.return_value = True container = ContainerSetupDocker( 'root_dir', {'container_name': 'system'} ) assert container.custom_args['container_name'] == 'system' ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7654994 kiwi-11.1.8/test/unit/container/setup/init_test.py0000644000000000000000000000171715273675667017165 0ustar00from unittest.mock import patch from pytest import raises from kiwi.container.setup import ContainerSetup from kiwi.exceptions import KiwiContainerSetupError class TestContainerSetup: def test_container_not_implemented(self): with raises(KiwiContainerSetupError): ContainerSetup.new('foo', 'root_dir') @patch('kiwi.container.setup.docker.ContainerSetupDocker') def test_container_docker(self, mock_docker): ContainerSetup.new('docker', 'root_dir') mock_docker.assert_called_once_with('root_dir', None) @patch('kiwi.container.setup.oci.ContainerSetupOCI') def test_container_oci(self, mock_oci): ContainerSetup.new('oci', 'root_dir') mock_oci.assert_called_once_with('root_dir', None) @patch('kiwi.container.setup.appx.ContainerSetupAppx') def test_container_appx(self, mock_appx): ContainerSetup.new('appx', 'root_dir') mock_appx.assert_called_once_with('root_dir', None) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7654994 kiwi-11.1.8/test/unit/container/setup/oci_test.py0000644000000000000000000000247615273675667016777 0ustar00from unittest.mock import patch from unittest.mock import call import unittest.mock as mock from kiwi.container.setup.oci import ContainerSetupOCI class TestContainerSetupOCI: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True self.container = ContainerSetupOCI( 'root_dir', {'container_name': 'system'} ) self.container.deactivate_bootloader_setup = mock.Mock() self.container.deactivate_root_filesystem_check = mock.Mock() self.container.setup_root_console = mock.Mock() self.container.deactivate_systemd_service = mock.Mock() @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() def test_setup(self): self.container.setup() self.container.deactivate_bootloader_setup.assert_called_once_with() self.container.deactivate_root_filesystem_check.assert_called_once_with() assert self.container.deactivate_systemd_service.call_args_list == [ call('device-mapper.service'), call('kbd.service'), call('swap.service'), call('udev.service'), call('proc-sys-fs-binfmt_misc.automount'), ] def test_post_init(self): self.container.custom_args['container_name'] == 'system' ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7654994 kiwi-11.1.8/test/unit/container/setup/wsl_test.py0000644000000000000000000000157615273675667017032 0ustar00from pytest import raises from unittest.mock import patch from kiwi.container.setup.wsl import ContainerSetupWsl from kiwi.exceptions import KiwiContainerSetupError class TestContainerSetupAppx: @patch('os.path.exists') def setup(self, mock_exists): self.wsl = ContainerSetupWsl('root_dir') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('os.path.exists') def test_setup(self, mock_exists): def exists(path): if path == path_to_fail: return False return True mock_exists.side_effect = exists path_to_fail = 'root_dir/etc/wsl-distribution.conf' with raises(KiwiContainerSetupError): self.wsl.setup() path_to_fail = 'root_dir/etc/wsl.conf' with raises(KiwiContainerSetupError): self.wsl.setup() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7654994 kiwi-11.1.8/test/unit/container/wsl_test.py0000644000000000000000000000306415273675667015664 0ustar00from unittest.mock import patch, Mock from kiwi.container.wsl import ContainerImageWsl class TestContainerImageWsl: def setup(self): self.wsl = ContainerImageWsl('root_dir') def setup_method(self, cls): self.setup() @patch('kiwi.container.wsl.ArchiveTar') @patch('kiwi.container.wsl.Compress') @patch('kiwi.container.wsl.Defaults.get_exclude_list_for_root_data_sync') @patch( 'kiwi.container.wsl.Defaults.get_exclude_list_from_custom_exclude_files' ) @patch('kiwi.container.wsl.Command.run') def test_create( self, mock_Command_run, mock_get_exclude_list_from_custom_exclude_files, mock_get_exclude_list_for_root_data_sync, mock_Compress, mock_ArchiveTar, ): archive = Mock() mock_ArchiveTar.return_value = archive compress = Mock() mock_Compress.return_value = compress self.wsl.create('target_dir/image.wsl') mock_ArchiveTar.assert_called_once_with('target_dir/image.wsl') archive.create.assert_called_once_with( 'root_dir', exclude=mock_get_exclude_list_for_root_data_sync.return_value + mock_get_exclude_list_from_custom_exclude_files.return_value, options=['--numeric-owner', '--absolute-names'], ) mock_Compress.assert_called_once_with(archive.create.return_value) compress.gzip.assert_called_once_with() mock_Command_run.assert_called_once_with( ['mv', compress.gzip.return_value, 'target_dir/image.wsl'] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7654994 kiwi-11.1.8/test/unit/defaults_test.py0000644000000000000000000003115015273675667014701 0ustar00import logging from unittest.mock import patch, call import sys from unittest.mock import MagicMock from pytest import fixture, raises from .test_helper import argv_kiwi_tests from kiwi.defaults import Defaults from kiwi.defaults import grub_loader_type from kiwi.defaults import shim_loader_type from kiwi.exceptions import KiwiBootLoaderGrubDataError class TestDefaults: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): self.defaults = Defaults() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def test_get(self): assert self.defaults.get('kiwi_align') == 1048576 assert self.defaults.get('kiwi_startsector') == 2048 assert self.defaults.get('kiwi_sectorsize') == 512 assert self.defaults.get('kiwi_inode_size') == 256 assert self.defaults.get('kiwi_inode_ratio') == 16384 assert self.defaults.get('kiwi_min_inodes') == 20000 assert self.defaults.get('kiwi_revision') def test_to_profile(self): profile = MagicMock() self.defaults.to_profile(profile) profile.add.assert_any_call('kiwi_align', 1048576) profile.add.assert_any_call('kiwi_startsector', 2048) profile.add.assert_any_call('kiwi_sectorsize', 512) profile.add.assert_any_call( 'kiwi_revision', self.defaults.get('kiwi_revision') ) def test_get_preparer(self): assert ( Defaults.get_preparer() == 'KIWI - https://github.com/OSInside/kiwi' ) def test_get_publisher(self): assert Defaults.get_publisher() == 'SUSE LINUX GmbH' def test_get_default_shared_cache_location(self): assert Defaults.get_shared_cache_location() == 'var/cache/kiwi' @patch('kiwi.defaults.Path.which') def test_get_grub_boot_directory_name(self, mock_which): mock_which.return_value = 'grub2-install-was-found' assert ( Defaults.get_grub_boot_directory_name(lookup_path='lookup_path') == 'grub2' ) mock_which.return_value = None assert ( Defaults.get_grub_boot_directory_name(lookup_path='lookup_path') == 'grub' ) def test_get_live_dracut_modules_from_flag(self): assert Defaults.get_live_dracut_modules_from_flag('foo') == [ 'kiwi-live' ] assert Defaults.get_live_dracut_modules_from_flag('overlay') == [ 'kiwi-live' ] assert Defaults.get_live_dracut_modules_from_flag('dmsquash') == [ 'dmsquash-live', 'livenet', ] def test_get_iso_kernel_flavor_file_name(self): assert Defaults.get_iso_kernel_flavor_file_name('linux', 0, 'rt') == ( 'linux' ) assert Defaults.get_iso_kernel_flavor_file_name( 'initrd', 1, 'default' ) == ('initrd-default') def test_get_iso_boot_path(self): Defaults.set_platform_name('i686') assert Defaults.get_iso_boot_path() == 'boot/ix86' Defaults.set_platform_name('x86_64') assert Defaults.get_iso_boot_path() == 'boot/x86_64' @patch('kiwi.defaults.glob.iglob') def test_get_unsigned_grub_loader(self, mock_glob): mock_glob.return_value = ['/usr/share/grub2/x86_64-efi/grub.efi'] assert ( mock_glob.return_value[0] in Defaults.get_unsigned_grub_loader('root')[0].filename ) assert mock_glob.call_args_list == [ call('root/usr/share/grub*/x86_64-efi/grub.efi'), call('root/usr/lib/grub*/x86_64-efi/grub.efi'), call('root/boot/efi/EFI/*/grubx64.efi'), call('root/boot/efi/EFI/*/grubia32.efi'), call('root/boot/efi/EFI/*/grubaa64.efi'), call('root/boot/efi/EFI/*/grubriscv64.efi'), ] mock_glob.reset_mock() mock_glob.return_value = [] assert Defaults.get_unsigned_grub_loader('root') == [] def test_is_x86_arch(self): assert Defaults.is_x86_arch('x86_64') is True assert Defaults.is_x86_arch('aarch64') is False @patch('os.path.exists') def test_get_vendor_grubenv(self, mock_path_exists): mock_path_exists.return_value = True assert ( Defaults.get_vendor_grubenv('boot/efi') == 'boot/efi/EFI/fedora/grubenv' ) def test_parse_exclude_file_is_valid(self): assert Defaults._parse_exclude_file( '../data/root-dir', 'exclude_files.yaml' ) == [ 'usr/bin/qemu-binfmt', 'usr/bin/qemu-x86_64-binfmt', 'usr/bin/qemu-x86_64', ] @patch('yaml.safe_load') def test_parse_exclude_file_is_invalid(self, mock_yaml_safe_load): mock_yaml_safe_load.return_value = {'invalid': 'artificial'} with self._caplog.at_level(logging.WARNING): assert ( Defaults._parse_exclude_file( '../data/root-dir', 'exclude_files.yaml' ) == [] ) def test_get_exclude_list_from_custom_exclude_files(self): assert Defaults.get_exclude_list_from_custom_exclude_files( '../data/root-dir' ) == [ 'usr/bin/qemu-binfmt', 'usr/bin/qemu-x86_64-binfmt', 'usr/bin/qemu-x86_64', ] @patch('yaml.safe_load') def test_get_exclude_list_from_custom_exclude_files_is_invalid( self, mock_yaml_safe_load ): mock_yaml_safe_load.return_value = {'invalid': 'artificial'} with self._caplog.at_level(logging.WARNING): assert ( Defaults.get_exclude_list_from_custom_exclude_files( '../data/root-dir' ) == [] ) def test_get_exclude_list_from_custom_exclude_files_for_efifatimage(self): assert ( Defaults.get_exclude_list_from_custom_exclude_files_for_efifatimage( '../data/root-dir' ) == [ 'BOOT/fbia32.efi', 'BOOT/fbx64.efi', ] ) @patch('yaml.safe_load') def test_get_exclude_list_from_custom_exclude_files_for_efifatimage_is_invalid( self, mock_yaml_safe_load ): mock_yaml_safe_load.return_value = {'invalid': 'artificial'} with self._caplog.at_level(logging.WARNING): assert ( Defaults.get_exclude_list_from_custom_exclude_files_for_efifatimage( '../data/root-dir' ) == [] ) def test_get_exclude_list_for_root_data_sync(self): assert Defaults.get_exclude_list_for_root_data_sync() == [ 'image', '.kconfig', 'run/*', 'tmp/*', '.buildenv', 'var/cache/kiwi', ] assert Defaults.get_exclude_list_for_root_data_sync( no_tmpdirs=False ) == ['image', '.kconfig', '.buildenv', 'var/cache/kiwi'] def test_get_sync_sparse(self): assert Defaults.get_sync_sparse() is False @patch('glob.iglob') def test_get_signed_grub_loader(self, mock_iglob): def iglob_no_matches(pattern): return [] def iglob_simple_match(pattern): if '/boot/efi/EFI/*/grubx64.efi' in pattern: return ['root_path/boot/efi/EFI/BOOT/grubx64.efi'] else: return [] def iglob_custom_binary_match(pattern): if '/usr/lib/grub/x86_64-efi-signed/grubx64.efi.signed' in pattern: return [ 'root_path' '/usr/lib/grub/x86_64-efi-signed/grubx64.efi.signed' ] else: return [] mock_iglob.side_effect = iglob_no_matches assert Defaults.get_signed_grub_loader('root_path') == [] mock_iglob.side_effect = iglob_simple_match assert Defaults.get_signed_grub_loader('root_path') == [ grub_loader_type( filename='root_path/boot/efi/EFI/BOOT/grubx64.efi', binaryname='grubx64.efi', targetname='bootx64.efi', ) ] mock_iglob.side_effect = iglob_custom_binary_match assert Defaults.get_signed_grub_loader('root_path') == [ grub_loader_type( filename='root_path' '/usr/lib/grub/x86_64-efi-signed/grubx64.efi.signed', binaryname='grubx64.efi', targetname='bootx64.efi', ) ] @patch('glob.iglob') def test_get_mok_manager(self, mock_iglob): mock_iglob.return_value = [] assert Defaults.get_mok_manager('root_path') == [] def iglob_match(pattern): if pattern == 'root_path/boot/efi/EFI/*/mm*.efi': return ['some'] return [] mock_iglob.side_effect = iglob_match assert Defaults.get_mok_manager('root_path') == ['some'] @patch('glob.iglob') def test_get_shim_loader(self, mock_iglob): def iglob_simple_match(pattern): if '/usr/lib64/efi/shim.efi' in pattern: return ['root_path/usr/lib64/efi/shim.efi'] else: return [] def iglob_custom_binary_match(pattern): if '/usr/lib/shim/shim*.efi.signed.latest' in pattern: return ['root_path' '/usr/lib/shim/shimx64.efi.signed.latest'] else: return [] assert Defaults.get_shim_loader('root_path') == [] mock_iglob.side_effect = iglob_simple_match assert Defaults.get_shim_loader('root_path') == [ shim_loader_type( filename='root_path' '/usr/lib64/efi/shim.efi', binaryname='bootx64.efi', ) ] mock_iglob.side_effect = iglob_custom_binary_match assert Defaults.get_shim_loader('root_path') == [ shim_loader_type( filename='root_path' '/usr/lib/shim/shimx64.efi.signed.latest', binaryname='bootx64.efi', ) ] @patch('os.path.exists') def test_get_snapper_config_template_file(self, mock_os_path_exists): mock_os_path_exists.return_value = False assert Defaults.get_snapper_config_template_file('root') == '' mock_os_path_exists.return_value = True assert ( Defaults.get_snapper_config_template_file('root') == 'root/etc/snapper/config-templates/default' ) def test_get_min_volume_mbytes(self): assert Defaults.get_min_volume_mbytes('btrfs') == 120 assert Defaults.get_min_volume_mbytes('xfs') == 300 assert Defaults.get_min_volume_mbytes('some') == 30 @patch('glob.iglob') def test_get_grub_chrp_loader(self, mock_glob_iglob): mock_glob_iglob.return_value = [] with raises(KiwiBootLoaderGrubDataError): Defaults.get_grub_chrp_loader('some-boot') mock_glob_iglob.reset_mock() mock_glob_iglob.return_value = [ '/some-boot/boot/grub2/powerpc-ieee1275/grub.elf' ] assert Defaults.get_grub_chrp_loader('some-boot') == 'grub.elf' mock_glob_iglob.assert_called_once_with( 'some-boot/boot/grub*/powerpc-ieee1275/grub.elf' ) @patch('glob.iglob') def test_get_grub_efi_font_directory(self, mock_glob_iglob): mock_glob_iglob.return_value = [] assert Defaults.get_grub_efi_font_directory('root_path') is None mock_glob_iglob.assert_called_once_with( 'root_path/boot/efi/EFI/*/fonts' ) mock_glob_iglob.return_value = [ 'root_path/boot/efi/EFI/fedora/fonts', 'root_path/boot/efi/EFI/opensuse/fonts', ] assert ( Defaults.get_grub_efi_font_directory('root_path') == 'root_path/boot/efi/EFI/fedora/fonts' ) @patch('os.path.exists') def test_get_grub_path(self, mock_os_path_exists): mock_os_path_exists.return_value = False assert ( Defaults.get_grub_path('root', 'some_file_to_search', False) == '' ) def test_get_efi_vendor_directory_not_found(self, tmp_path): assert Defaults.get_efi_vendor_directory(str(tmp_path)) is None assert Defaults.get_vendor_grubenv(str(tmp_path)) is None # a vendor directory without grubenv (tmp_path / 'EFI' / 'fedora').mkdir(parents=True) assert Defaults.get_vendor_grubenv(str(tmp_path)) is None def test_get_default_packager_tool_unknown(self): assert Defaults.get_default_packager_tool('unknown') is None ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7654994 kiwi-11.1.8/test/unit/filesystem/__init__.py0000644000000000000000000000000015273675667015744 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/base_test.py0000644000000000000000000002015615273675667016174 0ustar00import logging from unittest.mock import patch, Mock from pytest import raises, fixture import kiwi.defaults as defaults from kiwi.filesystem.base import FileSystemBase from kiwi.exceptions import KiwiFileSystemSyncError class TestFileSystemBase: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): provider = Mock() provider.get_device = Mock(return_value='/dev/loop0') provider.get_byte_size = Mock(return_value=1073741824) # 1GB custom_args = {'fs_attributes': ['no-copy-on-write']} self.fsbase = FileSystemBase(provider, 'root_dir', custom_args) def setup_method(self, cls): self.setup() def test_root_dir_does_not_exist(self): fsbase = FileSystemBase(Mock(), 'root_dir_not_existing') with raises(KiwiFileSystemSyncError): fsbase.sync_data() def test_root_dir_not_defined(self): fsbase = FileSystemBase(Mock()) with raises(KiwiFileSystemSyncError): fsbase.sync_data() def test_create_on_device(self): with raises(NotImplementedError): self.fsbase.create_on_device('/dev/foo') def test_create_on_file(self): with raises(NotImplementedError): self.fsbase.create_on_file('myimage') def test_get_mountpoint(self): assert self.fsbase.get_mountpoint() is None @patch('kiwi.filesystem.base.MountManager') @patch('kiwi.filesystem.base.DataSync') @patch('kiwi.filesystem.base.Command.run') @patch('os.path.exists') def test_sync_data( self, mock_exists, mock_Command_run, mock_sync, mock_mount ): mock_exists.return_value = True filesystem_mount = Mock() filesystem_mount.mountpoint = 'tmpdir' mock_mount.return_value = filesystem_mount data_sync = Mock() mock_sync.return_value = data_sync self.fsbase.sync_data(['exclude_me']) mock_sync.assert_called_once_with('root_dir', 'tmpdir') data_sync.sync_data.assert_called_once_with( exclude=['exclude_me'], options=[ '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', ], ) mock_mount.assert_called_once_with(device='/dev/loop0') mock_Command_run.assert_called_once_with(['chattr', '+C', 'tmpdir']) filesystem_mount.mount.assert_called_once_with([]) assert self.fsbase.get_mountpoint() == 'tmpdir' @patch('kiwi.filesystem.base.RuntimeConfig') def test_get_install_mount_options_no_sparse_options( self, mock_RuntimeConfig ): # a filesystem that declares nothing keeps the options as given # and does not even consult the runtime configuration self.fsbase.custom_args['mount_options'] = ['noatime'] assert self.fsbase._get_install_mount_options() == ['noatime'] assert not mock_RuntimeConfig.called @patch('kiwi.filesystem.base.RuntimeConfig') def test_get_install_mount_options_sparse_not_requested( self, mock_RuntimeConfig ): mock_RuntimeConfig.return_value.get_sync_sparse.return_value = False self.fsbase.sparse_install_mount_options = ['allocsize=4k'] self.fsbase.custom_args['mount_options'] = ['noatime'] assert self.fsbase._get_install_mount_options() == ['noatime'] @patch('kiwi.filesystem.base.RuntimeConfig') def test_get_install_mount_options_sparse_requested( self, mock_RuntimeConfig ): mock_RuntimeConfig.return_value.get_sync_sparse.return_value = True self.fsbase.sparse_install_mount_options = ['allocsize=4k'] # appended to the given options as one comma separated element self.fsbase.custom_args['mount_options'] = ['noatime'] with self._caplog.at_level(logging.INFO): assert self.fsbase._get_install_mount_options() == [ 'noatime,allocsize=4k' ] assert 'allocsize=4k' in self._caplog.text # used on its own if the image description provides no options self.fsbase.custom_args['mount_options'] = [] assert self.fsbase._get_install_mount_options() == ['allocsize=4k'] # the mount options from the image description take precedence self.fsbase.custom_args['mount_options'] = ['noatime,allocsize=1m'] assert self.fsbase._get_install_mount_options() == [ 'noatime,allocsize=1m' ] # and the result stays independent of the custom args, which # are the source for the fstab of the image assert self.fsbase.custom_args['mount_options'] == [ 'noatime,allocsize=1m' ] @patch('kiwi.filesystem.base.VeritySetup') def test_create_verity_layer(self, mock_VeritySetup): self.fsbase.create_verity_layer() mock_VeritySetup.return_value.format.assert_called_once_with() def test_create_verification_metadata(self): veritysetup = Mock() self.fsbase.veritysetup = veritysetup self.fsbase.create_verification_metadata('/some/device') veritysetup.create_verity_verification_metadata.assert_called_once_with() veritysetup.sign_verification_metadata.assert_called_once_with() veritysetup.write_verification_metadata.assert_called_once_with( '/some/device' ) def test_umount(self): mount = Mock() self.fsbase.filesystem_mount = mount self.fsbase.umount() mount.umount.assert_called_once_with() def test_umount_volumes(self): mount = Mock() self.fsbase.filesystem_mount = mount self.fsbase.umount_volumes() mount.umount.assert_called_once_with() def test_mount(self): mount = Mock() self.fsbase.filesystem_mount = mount self.fsbase.mount() mount.mount.assert_called_once_with([]) def test_mount_volumes(self): mount = Mock() self.fsbase.filesystem_mount = mount self.fsbase.mount_volumes() mount.mount.assert_called_once_with([]) def test_get_volumes(self): with raises(NotImplementedError): self.fsbase.get_volumes() def test_get_root_volume_name(self): with raises(NotImplementedError): self.fsbase.get_root_volume_name() def test_get_fstab(self): with raises(NotImplementedError): self.fsbase.get_fstab() def test_set_property_readonly_root(self): with raises(NotImplementedError): self.fsbase.set_property_readonly_root() def test_fs_size(self): # size of 100k must be 100k (default unit) assert self.fsbase._fs_size(100) == '100' # size of 1073741824b (see test init) - 100k must be 1048476k assert self.fsbase._fs_size(-100) == '1048476' # size of 1073741824b (see test init) - 102400b must be 1073639424b assert ( self.fsbase._fs_size(-102400, unit=defaults.UNIT.byte) == '1073639424' ) # size of 1073741824b - 1024m must be zero assert self.fsbase._fs_size(-1024, unit=defaults.UNIT.mb) == '0' # size of 1073741824b - 1g must be zero assert self.fsbase._fs_size(-1, unit=defaults.UNIT.gb) == '0' def test_set_uuid(self): with self._caplog.at_level(logging.WARNING): self.fsbase.set_uuid() def test_context_manager_exit(self): mount_manager = Mock() with FileSystemBase(Mock()) as fsbase: fsbase.filesystem_mount = mount_manager mount_manager.umount.assert_called_once_with() def test_generate_seed_uuid(self): with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': '123456'}): assert ( self.fsbase._generate_seed_uuid('label') == 'c0cbf4e3-10a7-86ea-9472-87aaca0074f2' ) @patch('kiwi.filesystem.base.uuid') def test_generate_seed_uuid_random(self, mock_uuid): mock_uuid.uuid4.return_value = 'some' with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': ''}): assert self.fsbase._generate_seed_uuid('label') == 'some' ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/btrfs_test.py0000644000000000000000000000357215273675667016405 0ustar00from unittest.mock import patch import unittest.mock as mock from kiwi.filesystem.btrfs import FileSystemBtrfs class TestFileSystemBtrfs: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True provider = mock.Mock() provider.get_device = mock.Mock(return_value='/dev/foo') self.btrfs = FileSystemBtrfs(provider, 'root_dir') self.btrfs.setup_mountpoint = mock.Mock(return_value='some-mount-point') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('kiwi.filesystem.btrfs.Command.run') def test_create_on_device(self, mock_command): with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': '0'}): self.btrfs.create_on_device('label', 100, uuid='uuid') call = mock_command.call_args_list[0] assert mock_command.call_args_list[0] == call( [ 'mkfs.btrfs', '-L', 'label', '-U', 'uuid', '--byte-count', '102400', '/dev/foo', ] ) mock_command.reset_mock() self.btrfs.create_on_device('label', 100) assert mock_command.call_args_list[0] == call( [ 'mkfs.btrfs', '-L', 'label', '-U', '2453562e-7073-2098-d091-fd7a04dc5434', '--byte-count', '102400', '/dev/foo', ] ) @patch('kiwi.filesystem.btrfs.Command.run') def test_set_uuid(self, mock_command): self.btrfs.set_uuid() mock_command.assert_called_once_with( ['btrfstune', '-f', '-u', '/dev/foo'] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/erofs_test.py0000644000000000000000000000277315273675667016405 0ustar00from unittest.mock import patch import unittest.mock as mock from kiwi.defaults import Defaults from kiwi.filesystem.erofs import FileSystemEroFs class TestFileSystemEroFs: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True self.erofs = FileSystemEroFs( mock.Mock(), 'root_dir', custom_args={'compression': 'zstd,level=21'}, ) @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('kiwi.filesystem.erofs.Command.run') def test_create_on_file(self, mock_command): Defaults.set_platform_name('x86_64') self.erofs.create_on_file('myimage', 'label') mock_command.assert_called_once_with( [ 'mkfs.erofs', '-z', 'zstd,level=21', '-L', 'label', 'myimage', 'root_dir', ] ) @patch('kiwi.filesystem.erofs.Command.run') def test_create_on_file_exclude_data(self, mock_command): Defaults.set_platform_name('x86_64') self.erofs.create_on_file('myimage', 'label', ['foo']) mock_command.assert_called_once_with( [ 'mkfs.erofs', '-z', 'zstd,level=21', '-L', 'label', '--exclude-regex=^foo$', 'myimage', 'root_dir', ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/ext2_test.py0000644000000000000000000000334315273675667016143 0ustar00from unittest.mock import patch, call import unittest.mock as mock from kiwi.filesystem.ext2 import FileSystemExt2 class TestFileSystemExt2: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True provider = mock.Mock() provider.get_device = mock.Mock(return_value='/dev/foo') self.ext2 = FileSystemExt2(provider, 'root_dir') self.ext2.setup_mountpoint = mock.Mock(return_value='some-mount-point') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('kiwi.filesystem.ext2.Command.run') def test_create_on_device(self, mock_command): with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': '0'}): self.ext2.create_on_device('label', 100, uuid='uuid') call = mock_command.call_args_list[0] assert mock_command.call_args_list[0] == call( ['mkfs.ext2', '-L', 'label', '-U', 'uuid', '/dev/foo', '100'] ) mock_command.reset_mock() self.ext2.create_on_device('label', 100) assert mock_command.call_args_list[0] == call( [ 'mkfs.ext2', '-L', 'label', '-U', '2453562e-7073-2098-d091-fd7a04dc5434', '/dev/foo', '100', ] ) @patch('kiwi.filesystem.ext2.Command.run') def test_set_uuid(self, mock_command): self.ext2.set_uuid() assert mock_command.call_args_list == [ call(['e2fsck', '-y', '-f', '/dev/foo'], raise_on_error=False), call(['tune2fs', '-f', '-U', 'random', '/dev/foo']), ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/ext3_test.py0000644000000000000000000000334315273675667016144 0ustar00from unittest.mock import patch, call import unittest.mock as mock from kiwi.filesystem.ext3 import FileSystemExt3 class TestFileSystemExt3: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True provider = mock.Mock() provider.get_device = mock.Mock(return_value='/dev/foo') self.ext3 = FileSystemExt3(provider, 'root_dir') self.ext3.setup_mountpoint = mock.Mock(return_value='some-mount-point') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('kiwi.filesystem.ext3.Command.run') def test_create_on_device(self, mock_command): with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': '0'}): self.ext3.create_on_device('label', 100, uuid='uuid') call = mock_command.call_args_list[0] assert mock_command.call_args_list[0] == call( ['mkfs.ext3', '-L', 'label', '-U', 'uuid', '/dev/foo', '100'] ) mock_command.reset_mock() self.ext3.create_on_device('label', 100) assert mock_command.call_args_list[0] == call( [ 'mkfs.ext3', '-L', 'label', '-U', '2453562e-7073-2098-d091-fd7a04dc5434', '/dev/foo', '100', ] ) @patch('kiwi.filesystem.ext3.Command.run') def test_set_uuid(self, mock_command): self.ext3.set_uuid() assert mock_command.call_args_list == [ call(['e2fsck', '-y', '-f', '/dev/foo'], raise_on_error=False), call(['tune2fs', '-f', '-U', 'random', '/dev/foo']), ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/ext4_test.py0000644000000000000000000000334315273675667016145 0ustar00from unittest.mock import patch, call import unittest.mock as mock from kiwi.filesystem.ext4 import FileSystemExt4 class TestFileSystemExt4: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True provider = mock.Mock() provider.get_device = mock.Mock(return_value='/dev/foo') self.ext4 = FileSystemExt4(provider, 'root_dir') self.ext4.setup_mountpoint = mock.Mock(return_value='some-mount-point') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('kiwi.filesystem.ext4.Command.run') def test_create_on_device(self, mock_command): with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': '0'}): self.ext4.create_on_device('label', 100, uuid='uuid') call = mock_command.call_args_list[0] assert mock_command.call_args_list[0] == call( ['mkfs.ext4', '-L', 'label', '-U', 'uuid', '/dev/foo', '100'] ) mock_command.reset_mock() self.ext4.create_on_device('label', 100) assert mock_command.call_args_list[0] == call( [ 'mkfs.ext4', '-L', 'label', '-U', '2453562e-7073-2098-d091-fd7a04dc5434', '/dev/foo', '100', ] ) @patch('kiwi.filesystem.ext4.Command.run') def test_set_uuid(self, mock_command): self.ext4.set_uuid() assert mock_command.call_args_list == [ call(['e2fsck', '-y', '-f', '/dev/foo'], raise_on_error=False), call(['tune2fs', '-f', '-U', 'random', '/dev/foo']), ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/fat16_test.py0000644000000000000000000000367315273675667016210 0ustar00from unittest.mock import patch import unittest.mock as mock from kiwi.filesystem.fat16 import FileSystemFat16 class TestFileSystemFat16: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True provider = mock.Mock() provider.get_device = mock.Mock(return_value='/dev/foo') self.fat16 = FileSystemFat16(provider, 'root_dir') self.fat16.setup_mountpoint = mock.Mock(return_value='some-mount-point') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('kiwi.filesystem.fat16.Command.run') def test_create_on_device(self, mock_command): with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': '0'}): self.fat16.create_on_device( 'label', 100, uuid='12345678-1234-5678-1234-567812345678' ) call = mock_command.call_args_list[0] assert mock_command.call_args_list[0] == call( [ 'mkdosfs', '-F16', '-I', '-n', 'label', '-i', '12345678', '/dev/foo', '100', ] ) mock_command.reset_mock() self.fat16.create_on_device('label', 100) assert mock_command.call_args_list[0] == call( [ 'mkdosfs', '-F16', '-I', '-n', 'label', '-i', '2453562E', '/dev/foo', '100', ] ) @patch('kiwi.filesystem.fat16.Command.run') def test_set_uuid(self, mock_command): self.fat16.set_uuid() mock_command.assert_called_once_with( ['mlabel', '-n', '-i', '/dev/foo', '::'] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/fat32_test.py0000644000000000000000000000367315273675667016206 0ustar00from unittest.mock import patch import unittest.mock as mock from kiwi.filesystem.fat32 import FileSystemFat32 class TestFileSystemFat32: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True provider = mock.Mock() provider.get_device = mock.Mock(return_value='/dev/foo') self.fat32 = FileSystemFat32(provider, 'root_dir') self.fat32.setup_mountpoint = mock.Mock(return_value='some-mount-point') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('kiwi.filesystem.fat32.Command.run') def test_create_on_device(self, mock_command): with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': '0'}): self.fat32.create_on_device( 'label', 100, uuid='12345678-1234-5678-1234-567812345678' ) call = mock_command.call_args_list[0] assert mock_command.call_args_list[0] == call( [ 'mkdosfs', '-F32', '-I', '-n', 'label', '-i', '12345678', '/dev/foo', '100', ] ) mock_command.reset_mock() self.fat32.create_on_device('label', 100) assert mock_command.call_args_list[0] == call( [ 'mkdosfs', '-F32', '-I', '-n', 'label', '-i', '2453562E', '/dev/foo', '100', ] ) @patch('kiwi.filesystem.fat32.Command.run') def test_set_uuid(self, mock_command): self.fat32.set_uuid() mock_command.assert_called_once_with( ['mlabel', '-n', '-i', '/dev/foo', '::'] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/init_test.py0000644000000000000000000000571015273675667016224 0ustar00from unittest.mock import patch from pytest import raises from unittest.mock import Mock from kiwi.filesystem import FileSystem from kiwi.exceptions import KiwiFileSystemSetupError class TestFileSystem: def test_filesystem_not_implemented(self): with raises(KiwiFileSystemSetupError): FileSystem.new('foo', Mock(), 'root_dir') @patch('kiwi.filesystem.ext2.FileSystemExt2') def test_filesystem_ext2(self, mock_ext2): provider = Mock() FileSystem.new('ext2', provider, 'root_dir') mock_ext2.assert_called_once_with(provider, 'root_dir', None) @patch('kiwi.filesystem.ext3.FileSystemExt3') def test_filesystem_ext3(self, mock_ext3): provider = Mock() FileSystem.new('ext3', provider, 'root_dir') mock_ext3.assert_called_once_with(provider, 'root_dir', None) @patch('kiwi.filesystem.ext4.FileSystemExt4') def test_filesystem_ext4(self, mock_ext4): provider = Mock() FileSystem.new('ext4', provider, 'root_dir') mock_ext4.assert_called_once_with(provider, 'root_dir', None) @patch('kiwi.filesystem.xfs.FileSystemXfs') def test_filesystem_xfs(self, mock_xfs): provider = Mock() FileSystem.new('xfs', provider, 'root_dir') mock_xfs.assert_called_once_with(provider, 'root_dir', None) @patch('kiwi.filesystem.btrfs.FileSystemBtrfs') def test_filesystem_btrfs(self, mock_btrfs): provider = Mock() FileSystem.new('btrfs', provider, 'root_dir') mock_btrfs.assert_called_once_with(provider, 'root_dir', None) @patch('kiwi.filesystem.fat16.FileSystemFat16') def test_filesystem_fat16(self, mock_fat16): provider = Mock() FileSystem.new('fat16', provider, 'root_dir') mock_fat16.assert_called_once_with(provider, 'root_dir', None) @patch('kiwi.filesystem.fat32.FileSystemFat32') def test_filesystem_fat32(self, mock_fat32): provider = Mock() FileSystem.new('fat32', provider, 'root_dir') mock_fat32.assert_called_once_with(provider, 'root_dir', None) @patch('kiwi.filesystem.squashfs.FileSystemSquashFs') def test_filesystem_squashfs(self, mock_squashfs): provider = Mock() FileSystem.new('squashfs', provider, 'root_dir') mock_squashfs.assert_called_once_with(provider, 'root_dir', None) @patch('kiwi.filesystem.swap.FileSystemSwap') def test_filesystem_swap(self, mock_swap): provider = Mock() FileSystem.new('swap', provider) mock_swap.assert_called_once_with(provider, None, None) def test_sparse_install_mount_options(self): assert FileSystem.sparse_install_mount_options('xfs') == [ 'allocsize=4k' ] def test_sparse_install_mount_options_not_declared(self): assert FileSystem.sparse_install_mount_options('ext3') == [] def test_sparse_install_mount_options_not_implemented(self): assert FileSystem.sparse_install_mount_options('foo') == [] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/isofs_test.py0000644000000000000000000000416115273675667016403 0ustar00import logging from pytest import fixture from unittest.mock import patch import unittest.mock as mock from kiwi.filesystem.isofs import FileSystemIsoFs class TestFileSystemIsoFs: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True self.isofs = FileSystemIsoFs(mock.Mock(), 'root_dir') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() def test_post_init(self): self.isofs.post_init({'some_args': 'data'}) assert self.isofs.custom_args['meta_data'] == {} assert self.isofs.custom_args['mount_options'] == [] assert self.isofs.custom_args['some_args'] == 'data' @patch('kiwi.filesystem.isofs.IsoTools') def test_create_on_file(self, mock_IsoTools): iso_tool = mock.Mock() iso_tool.has_iso_hybrid_capability = mock.Mock(return_value=True) iso_tool.get_tool_name = mock.Mock(return_value='/usr/bin/xorriso') mock_IsoTools.new.return_value = iso_tool self.isofs.create_on_file('myimage', None) iso_tool.init_iso_creation_parameters.assert_called_once_with({}) iso_tool.create_iso.assert_called_once_with('myimage') @patch('kiwi.filesystem.isofs.IsoTools') def test_create_on_file_EFI_enabled(self, mock_IsoTools): iso_tool = mock.Mock() iso_tool.has_iso_hybrid_capability = mock.Mock(return_value=True) iso_tool.get_tool_name = mock.Mock(return_value='/usr/bin/xorriso') mock_IsoTools.new.return_value = iso_tool self.isofs.custom_args['meta_data']['efi_mode'] = 'uefi' self.isofs.custom_args['meta_data']['efi_loader'] = 'esp-image-file' with self._caplog.at_level(logging.WARNING): self.isofs.create_on_file('myimage') iso_tool.create_iso.assert_called_once_with('myimage') iso_tool.add_efi_loader_parameters.assert_called_once_with( 'esp-image-file', {'efi_mode': 'uefi', 'efi_loader': 'esp-image-file'}, ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/setup_test.py0000644000000000000000000000401215273675667016413 0ustar00import logging from unittest.mock import patch from pytest import fixture import unittest.mock as mock from kiwi.filesystem.setup import FileSystemSetup class TestFileSystemSetup: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.filesystem.setup.SystemSize') def setup(self, mock_size): size = mock.Mock() size.accumulate_mbyte_file_sizes = mock.Mock(return_value=42) size.customize = mock.Mock(return_value=42) mock_size.return_value = size self.xml_state = mock.Mock() self.xml_state.get_build_type_name = mock.Mock(return_value='ext4') self.xml_state.get_build_type_unpartitioned_bytes = mock.Mock( return_value=0 ) self.setup = FileSystemSetup(self.xml_state, 'root_dir') @patch('kiwi.filesystem.setup.SystemSize') def setup_method(self, cls, mock_size): self.setup() def test_init_with_unpartitioned(self): self.xml_state.get_build_type_unpartitioned_bytes = mock.Mock( return_value=1024 ) FileSystemSetup(self.xml_state, 'root_dir') def test_setup_with_pxe_type(self): self.xml_state.get_build_type_name = mock.Mock(return_value='pxe') self.xml_state.build_type.get_filesystem = mock.Mock(return_value='xfs') setup = FileSystemSetup(self.xml_state, 'root_dir') assert setup.requested_filesystem == 'xfs' def test_get_size_mbytes_calculated(self): self.setup.configured_size = None assert self.setup.get_size_mbytes() == 42 def test_get_size_mbytes_configured_additive(self): self.setup.configured_size.mbytes = 20 self.setup.configured_size.additive = True assert self.setup.get_size_mbytes() == 62 def test_get_size_mbytes_configured(self): self.setup.configured_size.mbytes = 3 self.setup.configured_size.additive = False with self._caplog.at_level(logging.WARNING): assert self.setup.get_size_mbytes() == 3 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/squashfs_test.py0000644000000000000000000000642415273675667017121 0ustar00from unittest.mock import patch import unittest.mock as mock from kiwi.defaults import Defaults from kiwi.filesystem.squashfs import FileSystemSquashFs class TestFileSystemSquashfs: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True self.squashfs = FileSystemSquashFs(mock.Mock(), 'root_dir') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('kiwi.filesystem.squashfs.Command.run') def test_create_on_file(self, mock_command): Defaults.set_platform_name('x86_64') self.squashfs.create_on_file('myimage', 'label') mock_command.assert_called_once_with( [ 'mksquashfs', 'root_dir', 'myimage', '-noappend', '-b', '1M', '-comp', 'xz', '-Xbcj', 'x86', ] ) @patch('kiwi.filesystem.squashfs.Command.run') def test_create_on_file_exclude_data(self, mock_command): Defaults.set_platform_name('ppc64le') self.squashfs.create_on_file('myimage', 'label', ['foo']) mock_command.assert_called_once_with( [ 'mksquashfs', 'root_dir', 'myimage', '-noappend', '-b', '1M', '-comp', 'xz', '-Xbcj', 'powerpc', '-wildcards', '-e', 'foo', ] ) @patch('kiwi.filesystem.squashfs.Command.run') def test_create_on_file_unkown_arch(self, mock_command): Defaults.set_platform_name('aarch64') self.squashfs.create_on_file('myimage', 'label') mock_command.assert_called_once_with( [ 'mksquashfs', 'root_dir', 'myimage', '-noappend', '-b', '1M', '-comp', 'xz', ] ) @patch('kiwi.filesystem.squashfs.Command.run') def test_create_on_file_gzip(self, mock_command): self.squashfs.custom_args = { 'compression': 'gzip', 'create_options': [], } self.squashfs.create_on_file('myimage', 'label') mock_command.assert_called_once_with( [ 'mksquashfs', 'root_dir', 'myimage', '-noappend', '-b', '1M', '-comp', 'gzip', ] ) @patch('kiwi.filesystem.squashfs.Command.run') def test_create_on_file_no_compression(self, mock_command): self.squashfs.custom_args = { 'compression': 'uncompressed', 'create_options': [], } self.squashfs.create_on_file('myimage', 'label') mock_command.assert_called_once_with( [ 'mksquashfs', 'root_dir', 'myimage', '-noappend', '-b', '1M', '-noI', '-noD', '-noF', '-noX', ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/swap_test.py0000644000000000000000000000155415273675667016235 0ustar00from unittest.mock import patch import unittest.mock as mock from kiwi.filesystem.swap import FileSystemSwap class TestFileSystemSwap: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True provider = mock.Mock() provider.get_device = mock.Mock(return_value='/dev/foo') self.swap = FileSystemSwap(provider, 'root_dir') self.swap.setup_mountpoint = mock.Mock(return_value='some-mount-point') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('kiwi.filesystem.swap.Command.run') def test_create_on_device(self, mock_command): self.swap.create_on_device('label') call = mock_command.call_args_list[0] assert mock_command.call_args_list[0] == call( ['mkswap', '-L', 'label', '/dev/foo'] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/filesystem/xfs_test.py0000644000000000000000000000373115273675667016062 0ustar00from unittest.mock import patch, call import unittest.mock as mock from kiwi.filesystem.xfs import FileSystemXfs class TestFileSystemXfs: @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True provider = mock.Mock() provider.get_device = mock.Mock(return_value='/dev/foo') self.xfs = FileSystemXfs(provider, 'root_dir') self.xfs.setup_mountpoint = mock.Mock(return_value='some-mount-point') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() @patch('kiwi.filesystem.xfs.Command.run') def test_create_on_device(self, mock_command): with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': '0'}): self.xfs.create_on_device('label', 100, uuid='uuid') call = mock_command.call_args_list[0] assert mock_command.call_args_list[0] == call( [ 'mkfs.xfs', '-f', '-L', 'label', '-m', 'uuid=uuid', '-d', 'size=100k', '/dev/foo', ] ) mock_command.reset_mock() self.xfs.create_on_device('label', 100) assert mock_command.call_args_list[0] == call( [ 'mkfs.xfs', '-f', '-L', 'label', '-m', 'uuid=2453562e-7073-2098-d091-fd7a04dc5434', '-d', 'size=100k', '/dev/foo', ] ) @patch('kiwi.filesystem.xfs.Command.run') def test_set_uuid(self, mock_command): self.xfs.set_uuid() assert mock_command.call_args_list == [ call(['xfs_repair', '-L', '/dev/foo']), call(['xfs_admin', '-U', 'generate', '/dev/foo']), ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/firmware_test.py0000644000000000000000000001135315273675667014711 0ustar00from pytest import raises import unittest.mock as mock from kiwi.firmware import FirmWare from kiwi.defaults import Defaults from kiwi.exceptions import KiwiNotImplementedError class TestFirmWare: def setup(self): Defaults.set_platform_name('x86_64') xml_state = mock.Mock() xml_state.build_type.get_firmware = mock.Mock() xml_state.build_type.get_firmware.return_value = 'bios' self.firmware_bios = FirmWare(xml_state) xml_state.build_type.get_efiparttable.return_value = None xml_state.build_type.get_efipartsize.return_value = None xml_state.build_type.get_firmware.return_value = 'efi' self.firmware_efi = FirmWare(xml_state) xml_state.build_type.get_efiparttable.return_value = 'msdos' xml_state.build_type.get_efipartsize.return_value = None xml_state.build_type.get_firmware.return_value = 'efi' self.firmware_efi_mbr = FirmWare(xml_state) xml_state.build_type.get_efipartsize.return_value = 42 self.firmware_efi_custom_efi_part = FirmWare(xml_state) xml_state.build_type.get_firmware.return_value = 'ec2' self.firmware_ec2 = FirmWare(xml_state) Defaults.set_platform_name('s390x') xml_state.build_type.get_firmware.return_value = None xml_state.get_build_type_bootloader_targettype = mock.Mock() xml_state.get_build_type_bootloader_targettype.return_value = 'CDL' self.firmware_s390_cdl = FirmWare(xml_state) xml_state.get_build_type_bootloader_targettype.return_value = 'GPT' self.firmware_s390_gpt = FirmWare(xml_state) xml_state.get_build_type_bootloader_targettype.return_value = 'SCSI' self.firmware_s390_scsi = FirmWare(xml_state) Defaults.set_platform_name('ppc64le') xml_state.build_type.get_firmware.return_value = 'ofw' self.firmware_ofw = FirmWare(xml_state) xml_state.build_type.get_firmware.return_value = 'opal' self.firmware_opal = FirmWare(xml_state) Defaults.set_platform_name('x86_64') def setup_method(self, cls): self.setup() def test_firmware_unsupported(self): xml_state = mock.Mock() xml_state.build_type.get_firmware = mock.Mock(return_value='bogus') with raises(KiwiNotImplementedError): FirmWare(xml_state) def test_get_partition_table_type(self): assert self.firmware_bios.get_partition_table_type() == 'msdos' assert self.firmware_efi.get_partition_table_type() == 'gpt' assert self.firmware_efi_mbr.get_partition_table_type() == 'msdos' assert self.firmware_s390_cdl.get_partition_table_type() == 'dasd' assert self.firmware_s390_scsi.get_partition_table_type() == 'msdos' assert self.firmware_s390_gpt.get_partition_table_type() == 'gpt' def test_get_partition_table_type_ppc_ofw_mode(self): assert self.firmware_ofw.get_partition_table_type() == 'gpt' def test_get_partition_table_type_ppc_opal_mode(self): assert self.firmware_opal.get_partition_table_type() == 'gpt' def test_legacy_bios_mode(self): assert self.firmware_bios.legacy_bios_mode() is True assert self.firmware_efi.legacy_bios_mode() is True def test_legacy_bios_mode_non_x86_platform(self): self.firmware_efi.arch = 'arm64' assert self.firmware_efi.legacy_bios_mode() is False self.firmware_bios.arch = 'arm64' assert self.firmware_bios.legacy_bios_mode() is False assert self.firmware_s390_cdl.legacy_bios_mode() is False def test_ec2_mode(self): assert self.firmware_ec2.ec2_mode() == 'ec2' assert self.firmware_bios.ec2_mode() is None def test_efi_mode(self): assert self.firmware_bios.efi_mode() == '' assert self.firmware_efi.efi_mode() == 'efi' def test_bios_mode(self): assert self.firmware_bios.bios_mode() is True assert self.firmware_efi.bios_mode() is False def test_ofw_mode(self): assert self.firmware_ofw.ofw_mode() is True assert self.firmware_bios.ofw_mode() is False def test_opal_mode(self): assert self.firmware_opal.opal_mode() is True assert self.firmware_bios.opal_mode() is False def test_get_legacy_bios_partition_size(self): assert self.firmware_bios.get_legacy_bios_partition_size() == 0 assert self.firmware_efi.get_legacy_bios_partition_size() == 2 def test_get_efi_partition_size(self): assert self.firmware_bios.get_efi_partition_size() == 0 assert self.firmware_efi.get_efi_partition_size() == 20 assert self.firmware_efi_custom_efi_part.get_efi_partition_size() == 42 def test_get_prep_partition_size(self): assert self.firmware_ofw.get_prep_partition_size() == 8 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/help_test.py0000644000000000000000000000103515273675667014021 0ustar00from unittest.mock import patch from pytest import raises from kiwi.help import Help from kiwi.exceptions import KiwiHelpNoCommandGiven class TestHelp: def setup(self): self.help = Help() def setup_method(self, cls): self.setup() def test_show(self): with raises(KiwiHelpNoCommandGiven): self.help.show(None) @patch('subprocess.call') def test_show_command(self, mock_process): self.help.show('foo') mock_process.assert_called_once_with('man 8 foo', shell=True) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7658103 kiwi-11.1.8/test/unit/iso_tools/__init__.py0000644000000000000000000000000015273675667015572 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7664025 kiwi-11.1.8/test/unit/iso_tools/base_test.py0000644000000000000000000000636615273675667016031 0ustar00from unittest.mock import patch, Mock, call from pytest import raises from kiwi.defaults import Defaults from kiwi.iso_tools.base import IsoToolsBase class TestIsoToolsBase: def setup(self): Defaults.set_platform_name('x86_64') self.iso_tool = IsoToolsBase('source-dir') def setup_method(self, cls): self.setup() def test_create_iso(self): with raises(NotImplementedError): self.iso_tool.create_iso('filename') def test_list_iso(self): with raises(NotImplementedError): self.iso_tool.list_iso('isofile') def test_get_tool_name(self): with raises(NotImplementedError): self.iso_tool.get_tool_name() def test_init_iso_creation_parameters(self): with raises(NotImplementedError): self.iso_tool.init_iso_creation_parameters() def test_add_efi_loader_parameters(self): with raises(NotImplementedError): self.iso_tool.add_efi_loader_parameters('loader_file') def test_has_iso_hybrid_capability(self): with raises(NotImplementedError): self.iso_tool.has_iso_hybrid_capability() @patch('kiwi.iso_tools.base.DataSync') @patch('kiwi.iso_tools.base.shutil') @patch('kiwi.iso_tools.base.Command.run') @patch('kiwi.iso_tools.base.Path') @patch('os.path.exists') def test_setup_media_loader_directory( self, mock_exists, mock_Path, mock_command, mock_shutil, mock_sync ): mock_exists.return_value = True data = Mock() mock_sync.return_value = data self.iso_tool.setup_media_loader_directory( 'root_dir', 'media_dir', 'openSUSE' ) assert mock_shutil.copy.call_args_list == [ call( 'root_dir/usr/share/grub2/i386-pc/eltorito.img', 'root_dir/image/loader/', ), call( 'root_dir/usr/share/grub2/i386-pc/boot_hybrid.img', 'root_dir/image/loader/', ), ] assert mock_command.call_args_list == [ call( command=[ 'bash', '-c', 'cp root_dir/boot/memtest* ' 'root_dir/image/loader//memtest', ], raise_on_error=False, ), call( [ 'bash', '-c', 'cp root_dir/etc/bootsplash/themes/openSUSE/' 'cdrom/* root_dir/image/loader/', ] ), call( [ 'gfxboot', '--config-file', 'root_dir/image/loader//gfxboot.cfg', '--change-config', 'install::autodown=0', ] ), call( [ 'cp', 'root_dir/etc/bootsplash/themes/openSUSE/' 'bootloader/message', 'root_dir/image/loader/', ] ), ] mock_sync.assert_called_once_with( 'root_dir/image/loader/', 'media_dir/boot/x86_64/loader' ) data.sync_data.assert_called_once_with(options=['-a']) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7664025 kiwi-11.1.8/test/unit/iso_tools/init_test.py0000644000000000000000000000211415273675667016045 0ustar00from pytest import raises from unittest.mock import patch import unittest.mock as mock from kiwi.iso_tools import IsoTools from kiwi.exceptions import KiwiIsoToolError class TestIsoTools: def setup(self): self.runtime_config = mock.Mock() self.runtime_config.get_iso_tool_category = mock.Mock() def setup_method(self, cls): self.setup() @patch('kiwi.iso_tools.xorriso.IsoToolsXorrIso') @patch('kiwi.iso_tools.RuntimeConfig') def test_iso_tools_xorriso(self, mock_RuntimeConfig, mock_IsoToolsXorrIso): self.runtime_config.get_iso_tool_category.return_value = 'xorriso' mock_RuntimeConfig.return_value = self.runtime_config IsoTools.new('root-dir') mock_IsoToolsXorrIso.assert_called_once_with('root-dir') @patch('kiwi.iso_tools.RuntimeConfig') def test_iso_tools_unsupported(self, mock_RuntimeConfig): self.runtime_config.get_iso_tool_category.return_value = 'foo' mock_RuntimeConfig.return_value = self.runtime_config with raises(KiwiIsoToolError): IsoTools.new('root_dir') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7664025 kiwi-11.1.8/test/unit/iso_tools/iso_test.py0000644000000000000000000000235115273675667015677 0ustar00from unittest.mock import patch, Mock from kiwi.defaults import Defaults from kiwi.iso_tools.iso import Iso class TestIso: def setup(self): Defaults.set_platform_name('x86_64') self.iso = Iso('source-dir') def setup_method(self, cls): self.setup() @patch('kiwi.iso_tools.iso.Command.run') @patch('kiwi.iso_tools.iso.RuntimeConfig') def test_set_media_tag_checkmedia(self, mock_RuntimeConfig, mock_command): runtime_config = Mock() runtime_config.get_iso_media_tag_tool.return_value = 'checkmedia' mock_RuntimeConfig.return_value = runtime_config Iso.set_media_tag('foo') mock_command.assert_called_once_with( ['tagmedia', '--digest', 'sha256', '--check', '--pad', '0', 'foo'] ) @patch('kiwi.iso_tools.iso.Command.run') @patch('kiwi.iso_tools.iso.RuntimeConfig') def test_set_media_tag_isomd5sum(self, mock_RuntimeConfig, mock_command): runtime_config = Mock() runtime_config.get_iso_media_tag_tool.return_value = 'isomd5sum' mock_RuntimeConfig.return_value = runtime_config Iso.set_media_tag('foo') mock_command.assert_called_once_with( ['implantisomd5', '--force', 'foo'] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7664025 kiwi-11.1.8/test/unit/iso_tools/xorriso_test.py0000644000000000000000000002132415273675667016613 0ustar00import logging from unittest.mock import patch, call from pytest import raises, fixture from kiwi.defaults import Defaults from kiwi.iso_tools.xorriso import IsoToolsXorrIso from kiwi.exceptions import KiwiIsoToolError class TestIsoToolsXorrIso: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): Defaults.set_platform_name('x86_64') self.iso_tool = IsoToolsXorrIso('source-dir') def setup_method(self, cls): self.setup() @patch('kiwi.iso_tools.xorriso.Path.which') def test_get_tool_name(self, mock_which): mock_which.return_value = 'tool_found' assert self.iso_tool.get_tool_name() == 'tool_found' @patch('os.path.exists') def test_get_tool_name_raises(self, mock_exists): mock_exists.return_value = False with raises(KiwiIsoToolError): self.iso_tool.get_tool_name() @patch('os.path.exists') def test_init_iso_creation_parameters_no_hybrid_mbr( self, mock_os_path_exists ): mock_os_path_exists.return_value = False with self._caplog.at_level(logging.WARNING): self.iso_tool.init_iso_creation_parameters( { 'mbr_id': 'app_id', 'publisher': 'org', 'preparer': 'preparer', 'volume_id': 'vol_id', 'efi_mode': 'uefi', 'legacy_bios_mode': True, } ) assert 'No hybrid MBR file found' in self._caplog.text @patch('os.path.exists') def test_init_iso_creation_parameters_ppc(self, mock_os_path_exists): mock_os_path_exists.return_value = True self.iso_tool.arch = 'ppc64le' self.iso_tool.init_iso_creation_parameters( { 'mbr_id': 'app_id', 'publisher': 'org', 'preparer': 'preparer', 'volume_id': 'vol_id', 'efi_mode': 'ofw', 'legacy_bios_mode': False, } ) assert self.iso_tool.iso_parameters == [ '-application_id', 'app_id', '-publisher', 'org', '-preparer_id', 'preparer', '-volid', 'vol_id', '-joliet', 'on', '-padding', '0', '-compliance', 'untranslated_names', ] @patch('os.path.exists') def test_init_iso_creation_parameters_efi(self, mock_os_path_exists): mock_os_path_exists.return_value = True self.iso_tool.init_iso_creation_parameters( { 'mbr_id': 'app_id', 'publisher': 'org', 'preparer': 'preparer', 'volume_id': 'vol_id', 'efi_mode': 'uefi', 'legacy_bios_mode': True, } ) assert self.iso_tool.iso_parameters == [ '-application_id', 'app_id', '-publisher', 'org', '-preparer_id', 'preparer', '-volid', 'vol_id', '-joliet', 'on', '-padding', '0', '-compliance', 'no_emul_toc', ] assert self.iso_tool.iso_loaders == [ '-boot_image', 'grub', 'bin_path=boot/x86_64/loader/eltorito.img', '-boot_image', 'grub', 'grub2_mbr=source-dir/boot/x86_64/loader/boot_hybrid.img', '-boot_image', 'grub', 'grub2_boot_info=on', '-boot_image', 'any', 'partition_offset=16', '-boot_image', 'any', 'cat_path=boot/x86_64/boot.catalog', '-boot_image', 'any', 'cat_hidden=on', '-boot_image', 'any', 'boot_info_table=on', '-boot_image', 'any', 'platform_id=0x00', '-boot_image', 'any', 'emul_type=no_emulation', '-boot_image', 'any', 'load_size=2048', ] @patch('os.path.exists') def test_init_iso_creation_parameters_efi_custom_app_id( self, mock_os_path_exists ): mock_os_path_exists.return_value = True self.iso_tool.init_iso_creation_parameters( { 'mbr_id': 'app_id', 'application_id': 'some_other_app_id', 'publisher': 'org', 'preparer': 'preparer', 'volume_id': 'vol_id', 'efi_mode': 'uefi', 'legacy_bios_mode': True, } ) assert self.iso_tool.iso_parameters == [ '-application_id', 'some_other_app_id', '-publisher', 'org', '-preparer_id', 'preparer', '-volid', 'vol_id', '-joliet', 'on', '-padding', '0', '-compliance', 'no_emul_toc', ] def test_add_efi_loader_parameters(self): self.iso_tool.add_efi_loader_parameters('target_dir/efi-loader') assert self.iso_tool.iso_loaders == [ '-append_partition', '2', '0xef', 'target_dir/efi-loader', '-boot_image', 'any', 'next', '-boot_image', 'any', 'efi_path=--interval:appended_partition_2:all::', '-boot_image', 'any', 'platform_id=0xef', '-boot_image', 'any', 'emul_type=no_emulation', ] def test_add_efi_loader_parameters_gpt(self): self.iso_tool.add_efi_loader_parameters( 'target_dir/efi-loader', {'efi_partition_table': 'gpt'} ) assert self.iso_tool.iso_loaders == [ '-boot_image', 'any', 'appended_part_as=gpt', '-append_partition', '2', '0xef', 'target_dir/efi-loader', '-boot_image', 'any', 'next', '-boot_image', 'any', 'efi_path=--interval:appended_partition_2:all::', '-boot_image', 'any', 'platform_id=0xef', '-boot_image', 'any', 'emul_type=no_emulation', ] def test_add_efi_loader_parameters_gpt_hybrid(self): self.iso_tool.add_efi_loader_parameters( 'target_dir/efi-loader', { 'efi_partition_table': 'gpt', 'legacy_bios_mode': True, 'gpt_hybrid_mbr': True, }, ) assert self.iso_tool.iso_loaders == [ '-boot_image', 'any', 'appended_part_as=gpt', '-boot_image', 'any', 'mbr_force_bootable=on', '-append_partition', '2', '0xef', 'target_dir/efi-loader', '-boot_image', 'any', 'next', '-boot_image', 'any', 'efi_path=--interval:appended_partition_2:all::', '-boot_image', 'any', 'platform_id=0xef', '-boot_image', 'any', 'emul_type=no_emulation', ] @patch('kiwi.iso_tools.xorriso.Command.run') @patch('kiwi.iso_tools.xorriso.Path.wipe') @patch('kiwi.iso_tools.xorriso.Path.which') def test_create_iso(self, mock_which, mock_wipe, mock_command): mock_which.return_value = '/usr/bin/xorriso' self.iso_tool.create_iso('myiso', hidden_files=['hide_me']) mock_wipe.assert_called_once_with('myiso') assert mock_command.call_args_list == [ call( [ '/usr/bin/xorriso', '-outdev', 'myiso', '-map', 'source-dir', '/', '-chmod', '0755', '/', '--', '--', '-find', 'hide_me', '-exec', 'hide', 'on', ] ), call( [ '/usr/bin/xorriso', '-indev', 'myiso', '-report_system_area', 'plain', ] ), ] def test_has_iso_hybrid_capability(self): assert self.iso_tool.has_iso_hybrid_capability() is True ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7664025 kiwi-11.1.8/test/unit/logger_color_formatter_test.py0000644000000000000000000000117315273675667017634 0ustar00from unittest.mock import patch from collections import namedtuple from kiwi.logger_color_formatter import ColorFormatter class TestColorFormatter: def setup(self): self.color_formatter = ColorFormatter('%(levelname)s: %(message)s') def setup_method(self, cls): self.setup() @patch('logging.Formatter.format') def test_format(self, mock_format): MyRecord = namedtuple('MyRecord', 'levelname') record = MyRecord(levelname='INFO') mock_format.return_value = 'message' self.color_formatter.format(record) assert 'message' in self.color_formatter.format(record) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7664025 kiwi-11.1.8/test/unit/logger_filter_test.py0000644000000000000000000000366415273675667015727 0ustar00from collections import namedtuple import logging from kiwi.logger_filter import ( LoggerSchedulerFilter, InfoFilter, DebugFilter, ErrorFilter, WarningFilter, ) class TestLoggerSchedulerFilter: def setup(self): self.scheduler_filter = LoggerSchedulerFilter() def setup_method(self, cls): self.setup() def test_filter(self): MyRecord = namedtuple('MyRecord', 'name') ignorables = ['apscheduler.scheduler', 'apscheduler.executors.default'] for ignorable in ignorables: record = MyRecord(name=ignorable) assert self.scheduler_filter.filter(record) is False class TestInfoFilter: def setup(self): self.info_filter = InfoFilter() def setup_method(self, cls): self.setup() def test_filter(self): MyRecord = namedtuple('MyRecord', 'levelno') record = MyRecord(levelno=logging.INFO) assert self.info_filter.filter(record) is True class TestDebugFilter: def setup(self): self.debug_filter = DebugFilter() def setup_method(self, cls): self.setup() def test_filter(self): MyRecord = namedtuple('MyRecord', 'levelno') record = MyRecord(levelno=logging.DEBUG) assert self.debug_filter.filter(record) is True class TestErrorFilter: def setup(self): self.error_filter = ErrorFilter() def setup_method(self, cls): self.setup() def test_filter(self): MyRecord = namedtuple('MyRecord', 'levelno') record = MyRecord(levelno=logging.ERROR) assert self.error_filter.filter(record) is True class TestWarningFilter: def setup(self): self.error_filter = WarningFilter() def setup_method(self, cls): self.setup() def test_filter(self): MyRecord = namedtuple('MyRecord', 'levelno') record = MyRecord(levelno=logging.WARNING) assert self.error_filter.filter(record) is True ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7664025 kiwi-11.1.8/test/unit/logger_socket_test.py0000644000000000000000000000072515273675667015725 0ustar00from unittest.mock import Mock from kiwi.logger_socket import PlainTextSocketHandler class TestPlainTextSocketHandler: def setup(self): self.logger_socket = PlainTextSocketHandler('socket', None) self.logger_socket.formatter = Mock() def setup_method(self, cls): self.setup() def test_makePickle(self): self.logger_socket.makePickle('record') self.logger_socket.formatter.format.assert_called_once_with('record') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7664025 kiwi-11.1.8/test/unit/logger_test.py0000644000000000000000000000737315273675667014363 0ustar00import sys from unittest.mock import patch, call, Mock from pytest import raises from kiwi.logger import Logger from kiwi.exceptions import KiwiLogFileSetupFailed, KiwiLogSocketSetupFailed class TestLogger: def setup(self): self.log = Logger('kiwi') def setup_method(self, cls): self.setup() @patch('sys.stdout') def test_progress(self, mock_stdout): self.log.progress(50, 100, 'foo') mock_stdout.write.assert_called_once_with( '\rfoo: [#################### ] 50%' ) mock_stdout.flush.assert_called_once_with() def test_progress_raise(self): assert self.log.progress(50, 0, 'foo') is None @patch('logging.FileHandler') def test_set_logfile(self, mock_file_handler): self.log.set_logfile('logfile') mock_file_handler.assert_called_once_with( filename='logfile', encoding='utf-8' ) assert self.log.get_logfile() == 'logfile' @patch('kiwi.logger.PlainTextSocketHandler') def test_set_log_socket(self, mock_socket_handler): self.log.set_log_socket('socketfile') mock_socket_handler.assert_called_once_with('socketfile', None) @patch('logging.StreamHandler') def test_set_logfile_to_stdout(self, mock_stream_handler): self.log.set_logfile('stdout') mock_stream_handler.assert_called_once_with(sys.__stdout__) assert self.log.get_logfile() is None @patch('kiwi.logger.ColorFormatter') def test_set_color_format(self, mock_color_format): self.log.set_color_format() assert sorted(mock_color_format.call_args_list) == [ call( '$COLOR[ %(levelname)-8s]: %(asctime)-8s | %(message)s', '%H:%M:%S', ), call( '$COLOR[ %(levelname)-8s]: %(asctime)-8s | %(message)s', '%H:%M:%S', ), call( '$LIGHTCOLOR[ %(levelname)-8s]: %(asctime)-8s | %(message)s', '%H:%M:%S', ), ] @patch('logging.FileHandler') def test_set_logfile_raise(self, mock_file_handler): mock_file_handler.side_effect = KiwiLogFileSetupFailed with raises(KiwiLogFileSetupFailed): self.log.set_logfile('logfile') @patch('kiwi.logger.PlainTextSocketHandler') def test_set_log_socket_raise(self, mock_socket_handler): mock_socket_handler.side_effect = KiwiLogSocketSetupFailed with raises(KiwiLogSocketSetupFailed): self.log.set_log_socket('socketfile') def test_getLogLevel(self): self.log.setLogLevel(42) assert self.log.getLogLevel() == 42 def test_setLogLevel(self): handler_one = Mock() handler_two = Mock() self.log.log_handlers = { 'handler_one': handler_one, 'handler_two': handler_two, } self.log.setLogLevel(10, except_for=['handler_one']) assert not handler_one.setLevel.called handler_two.setLevel.assert_called_once_with(10) handler_one.reset_mock() handler_two.reset_mock() self.log.setLogLevel(10, only_for=['handler_one']) assert not handler_two.setLevel.called handler_one.setLevel.assert_called_once_with(10) handler_one.reset_mock() handler_two.reset_mock() self.log.setLogLevel( 10, except_for=['handler_one'], only_for=['handler_one'] ) assert not handler_two.setLevel.called handler_one.setLevel.assert_called_once_with(10) def test_getLogFlags(self): assert self.log.getLogFlags().get('run-scripts-in-screen') is None self.log.setLogFlag('run-scripts-in-screen') assert self.log.getLogFlags().get('run-scripts-in-screen') is True ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7664025 kiwi-11.1.8/test/unit/markup/__init__.py0000644000000000000000000000000015273675667015057 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7667167 kiwi-11.1.8/test/unit/markup/any_test.py0000644000000000000000000000222115273675667015155 0ustar00from unittest.mock import patch from pytest import raises from kiwi.markup.any import MarkupAny from kiwi.exceptions import KiwiDescriptionInvalid, KiwiAnyMarkupPluginError class TestMarkupXML: def setup(self): self.markup = MarkupAny('../data/example_config.xml') def setup_method(self, cls): self.setup() @patch('anymarkup_core.parse_file') def test_raises_markup_conversion_error(self, mock_anymarkup_parse_file): mock_anymarkup_parse_file.side_effect = Exception with raises(KiwiDescriptionInvalid): MarkupAny('../data/example_config.xml') @patch('importlib.import_module') def test_raises_anymarkup_not_available(self, mock_importlib): mock_importlib.side_effect = Exception with raises(KiwiAnyMarkupPluginError): MarkupAny('../data/example_config.xml') def test_get_xml_description(self): assert 'xslt-' in self.markup.get_xml_description() def test_get_yaml_description(self): assert 'xslt-' in self.markup.get_yaml_description() def test_get_toml_description(self): assert 'xslt-' in self.markup.get_toml_description() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7667167 kiwi-11.1.8/test/unit/markup/base_test.py0000644000000000000000000000546415273675667015314 0ustar00from lxml import etree from unittest.mock import patch from pytest import raises from kiwi.markup.base import MarkupBase from kiwi.xml_description import XMLDescription from kiwi.xml_state import XMLState from kiwi.exceptions import ( KiwiConfigFileFormatNotSupported, KiwiDescriptionInvalid, KiwiIncludFileNotFoundError, ) class TestMarkupBase: def setup(self): self.markup = MarkupBase('../data/example_config.xml') def setup_method(self, cls): self.setup() def test_get_xml_description(self): with raises(NotImplementedError): self.markup.get_xml_description() def test_get_yaml_description(self): with raises(NotImplementedError): self.markup.get_yaml_description() def test_get_toml_description(self): with raises(NotImplementedError): self.markup.get_toml_description() def test_apply_xslt_stylesheets(self): assert 'xslt-' in self.markup.apply_xslt_stylesheets( '../data/example_config.xml' ) @patch('kiwi.markup.base.etree.parse') def test_apply_xslt_stylesheets_nonXML(self, mock_parse): mock_parse.side_effect = etree.XMLSyntaxError('not-XML', '<', 1, 1) with raises(KiwiConfigFileFormatNotSupported): self.markup.apply_xslt_stylesheets( 'artificial_and_invalid_XML_markup' ) def test_apply_xslt_stylesheets_broken_XML(self): markup = MarkupBase('../data/example_include_config.xml') with raises(KiwiDescriptionInvalid): markup.apply_xslt_stylesheets('../data/example_include_config.xml') def test_apply_xslt_stylesheets_deprecated(self): markup = MarkupBase('../data/example_deprecated_schema.xml') with raises(KiwiDescriptionInvalid): markup.apply_xslt_stylesheets( '../data/example_deprecated_schema.xml' ) def test_apply_xslt_stylesheets_missing_include_reference(self): markup = MarkupBase( '../data/example_include_config_missing_reference.xml' ) with raises(KiwiIncludFileNotFoundError): markup.apply_xslt_stylesheets( '../data/example_include_config_missing_reference.xml' ) def test_apply_xslt_stylesheets_include_from_image_description_dir(self): markup = MarkupBase( '../data/example_include_config_from_description_dir.xml' ) xml_description = markup.apply_xslt_stylesheets( '../data/example_include_config_from_description_dir.xml' ) description = XMLDescription(xml_description) xml_data = description.load() state = XMLState(xml_data) assert ( state.xml_data.get_repository()[0].get_source().get_path() == 'http://example.com' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7667167 kiwi-11.1.8/test/unit/markup/markup_test.py0000644000000000000000000000117315273675667015672 0ustar00from unittest.mock import patch from kiwi.markup import Markup from kiwi.exceptions import KiwiAnyMarkupPluginError class TestMarkup: @patch('kiwi.markup.any.MarkupAny') def test_MarkupAny(self, mock_MarkupAny): Markup.new('description') mock_MarkupAny.assert_called_once_with('description') @patch('kiwi.markup.xml.MarkupXML') @patch('kiwi.markup.any.MarkupAny') def test_MarkupXML(self, mock_MarkupAny, mock_MarkupXML): mock_MarkupAny.side_effect = KiwiAnyMarkupPluginError('load-error') Markup.new('description') mock_MarkupXML.assert_called_once_with('description') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7667167 kiwi-11.1.8/test/unit/markup/xml_test.py0000644000000000000000000000122015273675667015164 0ustar00from pytest import raises from kiwi.markup.xml import MarkupXML from kiwi.exceptions import KiwiMarkupConversionError class TestMarkupXML: def setup(self): self.markup = MarkupXML('../data/example_config.xml') def setup_method(self, cls): self.setup() def test_get_xml_description(self): assert 'xslt-' in self.markup.get_xml_description() def test_get_yaml_description(self): with raises(KiwiMarkupConversionError): self.markup.get_yaml_description() def test_get_toml_description(self): with raises(KiwiMarkupConversionError): self.markup.get_toml_description() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7667167 kiwi-11.1.8/test/unit/mount_manager_test.py0000644000000000000000000002203515273675667015730 0ustar00import logging from typing import NoReturn from pytest import fixture, raises from unittest.mock import patch, call, Mock from kiwi.exceptions import KiwiCommandError, KiwiUmountBusyError from kiwi.mount_manager import MountManager class TestMountManager: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.mount_manager.Path.create') def setup(self, mock_path_create): self.mount_manager = MountManager( '/dev/some-device', '/some/mountpoint' ) mock_path_create.assert_called_once_with('/some/mountpoint') @patch('kiwi.mount_manager.Path.create') def setup_method(self, cls, mock_path_create): self.setup() def test_get_attributes(self): assert self.mount_manager.get_attributes() == {} @patch('kiwi.mount_manager.Temporary') def test_setup_empty_mountpoint(self, mock_Temporary): mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' mount_manager = MountManager('/dev/some-device') assert mount_manager.mountpoint == 'tmpdir' @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') def test_bind_mount(self, mock_mounted, mock_command): mock_mounted.return_value = False self.mount_manager.bind_mount() mock_command.assert_called_once_with( ['mount', '-n', '--bind', '/dev/some-device', '/some/mountpoint'] ) @patch('kiwi.mount_manager.Path.create') @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') def test_overlay_mount(self, mock_mounted, mock_command, mock_path_create): mock_mounted.return_value = False self.mount_manager.overlay_mount('lower_path') assert mock_path_create.call_args_list == [ call('/some/mountpoint_cow'), call('/some/mountpoint_work'), ] mock_command.assert_called_once_with( [ 'mount', '-t', 'overlay', 'overlay', '/some/mountpoint', '-o', 'lowerdir=lower_path,' 'upperdir=/some/mountpoint_cow,workdir=/some/mountpoint_work', ] ) @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') def test_tmpfs_mount(self, mock_mounted, mock_command): mock_mounted.return_value = False self.mount_manager.tmpfs_mount() mock_command.assert_called_once_with( ['mount', '-t', 'tmpfs', 'tmpfs', '/some/mountpoint'] ) @patch('kiwi.mount_manager.BlockID') @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') def test_mount(self, mock_mounted, mock_command, mock_BlockID): mock_mounted.return_value = False mock_BlockID.return_value.get_filesystem.return_value = 'vfat' self.mount_manager.mount(['options']) mock_BlockID.assert_called_once_with('/dev/some-device') mock_command.assert_called_once_with( [ 'mount', '-t', 'vfat', '-o', 'options', '/dev/some-device', '/some/mountpoint', ] ) @patch('kiwi.mount_manager.BlockID') @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') def test_mount_unknown_filesystem( self, mock_mounted, mock_command, mock_BlockID ): mock_mounted.return_value = False mock_BlockID.return_value.get_filesystem.return_value = '' self.mount_manager.mount(['options']) mock_BlockID.assert_called_once_with('/dev/some-device') mock_command.assert_called_once_with( ['mount', '-o', 'options', '/dev/some-device', '/some/mountpoint'] ) @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') def test_context_manager(self, mock_mounted, mock_command): mock_mounted.return_value = True with self.mount_manager: pass mock_command.assert_called_once_with(['umount', '/some/mountpoint']) @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') def test_umount_lazy(self, mock_mounted, mock_command): mock_mounted.return_value = True self.mount_manager.umount_lazy() mock_command.assert_called_once_with( ['umount', '-l', '/some/mountpoint'] ) @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') @patch('time.sleep') def test_umount_with_errors_but_lazy( self, mock_sleep, mock_mounted, mock_command ): command_errors = [True, False, False, False, False, False] def _cmd_err(args) -> NoReturn: if not command_errors.pop(): raise KiwiCommandError('error') mock_command.side_effect = _cmd_err mock_mounted.return_value = True with self._caplog.at_level(logging.WARNING): assert self.mount_manager.umount() is True assert mock_command.call_args_list == [ call(['umount', '/some/mountpoint']), # 1 call(['umount', '/some/mountpoint']), # 2 call(['umount', '/some/mountpoint']), # 3 call(['umount', '/some/mountpoint']), # 4 call(['umount', '/some/mountpoint']), # 5 call(['umount', '--lazy', '/some/mountpoint']), # lazy ] @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') @patch('time.sleep') def test_umount_with_errors(self, mock_sleep, mock_mounted, mock_command): def _cmd_err(args) -> NoReturn: raise KiwiCommandError('error') mock_command.side_effect = _cmd_err mock_mounted.return_value = True with self._caplog.at_level(logging.WARNING): assert self.mount_manager.umount(raise_on_busy=False) is False assert mock_command.call_args_list == [ call(['umount', '/some/mountpoint']), # 1 call(['umount', '/some/mountpoint']), # 2 call(['umount', '/some/mountpoint']), # 3 call(['umount', '/some/mountpoint']), # 4 call(['umount', '/some/mountpoint']), # 5 call(['umount', '--lazy', '/some/mountpoint']), # lazy ] @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') @patch('time.sleep') @patch('kiwi.mount_manager.Path.which') def test_umount_with_errors_raises_no_lsof_present( self, mock_Path_which, mock_sleep, mock_mounted, mock_command ): def command_call(args): if 'umount' in args: raise KiwiCommandError('error') mock_Path_which.return_value = None mock_command.side_effect = command_call mock_mounted.return_value = True with raises(KiwiUmountBusyError): self.mount_manager.umount() @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') @patch('time.sleep') @patch('kiwi.mount_manager.Path.which') def test_umount_with_errors_raises_lsof_present( self, mock_Path_which, mock_sleep, mock_mounted, mock_command ): def command_call(args, raise_on_error=None): if 'umount' in args: raise KiwiCommandError('error') else: call_return = Mock() call_return.output = 'HEADLINE\ndata' return call_return mock_Path_which.return_value = 'lsof' mock_command.side_effect = command_call mock_mounted.return_value = True with raises(KiwiUmountBusyError) as issue: self.mount_manager.umount() assert 'HEADLINE' in issue.value.message @patch('kiwi.mount_manager.Command.run') @patch('kiwi.mount_manager.MountManager.is_mounted') def test_umount_success(self, mock_mounted, mock_command): mock_mounted.return_value = True assert self.mount_manager.umount() is True mock_command.assert_called_once_with(['umount', '/some/mountpoint']) @patch('kiwi.mount_manager.Command.run') def test_is_mounted_true(self, mock_command): command = Mock() command.returncode = 0 mock_command.return_value = command assert self.mount_manager.is_mounted() is True mock_command.assert_called_once_with( command=['mountpoint', '-q', '/some/mountpoint'], raise_on_error=False, ) @patch('kiwi.mount_manager.Command.run') def test_is_mounted_false(self, mock_command): command = Mock() command.returncode = 1 mock_command.return_value = command assert self.mount_manager.is_mounted() is False mock_command.assert_called_once_with( command=['mountpoint', '-q', '/some/mountpoint'], raise_on_error=False, ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7667167 kiwi-11.1.8/test/unit/oci_tools/__init__.py0000644000000000000000000000000015273675667015552 0ustar00././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.766907 kiwi-11.1.8/test/unit/oci_tools/base_test.py0000644000000000000000000000473315273675667016005 0ustar00from pytest import raises from unittest.mock import Mock, patch from kiwi.oci_tools.base import OCIBase class TestOCIBase: def setup(self): self.oci = OCIBase() def setup_method(self, cls): self.setup() def test_init_container(self): with raises(NotImplementedError): self.oci.init_container() def test_import_container_image(self): with raises(NotImplementedError): self.oci.import_container_image('oci-archive:image.xz') def test_export_container_image(self): with raises(NotImplementedError): self.oci.export_container_image( 'image.xz', 'docker-archive', 'myimage:tag' ) def test_unpack(self): with raises(NotImplementedError): self.oci.unpack() def test_sync_rootfs(self): with raises(NotImplementedError): self.oci.sync_rootfs('root_dir') def test_import_rootfs(self): with raises(NotImplementedError): self.oci.import_rootfs('root_dir') def test_repack(self): with raises(NotImplementedError): self.oci.repack({}) def test_set_config(self): with raises(NotImplementedError): self.oci.set_config({}) def test_post_process(self): with raises(NotImplementedError): self.oci.post_process() @patch('kiwi.oci_tools.base.Path.which') @patch('kiwi.oci_tools.base.CommandCapabilities.check_version') def test_skopeo_provides_tmpdir_option( self, mock_Path_which, mock_CommandCapabilities_check_version ): mock_Path_which.return_value = 'skopeo' mock_CommandCapabilities_check_version.return_value = (0, 2, 0) assert self.oci._skopeo_provides_tmpdir_option() is True mock_Path_which.return_value = None assert self.oci._skopeo_provides_tmpdir_option() is False @patch('kiwi.oci_tools.base.datetime') def test_creation_date(self, mock_datetime): strftime = Mock() strftime.strftime = Mock(return_value='current_date') mock_datetime.utcnow = Mock(return_value=strftime) with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': ''}): oci = OCIBase() assert oci.creation_date == 'current_date' def test_creation_date_from_source_date_epoch(self): with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': '946729830'}): oci = OCIBase() assert oci.creation_date == '2000-01-01T12:30:30+00:00' ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.766907 kiwi-11.1.8/test/unit/oci_tools/buildah_test.py0000644000000000000000000002603515273675667016502 0ustar00import logging from unittest.mock import Mock, patch, call from pytest import raises, fixture from collections import namedtuple from kiwi.oci_tools.buildah import OCIBuildah from kiwi.exceptions import KiwiBuildahError from kiwi.oci_tools.base import OCIBase class TestOCIBuildah: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.oci_tools.base.datetime') def setup(self, mock_datetime): strftime = Mock() strftime.strftime = Mock(return_value='current_date') mock_datetime.utcnow = Mock(return_value=strftime) self.oci = OCIBuildah() @patch('kiwi.oci_tools.base.datetime') def setup_method(self, cls, mock_datetime): self.setup() @patch('kiwi.oci_tools.buildah.random.choice') @patch('kiwi.oci_tools.buildah.Command.run') def test_init_container(self, mock_Command_run, mock_choice): mock_choice.return_value = 'x' self.oci.init_container() mock_Command_run.assert_called_once_with( ['buildah', 'from', '--name', 'kiwi-container-xxxxxx', 'scratch'] ) def test_init_container_fail(self): with raises(KiwiBuildahError): self.oci.working_container = 'initialized' self.oci.init_container() @patch('kiwi.oci_tools.umoci.Command.run') def test_unpack(self, mock_cmd_run): command_type = namedtuple('command', ['output']) mock_cmd_run.return_value = command_type(output='mountpoint-dir') self.oci.working_container = 'kiwi-working' self.oci.unpack() mock_cmd_run.assert_called_once_with( ['buildah', 'mount', 'kiwi-working'] ) assert self.oci.oci_root_dir == 'mountpoint-dir' @patch('kiwi.oci_tools.base.DataSync') def test_sync_rootfs(self, mock_sync): sync = Mock() mock_sync.return_value = sync self.oci.oci_root_dir = 'oci_root' self.oci.sync_rootfs('root_dir', exclude_list=['/dev', '/proc']) mock_sync.assert_called_once_with('root_dir/', 'oci_root') sync.sync_data.assert_called_once_with( exclude=['/dev', '/proc'], options=[ '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', '--filter', '-x! user.*', '--filter', '-x! security.ima*', '--filter', '-x! security.capability*', '--delete', ], ) @patch('kiwi.oci_tools.base.DataSync') def test_import_rootfs(self, mock_sync): sync = Mock() mock_sync.return_value = sync self.oci.oci_root_dir = 'oci_root' self.oci.import_rootfs('root_dir', exclude_list=['/dev', '/proc']) mock_sync.assert_called_once_with('oci_root/', 'root_dir') sync.sync_data.assert_called_once_with( exclude=['/dev', '/proc'], options=[ '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', ], ) @patch('kiwi.oci_tools.umoci.Command.run') def test_repack(self, mock_cmd_run): self.oci.working_container = 'kiwi-working' self.oci.repack({}) mock_cmd_run.assert_called_once_with( ['buildah', 'umount', 'kiwi-working'] ) @patch('kiwi.oci_tools.umoci.Command.run') def test_set_config(self, mock_cmd_run): oci_config = { 'entry_command': ['/bin/bash', '-x'], 'entry_subcommand': ['ls', '-l'], 'maintainer': 'tux', 'user': 'root', 'workingdir': '/root', 'expose_ports': ['80', '42'], 'volumes': ['/var/log', '/tmp'], 'stopsignal': 'SIGINT', 'environment': {'FOO': 'bar', 'PATH': '/bin'}, 'labels': {'a': 'value', 'b': 'value'}, 'history': { 'author': 'history author', 'comment': 'This is a comment', 'created_by': 'created by text', }, } self.oci.working_container = 'kiwi-working' with self._caplog.at_level(logging.WARNING): self.oci.set_config(oci_config) mock_cmd_run.assert_called_once_with( [ 'buildah', 'config', '--author=tux', '--user=root', '--workingdir=/root', '--entrypoint=["/bin/bash","-x"]', '--cmd=ls -l', '--volume=/var/log', '--volume=/tmp', '--stop-signal=SIGINT', '--port=80', '--port=42', '--env=FOO=bar', '--env=PATH=/bin', '--label=a=value', '--label=b=value', '--history-comment=This is a comment', '--created-by=created by text', 'kiwi-working', ] ) @patch('kiwi.oci_tools.buildah.random.choice') @patch('kiwi.oci_tools.umoci.Command.run') def test_post_process(self, mock_cmd_run, mock_choice): mock_choice.return_value = 'x' self.oci.working_container = 'kiwi-container' self.oci.post_process() mock_cmd_run.assert_called_once_with( [ 'buildah', 'commit', '--rm', '--format', 'oci', 'kiwi-container', 'kiwi-image-xxxxxx:tag-xxxxxx', ] ) def test_post_processi_fail(self): with raises(KiwiBuildahError): self.oci.working_container = None self.oci.post_process() @patch('kiwi.oci_tools.buildah.random.choice') @patch('kiwi.oci_tools.buildah.Command.run') @patch.object(OCIBase, '_skopeo_provides_tmpdir_option') def test_import_container_image( self, mock_skopeo_provides_tmpdir_option, mock_Command_run, mock_choice ): mock_skopeo_provides_tmpdir_option.return_value = True mock_choice.return_value = 'x' self.oci.import_container_image('oci-archive:image.tar') assert mock_Command_run.call_args_list == [ call( [ 'skopeo', 'copy', 'oci-archive:image.tar', 'containers-storage:kiwi-image-xxxxxx:base_layer', '--tmpdir', '/var/tmp', ] ), call( [ 'buildah', 'from', '--name', 'kiwi-container-xxxxxx', 'containers-storage:kiwi-image-xxxxxx:base_layer', ] ), ] @patch('kiwi.oci_tools.buildah.random.choice') @patch('kiwi.oci_tools.buildah.Command.run') def test_import_container_image_fail_create_container( self, mock_Command_run, mock_choice ): with raises(KiwiBuildahError): mock_choice.return_value = 'x' self.oci.working_container = 'initialized' self.oci.import_container_image('oci-archive:image.tar') mock_Command_run.assert_called_once_with( [ 'skopeo', 'copy', 'oci-archive:image.tar', 'containers-storage:kiwi-image-xxxxxx:base_layer', ] ) def test_import_container_image_fail_load_image(self): with raises(KiwiBuildahError): self.oci.imported_image = 'initialized' self.oci.import_container_image('oci-archive:image.tar') @patch('kiwi.oci_tools.buildah.Path.wipe') @patch('kiwi.oci_tools.buildah.Command.run') @patch.object(OCIBase, '_skopeo_provides_tmpdir_option') def test_export_container_image( self, mock_skopeo_provides_tmpdir_option, mock_Command_run, mock_wipe ): mock_skopeo_provides_tmpdir_option.return_value = True self.oci.working_image = 'kiwi-image:tag' self.oci.export_container_image( 'image.tar', 'docker-archive', 'myimage:tag', ['myimage:tag2', 'myimage:tag3'], ) mock_Command_run.assert_called_once_with( [ 'skopeo', 'copy', 'containers-storage:kiwi-image:tag', 'docker-archive:image.tar:myimage:tag', '--additional-tag', 'myimage:tag2', '--additional-tag', 'myimage:tag3', '--tmpdir', '/var/tmp', ] ) mock_wipe.assert_called_once_with('image.tar') @patch('kiwi.oci_tools.buildah.Path.wipe') @patch('kiwi.oci_tools.buildah.Command.run') @patch.object(OCIBase, '_skopeo_provides_tmpdir_option') def test_export_container_image_imported( self, mock_skopeo_provides_tmpdir_option, mock_Command_run, mock_wipe ): mock_skopeo_provides_tmpdir_option.return_value = True self.oci.working_image = None self.oci.imported_image = 'kiwi-image:base_layer' self.oci.export_container_image( 'image.tar', 'docker-archive', 'myimage:tag', ['myimage:tag2', 'myimage:tag3'], ) mock_Command_run.assert_called_once_with( [ 'skopeo', 'copy', 'containers-storage:kiwi-image:base_layer', 'docker-archive:image.tar:myimage:tag', '--additional-tag', 'myimage:tag2', '--additional-tag', 'myimage:tag3', '--tmpdir', '/var/tmp', ] ) mock_wipe.assert_called_once_with('image.tar') @patch('kiwi.oci_tools.buildah.Path.wipe') @patch('kiwi.oci_tools.buildah.Command.run') def test_export_container_image_fail(self, mock_Command_run, mock_wipe): with raises(KiwiBuildahError): self.oci.working_image = None self.oci.imported_image = None self.oci.export_container_image( 'image.tar', 'docker-archive', 'myimage:tag', ['myimage:tag2', 'myimage:tag3'], ) mock_wipe.assert_called_once_with('image.tar') @patch('kiwi.oci_tools.buildah.Command.run') def test_context_manager_exit(self, mock_Command_run): with OCIBuildah() as oci: oci.working_container = 'working_container' oci.working_image = 'working_image' oci.imported_image = 'imported_image' assert mock_Command_run.call_args_list == [ call(['buildah', 'umount', 'working_container']), call(['buildah', 'rm', 'working_container']), call(['buildah', 'rmi', 'working_image']), call(['buildah', 'rmi', 'imported_image']), ] ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.766907 kiwi-11.1.8/test/unit/oci_tools/init_test.py0000644000000000000000000000253415273675667016033 0ustar00from pytest import raises from unittest.mock import patch, Mock from kiwi.oci_tools import OCI from kiwi.exceptions import KiwiOCIArchiveToolError class TestOCI: def setup(self): self.runtime_config = Mock() self.runtime_config.get_oci_archive_tool = Mock() def setup_method(self, cls): self.setup() @patch('kiwi.oci_tools.umoci.OCIUmoci') @patch('kiwi.oci_tools.RuntimeConfig') def test_oci_tool_umoci(self, mock_RuntimeConfig, mock_OCIUmoci): self.runtime_config.get_oci_archive_tool.return_value = 'umoci' mock_RuntimeConfig.return_value = self.runtime_config OCI.new() mock_OCIUmoci.assert_called_once_with() @patch('kiwi.oci_tools.buildah.OCIBuildah') @patch('kiwi.oci_tools.RuntimeConfig') def test_oci_tool_buildah(self, mock_RuntimeConfig, mock_OCIBuildah): self.runtime_config.get_oci_archive_tool.return_value = 'buildah' mock_RuntimeConfig.return_value = self.runtime_config OCI.new() mock_OCIBuildah.assert_called_once_with() @patch('kiwi.oci_tools.RuntimeConfig') def test_oci_tool_not_supported(self, mock_RuntimeConfig): self.runtime_config.get_oci_archive_tool.return_value = 'foo' mock_RuntimeConfig.return_value = self.runtime_config with raises(KiwiOCIArchiveToolError): OCI.new() ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.766907 kiwi-11.1.8/test/unit/oci_tools/umoci_test.py0000644000000000000000000002654415273675667016213 0ustar00from unittest.mock import Mock, patch, call from kiwi.oci_tools.umoci import OCIUmoci from kiwi.oci_tools.base import OCIBase class TestOCIUmoci: @patch('kiwi.oci_tools.umoci.CommandCapabilities.has_option_in_help') @patch('kiwi.oci_tools.base.datetime') @patch('kiwi.oci_tools.umoci.Temporary') def setup(self, mock_Temporary, mock_datetime, mock_cmd_caps): mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' mock_cmd_caps.return_value = True strftime = Mock() strftime.strftime = Mock(return_value='current_date') mock_datetime.utcnow = Mock(return_value=strftime) mock_datetime.fromtimestamp = Mock(return_value=strftime) self.oci = OCIUmoci() @patch('kiwi.oci_tools.umoci.CommandCapabilities.has_option_in_help') @patch('kiwi.oci_tools.base.datetime') @patch('kiwi.oci_tools.umoci.Temporary') def setup_method(self, cls, mock_Temporary, mock_datetime, mock_cmd_caps): self.setup() @patch('kiwi.oci_tools.umoci.Command.run') def test_init_container(self, mock_Command_run): self.oci.init_container() assert mock_Command_run.call_args_list == [ call(['umoci', 'init', '--layout', 'tmpdir/oci_layout']), call(['umoci', 'new', '--image', 'tmpdir/oci_layout:base_layer']), ] @patch('kiwi.oci_tools.umoci.Temporary') @patch('kiwi.oci_tools.umoci.Command.run') def test_unpack(self, mock_Command_run, mock_Temporary): mock_Temporary.return_value.new_dir.return_value.name = 'oci_root' self.oci.unpack() mock_Command_run.assert_called_once_with( [ 'umoci', 'unpack', '--image', 'tmpdir/oci_layout:base_layer', 'oci_root', ] ) @patch('kiwi.oci_tools.base.DataSync') def test_sync_rootfs(self, mock_sync): sync = Mock() mock_sync.return_value = sync self.oci.oci_root_dir = 'oci_root' self.oci.sync_rootfs('root_dir', exclude_list=['/dev', '/proc']) mock_sync.assert_called_once_with('root_dir/', 'oci_root/rootfs') sync.sync_data.assert_called_once_with( exclude=['/dev', '/proc'], options=[ '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', '--delete', ], ) @patch('kiwi.oci_tools.base.DataSync') def test_import_rootfs(self, mock_sync): sync = Mock() mock_sync.return_value = sync self.oci.oci_root_dir = 'oci_root' self.oci.import_rootfs('root_dir', exclude_list=['/dev', '/proc']) mock_sync.assert_called_once_with('oci_root/rootfs/', 'root_dir') sync.sync_data.assert_called_once_with( exclude=['/dev', '/proc'], options=[ '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', ], ) @patch('kiwi.oci_tools.umoci.Temporary') @patch('kiwi.oci_tools.umoci.Command.run') def test_repack(self, mock_Command_run, mock_Temporary): mock_Temporary.return_value.new_dir.return_value.name = 'oci_root' oci_config = { 'history': { 'author': 'history author', 'comment': 'This is a comment', 'created_by': 'created by text', } } self.oci.unpack() self.oci.repack(oci_config) assert ( call( [ 'umoci', 'repack', '--history.comment=This is a comment', '--history.created_by=created by text', '--history.author=history author', '--history.created', 'current_date', '--image', 'tmpdir/oci_layout:base_layer', 'oci_root', ] ) in mock_Command_run.call_args_list ) @patch('kiwi.oci_tools.umoci.Command.run') def test_set_config(self, mock_Command_run): oci_config = { 'container_tag': 'tag', 'entry_command': ['/bin/bash', '-x'], 'entry_subcommand': ['ls', '-l'], 'maintainer': 'tux', 'user': 'root', 'workingdir': '/root', 'expose_ports': ['80', '42'], 'volumes': ['/var/log', '/tmp'], 'stopsignal': 'SIGINT', 'environment': {'FOO': 'bar', 'PATH': '/bin'}, 'labels': {'a': 'value', 'b': 'value'}, } self.oci.set_config(oci_config) mock_Command_run.assert_called_once_with( [ 'umoci', 'config', '--author=tux', '--config.user=root', '--config.workingdir=/root', '--config.entrypoint=/bin/bash', '--config.entrypoint=-x', '--config.cmd=ls', '--config.cmd=-l', '--config.volume=/var/log', '--config.volume=/tmp', '--config.stopsignal=SIGINT', '--config.exposedports=80', '--config.exposedports=42', '--config.env=FOO=bar', '--config.env=PATH=/bin', '--config.label=a=value', '--config.label=b=value', '--no-history', '--image', 'tmpdir/oci_layout:base_layer', '--tag', 'tag', '--created', 'current_date', ] ) @patch('kiwi.oci_tools.umoci.Temporary') @patch('kiwi.oci_tools.base.datetime') @patch('kiwi.oci_tools.umoci.CommandCapabilities.has_option_in_help') @patch('kiwi.oci_tools.umoci.Command.run') def test_set_config_with_history( self, mock_Command_run, mock_cmd_caps, mock_datetime, mock_Temporary ): oci_config = { 'container_tag': 'tag', 'entry_command': ['/bin/bash', '-x'], 'entry_subcommand': ['ls', '-l'], 'maintainer': 'tux', 'user': 'root', 'workingdir': '/root', 'expose_ports': ['80', '42'], 'volumes': ['/var/log', '/tmp'], 'environment': {'FOO': 'bar', 'PATH': '/bin'}, 'labels': {'a': 'value', 'b': 'value'}, } mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' mock_cmd_caps.return_value = False strftime = Mock() strftime.strftime = Mock(return_value='current_date') mock_datetime.utcnow = Mock(return_value=strftime) mock_datetime.fromtimestamp = Mock(return_value=strftime) oci = OCIUmoci() oci.set_config(oci_config) mock_Command_run.assert_called_once_with( [ 'umoci', 'config', '--author=tux', '--config.user=root', '--config.workingdir=/root', '--config.entrypoint=/bin/bash', '--config.entrypoint=-x', '--config.cmd=ls', '--config.cmd=-l', '--config.volume=/var/log', '--config.volume=/tmp', '--config.exposedports=80', '--config.exposedports=42', '--config.env=FOO=bar', '--config.env=PATH=/bin', '--config.label=a=value', '--config.label=b=value', '--image', 'tmpdir/oci_layout:base_layer', '--tag', 'tag', '--created', 'current_date', ] ) @patch('kiwi.oci_tools.umoci.Command.run') def test_set_config_derived_image(self, mock_Command_run): self.oci.set_config({'container_tag': 'tag'}) mock_Command_run.assert_called_once_with( [ 'umoci', 'config', '--no-history', '--image', 'tmpdir/oci_layout:base_layer', '--tag', 'tag', '--created', 'current_date', ] ) self.oci.working_image == 'tmpdir/oci_layout:tag' @patch('kiwi.oci_tools.umoci.Command.run') def test_set_config_clear_inherited_commands(self, mock_Command_run): oci_config = { 'container_tag': 'tag', 'entry_command': [], 'entry_subcommand': [], } self.oci.set_config(oci_config) assert mock_Command_run.call_args_list == [ call( [ 'umoci', 'config', '--clear=config.entrypoint', '--clear=config.cmd', '--no-history', '--image', 'tmpdir/oci_layout:base_layer', '--tag', 'tag', '--created', 'current_date', ] ) ] @patch('kiwi.oci_tools.umoci.Command.run') @patch.object(OCIBase, '_skopeo_provides_tmpdir_option') def test_import_container_image( self, mock_skopeo_provides_tmpdir_option, mock_Command_run ): mock_skopeo_provides_tmpdir_option.return_value = True self.oci.import_container_image('oci-archive:image.tar') mock_Command_run.assert_called_once_with( [ 'skopeo', 'copy', 'oci-archive:image.tar', 'oci:tmpdir/oci_layout:base_layer', '--tmpdir', '/var/tmp', ] ) @patch('kiwi.oci_tools.umoci.Path.wipe') @patch('kiwi.oci_tools.umoci.Command.run') @patch.object(OCIBase, '_skopeo_provides_tmpdir_option') def test_export_container_image( self, mock_skopeo_provides_tmpdir_option, mock_Command_run, mock_wipe ): mock_skopeo_provides_tmpdir_option.return_value = True self.oci.export_container_image( 'image.tar', 'oci-archive', 'myimage:tag', ['myimage:tag2', 'myimage:tag3'], ) mock_Command_run.assert_called_once_with( [ 'skopeo', 'copy', 'oci:tmpdir/oci_layout:base_layer', 'oci-archive:image.tar:myimage:tag', '--additional-tag', 'myimage:tag2', '--additional-tag', 'myimage:tag3', '--tmpdir', '/var/tmp', ] ) mock_wipe.assert_called_once_with('image.tar') @patch('kiwi.oci_tools.umoci.Command.run') def test_post_process(self, mock_Command_run): self.oci.post_process() mock_Command_run.assert_called_once_with( ['umoci', 'gc', '--layout', 'tmpdir/oci_layout'] ) @patch('kiwi.oci_tools.umoci.CommandCapabilities.has_option_in_help') def test_context_manager_exit( self, mock_CommandCapabilities_has_option_in_help ): mock_CommandCapabilities_has_option_in_help.return_value = True with OCIUmoci(): pass # just pass ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.766907 kiwi-11.1.8/test/unit/package_manager/__init__.py0000644000000000000000000000000015273675667016645 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7671068 kiwi-11.1.8/test/unit/package_manager/apk_test.py0000644000000000000000000001131415273675667016732 0ustar00from unittest.mock import patch, Mock from pytest import fixture, raises from kiwi.package_manager.apk import PackageManagerApk from kiwi.exceptions import KiwiBootStrapPhaseFailed class TestPackageManagerApk: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): repository = Mock() repository.root_dir = '/root-dir' repository.runtime_config = Mock( return_value={ 'bootstrap_repo': 'https://some', 'command_env': ['env'], } ) self.manager = PackageManagerApk(repository) def setup_method(self, cls): self.setup() def test_request_package(self): self.manager.request_package('name') assert self.manager.package_requests == ['name'] def test_request_collection(self): self.manager.request_collection('name') assert self.manager.collection_requests == [] assert self.manager.package_requests == ['name'] def test_request_product(self): self.manager.request_product('name') assert self.manager.product_requests == [] def test_request_package_exclusion(self): self.manager.request_package_exclusion('name') assert self.manager.exclude_requests == ['name'] def test_setup_repository_modules(self): self.manager.setup_repository_modules({}) def test_process_install_requests_bootstrap_raises(self): self.manager.bootstrap_repo = None with raises(KiwiBootStrapPhaseFailed): self.manager.process_install_requests_bootstrap() @patch('kiwi.command.Command.call') def test_process_install_requests_bootstrap_default(self, mock_call): self.manager.process_install_requests_bootstrap() mock_call.assert_called_once_with( [ 'apk', '--root', '/root-dir', '-X', 'https://some', '-U', '--allow-untrusted', '--initdb', 'add', 'alpine-base', ], ['env'], ) @patch('kiwi.command.Command.call') def test_process_install_requests_bootstrap(self, mock_call): self.manager.request_package('vim') self.manager.request_collection('collection') self.manager.process_install_requests_bootstrap() mock_call.assert_called_once_with( [ 'apk', '--root', '/root-dir', '-X', 'https://some', '-U', '--allow-untrusted', '--initdb', 'add', 'vim', 'collection', ], ['env'], ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_install_requests(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.request_collection('collection') self.manager.request_package_exclusion('skipme') self.manager.process_install_requests() mock_run.assert_called_once_with( ['chroot', '/root-dir', 'apk', 'update'], ['env'] ) mock_call.assert_called_once_with( ['chroot', '/root-dir', 'apk', 'add', 'vim', 'collection'], ['env'] ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.process_delete_requests() mock_run.assert_called_once_with( ['chroot', '/root-dir', 'apk', 'update'], ['env'] ) mock_call.assert_called_once_with( ['chroot', '/root-dir', 'apk', 'del', 'vim'], ['env'] ) def test_process_only_required(self): self.manager.process_only_required() assert self.manager.custom_args == [] def test_process_plus_recommended(self): self.manager.process_plus_recommended() assert self.manager.custom_args == [] @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_update(self, mock_run, mock_call): self.manager.update() mock_run.assert_called_once_with( ['chroot', '/root-dir', 'apk', 'update'], ['env'] ) mock_call.assert_called_once_with( ['chroot', '/root-dir', 'apk', 'upgrade'], ['env'] ) def test_match_package_installed(self): assert self.manager.match_package_installed('foo', ' Installing foo') def test_match_package_deleted(self): assert self.manager.match_package_deleted('foo', ' Removing foo') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7671068 kiwi-11.1.8/test/unit/package_manager/apt_test.py0000644000000000000000000003403615273675667016751 0ustar00import logging import io from unittest.mock import patch, call, Mock, MagicMock from pytest import raises, fixture from kiwi.package_manager.apt import PackageManagerApt import kiwi.defaults as defaults from kiwi.exceptions import ( KiwiDebianBootstrapError, KiwiRequestError, KiwiFileNotFound, ) class TestPackageManagerApt: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): repository = Mock() repository.root_dir = 'root-dir' repository.unauthenticated = 'false' repository.components = ['main', 'restricted'] self.env = {'key': 'val'} repository.runtime_config = Mock( return_value={ 'apt_get_args': ['-c', 'apt.conf', '-y'], 'command_env': self.env, 'distribution': 'xenial', 'distribution_path': 'xenial_path', } ) self.manager = PackageManagerApt(repository) def setup_method(self, cls): self.setup() def test_request_package(self): self.manager.request_package('name') assert self.manager.package_requests == ['name'] def test_request_collection(self): self.manager.request_collection('name') with self._caplog.at_level(logging.WARNING): assert self.manager.collection_requests == [] def test_request_product(self): self.manager.request_product('name') with self._caplog.at_level(logging.WARNING): assert self.manager.product_requests == [] def test_request_package_exclusion(self): self.manager.request_package_exclusion('name') with self._caplog.at_level(logging.WARNING): assert self.manager.exclude_requests == [] def test_setup_repository_modules(self): self.manager.setup_repository_modules({}) @patch('pathlib.Path') @patch('kiwi.command.Command.run') @patch.object(PackageManagerApt, 'process_install_requests') @patch('os.path.isfile') def test_process_install_requests_bootstrap_prebuild_root( self, mock_os_path_isfile, mock_process_install_requests, mock_Command_run, mock_pathlib_Path, ): mock_os_path_isfile.return_value = True self.manager.process_install_requests_bootstrap( bootstrap_package='bootstrap-package' ) assert mock_Command_run.call_args_list == [ call(['apt-get', '-c', 'apt.conf', '-y', 'update'], self.env), call( [ 'apt-get', '-c', 'apt.conf', '-y', 'install', 'bootstrap-package', ], self.env, ), call( [ 'tar', '-C', 'root-dir', '-xf', '/var/lib/bootstrap/bootstrap-package.{0}.tar.xz'.format( defaults.PLATFORM_MACHINE ), ] ), ] mock_process_install_requests.assert_called_once_with() mock_os_path_isfile.return_value = False with raises(KiwiFileNotFound): self.manager.process_install_requests_bootstrap( bootstrap_package='bootstrap-package' ) @patch('pathlib.Path') @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') @patch('kiwi.package_manager.apt.Temporary.new_file') @patch('kiwi.package_manager.apt.Temporary.new_dir') def test_process_install_requests_bootstrap_failed( self, mock_Temporary_new_dir, mock_Temporary_new_file, mock_Command_run, mock_Command_call, mock_pathlib_Path, ): self.manager.request_package('apt') mock_Command_call.side_effect = Exception('update failed') with patch('builtins.open', create=True): with raises(KiwiDebianBootstrapError) as issue: self.manager.process_install_requests_bootstrap() assert 'update failed' in str(issue.value) @patch('pathlib.Path') @patch('kiwi.command.Command.run') @patch('kiwi.command.Command.call') @patch('kiwi.package_manager.apt.Temporary.new_file') @patch('kiwi.package_manager.apt.Temporary.new_dir') @patch('os.path.exists') def test_process_install_requests_bootstrap( self, mock_os_path_exists, mock_Temporary_new_dir, mock_Temporary_new_file, mock_Command_call, mock_Command_run, mock_pathlib_Path, ): def command_run(command, env=None): # mock a postinst error for base-passwd to test the retry logic if command == [ 'chroot', 'root-dir', 'tempdir/base-passwd/postinst', 'configure', ]: raise Exception return MagicMock(stdout='stdout', stderr='stderr') mock_Command_run.side_effect = command_run mock_os_path_exists.return_value = True mock_Temporary_new_dir.return_value.name = 'tempdir' mock_Temporary_new_file.return_value.name = 'temporary' self.manager.request_package('vim') call_result = Mock() call_result.process.communicate.return_value = ('stdout', 'stderr') mock_Command_call.return_value = call_result with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.__iter__.return_value = [ 'base-passwd\n', 'usrmerge', 'vim\n', ] self.manager.process_install_requests_bootstrap() new_env = self.env | { 'PATH': '$PATH:/usr/bin:/bin:/usr/sbin:/sbin', 'DPKG_MAINTSCRIPT_NAME': 'true', 'DPKG_MAINTSCRIPT_PACKAGE': 'libc6', } assert mock_Command_run.call_args_list == [ call(['apt-get', '-c', 'apt.conf', '-y', 'update'], self.env), call( [ 'apt-get', '-c', 'apt.conf', '-y', 'install', '-oDebug::pkgDPkgPm=1', '-oDPkg::Pre-Install-Pkgs::=cat >temporary', '?essential', 'vim', 'apt', ], self.env, ), call( [ 'bash', '-c', 'dpkg-deb --fsys-tarfile base-passwd | tar -C root-dir -x', ], self.env, ), call( [ 'bash', '-c', 'dpkg-deb --fsys-tarfile usrmerge | tar -C root-dir -x', ], self.env, ), call( [ 'bash', '-c', 'dpkg-deb --fsys-tarfile vim | tar -C root-dir -x', ], self.env, ), call(['dpkg', '-e', 'base-passwd', 'tempdir/base-passwd']), call(['chmod', '755', 'tempdir/base-passwd/preinst']), call( [ 'chroot', 'root-dir', 'tempdir/base-passwd/preinst', 'install', ], new_env, ), call(['chmod', '755', 'tempdir/base-passwd/postinst']), call( [ 'chroot', 'root-dir', 'tempdir/base-passwd/postinst', 'configure', ], new_env, ), call( [ 'chroot', 'root-dir', 'tempdir/base-passwd/postinst', 'configure', '0', ], new_env, ), call(['dpkg', '-e', 'base-passwd', 'tempdir/base-passwd']), call(['chmod', '755', 'tempdir/base-passwd/preinst']), call( [ 'chroot', 'root-dir', 'tempdir/base-passwd/preinst', 'install', ], new_env, ), call(['chmod', '755', 'tempdir/base-passwd/postinst']), call( [ 'chroot', 'root-dir', 'tempdir/base-passwd/postinst', 'configure', ], new_env, ), call( [ 'chroot', 'root-dir', 'tempdir/base-passwd/postinst', 'configure', '0', ], new_env, ), call(['dpkg', '-e', 'vim', 'tempdir/vim']), call(['chmod', '755', 'tempdir/vim/preinst']), call( ['chroot', 'root-dir', 'tempdir/vim/preinst', 'install'], new_env, ), call(['chmod', '755', 'tempdir/vim/postinst']), call( ['chroot', 'root-dir', 'tempdir/vim/postinst', 'configure'], new_env, ), ] @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_install_requests(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.bootstrap_packages = ['?essential', 'some'] self.manager.process_install_requests() mock_call.assert_called_once_with( [ 'chroot', 'root-dir', 'apt-get', '-c', 'apt.conf', '-y', 'install', '?essential', 'some', 'vim', ], self.env, ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.process_delete_requests() mock_call.assert_called_once_with( [ 'chroot', 'root-dir', 'apt-get', '-c', 'apt.conf', '-y', '--auto-remove', 'remove', 'vim', ], self.env, ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') @patch('kiwi.package_manager.apt.Path.wipe') @patch('glob.iglob') def test_process_delete_requests_force( self, mock_iglob, mock_Path_wipe, mock_run, mock_call ): mock_iglob.return_value = ['glob-result'] self.manager.request_package('vim') self.manager.process_delete_requests(True) assert mock_run.call_args_list == [ call(['chroot', 'root-dir', 'dpkg', '-l', 'vim']), call( [ 'cp', 'root-dir/usr/sbin/ldconfig', 'root-dir/usr/sbin/ldconfig.orig', ] ), call(['cp', 'root-dir/usr/bin/true', 'root-dir/usr/sbin/ldconfig']), ] mock_call.assert_called_once_with( [ 'chroot', 'root-dir', 'dpkg', '--remove', '--force-remove-reinstreq', '--force-remove-essential', '--force-depends', 'vim', ], self.env, ) mock_iglob.call_args_list == [ call('root-dir/var/lib/dpkg/info/vim*.pre*'), call('root-dir/var/lib/dpkg/info/vim*.post*'), ] mock_Path_wipe.call_args_list == [ call('glob-result'), call('glob-result'), ] @patch('kiwi.command.Command.run') def test_post_process_delete_requests(self, mock_run): self.manager.post_process_delete_requests() assert mock_run.call_args_list == [ call( [ 'mv', 'root-dir/usr/sbin/ldconfig.orig', 'root-dir/usr/sbin/ldconfig', ] ) ] @patch('kiwi.command.Command.run') def test_process_delete_requests_package_missing(self, mock_run): mock_run.side_effect = Exception self.manager.request_package('vim') with raises(KiwiRequestError): self.manager.process_delete_requests() @patch('kiwi.command.Command.call') def test_update(self, mock_call): self.manager.update() mock_call.assert_called_once_with( [ 'chroot', 'root-dir', 'apt-get', '-c', 'apt.conf', '-y', 'upgrade', ], self.env, ) def test_process_only_required(self): self.manager.process_only_required() assert self.manager.custom_args == ['--no-install-recommends'] def test_process_plus_recommended(self): self.manager.process_only_required() assert self.manager.custom_args == ['--no-install-recommends'] self.manager.process_plus_recommended() assert '--no-install-recommends' not in self.manager.custom_args def test_match_package_installed(self): assert self.manager.match_package_installed('foo', 'Unpacking foo') def test_clean_leftovers(self): self.manager.clean_leftovers() self.manager.repository.delete_trusted_keys.assert_called_once_with() def test_match_package_deleted(self): assert self.manager.match_package_deleted('foo', 'Removing foo') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7671068 kiwi-11.1.8/test/unit/package_manager/base_test.py0000644000000000000000000000676715273675667017111 0ustar00import unittest.mock as mock from pytest import raises from kiwi.package_manager.base import PackageManagerBase class TestPackageManagerBase: def setup(self): repository = mock.Mock() repository.root_dir = 'root-dir' self.manager = PackageManagerBase(repository) def setup_method(self, cls): self.setup() def test_request_package(self): with raises(NotImplementedError): self.manager.request_package('name') def test_request_collection(self): with raises(NotImplementedError): self.manager.request_collection('name') def test_request_product(self): with raises(NotImplementedError): self.manager.request_product('name') def test_request_package_lock(self): with raises(DeprecationWarning): self.manager.request_package_lock('name') def test_request_package_exclusion(self): with raises(NotImplementedError): self.manager.request_package_exclusion('name') def test_setup_repository_modules(self): with raises(NotImplementedError): self.manager.setup_repository_modules({}) def test_process_install_requests_bootstrap(self): with raises(NotImplementedError): self.manager.process_install_requests_bootstrap() def test_post_process_install_requests_bootstrap(self): self.manager.post_process_install_requests_bootstrap() def test_post_process_delete_requests(self): self.manager.post_process_delete_requests() def test_process_install_requests(self): with raises(NotImplementedError): self.manager.process_install_requests() def test_process_delete_requests(self): with raises(NotImplementedError): self.manager.process_delete_requests() def test_update(self): with raises(NotImplementedError): self.manager.update() def test_process_only_required(self): with raises(NotImplementedError): self.manager.process_only_required() def test_process_plus_recommended(self): with raises(NotImplementedError): self.manager.process_plus_recommended() def test_match_package_installed(self): with raises(NotImplementedError): self.manager.match_package_installed('package_name', 'log') def test_match_package_deleted(self): with raises(NotImplementedError): self.manager.match_package_deleted('package_name', 'log') def test_database_consistent(self): with raises(DeprecationWarning): self.manager.database_consistent() def test_dump_reload_package_database(self): with raises(DeprecationWarning): self.manager.dump_reload_package_database() def test_has_failed(self): assert self.manager.has_failed(0) is False assert self.manager.has_failed(1) is True def test_cleanup_requests(self): self.manager.cleanup_requests() assert self.manager.package_requests == [] assert self.manager.product_requests == [] assert self.manager.collection_requests == [] assert self.manager.exclude_requests == [] def test_get_error_details(self): assert self.manager.get_error_details() == '' def test_clean_leftovers(self): self.manager.clean_leftovers() def test_context_manager_exit(self): repository = mock.Mock() with PackageManagerBase(repository): pass repository.cleanup.assert_called_once_with() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7671068 kiwi-11.1.8/test/unit/package_manager/dnf4_test.py0000644000000000000000000002053415273675667017016 0ustar00from unittest.mock import patch, call from pytest import raises import unittest.mock as mock from kiwi.package_manager.dnf4 import PackageManagerDnf4 from kiwi.exceptions import KiwiRequestError class TestPackageManagerDnf4: def setup(self): repository = mock.Mock() repository.root_dir = '/root-dir' repository.runtime_config = mock.Mock( return_value={ 'dnf_args': ['--config', '/root-dir/dnf.conf', '-y'], 'command_env': ['env'], } ) self.manager = PackageManagerDnf4(repository) def setup_method(self, cls): self.setup() def test_request_package(self): self.manager.request_package('name') assert self.manager.package_requests == ['name'] def test_request_collection(self): self.manager.request_collection('name') assert self.manager.collection_requests == ['@name'] def test_request_product(self): self.manager.request_product('name') assert self.manager.product_requests == [] def test_request_package_exclusion(self): self.manager.request_package_exclusion('name') assert self.manager.exclude_requests == ['name'] @patch('kiwi.path.Path.which') def test_get_dnf4_binary_name(self, mock_which): mock_which.return_value = '/usr/bin/dnf4' assert self.manager._get_dnf4_binary_name() == 'dnf4' mock_which.assert_called_once_with( access_mode=1, custom_env=None, filename='dnf4' ) mock_which.return_value = None mock_which.reset_mock() assert self.manager._get_dnf4_binary_name(root='/some/root') == 'dnf-3' mock_which.assert_called_once_with( access_mode=1, custom_env={'PATH': '/some/root/usr/bin'}, filename='dnf4', ) @patch('kiwi.path.Path.which') @patch('kiwi.command.Command.run') def test_setup_repository_modules(self, mock_run, mock_exists): mock_exists.return_value = None self.manager.setup_repository_modules( {'disable': ['mod_c'], 'enable': ['mod_a:stream', 'mod_b']} ) dnf_call_args = [ 'dnf-3', '--config', '/root-dir/dnf.conf', '-y', '--installroot', '/root-dir', '--releasever=0', ] assert mock_run.call_args_list == [ call(dnf_call_args + ['module', 'disable', 'mod_c'], ['env']), call(dnf_call_args + ['module', 'reset', 'mod_a'], ['env']), call(dnf_call_args + ['module', 'enable', 'mod_a:stream'], ['env']), call(dnf_call_args + ['module', 'reset', 'mod_b'], ['env']), call(dnf_call_args + ['module', 'enable', 'mod_b'], ['env']), ] @patch('kiwi.path.Path.which') @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_install_requests_bootstrap( self, mock_run, mock_call, mock_exists ): mock_exists.return_value = None self.manager.request_package('vim') self.manager.request_collection('collection') self.manager.request_package_exclusion('skipme') self.manager.process_install_requests_bootstrap() mock_run.assert_called_once_with( [ 'dnf-3', '--config', '/root-dir/dnf.conf', '-y', '--releasever=0', 'makecache', ], ['env'], ) mock_call.assert_called_once_with( [ 'dnf-3', '--config', '/root-dir/dnf.conf', '-y', '--installroot', '/root-dir', '--releasever=0', '--exclude=skipme', 'install', 'vim', '@collection', ], ['env'], ) @patch('kiwi.path.Path.which') @patch('kiwi.command.Command.call') def test_process_install_requests(self, mock_call, mock_exists): mock_exists.return_value = None self.manager.request_package('vim') self.manager.request_collection('collection') self.manager.request_package_exclusion('skipme') self.manager.process_install_requests() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'dnf-3', '--config', '/dnf.conf', '-y', '--releasever=0', '--exclude=skipme', 'install', 'vim', '@collection', ], ['env'], ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests_force(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.process_delete_requests(True) mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'rpm', '-e', '--nodeps', '--allmatches', '--noscripts', 'vim', ], ['env'], ) @patch('kiwi.path.Path.which') @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests_no_force( self, mock_run, mock_call, mock_exists ): mock_exists.return_value = None self.manager.request_package('vim') self.manager.process_delete_requests() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'dnf-3', '--config', '/dnf.conf', '-y', '--releasever=0', 'autoremove', 'vim', ], ['env'], ) @patch('kiwi.command.Command.run') @patch('kiwi.command.Command.call') def test_process_delete_requests_package_missing(self, mock_call, mock_run): mock_run.side_effect = Exception self.manager.request_package('vim') with raises(KiwiRequestError): self.manager.process_delete_requests(force=True) mock_run.assert_called_once_with( ['chroot', '/root-dir', 'rpm', '-q', 'vim'] ) @patch('kiwi.path.Path.which') @patch('kiwi.command.Command.call') def test_update(self, mock_call, mock_exists): mock_exists.return_value = None self.manager.update() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'dnf-3', '--config', '/dnf.conf', '-y', '--releasever=0', 'upgrade', ], ['env'], ) def test_process_only_required(self): self.manager.process_only_required() assert self.manager.custom_args == ['--setopt=install_weak_deps=False'] def test_process_plus_recommended(self): self.manager.process_only_required() assert self.manager.custom_args == ['--setopt=install_weak_deps=False'] self.manager.process_plus_recommended() assert ( '--setopt=install_weak_deps=False' not in self.manager.custom_args ) def test_match_package_installed(self): assert self.manager.match_package_installed('foo', 'Installing : foo') def test_match_package_deleted(self): assert self.manager.match_package_deleted('foo', 'Removing: foo') @patch('kiwi.package_manager.dnf4.RpmDataBase') def test_post_process_install_requests_bootstrap(self, mock_RpmDataBase): rpmdb = mock.Mock() rpmdb.has_rpm.return_value = True mock_RpmDataBase.return_value = rpmdb self.manager.post_process_install_requests_bootstrap() rpmdb.rebuild_database.assert_called_once_with() rpmdb.set_database_to_image_path.assert_called_once_with() @patch('kiwi.package_manager.dnf4.Rpm') def test_clean_leftovers(self, mock_rpm): mock_rpm.return_value = mock.Mock() self.manager.clean_leftovers() mock_rpm.assert_called_once_with( '/root-dir', 'macros.kiwi-image-config' ) mock_rpm.return_value.wipe_config.assert_called_once_with() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7671068 kiwi-11.1.8/test/unit/package_manager/dnf5_test.py0000644000000000000000000001712215273675667017016 0ustar00from unittest.mock import patch, call from pytest import raises import unittest.mock as mock from kiwi.package_manager.dnf5 import PackageManagerDnf5 from kiwi.exceptions import KiwiRequestError class TestPackageManagerDnf5: def setup(self): repository = mock.Mock() repository.root_dir = '/root-dir' repository.runtime_config = mock.Mock( return_value={ 'dnf_args': ['--config', '/root-dir/dnf.conf', '-y'], 'command_env': ['env'], } ) self.manager = PackageManagerDnf5(repository) def setup_method(self, cls): self.setup() def test_request_package(self): self.manager.request_package('name') assert self.manager.package_requests == ['name'] def test_request_collection(self): self.manager.request_collection('name') assert self.manager.collection_requests == ['@name'] def test_request_product(self): self.manager.request_product('name') assert self.manager.product_requests == [] def test_request_package_exclusion(self): self.manager.request_package_exclusion('name') assert self.manager.exclude_requests == ['name'] @patch('kiwi.command.Command.run') def test_setup_repository_modules(self, mock_run): self.manager.setup_repository_modules( {'disable': ['mod_c'], 'enable': ['mod_a:stream', 'mod_b']} ) dnf_call_args = [ 'dnf5', '--config', '/root-dir/dnf.conf', '-y', '--installroot', '/root-dir', '--releasever=0', ] assert mock_run.call_args_list == [ call(dnf_call_args + ['module', 'disable', 'mod_c'], ['env']), call(dnf_call_args + ['module', 'reset', 'mod_a'], ['env']), call(dnf_call_args + ['module', 'enable', 'mod_a:stream'], ['env']), call(dnf_call_args + ['module', 'reset', 'mod_b'], ['env']), call(dnf_call_args + ['module', 'enable', 'mod_b'], ['env']), ] @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_install_requests_bootstrap(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.request_collection('collection') self.manager.request_package_exclusion('skipme') self.manager.process_install_requests_bootstrap() mock_run.assert_called_once_with( [ 'dnf5', '--config', '/root-dir/dnf.conf', '-y', '--releasever=0', 'makecache', ], ['env'], ) mock_call.assert_called_once_with( [ 'dnf5', '--config', '/root-dir/dnf.conf', '-y', '--installroot', '/root-dir', '--releasever=0', '--exclude=skipme', 'install', 'vim', '@collection', ], ['env'], ) @patch('kiwi.command.Command.call') def test_process_install_requests(self, mock_call): self.manager.request_package('vim') self.manager.request_collection('collection') self.manager.request_package_exclusion('skipme') self.manager.process_install_requests() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'dnf5', '--config', '/dnf.conf', '-y', '--releasever=0', '--exclude=skipme', 'install', 'vim', '@collection', ], ['env'], ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests_force(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.process_delete_requests(True) mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'rpm', '-e', '--nodeps', '--allmatches', '--noscripts', 'vim', ], ['env'], ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests_no_force(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.process_delete_requests() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'dnf5', '--config', '/dnf.conf', '-y', '--releasever=0', '--setopt=clean_requirements_on_remove=true', 'remove', 'vim', ], ['env'], ) @patch('kiwi.command.Command.run') @patch('kiwi.command.Command.call') def test_process_delete_requests_package_missing(self, mock_call, mock_run): mock_run.side_effect = Exception self.manager.request_package('vim') with raises(KiwiRequestError): self.manager.process_delete_requests(force=True) mock_run.assert_called_once_with( ['chroot', '/root-dir', 'rpm', '-q', 'vim'] ) @patch('kiwi.command.Command.call') def test_update(self, mock_call): self.manager.update() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'dnf5', '--config', '/dnf.conf', '-y', '--releasever=0', 'upgrade', ], ['env'], ) def test_process_only_required(self): self.manager.process_only_required() assert self.manager.custom_args == [ '--setopt=install_weak_deps=False', '--setopt=group_package_types=mandatory', ] def test_process_plus_recommended(self): self.manager.process_only_required() self.manager.process_plus_recommended() assert self.manager.custom_args == [ '--setopt=install_weak_deps=True', '--setopt=group_package_types=default,mandatory,conditional', ] self.manager.process_only_required() assert self.manager.custom_args == [ '--setopt=install_weak_deps=False', '--setopt=group_package_types=mandatory', ] def test_match_package_installed(self): assert self.manager.match_package_installed('foo', 'Installing : foo') def test_match_package_deleted(self): assert self.manager.match_package_deleted('foo', 'Removing: foo') @patch('kiwi.package_manager.dnf5.RpmDataBase') def test_post_process_install_requests_bootstrap(self, mock_RpmDataBase): rpmdb = mock.Mock() rpmdb.has_rpm.return_value = True mock_RpmDataBase.return_value = rpmdb self.manager.post_process_install_requests_bootstrap() rpmdb.rebuild_database.assert_called_once_with() rpmdb.set_database_to_image_path.assert_called_once_with() @patch('kiwi.package_manager.dnf5.Rpm') def test_clean_leftovers(self, mock_rpm): mock_rpm.return_value = mock.Mock() self.manager.clean_leftovers() mock_rpm.assert_called_once_with( '/root-dir', 'macros.kiwi-image-config' ) mock_rpm.return_value.wipe_config.assert_called_once_with() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7671068 kiwi-11.1.8/test/unit/package_manager/init_test.py0000644000000000000000000000312415273675667017122 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.package_manager import PackageManager from kiwi.exceptions import KiwiPackageManagerSetupError class TestPackageManager: def test_package_manager_not_implemented(self): with raises(KiwiPackageManagerSetupError): PackageManager.new('repository', 'ms-manager') @patch('kiwi.package_manager.zypper.PackageManagerZypper') def test_manager_zypper(self, mock_manager): repository = Mock() PackageManager.new(repository, 'zypper') mock_manager.assert_called_once_with(repository, [], '') @patch('kiwi.package_manager.dnf.PackageManagerDnf') def test_manager_dnf(self, mock_manager): repository = Mock() PackageManager.new(repository, 'dnf') mock_manager.assert_called_once_with(repository, [], '') @patch('kiwi.package_manager.microdnf.PackageManagerMicroDnf') def test_manager_microdnf(self, mock_manager): repository = Mock() PackageManager.new(repository, 'microdnf') mock_manager.assert_called_once_with(repository, [], '') @patch('kiwi.package_manager.apt.PackageManagerApt') def test_manager_apt(self, mock_manager): repository = Mock() PackageManager.new(repository, 'apt') mock_manager.assert_called_once_with(repository, [], '') @patch('kiwi.package_manager.pacman.PackageManagerPacman') def test_manager_pacman(self, mock_manager): repository = Mock() PackageManager.new(repository, 'pacman') mock_manager.assert_called_once_with(repository, [], '') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7671068 kiwi-11.1.8/test/unit/package_manager/microdnf_test.py0000644000000000000000000001671015273675667017765 0ustar00from unittest.mock import patch, call from pytest import raises import unittest.mock as mock from kiwi.package_manager.microdnf import PackageManagerMicroDnf from kiwi.exceptions import KiwiRequestError class TestPackageManagerMicroDnf: def setup(self): repository = mock.Mock() repository.root_dir = '/root-dir' repository.runtime_config = mock.Mock( return_value={ 'dnf_args': ['--config', '/root-dir/dnf.conf', '-y'], 'command_env': ['env'], } ) repository.shared_dnf_dir = { 'reposd-dir': 'repos', 'cache-dir': 'cache', 'pluginconf-dir': 'pluginconf', 'vars-dir': 'vars', } self.manager = PackageManagerMicroDnf(repository) def setup_method(self, cls): self.setup() def test_request_package(self): self.manager.request_package('name') assert self.manager.package_requests == ['name'] def test_request_collection(self): self.manager.request_collection('name') assert self.manager.collection_requests == [] def test_request_product(self): self.manager.request_product('name') assert self.manager.product_requests == [] def test_request_package_exclusion(self): self.manager.request_package_exclusion('name') assert self.manager.exclude_requests == ['name'] @patch('kiwi.command.Command.run') def test_setup_repository_modules(self, mock_run): self.manager.setup_repository_modules( {'disable': ['mod_c'], 'enable': ['mod_a:stream', 'mod_b']} ) microdnf_call_args = [ 'microdnf', '--refresh', '--config', '/root-dir/dnf.conf', '-y', '--installroot', '/root-dir', '--releasever=0', '--noplugins', '--setopt=cachedir=cache', '--setopt=reposdir=repos', '--setopt=varsdir=vars', ] assert mock_run.call_args_list == [ call(microdnf_call_args + ['module', 'disable', 'mod_c'], ['env']), call(microdnf_call_args + ['module', 'reset', 'mod_a'], ['env']), call( microdnf_call_args + ['module', 'enable', 'mod_a:stream'], ['env'], ), call(microdnf_call_args + ['module', 'reset', 'mod_b'], ['env']), call(microdnf_call_args + ['module', 'enable', 'mod_b'], ['env']), ] @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_install_requests_bootstrap(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.request_collection('collection') self.manager.process_install_requests_bootstrap() mock_call.assert_called_once_with( [ 'microdnf', '--refresh', '--config', '/root-dir/dnf.conf', '-y', '--installroot', '/root-dir', '--releasever=0', '--noplugins', '--setopt=cachedir=cache', '--setopt=reposdir=repos', '--setopt=varsdir=vars', 'install', 'vim', ], ['env'], ) @patch('kiwi.command.Command.call') def test_process_install_requests(self, mock_call): self.manager.request_package('vim') self.manager.request_collection('collection') self.manager.request_package_exclusion('skipme') self.manager.process_install_requests() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'microdnf', '--config', '/dnf.conf', '-y', '--releasever=0', '--exclude=skipme', 'install', 'vim', ], ['env'], ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests_force(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.process_delete_requests(True) mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'rpm', '-e', '--nodeps', '--allmatches', '--noscripts', 'vim', ], ['env'], ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests_no_force(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.process_delete_requests() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'microdnf', '--config', '/dnf.conf', '-y', '--releasever=0', 'remove', 'vim', ], ['env'], ) @patch('kiwi.command.Command.run') @patch('kiwi.command.Command.call') def test_process_delete_requests_package_missing(self, mock_call, mock_run): mock_run.side_effect = Exception self.manager.request_package('vim') with raises(KiwiRequestError): self.manager.process_delete_requests(force=True) mock_run.assert_called_once_with( ['chroot', '/root-dir', 'rpm', '-q', 'vim'] ) @patch('kiwi.command.Command.call') def test_update(self, mock_call): self.manager.update() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'microdnf', '--config', '/dnf.conf', '-y', '--releasever=0', 'upgrade', ], ['env'], ) def test_process_only_required(self): self.manager.process_only_required() assert self.manager.custom_args == ['--setopt=install_weak_deps=0'] def test_process_plus_recommended(self): self.manager.process_only_required() assert self.manager.custom_args == ['--setopt=install_weak_deps=0'] self.manager.process_plus_recommended() assert '--setopt=install_weak_deps=0' not in self.manager.custom_args def test_match_package_installed(self): assert self.manager.match_package_installed('foo', 'Installing : foo') def test_match_package_deleted(self): assert self.manager.match_package_deleted('foo', 'Removing: foo') @patch('kiwi.package_manager.microdnf.RpmDataBase') def test_post_process_install_requests_bootstrap(self, mock_RpmDataBase): rpmdb = mock.Mock() rpmdb.has_rpm.return_value = True mock_RpmDataBase.return_value = rpmdb self.manager.post_process_install_requests_bootstrap() rpmdb.rebuild_database.assert_called_once_with() rpmdb.set_database_to_image_path.assert_called_once_with() @patch('kiwi.package_manager.microdnf.Rpm') def test_clean_leftovers(self, mock_rpm): mock_rpm.return_value = mock.Mock() self.manager.clean_leftovers() mock_rpm.assert_called_once_with( '/root-dir', 'macros.kiwi-image-config' ) mock_rpm.return_value.wipe_config.assert_called_once_with() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7671068 kiwi-11.1.8/test/unit/package_manager/pacman_test.py0000644000000000000000000001353715273675667017427 0ustar00from unittest.mock import patch from pytest import raises, fixture import unittest.mock as mock from kiwi.package_manager.pacman import PackageManagerPacman from kiwi.exceptions import KiwiRequestError class TestPackageManagerPacman: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): repository = mock.Mock() repository.root_dir = '/root-dir' repository.runtime_config = mock.Mock( return_value={ 'pacman_args': [ '--config', '/root-dir/pacman.conf', '-y', '--noconfirm', ], 'command_env': ['env'], } ) self.manager = PackageManagerPacman(repository) def setup_method(self, cls): self.setup() def test_request_package(self): self.manager.request_package('name') assert self.manager.package_requests == ['name'] def test_request_collection(self): self.manager.request_collection('name') assert self.manager.collection_requests == [] assert self.manager.package_requests == ['name'] def test_request_product(self): self.manager.request_product('name') assert self.manager.product_requests == [] def test_request_package_exclusion(self): self.manager.request_package_exclusion('name') assert self.manager.exclude_requests == ['name'] def test_setup_repository_modules(self): self.manager.setup_repository_modules({}) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_install_requests_bootstrap(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.request_collection('collection') self.manager.process_install_requests_bootstrap() mock_run.assert_called_once_with( [ 'pacman', '--config', '/root-dir/pacman.conf', '-y', '--noconfirm', '--root', '/root-dir', '-Sy', ], ['env'], ) mock_call.assert_called_once_with( [ 'pacman', '--config', '/root-dir/pacman.conf', '-y', '--noconfirm', '--root', '/root-dir', '-S', '--needed', '--overwrite', '/root-dir/var/run', 'vim', 'collection', ], ['env'], ) @patch('kiwi.command.Command.call') def test_process_install_requests(self, mock_call): self.manager.request_package('vim') self.manager.request_collection('collection') self.manager.request_package_exclusion('skipme') self.manager.process_install_requests() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'pacman', '--config', '/pacman.conf', '-y', '--noconfirm', '-S', '--needed', 'vim', 'collection', ], ['env'], ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests_force(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.process_delete_requests(True) mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'pacman', '--config', '/pacman.conf', '-y', '--noconfirm', '-Rdd', 'vim', ], ['env'], ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests_no_force(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.process_delete_requests() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'pacman', '--config', '/pacman.conf', '-y', '--noconfirm', '-Rs', 'vim', ], ['env'], ) @patch('kiwi.command.Command.run') @patch('kiwi.command.Command.call') def test_process_delete_requests_package_missing(self, mock_call, mock_run): mock_run.side_effect = Exception self.manager.request_package('vim') with raises(KiwiRequestError): self.manager.process_delete_requests() mock_run.assert_called_once_with( ['chroot', '/root-dir', 'pacman', '-Qi', 'vim'] ) def test_process_only_required(self): self.manager.process_only_required() assert self.manager.custom_args == [] def test_process_plus_recommended(self): self.manager.process_plus_recommended() assert self.manager.custom_args == [] @patch('kiwi.command.Command.call') def test_update(self, mock_call): self.manager.update() mock_call.assert_called_once_with( [ 'chroot', '/root-dir', 'pacman', '--config', '/pacman.conf', '-y', '--noconfirm', '-Su', ], ['env'], ) def test_match_package_installed(self): assert self.manager.match_package_installed('foo', ' installing foo') def test_match_package_deleted(self): assert self.manager.match_package_deleted('foo', ' removing foo') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7671068 kiwi-11.1.8/test/unit/package_manager/zypper_test.py0000644000000000000000000001765315273675667017524 0ustar00from unittest.mock import patch from pytest import raises import unittest.mock as mock from kiwi.path import Path from kiwi.package_manager.zypper import PackageManagerZypper from kiwi.exceptions import KiwiRequestError class TestPackageManagerZypper: def setup(self): repository = mock.Mock() repository.root_dir = 'root-dir' self.command_env = { 'HOME': '/home/ms', 'ZYPP_CONF': 'root-dir/my/zypp.conf', } repository.runtime_config = mock.MagicMock( return_value={ 'zypper_args': ['--reposd-dir', 'root-dir/my/repos'], 'command_env': self.command_env, } ) self.manager = PackageManagerZypper(repository) self.chroot_zypper_args = Path.move_to_root( 'root-dir', self.manager.zypper_args ) self.chroot_command_env = self.manager.command_env zypp_conf = self.manager.command_env['ZYPP_CONF'] self.chroot_command_env['ZYPP_CONF'] = Path.move_to_root( 'root-dir', [zypp_conf] )[0] def setup_method(self, cls): self.setup() def test_request_package(self): self.manager.request_package('name') assert self.manager.package_requests == ['name'] def test_request_collection(self): self.manager.request_collection('name') assert self.manager.collection_requests == ['pattern:name'] def test_request_product(self): self.manager.request_product('name') assert self.manager.product_requests == ['product:name'] def test_request_package_exclusion(self): self.manager.request_package_exclusion('name') assert self.manager.exclude_requests == ['name'] def test_setup_repository_modules(self): self.manager.setup_repository_modules({}) @patch('kiwi.command.Command.call') def test_process_install_requests_bootstrap(self, mock_call): self.manager.request_package('vim') self.manager.process_install_requests_bootstrap() mock_call.assert_called_once_with( [ 'zypper', '--reposd-dir', 'root-dir/my/repos', '--root', 'root-dir', 'install', '--download', 'in-advance', '--auto-agree-with-licenses', ] + self.manager.custom_args + ['--', 'vim'], self.command_env, ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') @patch('os.path.exists') @patch('kiwi.package_manager.zypper.Path.create') def test_process_install_requests( self, mock_path, mock_exists, mock_run, mock_call ): mock_exists.return_value = False self.manager.request_package('vim') self.manager.request_package_exclusion('skipme') self.manager.process_install_requests() mock_path.assert_called_once_with('root-dir/etc/zypp') mock_run.assert_called_once_with( ['chroot', 'root-dir', 'zypper'] + self.chroot_zypper_args + ['al'] + self.manager.custom_args + ['skipme'], self.chroot_command_env, ) mock_call.assert_called_once_with( ['chroot', 'root-dir', 'zypper'] + self.chroot_zypper_args + [ 'install', '--download', 'in-advance', '--auto-agree-with-licenses', ] + self.manager.custom_args + ['--', 'vim'], self.chroot_command_env, ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests_all_installed(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.process_delete_requests() mock_call.assert_called_once_with( ['chroot', 'root-dir', 'zypper'] + self.chroot_zypper_args + ['remove', '-u', '--force-resolution'] + self.manager.custom_args + ['vim'], self.chroot_command_env, ) @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') def test_process_delete_requests_force(self, mock_run, mock_call): self.manager.request_package('vim') self.manager.process_delete_requests(True) mock_call.assert_called_once_with( [ 'chroot', 'root-dir', 'rpm', '-e', '--nodeps', '--allmatches', '--noscripts', 'vim', ], self.command_env, ) @patch('kiwi.command.Command.run') @patch('kiwi.command.Command.call') def test_process_delete_requests_package_missing(self, mock_call, mock_run): mock_run.side_effect = Exception self.manager.request_package('vim') with raises(KiwiRequestError): self.manager.process_delete_requests(force=True) mock_run.assert_called_once_with( ['chroot', 'root-dir', 'rpm', '-q', 'vim'] ) @patch('kiwi.command.Command.call') def test_update(self, mock_call): self.manager.update() mock_call.assert_called_once_with( ['chroot', 'root-dir', 'zypper'] + self.chroot_zypper_args + [ 'update', '--download', 'in-advance', '--auto-agree-with-licenses', ] + self.manager.custom_args, self.chroot_command_env, ) def test_process_only_required(self): self.manager.process_only_required() assert self.manager.custom_args == ['--no-recommends'] def test_process_plus_recommended(self): self.manager.process_only_required() assert self.manager.custom_args == ['--no-recommends'] self.manager.process_plus_recommended() assert '--no-recommends' not in self.manager.custom_args def test_match_package_installed(self): assert self.manager.match_package_installed('foo', 'Installing: foo') def test_match_package_deleted(self): assert self.manager.match_package_deleted('foo', 'Removing: foo') @patch('kiwi.package_manager.zypper.RpmDataBase') def test_post_process_install_requests_bootstrap(self, mock_RpmDataBase): rpmdb = mock.Mock() rpmdb.has_rpm.return_value = True mock_RpmDataBase.return_value = rpmdb self.manager.post_process_install_requests_bootstrap() rpmdb.rebuild_database.assert_called_once_with() rpmdb.set_database_to_image_path.assert_called_once_with() def test_has_failed(self): assert self.manager.has_failed(0) is False assert self.manager.has_failed(102) is False assert self.manager.has_failed(100) is False assert self.manager.has_failed(104) is True assert self.manager.has_failed(105) is True assert self.manager.has_failed(106) is True assert self.manager.has_failed(1) is True assert self.manager.has_failed(4) is True assert self.manager.has_failed(-42) is True assert self.manager.has_failed(127) is True @patch('kiwi.package_manager.zypper.os.unlink') @patch('kiwi.package_manager.zypper.os.path.exists') @patch('kiwi.package_manager.zypper.Rpm') def test_clean_leftovers(self, mock_rpm, mock_exists, mock_unlink): mock_exists.return_value = True mock_rpm.return_value = mock.Mock() self.manager.clean_leftovers() mock_rpm.assert_called_once_with('root-dir', 'macros.kiwi-image-config') mock_rpm.return_value.wipe_config.assert_called_once_with() mock_exists.assert_called_once_with( 'root-dir/var/lib/zypp/AnonymousUniqueId' ) mock_unlink.assert_called_once_with( 'root-dir/var/lib/zypp/AnonymousUniqueId' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7671068 kiwi-11.1.8/test/unit/partitioner/__init__.py0000644000000000000000000000000015273675667016120 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7674773 kiwi-11.1.8/test/unit/partitioner/base_test.py0000644000000000000000000000237515273675667016353 0ustar00from unittest.mock import Mock from pytest import raises from kiwi.partitioner.base import PartitionerBase class TestPartitionerBase: def setup(self): disk_provider = Mock() disk_provider.get_device = Mock(return_value='/dev/loop0') self.partitioner = PartitionerBase(disk_provider) def setup_method(self, cls): self.setup() def test_get_id(self): assert self.partitioner.get_id() == 0 def test_set_uuid(self): with raises(NotImplementedError): self.partitioner.set_uuid(100, 'ID') def test_create(self): with raises(NotImplementedError): self.partitioner.create('name', 100, 'type', ['flag']) def test_set_flag(self): with raises(NotImplementedError): self.partitioner.set_flag(1, 'flag') def test_set_hybrid_mbr(self): with raises(NotImplementedError): self.partitioner.set_hybrid_mbr() def test_set_mbr(self): with raises(NotImplementedError): self.partitioner.set_mbr() def test_resize_table(self): with raises(NotImplementedError): self.partitioner.resize_table() def test_set_start_sector(self): assert self.partitioner.set_start_sector(4096) is None ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7674773 kiwi-11.1.8/test/unit/partitioner/dasd_test.py0000644000000000000000000000412615273675667016350 0ustar00import logging from pytest import fixture from unittest.mock import patch, mock_open import unittest.mock as mock from kiwi.partitioner.dasd import PartitionerDasd class TestPartitionerDasd: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.partitioner.dasd.Command.run') @patch('kiwi.partitioner.dasd.Temporary.new_file') def setup(self, mock_temp, mock_command): self.tempfile = mock.Mock() self.tempfile.name = 'tempfile' mock_temp.return_value = self.tempfile disk_provider = mock.Mock() disk_provider.get_device = mock.Mock(return_value='/dev/loop0') self.partitioner = PartitionerDasd(disk_provider) @patch('kiwi.partitioner.dasd.Command.run') @patch('kiwi.partitioner.dasd.Temporary.new_file') def setup_method(self, cls, mock_temp, mock_command): self.setup() @patch('kiwi.partitioner.dasd.Command.run') @patch('kiwi.partitioner.dasd.Temporary.new_file') def test_create(self, mock_temp, mock_command): mock_command.side_effect = Exception mock_temp.return_value = self.tempfile m_open = mock_open() with patch('builtins.open', m_open, create=True): with self._caplog.at_level(logging.DEBUG): self.partitioner.create('name', '100', 't.linux', ['f.active']) m_open.return_value.write.assert_called_once_with( 'n\np\n\n+100M\nw\nq\n' ) mock_command.assert_called_once_with( ['bash', '-c', 'cat tempfile | fdasd -f /dev/loop0'] ) @patch('kiwi.partitioner.dasd.Command.run') @patch('kiwi.partitioner.dasd.Temporary.new_file') def test_create_all_free(self, mock_temp, mock_command): mock_temp.return_value = self.tempfile m_open = mock_open() with patch('builtins.open', m_open, create=True): self.partitioner.create('name', 'all_free', 't.linux') m_open.return_value.write.assert_called_once_with('n\np\n\n\nw\nq\n') def test_resize_table(self): self.partitioner.resize_table() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7674773 kiwi-11.1.8/test/unit/partitioner/gpt_test.py0000644000000000000000000001231715273675667016230 0ustar00import logging from unittest.mock import patch, call, Mock from pytest import raises, fixture from kiwi.partitioner.gpt import PartitionerGpt from kiwi.exceptions import KiwiPartitionerGptFlagError class TestPartitionerGpt: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): disk_provider = Mock() disk_provider.get_device = Mock(return_value='/dev/loop0') self.partitioner = PartitionerGpt(disk_provider) def setup_method(self, cls): self.setup() @patch('kiwi.partitioner.gpt.Command.run') @patch('kiwi.partitioner.gpt.PartitionerGpt.set_flag') def test_create(self, mock_flag, mock_command): self.partitioner.create('name', 100, 't.linux', ['t.csm']) mock_command.assert_called_once_with( [ 'sgdisk', '--align-end', '-n', '1:0:+100M', '-c', '1:name', '/dev/loop0', ] ) call = mock_flag.call_args_list[0] assert mock_flag.call_args_list[0] == call(1, 't.linux') call = mock_flag.call_args_list[1] assert mock_flag.call_args_list[1] == call(1, 't.csm') @patch('kiwi.partitioner.gpt.Command.run') @patch('kiwi.partitioner.gpt.PartitionerGpt.set_flag') def test_create_custom_start_sector(self, mock_flag, mock_command): disk_provider = Mock() disk_provider.get_device = Mock(return_value='/dev/loop0') partitioner = PartitionerGpt(disk_provider, 4096) partitioner.create('name', 100, 't.linux', ['t.csm']) partitioner.create('name', 100, 't.linux', ['t.csm']) mock_command.assert_has_calls( [ call( [ 'sgdisk', '--align-end', '-n', '1:4096:+100M', '-c', '1:name', '/dev/loop0', ] ), call( [ 'sgdisk', '--align-end', '-n', '2:0:+100M', '-c', '2:name', '/dev/loop0', ] ), ] ) assert mock_flag.call_args_list[0] == call(1, 't.linux') assert mock_flag.call_args_list[1] == call(1, 't.csm') @patch('kiwi.partitioner.gpt.Command.run') @patch('kiwi.partitioner.gpt.PartitionerGpt.set_flag') def test_create_all_free(self, mock_flag, mock_command): self.partitioner.create('name', 'all_free', 't.linux') mock_command.assert_called_once_with( [ 'sgdisk', '--align-end', '-n', '1:0:0', '-c', '1:name', '/dev/loop0', ] ) def test_set_flag_invalid(self): with raises(KiwiPartitionerGptFlagError): self.partitioner.set_flag(1, 'foo') @patch('kiwi.partitioner.gpt.Command.run') def test_set_flag(self, mock_command): self.partitioner.set_flag(1, 't.csm') mock_command.assert_called_once_with( ['sgdisk', '-t', '1:EF02', '/dev/loop0'] ) def test_set_flag_ignored(self): with self._caplog.at_level(logging.WARNING): self.partitioner.set_flag(1, 'f.active') @patch('kiwi.partitioner.gpt.Command.run') def test_set_hybrid_mbr(self, mock_command): self.partitioner.partition_id = 5 self.partitioner.partition_count = 5 self.partitioner.partition_map = {1: 1, 2: 2, 3: 3, 4: 4, 5: 5} self.partitioner.set_hybrid_mbr() mock_command.assert_called_once_with( ['sgdisk', '-h', '1:2:3', '/dev/loop0'] ) @patch('kiwi.partitioner.gpt.Command.run') def test_set_mbr(self, mock_command): command_output = Mock() command_output.output = '...(EFI System)' self.partitioner.partition_id = 4 self.partitioner.partition_count = 4 self.partitioner.partition_map = {1: 1, 2: 2, 3: 3, 4: 4} mock_command.return_value = command_output self.partitioner.set_mbr() assert mock_command.call_args_list == [ call(['sgdisk', '-i=1', '/dev/loop0']), call(['sgdisk', '-i=2', '/dev/loop0']), call(['sgdisk', '-i=3', '/dev/loop0']), call(['sgdisk', '-i=4', '/dev/loop0']), call(['sgdisk', '-t', '4:8300', '/dev/loop0']), call(['sgdisk', '-m', '1:2:3:4', '/dev/loop0']), ] @patch('kiwi.partitioner.gpt.Command.run') def test_resize_table(self, mock_command): self.partitioner.resize_table(42) mock_command.assert_called_once_with( ['sgdisk', '--resize-table', '42', '/dev/loop0'] ) @patch('kiwi.partitioner.gpt.Command.run') def test_set_uuid(self, mock_Command_run): self.partitioner.set_uuid(42, 'ID') mock_Command_run.assert_called_once_with( ['sgdisk', '--typecode', '42:ID', '/dev/loop0'] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7674773 kiwi-11.1.8/test/unit/partitioner/init_test.py0000644000000000000000000000326315273675667016401 0ustar00import logging from unittest.mock import patch, Mock from pytest import raises, fixture from kiwi.partitioner import Partitioner from kiwi.exceptions import KiwiPartitionerSetupError class TestPartitioner: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def test_partitioner_not_implemented(self): with raises(KiwiPartitionerSetupError): Partitioner.new('foo', Mock()) def test_partitioner_for_arch_not_implemented(self): with raises(KiwiPartitionerSetupError): Partitioner.new('foo', Mock()) @patch('kiwi.partitioner.gpt.PartitionerGpt') def test_partitioner_gpt(self, mock_gpt): storage_provider = Mock() Partitioner.new('gpt', storage_provider) mock_gpt.assert_called_once_with(storage_provider, None, False) @patch('kiwi.partitioner.msdos.PartitionerMsDos') def test_partitioner_msdos(self, mock_dos): storage_provider = Mock() Partitioner.new('msdos', storage_provider) mock_dos.assert_called_once_with(storage_provider, None, False) @patch('kiwi.partitioner.dasd.PartitionerDasd') def test_partitioner_dasd(self, mock_dasd): storage_provider = Mock() Partitioner.new('dasd', storage_provider) mock_dasd.assert_called_once_with(storage_provider, None, False) @patch('kiwi.partitioner.dasd.PartitionerDasd') def test_partitioner_dasd_with_custom_start_sector(self, mock_dasd): storage_provider = Mock() with self._caplog.at_level(logging.WARNING): Partitioner.new('dasd', storage_provider, 4096) mock_dasd.assert_called_once_with(storage_provider, None, False) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7674773 kiwi-11.1.8/test/unit/partitioner/msdos_test.py0000644000000000000000000001777715273675667016602 0ustar00import logging from unittest.mock import patch, call, mock_open, Mock from pytest import raises, fixture from collections import namedtuple from kiwi.partitioner.msdos import PartitionerMsDos from kiwi.exceptions import KiwiPartitionerMsDosFlagError class TestPartitionerMsDos: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): disk_provider = Mock() disk_provider.get_device = Mock(return_value='/dev/loop0') self.partitioner = PartitionerMsDos(disk_provider, 4096) self.partitioner_extended = PartitionerMsDos( disk_provider, extended_layout=True ) def setup_method(self, cls): self.setup() @patch('kiwi.partitioner.msdos.Command.run') @patch('kiwi.partitioner.msdos.PartitionerMsDos.set_flag') @patch('kiwi.partitioner.msdos.Temporary.new_file') def test_create_primary_size_as_string( self, mock_temp, mock_flag, mock_command ): # sizes of clones are given as numeric strings temp_type = namedtuple('temp_type', ['name']) mock_temp.return_value = temp_type(name='tempfile') m_open = mock_open() with patch('builtins.open', m_open, create=True): self.partitioner._create_primary('name', '100', 't.linux') m_open.return_value.write.assert_called_once_with( 'n\np\n1\n\n+101M\nw\nq\n' ) @patch('kiwi.partitioner.msdos.Command.run') @patch('kiwi.partitioner.msdos.PartitionerMsDos.set_flag') @patch('kiwi.partitioner.msdos.Temporary.new_file') def test_create_primary(self, mock_temp, mock_flag, mock_command): mock_command.side_effect = Exception temp_type = namedtuple('temp_type', ['name']) mock_temp.return_value = temp_type(name='tempfile') m_open = mock_open() with patch('builtins.open', m_open, create=True): self.partitioner._create_primary( 'name', 100, 't.linux', ['f.active'] ) m_open.return_value.write.assert_called_once_with( 'n\np\n1\n\n+101M\nw\nq\n' ) call = mock_flag.call_args_list[0] assert mock_flag.call_args_list[0] == call(1, 't.linux') call = mock_flag.call_args_list[1] assert mock_flag.call_args_list[1] == call(1, 'f.active') mock_command.assert_called_once_with( ['bash', '-c', 'cat tempfile | fdisk /dev/loop0'] ) @patch('kiwi.partitioner.msdos.Command.run') @patch('kiwi.partitioner.msdos.PartitionerMsDos.set_flag') @patch('kiwi.partitioner.msdos.Temporary.new_file') def test_create_extended(self, mock_temp, mock_flag, mock_command): mock_command.side_effect = Exception temp_type = namedtuple('temp_type', ['name']) mock_temp.return_value = temp_type(name='tempfile') m_open = mock_open() with patch('builtins.open', m_open, create=True): self.partitioner._create_extended('name') m_open.return_value.write.assert_called_once_with('n\ne\n1\n\n\nw\nq\n') mock_command.assert_called_once_with( ['bash', '-c', 'cat tempfile | fdisk /dev/loop0'] ) @patch('kiwi.partitioner.msdos.Command.run') @patch('kiwi.partitioner.msdos.PartitionerMsDos.set_flag') @patch('kiwi.partitioner.msdos.Temporary.new_file') def test_create_logical(self, mock_temp, mock_flag, mock_command): mock_command.side_effect = Exception temp_type = namedtuple('temp_type', ['name']) mock_temp.return_value = temp_type(name='tempfile') m_open = mock_open() with patch('builtins.open', m_open, create=True): self.partitioner._create_logical( 'name', 100, 't.linux', ['f.active'] ) m_open.return_value.write.assert_called_once_with( 'n\n1\n\n+100M\nw\nq\n' ) call = mock_flag.call_args_list[0] assert mock_flag.call_args_list[0] == call(1, 't.linux') call = mock_flag.call_args_list[1] assert mock_flag.call_args_list[1] == call(1, 'f.active') mock_command.assert_called_once_with( ['bash', '-c', 'cat tempfile | fdisk /dev/loop0'] ) @patch.object(PartitionerMsDos, '_create_primary') @patch.object(PartitionerMsDos, '_create_extended') @patch.object(PartitionerMsDos, '_create_logical') def test_create( self, mock_create_logical, mock_create_extended, mock_create_primary ): self.partitioner.create('name', 100, 't.linux') mock_create_primary.assert_called_once_with( 'name', 100, 't.linux', [], None ) mock_create_primary.reset_mock() self.partitioner_extended.create('name', 100, 't.linux') mock_create_primary.assert_called_once_with( 'name', 100, 't.linux', [], None ) self.partitioner_extended.partition_id = 3 self.partitioner_extended.partition_count = 3 self.partitioner_extended.create('name', 100, 't.linux') mock_create_extended.assert_called_once_with('name') mock_create_logical.assert_called_once_with( 'name', 100, 't.linux', [], None ) mock_create_logical.reset_mock() self.partitioner_extended.partition_id = 7 self.partitioner_extended.partition_count = 7 self.partitioner_extended.create('name', 100, 't.linux') mock_create_logical.assert_called_once_with( 'name', 100, 't.linux', [], None ) @patch('kiwi.partitioner.msdos.Command.run') @patch('kiwi.partitioner.msdos.PartitionerMsDos.set_flag') @patch('kiwi.partitioner.msdos.Temporary.new_file') def test_create_all_free(self, mock_temp, mock_flag, mock_command): mock_command.side_effect = Exception temp_type = namedtuple('temp_type', ['name']) mock_temp.return_value = temp_type(name='tempfile') m_open = mock_open() with patch('builtins.open', m_open, create=True): self.partitioner.create('name', 'all_free', 't.linux') m_open.return_value.write.assert_called_once_with('n\np\n1\n\n\nw\nq\n') def test_set_flag_invalid(self): with raises(KiwiPartitionerMsDosFlagError): self.partitioner.set_flag(1, 'foo') @patch('kiwi.partitioner.msdos.Command.run') def test_set_flag(self, mock_command): self.partitioner.set_flag(1, 't.linux') mock_command.assert_called_once_with( ['sfdisk', '-c', '/dev/loop0', '1', '83'] ) @patch('kiwi.partitioner.msdos.Command.run') def test_set_active(self, mock_command): self.partitioner.set_flag(1, 'f.active') mock_command.assert_called_once_with( ['sfdisk', '--activate', '/dev/loop0', '1'] ) def test_set_flag_ignored(self): with self._caplog.at_level(logging.WARNING): self.partitioner.set_flag(1, 't.csm') def test_resize_table(self): self.partitioner.resize_table() @patch('kiwi.partitioner.msdos.Command.run') @patch('kiwi.partitioner.msdos.Temporary.new_file') @patch('kiwi.partitioner.msdos.BlockID') def test_set_start_sector(self, mock_BlockID, mock_temp, mock_Command_run): temp_type = namedtuple('temp_type', ['name']) mock_temp.return_value = temp_type(name='tempfile') m_open = mock_open() mock_BlockID.return_value.get_partition_count.return_value = 4 with patch('builtins.open', m_open, create=True): self.partitioner.set_start_sector(4096) assert m_open.return_value.write.call_args_list == [ call('d\n1\nn\np\n4096\n\nw\nq\n') ] mock_Command_run.assert_called_once_with( ['bash', '-c', 'cat tempfile | fdisk /dev/loop0'] ) mock_BlockID.return_value.get_partition_count.return_value = 3 m_open.reset_mock() with patch('builtins.open', m_open, create=True): self.partitioner.set_start_sector(4096) assert m_open.return_value.write.call_args_list == [ call('d\n1\nn\np\n1\n4096\n\nw\nq\n') ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7674773 kiwi-11.1.8/test/unit/path_test.py0000644000000000000000000001224415273675667014031 0ustar00import logging from unittest.mock import patch, call, Mock from pytest import raises, fixture import os import pytest from kiwi.path import Path from kiwi.exceptions import KiwiFileAccessError class TestPath: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def test_sort_by_hierarchy(self): ordered = Path.sort_by_hierarchy(['usr', 'usr/bin', 'etc', 'usr/lib']) assert ordered == ['usr', 'etc', 'usr/bin', 'usr/lib'] @patch('pathlib.Path') def test_create(self, mock_Path): path = Mock() mock_Path.return_value = path Path.create('foo') path.mkdir.assert_called_once_with(parents=True, exist_ok=True) mock_Path.return_value = Exception with raises(KiwiFileAccessError): Path.create('foo') @patch('kiwi.command.os.path.exists') @patch('kiwi.command.Command.run') def test_wipe(self, mock_command, mock_exists): mock_exists.return_value = True Path.wipe('foo') mock_command.assert_called_once_with(['rm', '-r', '-f', 'foo']) mock_exists.return_value = False mock_command.reset_mock() Path.wipe('foo') assert not mock_command.called @patch('kiwi.command.Command.run') def test_remove_hierarchy(self, mock_command): Path.remove_hierarchy('/my_root', '/tmp/foo/bar') with self._caplog.at_level(logging.WARNING): assert mock_command.call_args_list == [ call( [ 'rmdir', '--ignore-fail-on-non-empty', '/my_root/tmp/foo/bar', ] ), call( ['rmdir', '--ignore-fail-on-non-empty', '/my_root/tmp/foo'] ), ] assert ( 'remove_hierarchy: path /my_root/tmp is protected' in self._caplog.text ) mock_command.reset_mock() Path.remove_hierarchy('/home/kiwi/my_root', 'foo') mock_command.assert_called_once_with( ['rmdir', '--ignore-fail-on-non-empty', '/home/kiwi/my_root/foo'] ) def test_move_to_root(self): assert ['/usr/bin', '/sbin'] == Path.move_to_root( '/root_dir', ['/root_dir/usr/bin', '/sbin'] ) def test_rebase_to_root(self): assert ['/root_dir/usr/bin', '/root_dir/sbin'] == Path.rebase_to_root( '/root_dir', ['usr/bin', '/sbin'] ) @patch('os.access') @patch('os.environ.get') @patch('os.path.exists') def test_which(self, mock_exists, mock_env, mock_access): mock_env.return_value = '/usr/local/bin:/usr/bin:/bin' mock_exists.return_value = True assert Path.which('some-file') == '/usr/local/bin/some-file' mock_exists.return_value = False assert Path.which('some-file') is None mock_access.return_value = False mock_env.return_value = '/usr/local/bin:/usr/bin:/bin' assert Path.which('some-file', access_mode=os.X_OK) is None def test_which_with_real_data(self, pytestconfig: 'pytest.Config'): rootpath = getattr( pytestconfig, 'rootpath', getattr(pytestconfig, 'rootdir') ) assert Path.which( 'pyproject.toml', custom_env={'PATH': str(rootpath)}, access_mode=os.F_OK, ) == str(rootpath / "pyproject.toml") assert Path.which( '__init__.py', custom_env={'PATH': "/kiwi/"}, access_mode=os.F_OK, root_dir=str(rootpath), ) == str(rootpath / "kiwi" / "__init__.py") @patch('os.access') @patch('os.environ.get') @patch('os.path.exists') def test_which_not_found_log(self, mock_exists, mock_env, mock_access): PATH = '/usr/local/bin:/usr/bin:/bin' mock_env.return_value = PATH mock_exists.return_value = False with self._caplog.at_level(logging.DEBUG): assert Path.which('file') is None assert ('Looking for file in ' + PATH) in self._caplog.text def test_access_invalid_mode(self): with raises(ValueError) as issue: Path.access("/some/non-existent-file/", 128) assert '0x80' in format(issue.value) def test_access_with_non_existent_file(self): non_existent = "/some/file/that/should/not/exist" with raises(KiwiFileAccessError) as issue: Path.access(non_existent, os.F_OK) assert non_existent in issue.value.message @patch('os.stat') @patch('os.access') def test_access_with_args(self, mock_access, mock_stat): mock_access.return_value = True fname = "arbitrary" mode = os.R_OK assert Path.access(fname, mode, effective_ids=True) mock_stat.assert_called_once_with(fname) mock_access.assert_called_once_with(fname, mode, effective_ids=True) def test_first_exists(self): assert Path.first_exists('/') == '/' assert Path.first_exists('/etc/foo/bar') == '/etc' assert Path.first_exists('artificial') == '.' assert Path.first_exists('foo/bar') == '.' assert Path.first_exists('/x/y/z') == '/' ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7674773 kiwi-11.1.8/test/unit/privileges_test.py0000644000000000000000000000110015273675667015233 0ustar00from unittest.mock import patch from pytest import raises from kiwi.privileges import Privileges from kiwi.exceptions import KiwiPrivilegesError class TestPrivileges: @patch('os.geteuid') def test_check_for_root_permiossion_false(self, mock_euid): mock_euid.return_value = 1 with raises(KiwiPrivilegesError): Privileges.check_for_root_permissions() @patch('os.geteuid') def test_check_for_root_permiossion_true(self, mock_euid): mock_euid.return_value = 0 assert Privileges.check_for_root_permissions() is True ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7674773 kiwi-11.1.8/test/unit/repository/__init__.py0000644000000000000000000000000015273675667015777 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7677321 kiwi-11.1.8/test/unit/repository/apk_test.py0000644000000000000000000000633515273675667016073 0ustar00import io from unittest.mock import patch, Mock, MagicMock from kiwi.repository.apk import RepositoryApk class TestRepositoryApk: @patch('kiwi.repository.apk.Path.create') def setup(self, mock_path_create): root_bind = Mock() root_bind.root_dir = '../data' root_bind.shared_location = '/shared-dir' self.repo = RepositoryApk(root_bind) mock_path_create.assert_called_once_with('../data//etc/apk') @patch('kiwi.repository.apk.Path.create') def setup_method(self, cls, mock_path_create): self.setup() def test_runtime_config(self): assert ( self.repo.runtime_config()['bootstrap_repo'] == self.repo.bootstrap_repo ) assert ( self.repo.runtime_config()['command_env'] == self.repo.command_env ) def test_runtime_environment_host_proxy(self, monkeypatch): monkeypatch.setenv('HTTP_PROXY', 'http://proxy:3128') command_env = self.repo._create_apk_get_runtime_environment() assert command_env['http_proxy'] == 'http://proxy:3128' assert command_env['HTTP_PROXY'] == 'http://proxy:3128' def test_add_repo(self): with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.add_repo('some', 'https://some') assert self.repo.bootstrap_repo == 'https://some' file_handle.write.assert_called_once_with('https://some\n') def test_setup_package_database_configuration(self): self.repo.setup_package_database_configuration() def test_import_trusted_keys(self): self.repo.import_trusted_keys([]) @patch('os.path.isfile') @patch('os.unlink') def test_delete_repo(self, mock_os_unlink, mock_os_path_isfile): mock_os_path_isfile.return_value = True with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.add_repo('some_A', 'https://some_A') self.repo.add_repo('some_B', 'https://some_B') mock_open.reset_mock() self.repo.delete_repo('some_A') mock_os_unlink.assert_called_once_with( '../data//etc/apk/repositories' ) mock_open.assert_called_once_with( '../data//etc/apk/repositories', 'a' ) file_handle.write.assert_called_once_with('https://some_B\n') @patch('os.unlink') @patch('os.path.isfile') def test_delete_all_repos(self, mock_os_path_isfile, mock_os_unlink): mock_os_path_isfile.return_value = True self.repo.delete_all_repos() mock_os_unlink.assert_called_once_with('../data//etc/apk/repositories') mock_os_path_isfile.assert_called_once_with( '../data//etc/apk/repositories' ) def test_cleanup_unused_repos(self): self.repo.cleanup_unused_repos() def test_use_default_location(self): self.repo.use_default_location() def test_delete_repo_cache(self): self.repo.delete_repo_cache('unused') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7677321 kiwi-11.1.8/test/unit/repository/apt_test.py0000644000000000000000000007236715273675667016114 0ustar00from unittest.mock import patch, call, MagicMock from base64 import b64encode from pytest import raises import io import unittest.mock as mock from kiwi.repository.apt import RepositoryApt from kiwi.exceptions import KiwiUriOpenError class TestRepositoryApt: @patch('kiwi.repository.apt.Temporary.unmanaged_file') @patch('kiwi.repository.apt.PackageManagerTemplateAptGet') @patch('kiwi.repository.apt.Path.create') def setup(self, mock_path, mock_template, mock_temp): self.apt_conf = mock.Mock() mock_template.return_value = self.apt_conf template = mock.Mock() self.apt_conf.get_host_template.return_value = template tmpfile = mock.Mock() tmpfile.name = 'tmpfile' mock_temp.return_value = tmpfile root_bind = mock.Mock() root_bind.root_dir = '../data' root_bind.shared_location = '/shared-dir' with patch('builtins.open', create=True): self.repo = RepositoryApt(root_bind, custom_args=['exclude_docs']) self.exclude_docs = True self.apt_conf.get_host_template.assert_called_once_with( self.exclude_docs ) template.substitute.assert_called_once_with( { 'apt_shared_base': '/shared-dir/apt-get', 'unauthenticated': 'true', } ) repo = RepositoryApt( root_bind, custom_args=['check_signatures', '_target_arch%amd64'], ) assert repo.custom_args == [] assert repo.unauthenticated == 'false' repo = RepositoryApt(root_bind) assert repo.custom_args == [] assert repo.unauthenticated == 'true' @patch('kiwi.repository.apt.Temporary.unmanaged_file') @patch('kiwi.repository.apt.PackageManagerTemplateAptGet') @patch('kiwi.repository.apt.Path.create') def setup_method(self, cls, mock_path, mock_template, mock_temp): self.setup() def test_use_default_location(self): template = mock.Mock() template.substitute.return_value = 'template-data' self.apt_conf.get_image_template.return_value = template with patch('builtins.open', create=True): self.repo.use_default_location() assert ( self.repo.shared_apt_get_dir['sources-dir'] == '../data/etc/apt/sources.list.d' ) assert ( self.repo.shared_apt_get_dir['preferences-dir'] == '../data/etc/apt/preferences.d' ) assert ( self.repo.shared_apt_get_dir['netrcparts-dir'] == '../data/etc/apt/auth.conf.d' ) self.apt_conf.get_image_template.assert_called_once_with( self.exclude_docs ) template.substitute.assert_called_once_with( {'apt_shared_base': '../data/etc/apt', 'unauthenticated': 'true'} ) @patch('kiwi.repository.apt.HostProxy') def test_use_default_location_host_proxy(self, mock_HostProxy): mock_HostProxy.get_apt_config.return_value = [ 'Acquire::http::Proxy "http://proxy:3128/";' ] template = mock.Mock() template.substitute.return_value = 'template-data\n' self.apt_conf.get_image_template.return_value = template with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.use_default_location() file_handle.write.assert_called_once_with( 'template-data\nAcquire::http::Proxy "http://proxy:3128/";\n' ) @patch('kiwi.repository.apt.Path.create') @patch('kiwi.repository.apt.HostProxy') def test_runtime_environment_host_proxy( self, mock_HostProxy, mock_Path_create ): mock_HostProxy.return_value.get_env.return_value = { 'http_proxy': 'http://proxy:3128' } command_env = self.repo._create_apt_get_runtime_environment() assert command_env['http_proxy'] == 'http://proxy:3128' assert command_env['DEBIAN_FRONTEND'] == 'noninteractive' def test_runtime_config(self): assert ( self.repo.runtime_config()['apt_get_args'] == self.repo.apt_get_args ) assert ( self.repo.runtime_config()['command_env'] == self.repo.command_env ) def test_setup_package_database_configuration(self): # just pass self.repo.setup_package_database_configuration() @patch('os.path.exists') @patch('kiwi.command.Command.run') def test_add_repo_with_priority(self, mock_Command_run, mock_exists): mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.add_repo( 'foo', '/srv/my-repo', 'deb', '42', 'xenial', 'a b', customization_script='custom_script', ) assert mock_open.call_args_list == [ call('/shared-dir/apt-get/sources.list.d/foo.sources', 'w'), call('/shared-dir/apt-get/preferences.d/foo.pref', 'w'), ] assert file_handle.write.call_args_list == [ call( 'Types: deb\n' 'URIs: file:/srv/my-repo\n' 'Suites: xenial\n' 'Components: a b\n' ), call('Package: *\n'), call('Pin: origin ""\n'), call('Pin-Priority: 42\n'), ] assert mock_Command_run.call_args_list == [ call( [ 'bash', '--norc', 'custom_script', '/shared-dir/apt-get/sources.list.d/foo.sources', ] ), call( [ 'bash', '--norc', 'custom_script', '/shared-dir/apt-get/preferences.d/foo.pref', ] ), ] mock_exists.return_value = False with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.add_repo( 'foo', 'http://download.opensuse.org/repositories/V:/A:/C/Debian_9.0/', 'deb', '99', 'xenial', 'a b', ) assert file_handle.write.call_args_list == [ call( 'Types: deb\n' 'URIs: http://download.opensuse.org/repositories/V:/A:/C/Debian_9.0/\n' 'Suites: xenial\n' 'Components: a b\n' ), call('Package: *\n'), call('Pin: origin "download.opensuse.org"\n'), call('Pin-Priority: 99\n'), ] @patch('os.path.exists') def test_add_repo_distribution(self, mock_exists): mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.add_repo( 'foo', 'kiwi_iso_mount/uri', 'deb', None, 'xenial', 'a b', architectures='amd64,arm64', ) file_handle.write.assert_called_once_with( 'Types: deb\n' 'URIs: file:/kiwi_iso_mount/uri\n' 'Architectures: amd64 arm64\n' 'Suites: xenial\n' 'Components: a b\n' ) mock_open.assert_called_once_with( '/shared-dir/apt-get/sources.list.d/foo.sources', 'w' ) @patch('os.path.exists') def test_add_repo_private_with_authentication(self, mock_exists): mock_exists.return_value = False with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.add_repo( 'foo', 'https://example.org/debian', 'deb', None, 'xenial', 'a b', user='some-user', secret='some-secret', architectures='amd64,arm64', ) assert mock_open.call_args_list == [ call('/shared-dir/apt-get/sources.list.d/foo.sources', 'w'), call('/shared-dir/apt-get/auth.conf.d/foo.conf', 'w'), ] assert file_handle.write.call_args_list == [ call( 'Types: deb\n' 'URIs: https://example.org/debian\n' 'Architectures: amd64 arm64\n' 'Suites: xenial\n' 'Components: a b\n' ), call( 'machine https://example.org/debian login ' 'some-user password some-secret\n' ), ] file_handle.reset_mock() self.repo.add_repo( 'foo', 'https://example.org/debian', 'deb', None, 'xenial', 'a b', secret='some-token', architectures='amd64,arm64', ) assert file_handle.write.call_args_list == [ call( 'Types: deb\n' 'URIs: https://example.org/debian\n' 'Architectures: amd64 arm64\n' 'Suites: xenial\n' 'Components: a b\n' ), call( 'machine https://example.org/debian login ' 'some-token\n' ), ] @patch('os.path.exists') def test_add_repo_distribution_without_gpgchecks(self, mock_exists): mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.add_repo( 'foo', 'kiwi_iso_mount/uri', 'deb', None, 'xenial', 'a b', repo_gpgcheck=False, pkg_gpgcheck=False, ) file_handle.write.assert_called_once_with( 'Types: deb\n' 'URIs: file:/kiwi_iso_mount/uri\n' 'Suites: xenial\n' 'Components: a b\n' 'trusted: yes\n' 'check-valid-until: no\n' ) mock_open.assert_called_once_with( '/shared-dir/apt-get/sources.list.d/foo.sources', 'w' ) @patch('os.path.exists') def test_add_repo_distribution_default_component(self, mock_exists): mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.add_repo( 'foo', '/kiwi_iso_mount/uri', 'deb', None, 'xenial' ) file_handle.write.assert_called_once_with( 'Types: deb\n' 'URIs: file:/kiwi_iso_mount/uri\n' 'Suites: xenial\n' 'Components: main\n' ) mock_open.assert_called_once_with( '/shared-dir/apt-get/sources.list.d/foo.sources', 'w' ) @patch('os.path.exists') def test_add_repo_flat(self, mock_exists): mock_exists.return_value = False with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.add_repo('foo', 'http://repo.com', 'deb') file_handle.write.assert_called_once_with( 'Types: deb\n' 'URIs: http://repo.com\n' 'Suites: ./\n' ) mock_open.assert_called_once_with( '/shared-dir/apt-get/sources.list.d/foo.sources', 'w' ) @patch('kiwi.repository.apt.glob.glob') @patch('kiwi.repository.apt.os.chmod') @patch('kiwi.repository.apt.shutil.copy') @patch('kiwi.repository.apt.Path.create') @patch('kiwi.repository.apt.Temporary.new_dir') @patch('kiwi.repository.apt.os.unlink') def test_import_trusted_keys( self, mock_unlink, mock_Temporary_new_dir, mock_Path_create, mock_copy, mock_chmod, mock_glob, ): mock_Temporary_new_dir.return_value.__enter__.return_value = '/tmp/keys' mock_glob.side_effect = lambda pattern: [pattern.replace('*', '0.gpg')] self.repo.keyring_prefix = 'kiwi-1234-' self.repo.import_trusted_keys( ['../data/signing_key.asc', '../data/signing_key.gpg'] ) # keyrings of a former import are deleted assert mock_unlink.call_args_list == [ call('/etc/apt/keyrings/kiwi-1234-0.gpg'), call('../data/etc/apt/keyrings/kiwi-1234-0.gpg'), ] assert mock_Path_create.call_args_list == [ call('/etc/apt/keyrings'), call('../data/etc/apt/keyrings'), call('/etc/apt/keyrings'), call('../data/etc/apt/keyrings'), ] # keys are used as they are, the name extension # reflects the key format as apt expects it assert mock_copy.call_args_list == [ call( '../data/signing_key.asc', '/etc/apt/keyrings/kiwi-1234-0.asc' ), call( '../data/signing_key.asc', '../data/etc/apt/keyrings/kiwi-1234-0.asc', ), call( '../data/signing_key.gpg', '/etc/apt/keyrings/kiwi-1234-1.gpg' ), call( '../data/signing_key.gpg', '../data/etc/apt/keyrings/kiwi-1234-1.gpg', ), ] assert mock_chmod.call_args_list == [ call('/etc/apt/keyrings/kiwi-1234-0.asc', 0o644), call('../data/etc/apt/keyrings/kiwi-1234-0.asc', 0o644), call('/etc/apt/keyrings/kiwi-1234-1.gpg', 0o644), call('../data/etc/apt/keyrings/kiwi-1234-1.gpg', 0o644), ] assert self.repo.keyrings == [ '/etc/apt/keyrings/kiwi-1234-0.asc', '/etc/apt/keyrings/kiwi-1234-1.gpg', ] # sources files reference the keyrings via Signed-By with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.add_repo( 'foo', 'http://example.com/debian', 'deb', None, 'trixie', 'main', ) file_handle.write.assert_called_once_with( 'Types: deb\n' 'URIs: http://example.com/debian\n' 'Suites: trixie\n' 'Components: main\n' 'Signed-By: /etc/apt/keyrings/kiwi-1234-0.asc ' '/etc/apt/keyrings/kiwi-1234-1.gpg\n' ) @patch('kiwi.repository.apt.glob.glob') @patch('kiwi.repository.apt.os.chmod') @patch('kiwi.repository.apt.shutil.copy') @patch('kiwi.repository.apt.Path.create') @patch('kiwi.repository.apt.Temporary.new_dir') @patch('kiwi.repository.apt.os.unlink') def test_import_repository_signing_keys( self, mock_unlink, mock_Temporary_new_dir, mock_Path_create, mock_copy, mock_chmod, mock_glob, ): mock_Temporary_new_dir.return_value.__enter__.return_value = '/tmp/keys' mock_glob.return_value = [ '../data/usr/share/keyrings/foo-archive-keyring.gpg' ] self.repo.keyrings = ['/etc/apt/keyrings/kiwi-1234-0.asc'] self.repo.import_repository_signing_keys( 'foo', ['../data/signing_key.asc', '../data/signing_key.gpg'] ) # keyrings of a former import for this repository are deleted mock_glob.assert_called_once_with( '../data/usr/share/keyrings/foo-archive-keyring*' ) mock_unlink.assert_called_once_with( '../data/usr/share/keyrings/foo-archive-keyring.gpg' ) # keys are stored in the image root only assert mock_Path_create.call_args_list == [ call('../data/usr/share/keyrings'), call('../data/usr/share/keyrings'), ] assert mock_copy.call_args_list == [ call( '../data/signing_key.asc', '../data/usr/share/keyrings/foo-archive-keyring.asc', ), call( '../data/signing_key.gpg', '../data/usr/share/keyrings/foo-archive-keyring-1.gpg', ), ] assert mock_chmod.call_args_list == [ call('../data/usr/share/keyrings/foo-archive-keyring.asc', 0o644), call('../data/usr/share/keyrings/foo-archive-keyring-1.gpg', 0o644), ] assert self.repo.repository_keyrings == { 'foo': [ '/usr/share/keyrings/foo-archive-keyring.asc', '/usr/share/keyrings/foo-archive-keyring-1.gpg', ] } with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value # the sources file of the repository references # its own keyrings via Signed-By self.repo.add_repo( 'foo', 'http://example.com/debian', 'deb', None, 'trixie', 'main', ) file_handle.write.assert_called_once_with( 'Types: deb\n' 'URIs: http://example.com/debian\n' 'Suites: trixie\n' 'Components: main\n' 'Signed-By: /usr/share/keyrings/foo-archive-keyring.asc ' '/usr/share/keyrings/foo-archive-keyring-1.gpg\n' ) # repositories without own keyrings use the build keyrings file_handle.write.reset_mock() self.repo.add_repo( 'bar', 'http://example.com/debian', 'deb', None, 'trixie', 'main', ) file_handle.write.assert_called_once_with( 'Types: deb\n' 'URIs: http://example.com/debian\n' 'Suites: trixie\n' 'Components: main\n' 'Signed-By: /etc/apt/keyrings/kiwi-1234-0.asc\n' ) @patch('kiwi.repository.apt.glob.glob') @patch('kiwi.repository.apt.os.chmod') @patch('kiwi.repository.apt.shutil.copy') @patch('kiwi.repository.apt.Path.create') @patch('kiwi.repository.apt.urlopen') @patch('kiwi.repository.apt.Temporary.new_dir') def test_import_repository_signing_keys_remote( self, mock_Temporary_new_dir, mock_urlopen, mock_Path_create, mock_copy, mock_chmod, mock_glob, ): mock_glob.return_value = [] mock_Temporary_new_dir.return_value.__enter__.return_value = '/tmp/keys' mock_urlopen.return_value.__enter__.return_value.read.return_value = ( b'key-data' ) with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = ( b'-----BEGIN PGP PUBLIC KEY BLOCK-----' ) self.repo.import_repository_signing_keys( 'foo', ['https://example.com/key.asc'] ) mock_copy.assert_called_once_with( '/tmp/keys/key.0', '../data/usr/share/keyrings/foo-archive-keyring.asc', ) assert self.repo.repository_keyrings == { 'foo': ['/usr/share/keyrings/foo-archive-keyring.asc'] } @patch('kiwi.repository.apt.glob.glob') @patch('kiwi.repository.apt.os.chmod') @patch('kiwi.repository.apt.shutil.copy') @patch('kiwi.repository.apt.Path.create') @patch('kiwi.repository.apt.urlopen') @patch('kiwi.repository.apt.Temporary.new_dir') def test_import_trusted_keys_remote( self, mock_Temporary_new_dir, mock_urlopen, mock_Path_create, mock_copy, mock_chmod, mock_glob, ): mock_glob.return_value = [] mock_Temporary_new_dir.return_value.__enter__.return_value = '/tmp/keys' mock_urlopen.return_value.__enter__.return_value.read.return_value = ( b'key-data' ) self.repo.keyring_prefix = 'kiwi-1234-' with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = ( b'-----BEGIN PGP PUBLIC KEY BLOCK-----' ) self.repo.import_trusted_keys( [ 'https://user:pass%40word@example.com/key.asc', 'ftp://user:secret@example.com/key.asc', ] ) assert mock_open.call_args_list == [ call('/tmp/keys/key.0', 'wb'), call('/tmp/keys/key.0', 'rb'), call('/tmp/keys/key.1', 'wb'), call('/tmp/keys/key.1', 'rb'), ] assert file_handle.write.call_args_list == [ call(b'key-data'), call(b'key-data'), ] http_request = mock_urlopen.call_args_list[0][0][0] assert http_request.full_url == 'https://example.com/key.asc' assert ( http_request.get_header('Authorization') == 'Basic ' + b64encode(b'user:pass@word').decode() ) ftp_request = mock_urlopen.call_args_list[1][0][0] assert ftp_request.full_url == 'ftp://user:secret@example.com/key.asc' assert ftp_request.get_header('Authorization') is None assert mock_copy.call_args_list[::2] == [ call('/tmp/keys/key.0', '/etc/apt/keyrings/kiwi-1234-0.asc'), call('/tmp/keys/key.1', '/etc/apt/keyrings/kiwi-1234-1.asc'), ] @patch('kiwi.repository.apt.glob.glob') @patch('kiwi.repository.apt.shutil.copy') @patch('kiwi.repository.apt.urlopen') @patch('kiwi.repository.apt.Temporary.new_dir') def test_import_trusted_keys_remote_download_failed( self, mock_Temporary_new_dir, mock_urlopen, mock_copy, mock_glob ): mock_glob.return_value = [] mock_Temporary_new_dir.return_value.__enter__.return_value = '/tmp/keys' mock_urlopen.side_effect = Exception('404') with raises(KiwiUriOpenError) as issue: self.repo.import_trusted_keys( ['https://user:secret@example.com/key.asc'] ) assert 'secret' not in str(issue.value) assert not mock_copy.called @patch('kiwi.repository.apt.glob.glob') @patch('kiwi.repository.apt.os.unlink') def test_delete_trusted_keys(self, mock_unlink, mock_glob): mock_glob.side_effect = lambda pattern: [pattern.replace('*', '0.gpg')] self.repo.keyring_prefix = 'kiwi-1234-' self.repo.keyrings = ['/etc/apt/keyrings/kiwi-1234-0.gpg'] self.repo.repository_keyrings = { 'foo': ['/usr/share/keyrings/foo-archive-keyring.gpg'] } self.repo.delete_trusted_keys() assert mock_glob.call_args_list == [ call('/etc/apt/keyrings/kiwi-1234-*'), call('../data/etc/apt/keyrings/kiwi-1234-*'), ] assert mock_unlink.call_args_list == [ call('/etc/apt/keyrings/kiwi-1234-0.gpg'), call('../data/etc/apt/keyrings/kiwi-1234-0.gpg'), ] assert self.repo.keyrings == [] # keyrings permanently stored in the image are kept assert self.repo.repository_keyrings == { 'foo': ['/usr/share/keyrings/foo-archive-keyring.gpg'] } @patch('kiwi.repository.apt.Temporary.unmanaged_file') @patch('kiwi.repository.apt.PackageManagerTemplateAptGet') @patch('kiwi.repository.apt.Path.create') @patch('kiwi.repository.apt.os.path.exists') @patch('kiwi.repository.apt.os.unlink') def test_post_init_deletes_legacy_keyring( self, mock_unlink, mock_exists, mock_Path_create, mock_template, mock_temp, ): mock_exists.return_value = True root_bind = mock.Mock() root_bind.root_dir = '../data' root_bind.shared_location = '/shared-dir' with patch('builtins.open', create=True): RepositoryApt(root_bind) mock_unlink.assert_called_once_with('/shared-dir/apt-get/trusted.gpg') @patch('kiwi.path.Path.wipe') def test_delete_repo(self, mock_wipe): self.repo.delete_repo('foo') assert mock_wipe.call_args_list == [ call('/shared-dir/apt-get/sources.list.d/foo.sources'), call('/shared-dir/apt-get/auth.conf.d/foo.conf'), call('/shared-dir/apt-get/preferences.d/foo.pref'), ] @patch('kiwi.path.Path.wipe') @patch('os.walk') def test_cleanup_unused_repos(self, mock_walk, mock_path): mock_walk.side_effect = [ [('/foo', (), ('spam.sources', 'eggs.sources'))], [('/foo', (), ('spam.conf',))], [('/foo', (), ('spam.pref', 'eggs.pref'))], ] self.repo.repo_files = [ '/shared-dir/apt-get/sources.list.d/eggs.sources' ] self.repo.cleanup_unused_repos() assert mock_walk.call_args_list == [ call('/shared-dir/apt-get/sources.list.d'), call('/shared-dir/apt-get/auth.conf.d'), call('/shared-dir/apt-get/preferences.d'), ] assert mock_path.call_args_list == [ call('/shared-dir/apt-get/sources.list.d/spam.sources'), call('/shared-dir/apt-get/auth.conf.d/spam.conf'), call('/shared-dir/apt-get/preferences.d/spam.pref'), call('/shared-dir/apt-get/preferences.d/eggs.pref'), ] @patch('os.path.exists') def test_add_repo_tracks_written_files(self, mock_exists): mock_exists.return_value = False with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) self.repo.add_repo('foo', 'http://example.com/repo') self.repo.add_repo( 'bar', 'http://example.com/repo', prio=600, secret='token' ) assert self.repo.repo_files == [ '/shared-dir/apt-get/sources.list.d/foo.sources', '/shared-dir/apt-get/sources.list.d/bar.sources', '/shared-dir/apt-get/auth.conf.d/bar.conf', '/shared-dir/apt-get/preferences.d/bar.pref', ] @patch('kiwi.path.Path.wipe') @patch('kiwi.path.Path.create') def test_delete_all_repos(self, mock_create, mock_wipe): self.repo.delete_all_repos() assert mock_wipe.call_args_list == [ call('/shared-dir/apt-get/sources.list.d'), call('/shared-dir/apt-get/auth.conf.d'), call('/shared-dir/apt-get/preferences.d'), ] assert mock_create.call_args_list == [ call('/shared-dir/apt-get/sources.list.d'), call('/shared-dir/apt-get/auth.conf.d'), call('/shared-dir/apt-get/preferences.d'), ] @patch('kiwi.path.Path.wipe') def test_delete_repo_cache(self, mock_wipe): self.repo.delete_repo_cache('foo') assert mock_wipe.call_args_list == [ call('/shared-dir/apt-get/archives'), call('/shared-dir/apt-get/pkgcache.bin'), call('/shared-dir/apt-get/srcpkgcache.bin'), ] @patch('kiwi.repository.apt.glob.glob') @patch('os.path.isfile') @patch('os.unlink') def test_cleanup(self, mock_os_unlink, mock_os_path_isfile, mock_glob): mock_glob.return_value = ['/etc/apt/keyrings/kiwi-1234-0.gpg'] self.repo.keyring_prefix = 'kiwi-1234-' self.repo.cleanup() # keyrings in the image root are kept, see delete_trusted_keys mock_glob.assert_called_once_with('/etc/apt/keyrings/kiwi-1234-*') assert mock_os_unlink.call_args_list == [ call('tmpfile'), call('/etc/apt/keyrings/kiwi-1234-0.gpg'), ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7677321 kiwi-11.1.8/test/unit/repository/base_test.py0000644000000000000000000000401515273675667016223 0ustar00import unittest.mock as mock from pytest import raises from kiwi.repository.base import RepositoryBase class TestRepositoryBase: def setup(self): root_bind = mock.Mock() self.repo = RepositoryBase(root_bind) self.repo.root_dir = 'root-dir' self.repo.shared_location = 'shared-dir' def setup_method(self, cls): self.setup() def test_use_default_location(self): with raises(NotImplementedError): self.repo.use_default_location() def test_runtime_config(self): with raises(NotImplementedError): self.repo.runtime_config() def test_add_repo(self): with raises(NotImplementedError): self.repo.add_repo( 'name', 'uri', 'type', 'prio', 'dist', ['components'], 'user', 'secret', 'credentials-file', False, False, False, False, ) def test_setup_package_database_configuration(self): with raises(NotImplementedError): self.repo.setup_package_database_configuration() def test_import_trusted_keys(self): with raises(NotImplementedError): self.repo.import_trusted_keys(['key-file.asc']) def test_import_repository_signing_keys(self): # no-op for package managers keeping the keys in the image self.repo.import_repository_signing_keys('name', ['key-file.asc']) def test_delete_repo(self): with raises(NotImplementedError): self.repo.delete_repo('name') def test_delete_all_repos(self): with raises(NotImplementedError): self.repo.delete_all_repos() def test_cleanup_unused_repos(self): with raises(NotImplementedError): self.repo.cleanup_unused_repos() def test_delete_repo_cache(self): with raises(NotImplementedError): self.repo.delete_repo_cache('foo') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7677321 kiwi-11.1.8/test/unit/repository/dnf4_test.py0000644000000000000000000003305415273675667016151 0ustar00from pytest import fixture from unittest.mock import patch, call, mock_open import unittest.mock as mock from kiwi.repository.dnf4 import RepositoryDnf4 class TestRepositoryDnf4: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.repository.dnf4.Temporary.unmanaged_file') @patch('kiwi.repository.dnf4.ConfigParser') @patch('kiwi.repository.dnf4.Path.create') def setup(self, mock_path, mock_config, mock_temp): runtime_dnf_config = mock.MagicMock() mock_config.return_value = runtime_dnf_config tmpfile = mock.Mock() tmpfile.name = 'tmpfile' mock_temp.return_value = tmpfile root_bind = mock.Mock() root_bind.root_dir = '../data' root_bind.shared_location = '/shared-dir' with patch('builtins.open', create=True): self.repo = RepositoryDnf4( root_bind, [ 'exclude_docs', '_install_langs%en_US:de_DE', '_target_arch%x86_64', ], ) assert runtime_dnf_config.__setitem__.call_args_list == [ call( 'main', { 'cachedir': '/shared-dir/dnf/cache', 'reposdir': '/shared-dir/dnf/repos', 'varsdir': '/shared-dir/dnf/vars', 'pluginconfpath': '/shared-dir/dnf/pluginconf', 'keepcache': '1', 'debuglevel': '2', 'best': '1', 'obsoletes': '1', 'plugins': '1', 'gpgcheck': '0', }, ) ] @patch('kiwi.repository.dnf4.Temporary.unmanaged_file') @patch('kiwi.repository.dnf4.ConfigParser') @patch('kiwi.repository.dnf4.Path.create') def setup_method(self, cls, mock_path, mock_config, mock_temp): self.setup() @patch('kiwi.repository.dnf4.Temporary.unmanaged_file') @patch('kiwi.repository.dnf4.Path.create') def test_post_init_no_custom_args(self, mock_path, mock_temp): with patch('builtins.open', create=True): self.repo.post_init() assert self.repo.custom_args == [] @patch('kiwi.repository.dnf4.HostProxy') @patch('kiwi.repository.dnf4.Temporary.unmanaged_file') @patch('kiwi.repository.dnf4.Path.create') @patch('os.path.exists') def test_post_init_with_custom_args( self, mock_exists, mock_path, mock_temp, mock_HostProxy ): mock_HostProxy.return_value.get_env.return_value = { 'http_proxy': 'http://proxy:3128' } mock_HostProxy.get_dnf_config.return_value = { 'proxy': 'http://dnf-proxy:3128' } mock_exists.return_value = True m_open = mock_open() with patch('builtins.open', m_open, create=True): self.repo.post_init(['check_signatures']) assert m_open.call_args_list == [ call(mock_temp.return_value.name, 'w') ] assert self.repo.custom_args == [] assert self.repo.gpg_check == '1' assert self.repo.command_env['http_proxy'] == 'http://proxy:3128' assert ( self.repo.runtime_dnf_config['main']['proxy'] == 'http://dnf-proxy:3128' ) @patch('kiwi.repository.dnf4.ConfigParser') def test_use_default_location(self, mock_config): runtime_dnf_config = mock.MagicMock() mock_config.return_value = runtime_dnf_config with patch('builtins.open', create=True): self.repo.use_default_location() assert runtime_dnf_config.__setitem__.call_args_list == [ call( 'main', { 'cachedir': '../data/var/cache/dnf', 'reposdir': '../data/etc/yum.repos.d', 'varsdir': '../data/etc/dnf/vars', 'pluginconfpath': '../data/etc/dnf/plugins', 'keepcache': '1', 'debuglevel': '2', 'best': '1', 'obsoletes': '1', 'plugins': '1', 'gpgcheck': '0', }, ) ] def test_runtime_config(self): assert self.repo.runtime_config()['dnf_args'] == self.repo.dnf_args assert ( self.repo.runtime_config()['command_env'] == self.repo.command_env ) @patch('kiwi.repository.dnf4.ConfigParser') @patch('kiwi.repository.dnf4.Defaults.is_buildservice_worker') @patch('os.path.exists') @patch('kiwi.command.Command.run') @patch('os.path.isdir') @patch('kiwi.repository.dnf4.Path') def test_add_repo( self, mock_Path, mock_os_path_isdir, mock_Command_run, mock_exists, mock_buildservice, mock_config, ): mock_os_path_isdir.return_value = False repo_config = mock.Mock() mock_buildservice.return_value = False mock_config.return_value = repo_config mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: self.repo.add_repo( 'foo', 'kiwi_iso_mount/uri', 'rpm-md', 42, customization_script='custom_script', ) repo_config.add_section.assert_called_once_with('foo') assert repo_config.set.call_args_list == [ call('foo', 'name', 'foo'), call('foo', 'baseurl', 'file://kiwi_iso_mount/uri'), call('foo', 'priority', '42'), call('foo', 'repo_gpgcheck', '0'), call('foo', 'gpgcheck', '0'), ] mock_open.assert_called_once_with( '/shared-dir/dnf/repos/foo.repo', 'w' ) mock_Command_run.assert_called_once_with( [ 'bash', '--norc', 'custom_script', '/shared-dir/dnf/repos/foo.repo', ] ) mock_Path.create.assert_called_once_with('/shared-dir/dnf/repos') repo_config.add_section.reset_mock() repo_config.set.reset_mock() mock_exists.return_value = False with patch('builtins.open', create=True) as mock_open: self.repo.add_repo( 'bar', 'https://metalink', 'rpm-md', sourcetype='metalink' ) repo_config.add_section.assert_called_once_with('bar') assert repo_config.set.call_args_list == [ call('bar', 'name', 'bar'), call('bar', 'metalink', 'https://metalink'), call('bar', 'repo_gpgcheck', '0'), call('bar', 'gpgcheck', '0'), ] mock_open.assert_called_once_with( '/shared-dir/dnf/repos/bar.repo', 'w' ) @patch('kiwi.repository.dnf4.ConfigParser') @patch('kiwi.repository.dnf4.Defaults.is_buildservice_worker') @patch('os.path.exists') @patch('kiwi.repository.dnf4.Path') def test_add_repo_inside_buildservice( self, mock_path, mock_exists, mock_buildservice, mock_config ): repo_config = mock.Mock() mock_buildservice.return_value = True mock_config.return_value = repo_config mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: self.repo.add_repo('foo', 'kiwi_iso_mount/uri', 'rpm-md', 42) repo_config.add_section.assert_called_once_with('foo') assert repo_config.set.call_args_list == [ call('foo', 'name', 'foo'), call('foo', 'baseurl', 'file://kiwi_iso_mount/uri'), call('foo', 'priority', '42'), call('foo', 'repo_gpgcheck', '0'), call('foo', 'gpgcheck', '0'), call('foo', 'module_hotfixes', '1'), ] mock_open.assert_called_once_with( '/shared-dir/dnf/repos/foo.repo', 'w' ) @patch('kiwi.repository.dnf4.RpmDataBase') @patch('kiwi.command.Command.run') @patch('kiwi.repository.dnf4.Path.create') def test_setup_package_database_configuration( self, mock_Path_create, mock_Command_run, mock_RpmDataBase ): rpmdb = mock.Mock() rpmdb.has_rpm.return_value = False rpmdb.rpmdb_host.expand_query.return_value = '/usr/lib/sysimage/rpm' mock_RpmDataBase.return_value = rpmdb self.repo.setup_package_database_configuration() assert mock_RpmDataBase.call_args_list == [ call('../data', 'macros.kiwi-image-config'), call('../data'), ] rpmdb.set_macro_from_string.assert_called_once_with( '_install_langs%en_US:de_DE' ) rpmdb.write_config.assert_called_once_with() rpmdb.set_database_to_host_path.assert_called_once_with() mock_Path_create.assert_called_once_with('../data/var/lib') mock_Command_run.assert_called_once_with( [ 'ln', '-s', '--no-target-directory', '../../usr/lib/sysimage/rpm', '../data/var/lib/rpm', ], raise_on_error=False, ) @patch('kiwi.repository.dnf4.RpmDataBase') @patch('kiwi.command.Command.run') @patch('kiwi.repository.dnf4.Path.create') def test_setup_package_database_configuration_bootstrapped_system( self, mock_Path_create, mock_Command_run, mock_RpmDataBase ): rpmdb = mock.Mock() rpmdb.has_rpm.return_value = True rpmdb.rpmdb_host.expand_query.return_value = '/usr/lib/sysimage/rpm' mock_RpmDataBase.return_value = rpmdb self.repo.setup_package_database_configuration() assert mock_RpmDataBase.call_args_list == [ call('../data', 'macros.kiwi-image-config'), call('../data'), ] rpmdb.set_macro_from_string.assert_called_once_with( '_install_langs%en_US:de_DE' ) rpmdb.write_config.assert_called_once_with() rpmdb.link_database_to_host_path.assert_called_once_with() mock_Path_create.assert_called_once_with('../data/var/lib') mock_Command_run.assert_called_once_with( [ 'ln', '-s', '--no-target-directory', '../../usr/lib/sysimage/rpm', '../data/var/lib/rpm', ], raise_on_error=False, ) @patch('kiwi.repository.dnf4.ConfigParser') @patch('kiwi.repository.dnf4.Defaults.is_buildservice_worker') @patch('os.path.exists') @patch('kiwi.repository.dnf4.Path') def test_add_repo_with_gpgchecks( self, mock_path, mock_exists, mock_buildservice, mock_config ): repo_config = mock.Mock() mock_buildservice.return_value = False mock_config.return_value = repo_config mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: self.repo.add_repo( 'foo', 'kiwi_iso_mount/uri', 'rpm-md', 42, repo_gpgcheck=False, pkg_gpgcheck=True, ) repo_config.add_section.assert_called_once_with('foo') assert repo_config.set.call_args_list == [ call('foo', 'name', 'foo'), call('foo', 'baseurl', 'file://kiwi_iso_mount/uri'), call('foo', 'priority', '42'), call('foo', 'repo_gpgcheck', '0'), call('foo', 'gpgcheck', '1'), ] mock_open.assert_called_once_with( '/shared-dir/dnf/repos/foo.repo', 'w' ) @patch('kiwi.repository.dnf4.RpmDataBase') def test_import_trusted_keys(self, mock_RpmDataBase): rpmdb = mock.Mock() mock_RpmDataBase.return_value = rpmdb signing_keys = ['key-file-a.asc', 'key-file-b.asc'] self.repo.import_trusted_keys(signing_keys) assert rpmdb.import_signing_key_to_image.call_args_list == [ call('key-file-a.asc'), call('key-file-b.asc'), ] @patch('kiwi.path.Path.wipe') def test_delete_repo(self, mock_wipe): self.repo.delete_repo('foo') mock_wipe.assert_called_once_with('/shared-dir/dnf/repos/foo.repo') @patch('kiwi.path.Path.wipe') @patch('os.walk') def test_cleanup_unused_repos(self, mock_walk, mock_path): mock_walk.return_value = [('/foo', ('bar', 'baz'), ('spam', 'eggs'))] self.repo.repo_names = ['eggs'] self.repo.cleanup_unused_repos() mock_path.assert_called_once_with('/shared-dir/dnf/repos/spam') @patch('kiwi.path.Path.wipe') @patch('kiwi.path.Path.create') def test_delete_all_repos(self, mock_create, mock_wipe): self.repo.delete_all_repos() mock_wipe.assert_called_once_with('/shared-dir/dnf/repos') mock_create.assert_called_once_with('/shared-dir/dnf/repos') @patch('kiwi.path.Path.wipe') @patch('kiwi.repository.dnf4.glob.iglob') def test_delete_repo_cache(self, mock_glob, mock_wipe): mock_glob.return_value = ['foo_cache'] self.repo.delete_repo_cache('foo') mock_glob.assert_called_once_with('/shared-dir/dnf/cache/foo*') mock_wipe.assert_called_once_with('foo_cache') @patch('os.path.isfile') @patch('os.unlink') def test_cleanup(self, mock_os_unlink, mock_os_path_isfile): self.repo.cleanup() mock_os_unlink.assert_called_once_with('tmpfile') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7677321 kiwi-11.1.8/test/unit/repository/dnf5_test.py0000644000000000000000000003310615273675667016150 0ustar00from pytest import fixture from unittest.mock import patch, call, mock_open import unittest.mock as mock from kiwi.repository.dnf5 import RepositoryDnf5 class TestRepositoryDnf5: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.repository.dnf5.Temporary.unmanaged_file') @patch('kiwi.repository.dnf5.ConfigParser') @patch('kiwi.repository.dnf5.Path.create') def setup(self, mock_path, mock_config, mock_temp): runtime_dnf_config = mock.MagicMock() mock_config.return_value = runtime_dnf_config tmpfile = mock.Mock() tmpfile.name = 'tmpfile' mock_temp.return_value = tmpfile root_bind = mock.Mock() root_bind.root_dir = '../data' root_bind.shared_location = '/shared-dir' with patch('builtins.open', create=True): self.repo = RepositoryDnf5( root_bind, [ 'exclude_docs', '_install_langs%en_US:de_DE', '_target_arch%x86_64', ], ) assert runtime_dnf_config.__setitem__.call_args_list == [ call( 'main', { 'system_cachedir': '/shared-dir/dnf/cache', 'reposdir': '/shared-dir/dnf/repos', 'varsdir': '/shared-dir/dnf/vars', 'pluginconfpath': '/shared-dir/dnf/pluginconf', 'keepcache': '1', 'debuglevel': '2', 'best': '1', 'obsoletes': '1', 'plugins': '0', 'gpgcheck': '0', }, ) ] @patch('kiwi.repository.dnf5.Temporary.unmanaged_file') @patch('kiwi.repository.dnf5.ConfigParser') @patch('kiwi.repository.dnf5.Path.create') def setup_method(self, cls, mock_path, mock_config, mock_temp): self.setup() @patch('kiwi.repository.dnf5.Temporary.unmanaged_file') @patch('kiwi.repository.dnf5.Path.create') def test_post_init_no_custom_args(self, mock_path, mock_temp): with patch('builtins.open', create=True): self.repo.post_init() assert self.repo.custom_args == [] @patch('kiwi.repository.dnf5.HostProxy') @patch('kiwi.repository.dnf5.Temporary.unmanaged_file') @patch('kiwi.repository.dnf5.Path.create') @patch('os.path.exists') def test_post_init_with_custom_args( self, mock_exists, mock_path, mock_temp, mock_HostProxy ): mock_HostProxy.return_value.get_env.return_value = { 'http_proxy': 'http://proxy:3128' } mock_HostProxy.get_dnf_config.return_value = { 'proxy': 'http://dnf-proxy:3128' } mock_exists.return_value = True m_open = mock_open() with patch('builtins.open', m_open, create=True): self.repo.post_init(['check_signatures']) assert m_open.call_args_list == [ call(mock_temp.return_value.name, 'w') ] assert self.repo.custom_args == [] assert self.repo.gpg_check == '1' assert self.repo.command_env['http_proxy'] == 'http://proxy:3128' assert ( self.repo.runtime_dnf_config['main']['proxy'] == 'http://dnf-proxy:3128' ) @patch('kiwi.repository.dnf5.ConfigParser') def test_use_default_location(self, mock_config): runtime_dnf_config = mock.MagicMock() mock_config.return_value = runtime_dnf_config with patch('builtins.open', create=True): self.repo.use_default_location() assert runtime_dnf_config.__setitem__.call_args_list == [ call( 'main', { 'system_cachedir': '../data/var/cache/libdnf5', 'reposdir': '../data/etc/yum.repos.d', 'varsdir': '../data/etc/dnf/vars', 'pluginconfpath': '../data/etc/dnf/libdnf5-plugins', 'keepcache': '1', 'debuglevel': '2', 'best': '1', 'obsoletes': '1', 'plugins': '0', 'gpgcheck': '0', }, ) ] def test_runtime_config(self): assert self.repo.runtime_config()['dnf_args'] == self.repo.dnf_args assert ( self.repo.runtime_config()['command_env'] == self.repo.command_env ) @patch('kiwi.repository.dnf5.ConfigParser') @patch('kiwi.repository.dnf5.Defaults.is_buildservice_worker') @patch('os.path.exists') @patch('kiwi.command.Command.run') @patch('os.path.isdir') @patch('kiwi.repository.dnf5.Path') def test_add_repo( self, mock_Path, mock_os_path_isdir, mock_Command_run, mock_exists, mock_buildservice, mock_config, ): mock_os_path_isdir.return_value = False repo_config = mock.Mock() mock_buildservice.return_value = False mock_config.return_value = repo_config mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: self.repo.add_repo( 'foo', 'kiwi_iso_mount/uri', 'rpm-md', 42, customization_script='custom_script', ) repo_config.add_section.assert_called_once_with('foo') assert repo_config.set.call_args_list == [ call('foo', 'name', 'foo'), call('foo', 'baseurl', 'file://kiwi_iso_mount/uri'), call('foo', 'priority', '42'), call('foo', 'repo_gpgcheck', '0'), call('foo', 'gpgcheck', '0'), ] mock_open.assert_called_once_with( '/shared-dir/dnf/repos/foo.repo', 'w' ) mock_Command_run.assert_called_once_with( [ 'bash', '--norc', 'custom_script', '/shared-dir/dnf/repos/foo.repo', ] ) mock_Path.create.assert_called_once_with('/shared-dir/dnf/repos') repo_config.add_section.reset_mock() repo_config.set.reset_mock() mock_exists.return_value = False with patch('builtins.open', create=True) as mock_open: self.repo.add_repo( 'bar', 'https://metalink', 'rpm-md', sourcetype='metalink' ) repo_config.add_section.assert_called_once_with('bar') assert repo_config.set.call_args_list == [ call('bar', 'name', 'bar'), call('bar', 'metalink', 'https://metalink'), call('bar', 'repo_gpgcheck', '0'), call('bar', 'gpgcheck', '0'), ] mock_open.assert_called_once_with( '/shared-dir/dnf/repos/bar.repo', 'w' ) @patch('kiwi.repository.dnf5.ConfigParser') @patch('kiwi.repository.dnf5.Defaults.is_buildservice_worker') @patch('os.path.exists') @patch('kiwi.repository.dnf5.Path') def test_add_repo_inside_buildservice( self, mock_path, mock_exists, mock_buildservice, mock_config ): repo_config = mock.Mock() mock_buildservice.return_value = True mock_config.return_value = repo_config mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: self.repo.add_repo('foo', 'kiwi_iso_mount/uri', 'rpm-md', 42) repo_config.add_section.assert_called_once_with('foo') assert repo_config.set.call_args_list == [ call('foo', 'name', 'foo'), call('foo', 'baseurl', 'file://kiwi_iso_mount/uri'), call('foo', 'priority', '42'), call('foo', 'repo_gpgcheck', '0'), call('foo', 'gpgcheck', '0'), call('foo', 'module_hotfixes', '1'), ] mock_open.assert_called_once_with( '/shared-dir/dnf/repos/foo.repo', 'w' ) @patch('kiwi.repository.dnf5.RpmDataBase') @patch('kiwi.command.Command.run') @patch('kiwi.repository.dnf5.Path.create') def test_setup_package_database_configuration( self, mock_Path_create, mock_Command_run, mock_RpmDataBase ): rpmdb = mock.Mock() rpmdb.has_rpm.return_value = False rpmdb.rpmdb_host.expand_query.return_value = '/usr/lib/sysimage/rpm' mock_RpmDataBase.return_value = rpmdb self.repo.setup_package_database_configuration() assert mock_RpmDataBase.call_args_list == [ call('../data', 'macros.kiwi-image-config'), call('../data'), ] rpmdb.set_macro_from_string.assert_called_once_with( '_install_langs%en_US:de_DE' ) rpmdb.write_config.assert_called_once_with() rpmdb.set_database_to_host_path.assert_called_once_with() mock_Path_create.assert_called_once_with('../data/var/lib') mock_Command_run.assert_called_once_with( [ 'ln', '-s', '--no-target-directory', '../../usr/lib/sysimage/rpm', '../data/var/lib/rpm', ], raise_on_error=False, ) @patch('kiwi.repository.dnf5.RpmDataBase') @patch('kiwi.command.Command.run') @patch('kiwi.repository.dnf5.Path.create') def test_setup_package_database_configuration_bootstrapped_system( self, mock_Path_create, mock_Command_run, mock_RpmDataBase ): rpmdb = mock.Mock() rpmdb.has_rpm.return_value = True rpmdb.rpmdb_host.expand_query.return_value = '/usr/lib/sysimage/rpm' mock_RpmDataBase.return_value = rpmdb self.repo.setup_package_database_configuration() assert mock_RpmDataBase.call_args_list == [ call('../data', 'macros.kiwi-image-config'), call('../data'), ] rpmdb.set_macro_from_string.assert_called_once_with( '_install_langs%en_US:de_DE' ) rpmdb.write_config.assert_called_once_with() rpmdb.link_database_to_host_path.assert_called_once_with() mock_Path_create.assert_called_once_with('../data/var/lib') mock_Command_run.assert_called_once_with( [ 'ln', '-s', '--no-target-directory', '../../usr/lib/sysimage/rpm', '../data/var/lib/rpm', ], raise_on_error=False, ) @patch('kiwi.repository.dnf5.ConfigParser') @patch('kiwi.repository.dnf5.Defaults.is_buildservice_worker') @patch('os.path.exists') @patch('kiwi.repository.dnf5.Path') def test_add_repo_with_gpgchecks( self, mock_path, mock_exists, mock_buildservice, mock_config ): repo_config = mock.Mock() mock_buildservice.return_value = False mock_config.return_value = repo_config mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: self.repo.add_repo( 'foo', 'kiwi_iso_mount/uri', 'rpm-md', 42, repo_gpgcheck=False, pkg_gpgcheck=True, ) repo_config.add_section.assert_called_once_with('foo') assert repo_config.set.call_args_list == [ call('foo', 'name', 'foo'), call('foo', 'baseurl', 'file://kiwi_iso_mount/uri'), call('foo', 'priority', '42'), call('foo', 'repo_gpgcheck', '0'), call('foo', 'gpgcheck', '1'), ] mock_open.assert_called_once_with( '/shared-dir/dnf/repos/foo.repo', 'w' ) @patch('kiwi.repository.dnf5.RpmDataBase') def test_import_trusted_keys(self, mock_RpmDataBase): rpmdb = mock.Mock() mock_RpmDataBase.return_value = rpmdb signing_keys = ['key-file-a.asc', 'key-file-b.asc'] self.repo.import_trusted_keys(signing_keys) assert rpmdb.import_signing_key_to_image.call_args_list == [ call('key-file-a.asc'), call('key-file-b.asc'), ] @patch('kiwi.path.Path.wipe') def test_delete_repo(self, mock_wipe): self.repo.delete_repo('foo') mock_wipe.assert_called_once_with('/shared-dir/dnf/repos/foo.repo') @patch('kiwi.path.Path.wipe') @patch('os.walk') def test_cleanup_unused_repos(self, mock_walk, mock_path): mock_walk.return_value = [('/foo', ('bar', 'baz'), ('spam', 'eggs'))] self.repo.repo_names = ['eggs'] self.repo.cleanup_unused_repos() mock_path.assert_called_once_with('/shared-dir/dnf/repos/spam') @patch('kiwi.path.Path.wipe') @patch('kiwi.path.Path.create') def test_delete_all_repos(self, mock_create, mock_wipe): self.repo.delete_all_repos() mock_wipe.assert_called_once_with('/shared-dir/dnf/repos') mock_create.assert_called_once_with('/shared-dir/dnf/repos') @patch('kiwi.path.Path.wipe') @patch('kiwi.repository.dnf5.glob.iglob') def test_delete_repo_cache(self, mock_glob, mock_wipe): mock_glob.return_value = ['foo_cache'] self.repo.delete_repo_cache('foo') mock_glob.assert_called_once_with('/shared-dir/dnf/cache/foo*') mock_wipe.assert_called_once_with('foo_cache') @patch('os.path.isfile') @patch('os.unlink') def test_cleanup(self, mock_os_unlink, mock_os_path_isfile): self.repo.cleanup() mock_os_unlink.assert_called_once_with('tmpfile') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7677321 kiwi-11.1.8/test/unit/repository/init_test.py0000644000000000000000000000376315273675667016265 0ustar00from unittest.mock import patch from pytest import raises import unittest.mock as mock from kiwi.repository import Repository from kiwi.exceptions import KiwiRepositorySetupError class TestRepository: def test_repository_manager_not_implemented(self): with raises(KiwiRepositorySetupError): Repository.new('root_bind', 'ms-manager') @patch('kiwi.repository.zypper.RepositoryZypper') def test_repository_zypper(self, mock_manager): root_bind = mock.Mock() Repository.new(root_bind, 'zypper') mock_manager.assert_called_once_with(root_bind, None) @patch('kiwi.repository.dnf.RepositoryDnf') def test_repository_dnf(self, mock_manager): root_bind = mock.Mock() Repository.new(root_bind, 'dnf') mock_manager.assert_called_once_with(root_bind, None) @patch('kiwi.repository.dnf4.RepositoryDnf4') def test_repository_dnf4(self, mock_manager): root_bind = mock.Mock() Repository.new(root_bind, 'dnf4') mock_manager.assert_called_once_with(root_bind, None) @patch('kiwi.repository.dnf5.RepositoryDnf5') def test_repository_dnf5(self, mock_manager): root_bind = mock.Mock() Repository.new(root_bind, 'dnf5') mock_manager.assert_called_once_with(root_bind, None) @patch('kiwi.repository.dnf4.RepositoryDnf4') def test_repository_microdnf(self, mock_manager): root_bind = mock.Mock() Repository.new(root_bind, 'microdnf') mock_manager.assert_called_once_with(root_bind, None) @patch('kiwi.repository.apt.RepositoryApt') def test_repository_apt(self, mock_manager): root_bind = mock.Mock() Repository.new(root_bind, 'apt') mock_manager.assert_called_once_with(root_bind, None) @patch('kiwi.repository.pacman.RepositoryPacman') def test_repository_pacman(self, mock_manager): root_bind = mock.Mock() Repository.new(root_bind, 'pacman') mock_manager.assert_called_once_with(root_bind, None) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7677321 kiwi-11.1.8/test/unit/repository/pacman_test.py0000644000000000000000000002060715273675667016555 0ustar00from unittest.mock import patch, Mock, call, mock_open import os from kiwi.repository.pacman import RepositoryPacman class TestRepositorPacman(object): @patch('kiwi.repository.pacman.Temporary.unmanaged_file') @patch('kiwi.repository.pacman.ConfigParser') @patch('kiwi.repository.pacman.Path.create') def setup(self, mock_path, mock_config, mock_temp): runtime_pacman_config = Mock() mock_config.return_value = runtime_pacman_config tmpfile = Mock() tmpfile.name = 'tmpfile' mock_temp.return_value = tmpfile root_bind = Mock() root_bind.move_to_root = Mock(return_value=['root-moved-arguments']) root_bind.root_dir = '../data' root_bind.shared_location = '/shared-dir' with patch('builtins.open', create=True): self.repo = RepositoryPacman(root_bind) assert runtime_pacman_config.set.call_args_list == [ call('options', 'Architecture', 'auto'), call('options', 'CacheDir', '/shared-dir/pacman/cache'), call('options', 'SigLevel', 'Never DatabaseNever'), call('options', 'LocalFileSigLevel', 'Never DatabaseNever'), call('options', 'Include', '/shared-dir/pacman/repos/*.repo'), ] runtime_pacman_config.reset_mock() RepositoryPacman( root_bind, custom_args=['check_signatures', '_target_arch%x86_64'], ) assert runtime_pacman_config.set.call_args_list == [ call('options', 'Architecture', 'auto'), call('options', 'CacheDir', '/shared-dir/pacman/cache'), call('options', 'SigLevel', 'Required DatabaseRequired'), call( 'options', 'LocalFileSigLevel', 'Required DatabaseRequired' ), call('options', 'Include', '/shared-dir/pacman/repos/*.repo'), ] @patch('kiwi.repository.pacman.Temporary.unmanaged_file') @patch('kiwi.repository.pacman.ConfigParser') @patch('kiwi.repository.pacman.Path.create') def setup_method(self, cls, mock_path, mock_config, mock_temp): self.setup() def test_runtime_config(self): assert ( self.repo.runtime_config()['pacman_args'] == self.repo.pacman_args ) assert self.repo.runtime_config()['command_env'] == os.environ def test_runtime_config_host_proxy(self, monkeypatch): monkeypatch.setenv('https_proxy', 'http://proxy:3128') command_env = self.repo.runtime_config()['command_env'] assert command_env['https_proxy'] == 'http://proxy:3128' assert command_env['HTTPS_PROXY'] == 'http://proxy:3128' @patch('kiwi.repository.pacman.ConfigParser') @patch('os.path.exists') @patch('kiwi.command.Command.run') def test_add_local_repo_with_components( self, mock_Command_run, mock_exists, mock_config ): repo_config = Mock() mock_config.return_value = repo_config mock_exists.return_value = True m_open = mock_open() with patch('builtins.open', m_open, create=True): self.repo.add_repo( 'foo', '/some_uri', components='core extra', repo_gpgcheck=False, pkg_gpgcheck=True, customization_script='custom_script', ) m_open.assert_called_once_with('/shared-dir/pacman/repos/foo.repo', 'w') assert repo_config.add_section.call_args_list == [ call('core'), call('extra'), ] assert repo_config.set.call_args_list == [ call('core', 'Server', 'file:///some_uri'), call('core', 'SigLevel', 'Required DatabaseNever'), call('extra', 'Server', 'file:///some_uri'), call('extra', 'SigLevel', 'Required DatabaseNever'), ] mock_Command_run.assert_called_once_with( [ 'bash', '--norc', 'custom_script', '/shared-dir/pacman/repos/foo.repo', ] ) @patch('kiwi.repository.pacman.ConfigParser') @patch('os.path.exists') def test_add_repo_with_components(self, mock_exists, mock_config): repo_config = Mock() mock_config.return_value = repo_config mock_exists.return_value = True m_open = mock_open() with patch('builtins.open', m_open, create=True): self.repo.add_repo( 'foo', 'some_uri', components='core extra', repo_gpgcheck=False, pkg_gpgcheck=True, ) m_open.assert_called_once_with('/shared-dir/pacman/repos/foo.repo', 'w') assert repo_config.add_section.call_args_list == [ call('core'), call('extra'), ] assert repo_config.set.call_args_list == [ call('core', 'Server', 'some_uri'), call('core', 'SigLevel', 'Required DatabaseNever'), call('extra', 'Server', 'some_uri'), call('extra', 'SigLevel', 'Required DatabaseNever'), ] @patch('kiwi.repository.pacman.ConfigParser') @patch('os.path.exists') def test_add_repo_without_components(self, mock_exists, mock_config): repo_config = Mock() mock_config.return_value = repo_config mock_exists.return_value = True m_open = mock_open() with patch('builtins.open', m_open, create=True): self.repo.add_repo('foo', 'some_uri', pkg_gpgcheck=False) m_open.assert_called_once_with('/shared-dir/pacman/repos/foo.repo', 'w') assert repo_config.add_section.call_args_list == [call('foo')] assert repo_config.set.call_args_list == [ call('foo', 'Server', 'some_uri'), call('foo', 'SigLevel', 'Never DatabaseNever'), ] @patch('kiwi.repository.pacman.Path.create') def test_setup_package_database_configuration(self, mock_path_create): self.repo.setup_package_database_configuration() mock_path_create.assert_called_once_with('../data/var/lib/pacman') @patch('kiwi.repository.pacman.os.path.exists') @patch('kiwi.repository.pacman.Command.run') def test_import_trusted_keys(self, mock_cmd, mock_exists): exists = [True, False] mock_exists.side_effect = lambda x: exists.pop() signing_keys = ['key-file-a.asc', 'key-file-b_ID'] self.repo.import_trusted_keys(signing_keys) assert mock_cmd.call_args_list == [ call(['pacman-key', '--add', 'key-file-a.asc']), call(['pacman-key', '--recv-keys', 'key-file-b_ID']), ] @patch('kiwi.repository.pacman.Path') def test_delete_repo(self, mock_path): self.repo.delete_repo('foo') mock_path.wipe.assert_called_once_with( '/shared-dir/pacman/repos/foo.repo' ) @patch('kiwi.repository.pacman.Path') def test_delete_all_repos(self, mock_path): self.repo.delete_all_repos() mock_path.wipe.assert_called_once_with('/shared-dir/pacman/repos') mock_path.create.assert_called_once_with('/shared-dir/pacman/repos') @patch('kiwi.repository.pacman.Path.wipe') @patch('kiwi.repository.pacman.os.walk') def test_cleanup_unused_repos(self, mock_os_walk, mock_wipe): mock_os_walk.return_value = [ ('/shared-dir/pacman/repos', [], ['foo.repo', 'bar.repo']) ] self.repo.cleanup_unused_repos() mock_os_walk.assert_called_once_with('/shared-dir/pacman/repos') assert mock_wipe.call_args_list == [ call('/shared-dir/pacman/repos/foo.repo'), call('/shared-dir/pacman/repos/bar.repo'), ] def test_use_default_location(self): self.repo.use_default_location() assert ( self.repo.shared_pacman_dir['cache-dir'] == '/shared-dir/pacman/cache' ) assert ( self.repo.shared_pacman_dir['repos-dir'] == '../data/etc/pacman.d' ) @patch('kiwi.repository.pacman.Path') def test_delete_repo_cache(self, mock_path): self.repo.delete_repo_cache('foo') mock_path.wipe.assert_called_once_with('/shared-dir/pacman/cache') @patch('os.path.isfile') @patch('os.unlink') def test_cleanup(self, mock_os_unlink, mock_os_path_isfile): self.repo.cleanup() mock_os_unlink.assert_called_once_with('tmpfile') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7677321 kiwi-11.1.8/test/unit/repository/template/__init__.py0000644000000000000000000000000015273675667017612 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7680697 kiwi-11.1.8/test/unit/repository/template/apt_test.py0000644000000000000000000000165015273675667017712 0ustar00from kiwi.repository.template.apt import PackageManagerTemplateAptGet class TestPackageManagerTemplateAptGet: def setup(self): self.apt = PackageManagerTemplateAptGet() def setup_method(self, cls): self.setup() def test_get_host_template(self): assert self.apt.get_host_template().substitute( apt_shared_base='/var/cache/kiwi/apt-get', unauthenticated='true' ) def test_get_image_template(self): assert self.apt.get_image_template().substitute(unauthenticated='true') def test_get_host_template_with_exclude_docs(self): assert self.apt.get_host_template(exclude_docs=True).substitute( apt_shared_base='/var/cache/kiwi/apt-get', unauthenticated='true' ) def test_get_image_template_with_exclude_docs(self): assert self.apt.get_image_template(exclude_docs=True).substitute( unauthenticated='true' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7680697 kiwi-11.1.8/test/unit/repository/zypper_test.py0000644000000000000000000005227615273675667016656 0ustar00from pytest import raises, fixture from unittest.mock import patch, call, MagicMock, Mock import io import os from kiwi.defaults import Defaults from kiwi.repository.zypper import RepositoryZypper from kiwi.exceptions import KiwiCommandError @fixture(autouse=True) def no_shared_zypper_dirs_on_host(): """ RepositoryZypper creates the shared zypper directories below the root directory of the tests, which is the test data directory. Directories must not be created there, tests running in parallel share it. A module level fixture is used as it is in place before the setup method of the test class runs """ with patch('kiwi.repository.zypper.Path.create'): yield class TestRepositoryZypper: @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Temporary.unmanaged_file') def setup(self, mock_temp, mock_command): self.context_manager_mock = Mock() self.file_mock = Mock() self.enter_mock = Mock() self.exit_mock = Mock() self.enter_mock.return_value = self.file_mock setattr(self.context_manager_mock, '__enter__', self.enter_mock) setattr(self.context_manager_mock, '__exit__', self.exit_mock) tmpfile = Mock() tmpfile.name = 'tmpfile' mock_temp.return_value = tmpfile self.root_bind = Mock() self.root_bind.root_dir = '../data' self.root_bind.shared_location = '/shared-dir' with patch('builtins.open', create=True): self.repo = RepositoryZypper( self.root_bind, ['exclude_docs', '_install_langs%en_US:de_DE'] ) @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Temporary.unmanaged_file') def setup_method(self, cls, mock_temp, mock_command): self.setup() @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Temporary.unmanaged_file') def test_custom_args_init_excludedocs(self, mock_temp, mock_command): with patch('builtins.open', create=True): repo = RepositoryZypper(self.root_bind) assert repo.custom_args == [] @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Temporary.unmanaged_file') @patch('kiwi.repository.zypper.ConfigParser') def test_custom_args_init_check_signatures( self, mock_config, mock_temp, mock_command ): Defaults.set_platform_name('x86_64') runtime_zypp_config = Mock() mock_config.return_value = runtime_zypp_config with patch('builtins.open', create=True): repo = RepositoryZypper( self.root_bind, ['check_signatures', '_target_arch%x86_64'] ) assert repo.custom_args == [] assert runtime_zypp_config.set.call_args_list == [ call( 'main', 'credentials.global.dir', '../data/shared-dir/zypper/credentials', ), call('main', 'arch', 'x86_64'), call('main', 'gpgcheck', '1'), ] @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Temporary.unmanaged_file') def test_post_init_intermediate_proxy_config( self, mock_temp, mock_command, monkeypatch ): monkeypatch.setenv('http_proxy', 'http://proxy:3128') monkeypatch.setenv('NO_PROXY', 'localhost') with patch('builtins.open', create=True): repo = RepositoryZypper(self.root_bind) assert repo.command_env['http_proxy'] == 'http://proxy:3128' assert repo.command_env['HTTP_PROXY'] == 'http://proxy:3128' assert repo.command_env['no_proxy'] == 'localhost' self.root_bind.add_intermediate_config.assert_called_once_with( '/etc/sysconfig/proxy', os.linesep.join( [ '# kiwi generated proxy config file', 'PROXY_ENABLED="yes"', 'HTTP_PROXY="http://proxy:3128"', 'HTTPS_PROXY=""', 'FTP_PROXY=""', 'NO_PROXY="localhost"', ] ) + os.linesep, ) @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Temporary.unmanaged_file') @patch('os.path.islink') def test_post_init_intermediate_proxy_config_exists( self, mock_islink, mock_temp, mock_command, monkeypatch ): monkeypatch.setenv('http_proxy', 'http://proxy:3128') mock_islink.return_value = True with patch('builtins.open', create=True): RepositoryZypper(self.root_bind) mock_islink.assert_called_once_with('../data/etc/sysconfig/proxy') assert not self.root_bind.add_intermediate_config.called @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Temporary.unmanaged_file') def test_post_init_no_intermediate_proxy_config( self, mock_temp, mock_command, monkeypatch ): # host sysconfig proxy file is setup by RootBind monkeypatch.setattr( 'kiwi.defaults.HOST_SYSCONFIG_PROXY', '../data/sysconfig_proxy' ) monkeypatch.setenv('http_proxy', 'http://proxy:3128') with patch('builtins.open', create=True): RepositoryZypper(self.root_bind) assert not self.root_bind.add_intermediate_config.called def test_use_default_location(self): self.repo.use_default_location() assert self.repo.zypper_args == ['--non-interactive'] assert ( self.repo.shared_zypper_dir['reposd-dir'] == '../data/etc/zypp/repos.d' ) assert self.repo.command_env == dict(os.environ, LANG='C') def test_runtime_config(self): assert ( self.repo.runtime_config()['zypper_args'] == self.repo.zypper_args ) assert ( self.repo.runtime_config()['command_env'] == self.repo.command_env ) @patch.object(RepositoryZypper, '_backup_package_cache') @patch.object(RepositoryZypper, '_restore_package_cache') @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Path') @patch('kiwi.repository.zypper.Uri') @patch('os.path.exists') def test_add_repo_second_attempt_on_failure( self, mock_exists, mock_uri, mock_path, mock_command, mock_restore_package_cache, mock_backup_package_cache, ): mock_command.side_effect = KiwiCommandError('error') with raises(KiwiCommandError): self.repo.add_repo('foo', 'http://foo/uri', 'rpm-md', 42) assert mock_command.call_count == 2 @patch('kiwi.repository.zypper.ConfigParser') @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Path.wipe') @patch('os.path.exists') @patch('kiwi.repository.zypper.Uri') def test_add_repo( self, mock_uri, mock_exists, mock_wipe, mock_command, mock_config ): repo_config = Mock() mock_config.return_value = repo_config mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: self.repo.add_repo( 'foo', 'kiwi_iso_mount/uri', 'rpm-md', 42, customization_script='custom_script', ) mock_wipe.assert_called_once_with( '../data/shared-dir/zypper/repos/foo.repo' ) uri = Mock() uri.is_remote.return_value = True mock_uri.return_value = uri assert mock_command.call_args_list == [ call( [ 'mv', '-f', '/shared-dir/packages', '/shared-dir/packages.moved', ] ), call( ['zypper'] + self.repo.zypper_args + [ '--root', '../data', 'addrepo', '--refresh', '--keep-packages', '--no-check', 'kiwi_iso_mount/uri', 'foo', ], self.repo.command_env, ), call( [ 'bash', '--norc', 'custom_script', '../data/shared-dir/zypper/repos/foo.repo', ] ), call( [ 'mv', '-f', '/shared-dir/packages.moved', '/shared-dir/packages', ] ), ] repo_config.read.assert_called_once_with( '../data/shared-dir/zypper/repos/foo.repo' ) assert repo_config.set.call_args_list == [ call('foo', 'repo_gpgcheck', '0'), call('foo', 'pkg_gpgcheck', '0'), call('foo', 'priority', '42'), ] mock_open.assert_called_once_with( '../data/shared-dir/zypper/repos/foo.repo', 'w' ) mock_command.reset_mock() uri.is_remote.return_value = False with patch('builtins.open', create=True): self.repo.add_repo('foo', 'http://foo/uri', 'rpm-md', 42) assert mock_command.call_args_list == [ call( [ 'mv', '-f', '/shared-dir/packages', '/shared-dir/packages.moved', ] ), call( ['zypper'] + self.repo.zypper_args + [ '--root', '../data', 'addrepo', '--refresh', '--no-keep-packages', '--no-check', 'http://foo/uri', 'foo', ], self.repo.command_env, ), call( [ 'mv', '-f', '/shared-dir/packages.moved', '/shared-dir/packages', ] ), ] @patch('kiwi.repository.zypper.ConfigParser') @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Path.wipe') @patch('os.path.exists') @patch('kiwi.repository.zypper.Uri') def test_add_repo_with_credentials_in_uri( self, mock_uri, mock_exists, mock_wipe, mock_command, mock_config ): repo_config = Mock() mock_config.return_value = repo_config mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: self.repo.add_repo( 'foo', 'https://some_user%40domain.com:my_token123@example.com/foo', 'rpm-md', ) assert repo_config.set.call_args_list == [ call( 'foo', 'baseurl', 'https://some_user%40domain.com:my_token123@example.com/foo', ), call('foo', 'repo_gpgcheck', '0'), call('foo', 'pkg_gpgcheck', '0'), ] mock_open.assert_called_once_with( '../data/shared-dir/zypper/repos/foo.repo', 'w' ) @patch('kiwi.repository.zypper.ConfigParser') @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Path.wipe') @patch('os.path.exists') @patch('kiwi.repository.zypper.Uri') def test_add_repo_with_gpgchecks( self, mock_uri, mock_exists, mock_wipe, mock_command, mock_config ): repo_config = Mock() mock_config.return_value = repo_config mock_exists.return_value = True with patch('builtins.open', create=True) as mock_open: self.repo.add_repo( 'foo', 'kiwi_iso_mount/uri', 'rpm-md', 42, repo_gpgcheck=False, pkg_gpgcheck=True, ) mock_wipe.assert_called_once_with( '../data/shared-dir/zypper/repos/foo.repo' ) assert mock_command.call_args_list == [ call( [ 'mv', '-f', '/shared-dir/packages', '/shared-dir/packages.moved', ] ), call( ['zypper'] + self.repo.zypper_args + [ '--root', '../data', 'addrepo', '--refresh', '--keep-packages', '--no-check', 'kiwi_iso_mount/uri', 'foo', ], self.repo.command_env, ), call( [ 'mv', '-f', '/shared-dir/packages.moved', '/shared-dir/packages', ] ), ] repo_config.read.assert_called_once_with( '../data/shared-dir/zypper/repos/foo.repo' ) assert repo_config.set.call_args_list == [ call('foo', 'repo_gpgcheck', '0'), call('foo', 'pkg_gpgcheck', '1'), call('foo', 'priority', '42'), ] mock_open.assert_called_once_with( '../data/shared-dir/zypper/repos/foo.repo', 'w' ) @patch('kiwi.repository.zypper.RpmDataBase') @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Path.create') def test_setup_package_database_configuration( self, mock_Path_create, mock_Command_run, mock_RpmDataBase ): rpmdb = Mock() rpmdb.has_rpm.return_value = False rpmdb.rpmdb_host.expand_query.return_value = '/usr/lib/sysimage/rpm' mock_RpmDataBase.return_value = rpmdb self.repo.setup_package_database_configuration() assert mock_RpmDataBase.call_args_list == [ call('../data', 'macros.kiwi-image-config'), call('../data'), ] rpmdb.set_macro_from_string.assert_called_once_with( '_install_langs%en_US:de_DE' ) rpmdb.write_config.assert_called_once_with() rpmdb.set_database_to_host_path.assert_called_once_with() rpmdb.init_database.assert_called_once_with() mock_Path_create.assert_called_once_with('../data/var/lib') mock_Command_run.assert_called_once_with( [ 'ln', '-s', '--no-target-directory', '../../usr/lib/sysimage/rpm', '../data/var/lib/rpm', ], raise_on_error=False, ) mock_Command_run.reset_mock() rpmdb.rpmdb_host.expand_query.return_value = '/var/lib/rpm' self.repo.setup_package_database_configuration() assert not mock_Command_run.called @patch('kiwi.repository.zypper.RpmDataBase') @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Path.create') def test_setup_package_database_configuration_bootstrapped_system( self, mock_Path_create, mock_Command_run, mock_RpmDataBase ): rpmdb = Mock() rpmdb.has_rpm.return_value = True rpmdb.rpmdb_host.expand_query.return_value = '/usr/lib/sysimage/rpm' mock_RpmDataBase.return_value = rpmdb self.repo.setup_package_database_configuration() assert mock_RpmDataBase.call_args_list == [ call('../data', 'macros.kiwi-image-config'), call('../data'), ] rpmdb.set_macro_from_string.assert_called_once_with( '_install_langs%en_US:de_DE' ) rpmdb.write_config.assert_called_once_with() rpmdb.link_database_to_host_path.assert_called_once_with() rpmdb.init_database.assert_called_once_with() mock_Path_create.assert_called_once_with('../data/var/lib') mock_Command_run.assert_called_once_with( [ 'ln', '-s', '--no-target-directory', '../../usr/lib/sysimage/rpm', '../data/var/lib/rpm', ], raise_on_error=False, ) @patch('kiwi.repository.zypper.RpmDataBase') def test_import_trusted_keys(self, mock_RpmDataBase): rpmdb = Mock() mock_RpmDataBase.return_value = rpmdb signing_keys = ['key-file-a.asc', 'key-file-b.asc'] self.repo.import_trusted_keys(signing_keys) assert rpmdb.import_signing_key_to_image.call_args_list == [ call('key-file-a.asc'), call('key-file-b.asc'), ] @patch('kiwi.repository.zypper.ConfigParser') @patch('kiwi.command.Command.run') @patch('kiwi.repository.zypper.Path.wipe') @patch('os.path.exists') @patch('kiwi.repository.zypper.Uri') def test_add_repo_with_credentials( self, mock_uri, mock_exists, mock_wipe, mock_command, mock_config ): exists_results = [False, False, False, True] def side_effect(arg): return exists_results.pop() mock_exists.side_effect = side_effect with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.repo.add_repo( name='foo', uri='http://some/repo', user='user', secret='secret', credentials_file='credentials_file', ) mock_wipe.assert_called_once_with( '../data/shared-dir/zypper/credentials/credentials_file' ) assert mock_open.call_args_list == [ call( '../data/shared-dir/zypper/credentials/credentials_file', 'w', ), call('../data/shared-dir/zypper/repos/foo.repo', 'w'), ] assert file_handle.write.call_args_list == [ call('username=user\n'), call('password=secret\n'), ] mock_command.assert_called_once_with( ['zypper'] + self.repo.zypper_args + [ '--root', '../data', 'addrepo', '--refresh', '--keep-packages', '--no-check', 'http://some/repo?credentials=credentials_file', 'foo', ], self.repo.command_env, ) @patch('kiwi.command.Command.run') def test_delete_repo(self, mock_command): self.repo.delete_repo('foo') mock_command.assert_called_once_with( ['zypper'] + self.repo.zypper_args + ['--root', '../data', 'removerepo', 'foo'], self.repo.command_env, ) @patch('kiwi.path.Path.wipe') @patch('os.walk') def test_cleanup_unused_repos(self, mock_walk, mock_path): mock_walk.return_value = [('/foo', ('bar', 'baz'), ('spam', 'eggs'))] self.repo.repo_names = ['eggs'] self.repo.cleanup_unused_repos() assert mock_path.call_args_list == [ call('../data/shared-dir/zypper/solv/@System'), call('../data/shared-dir/zypper/repos/spam'), ] @patch('kiwi.path.Path.wipe') @patch('kiwi.path.Path.create') def test_delete_all_repos(self, mock_create, mock_wipe): self.repo.delete_all_repos() mock_wipe.assert_called_once_with('../data/shared-dir/zypper/repos') mock_create.assert_called_once_with('../data/shared-dir/zypper/repos') @patch('kiwi.path.Path.wipe') def test_delete_repo_cache(self, mock_wipe): self.repo.delete_repo_cache('foo') assert mock_wipe.call_args_list == [ call('../data/shared-dir/packages/foo'), call('../data/shared-dir/zypper/solv/foo'), call('../data/shared-dir/zypper/raw/foo'), ] @patch('os.path.isfile') @patch('os.unlink') def test_cleanup(self, mock_os_unlink, mock_os_path_isfile): self.repo.cleanup() assert mock_os_unlink.call_args_list == [ call('tmpfile'), call('tmpfile'), ] @patch('kiwi.command.Command.run') @patch('os.path.exists') def test_context_manager_exit(self, mock_os_path_exists, mock_command_run): mock_os_path_exists.return_value = True with patch('builtins.open', create=True): with RepositoryZypper(self.root_bind): pass mock_command_run.assert_called_once_with( ['mv', '-f', '/shared-dir/packages.moved', '/shared-dir/packages'] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7680697 kiwi-11.1.8/test/unit/runtime_checker_test.py0000644000000000000000000005247515273675667016256 0ustar00import sys import logging from unittest.mock import patch, Mock from pytest import raises, fixture import pytest from .test_helper import argv_kiwi_tests import kiwi from kiwi.defaults import Defaults from kiwi.xml_state import XMLState from kiwi.xml_description import XMLDescription from kiwi.runtime_checker import RuntimeChecker from kiwi.exceptions import KiwiRuntimeError class TestRuntimeChecker: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): Defaults.set_platform_name('x86_64') Defaults.set_runtime_checker_metadata( '../data/runtime_checker_metadata.yml' ) self.description = XMLDescription( '../data/example_runtime_checker_config.xml' ) self.xml_state = XMLState(self.description.load()) self.runtime_config = Mock() self.runtime_config.get_oci_archive_tool.return_value = 'umoci' kiwi.runtime_checker.RuntimeConfig = Mock( return_value=self.runtime_config ) self.runtime_checker = RuntimeChecker(self.xml_state) def setup_method(self, cls): self.setup() @patch('kiwi.runtime_checker.Uri') def test_check_image_include_repos_publicly_resolvable(self, mock_Uri): uri = Mock() uri.is_public.return_value = False mock_Uri.return_value = uri with raises(KiwiRuntimeError): self.runtime_checker.check_image_include_repos_publicly_resolvable() @patch('kiwi.runtime_checker.Command.run') def test_check_target_dir_on_unsupported_filesystem(self, mock_Command_run): stat = Mock() stat.output = 'bogus' mock_Command_run.return_value = stat with raises(KiwiRuntimeError): self.runtime_checker.check_target_dir_on_unsupported_filesystem( '/some/root_dir' ) def test_invalid_target_dir_pointing_to_shared_cache_1(self): with raises(KiwiRuntimeError): self.runtime_checker.check_target_directory_not_in_shared_cache( '/var/cache//kiwi/foo' ) def test_invalid_target_dir_pointing_to_shared_cache_2(self): with raises(KiwiRuntimeError): self.runtime_checker.check_target_directory_not_in_shared_cache( '/var/cache/kiwi' ) @patch('os.getcwd') def test_invalid_target_dir_pointing_to_shared_cache_3(self, mock_getcwd): mock_getcwd.return_value = '/' with raises(KiwiRuntimeError): self.runtime_checker.check_target_directory_not_in_shared_cache( 'var/cache/kiwi' ) def test_invalid_target_dir_pointing_to_shared_cache_4(self): with raises(KiwiRuntimeError): self.runtime_checker.check_target_directory_not_in_shared_cache( '//var/cache//kiwi/foo' ) @patch('os.path.isdir') def test_check_dracut_module_versions_compatible_to_kiwi_no_dracut( self, mock_os_path_isdir ): mock_os_path_isdir.return_value = False self.runtime_checker.check_dracut_module_versions_compatible_to_kiwi( 'root_dir' ) # does not raise if no dracut is installed @patch('os.listdir') @patch('os.path.isdir') @patch('kiwi.runtime_checker.Command.run') def test_check_dracut_module_versions_compatible_to_kiwi( self, mock_Command_run, mock_os_path_isdir, mock_os_listdir ): mock_os_path_isdir.return_value = True command = Mock() command.output = '1.2.3-1.2' mock_Command_run.return_value = command mock_os_listdir.return_value = ['55kiwi-dump'] package_manager = Mock() package_manager.return_value = 'zypper' self.xml_state.get_package_manager = package_manager with raises(KiwiRuntimeError) as exception_data: self.runtime_checker.check_dracut_module_versions_compatible_to_kiwi( 'root_dir' ) assert "'dracut-kiwi-oem-dump': 'got:1.2.3, need:>=9.20.1'" in str( exception_data.value ) mock_Command_run.assert_called_once_with( [ 'chroot', 'root_dir', 'rpm', '-q', '--qf', '%{VERSION}', 'dracut-kiwi-oem-dump', ] ) package_manager.return_value = 'apt' mock_Command_run.reset_mock() with raises(KiwiRuntimeError) as exception_data: self.runtime_checker.check_dracut_module_versions_compatible_to_kiwi( 'root_dir' ) assert "'dracut-kiwi-oem-dump': 'got:1.2.3, need:>=9.20.1'" in str( exception_data.value ) mock_Command_run.assert_called_once_with( [ 'chroot', 'root_dir', 'dpkg-query', '-W', '-f', '${Version}', 'dracut-kiwi-oem-dump', ] ) mock_Command_run.side_effect = Exception # If the package manager call failed with an exception # the expected behavior is the runtime check to just pass # because there is no data to operate on. Best guess approach with self._caplog.at_level(logging.DEBUG): self.runtime_checker.check_dracut_module_versions_compatible_to_kiwi( 'root_dir' ) def test_valid_target_dir_1(self): assert ( self.runtime_checker.check_target_directory_not_in_shared_cache( '/var/cache/kiwi-fast-tmpsystemdir' ) is None ) def test_valid_target_dir_2(self): assert ( self.runtime_checker.check_target_directory_not_in_shared_cache( '/foo/bar' ) is None ) def test_check_repositories_configured(self): self.xml_state.delete_repository_sections() with raises(KiwiRuntimeError): self.runtime_checker.check_repositories_configured() def test_check_volume_setup_defines_reserved_labels(self): xml_state = XMLState( self.description.load(), ['vmxSimpleFlavour'], 'oem' ) runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_volume_setup_defines_reserved_labels() def test_appx_invalid_name(self): xml_state = XMLState(self.description.load(), ['wsl_launcher'], 'appx') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_appx_naming_conventions_valid() def test_appx_invalid_id(self): xml_state = XMLState(self.description.load(), ['wsl_id'], 'appx') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_appx_naming_conventions_valid() def test_check_volume_setup_defines_multiple_fullsize_volumes(self): with raises(KiwiRuntimeError): self.runtime_checker.check_volume_setup_defines_multiple_fullsize_volumes() def test_check_volume_setup_has_no_root_definition(self): with raises(KiwiRuntimeError): self.runtime_checker.check_volume_setup_has_no_root_definition() def test_check_partuuid_persistency_type_used_with_mbr(self): xml_state = XMLState(self.description.load(), ['vmxFlavour'], 'iso') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_partuuid_persistency_type_used_with_mbr() @patch('kiwi.runtime_checker.CommandCapabilities.has_option_in_help') def test_check_luksformat_options_valid(self, mock_has_option_in_help): mock_has_option_in_help.return_value = False with raises(KiwiRuntimeError): self.runtime_checker.check_luksformat_options_valid() @patch('kiwi.runtime_checker.Path.which') def test_check_container_tool_chain_installed(self, mock_which): mock_which.return_value = False xml_state = XMLState(self.description.load(), ['docker'], 'docker') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_container_tool_chain_installed() @patch('kiwi.runtime_checker.Path.which') def test_check_container_tool_chain_installed_unknown_tool( self, mock_which ): self.runtime_config.get_oci_archive_tool.return_value = 'budah' mock_which.return_value = False xml_state = XMLState(self.description.load(), ['docker'], 'docker') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_container_tool_chain_installed() @patch('kiwi.runtime_checker.Path.which') def test_check_container_tool_chain_installed_buildah(self, mock_which): self.runtime_config.get_oci_archive_tool.return_value = 'buildah' mock_which.return_value = False xml_state = XMLState(self.description.load(), ['docker'], 'docker') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_container_tool_chain_installed() @patch('kiwi.runtime_checker.Path.which') @patch('kiwi.runtime_checker.CommandCapabilities.check_version') def test_check_container_tool_chain_installed_with_version( self, mock_cmdver, mock_which ): mock_which.return_value = True mock_cmdver.return_value = False xml_state = XMLState(self.description.load(), ['docker'], 'docker') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_container_tool_chain_installed() @patch('kiwi.runtime_checker.Path.which') @patch('kiwi.runtime_checker.CommandCapabilities.check_version') @patch('kiwi.runtime_checker.CommandCapabilities.has_option_in_help') def test_check_container_tool_chain_installed_with_multitags( self, mock_cmdoptions, mock_cmdver, mock_which ): mock_which.return_value = True mock_cmdver.return_value = True mock_cmdoptions.return_value = False xml_state = XMLState(self.description.load(), ['docker'], 'docker') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_container_tool_chain_installed() @patch('kiwi.runtime_checker.Defaults.get_boot_image_description_path') def test_check_consistent_kernel_in_boot_and_system_image( self, mock_boot_path ): mock_boot_path.return_value = '../data' xml_state = XMLState(self.description.load(), ['vmxFlavour'], 'oem') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_consistent_kernel_in_boot_and_system_image() def test_check_initrd_selection_required(self): description = XMLDescription( '../data/example_runtime_checker_no_initrd_system_reference.xml' ) xml_state = XMLState(description.load()) runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_initrd_selection_required() def test_check_boot_description_exists_no_boot_ref(self): description = XMLDescription( '../data/example_runtime_checker_no_boot_reference.xml' ) xml_state = XMLState(description.load()) runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_boot_description_exists() def test_check_boot_description_exists_does_not_exist(self): description = XMLDescription( '../data/example_runtime_checker_boot_desc_not_found.xml' ) xml_state = XMLState(description.load()) runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_boot_description_exists() def test_check_xen_uniquely_setup_as_server_or_guest_for_ec2(self): self.xml_state.build_type.get_firmware = Mock(return_value='ec2') self.xml_state.is_xen_server = Mock(return_value=True) self.xml_state.is_xen_guest = Mock(return_value=True) with raises(KiwiRuntimeError): self.runtime_checker.check_xen_uniquely_setup_as_server_or_guest() def test_check_efi_fat_image_has_correct_size(self): self.xml_state.build_type.get_efifatimagesize = Mock(return_value='200') with raises(KiwiRuntimeError): self.runtime_checker.check_efi_fat_image_has_correct_size() def test_check_xen_uniquely_setup_as_server_or_guest_for_xen(self): self.xml_state.build_type.get_firmware = Mock(return_value=None) self.xml_state.is_xen_server = Mock(return_value=True) self.xml_state.is_xen_guest = Mock(return_value=True) with raises(KiwiRuntimeError): self.runtime_checker.check_xen_uniquely_setup_as_server_or_guest() def test_check_dracut_module_for_disk_overlay_in_package_list(self): xml_state = XMLState(self.description.load(), ['vmxFlavour'], 'iso') xml_state.build_type.get_overlayroot = Mock(return_value=True) runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_dracut_module_for_disk_overlay_in_package_list() @pytest.mark.parametrize( "tool_name, tool_binary", [("isomd5sum", "implantisomd5"), ("checkmedia", "tagmedia")], ) @patch('kiwi.runtime_checker.Path.which') @patch('kiwi.runtime_checker.RuntimeConfig') def test_check_mediacheck_installed_implantisomd5_missing( self, mock_RuntimeConfig, mock_which, tool_name, tool_binary ): runtime_config = Mock() runtime_config.get_iso_media_tag_tool.return_value = tool_name mock_RuntimeConfig.return_value = runtime_config mock_which.return_value = False xml_state = XMLState(self.description.load(), ['vmxFlavour'], 'iso') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError) as rt_err_ctx: runtime_checker.check_mediacheck_installed() assert ( f"Required tool {tool_binary} not found in caller environment" in str(rt_err_ctx.value) ) @patch('kiwi.runtime_checker.Path.which') @patch('kiwi.runtime_checker.RuntimeConfig') @patch('kiwi.runtime_checker.FirmWare') @patch('kiwi.runtime_checker.CommandCapabilities.check_version') def test_check_checkmedia_used_with_msdos_table( self, mock_CommandCapabilities_check_version, mock_FirmWare, mock_RuntimeConfig, mock_which, ): mock_CommandCapabilities_check_version.return_value = False firmware = Mock() firmware.get_partition_table_type.return_value = 'gpt' mock_FirmWare.return_value = firmware runtime_config = Mock() runtime_config.get_iso_media_tag_tool.return_value = 'checkmedia' mock_RuntimeConfig.return_value = runtime_config mock_which.return_value = True xml_state = XMLState(self.description.load(), ['vmxFlavour'], 'iso') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError) as runtime_context: runtime_checker.check_checkmedia_used_with_msdos_table() assert ( 'ISO media tag tool tagmedia < v6.6 does not support gpt' in format(runtime_context) ) def test_check_dracut_module_for_live_iso_in_package_list(self): xml_state = XMLState(self.description.load(), ['vmxFlavour'], 'iso') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_dracut_module_for_live_iso_in_package_list() def test_check_dracut_module_for_disk_oem_in_package_list(self): xml_state = XMLState(self.description.load(), ['vmxFlavour'], 'oem') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_dracut_module_for_disk_oem_in_package_list() def test_check_dracut_module_for_oem_install_in_package_list(self): xml_state = XMLState(self.description.load(), ['vmxFlavour'], 'oem') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_dracut_module_for_oem_install_in_package_list() def test_check_volume_label_used_with_lvm(self): with raises(KiwiRuntimeError): self.runtime_checker.check_volume_label_used_with_lvm() def test_check_swap_name_used_with_lvm(self): xml_state = XMLState(self.description.load(), ['vmxFlavour'], 'oem') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_swap_name_used_with_lvm() def test_check_preferences_data_no_version(self): xml_state = XMLState(self.description.load(), ['docker'], 'docker') runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_image_version_provided() def test_check_image_type_unique(self): description = XMLDescription( '../data/example_runtime_checker_conflicting_types.xml' ) xml_state = XMLState(description.load()) runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_image_type_unique() def test_check_include_references_unresolvable(self): description = XMLDescription( '../data/example_runtime_checker_include_nested_reference.xml' ) xml_state = XMLState(description.load()) runtime_checker = RuntimeChecker(xml_state) with raises(KiwiRuntimeError): runtime_checker.check_include_references_unresolvable() def test_check_bootloader_env_compatible_with_loader(self): self.xml_state.get_build_type_bootloader_name = Mock( return_value='systemd_boot' ) self.xml_state.get_build_type_bootloader_environment_variables = Mock( return_value=['some'] ) with raises(KiwiRuntimeError): self.runtime_checker.check_bootloader_env_compatible_with_loader() def test_check_kernel_flavor_supported(self): description = XMLDescription('../data/example_kernel_flavor_config.xml') xml_data = description.load() for profile in ['flavor', 'noFlavor']: RuntimeChecker( XMLState(xml_data, [profile]) ).check_kernel_flavor_supported() with raises(KiwiRuntimeError) as issue: RuntimeChecker( XMLState(xml_data, ['flavorKiwiInitrd']) ).check_kernel_flavor_supported() assert 'require the dracut initrd system' in str(issue.value) with raises(KiwiRuntimeError) as issue: RuntimeChecker( XMLState(xml_data, ['flavorUKI']) ).check_kernel_flavor_supported() assert 'not supported with UKI' in str(issue.value) xml_state = XMLState(xml_data, ['flavor']) xml_state.get_build_type_bootloader_name = Mock(return_value='zipl') xml_state.get_host_key_certificates = Mock( return_value=[{'hkd_cert': ['host.crt']}] ) with raises(KiwiRuntimeError) as issue: RuntimeChecker(xml_state).check_kernel_flavor_supported() assert 'not supported with zipl secure execution' in str(issue.value) # secure execution through grub is not affected xml_state.get_build_type_bootloader_name = Mock( return_value='grub2_s390x_emu' ) RuntimeChecker(xml_state).check_kernel_flavor_supported() def test_check_kernel_flavors_installed(self, tmp_path): description = XMLDescription('../data/example_kernel_flavor_config.xml') xml_data = description.load() runtime_checker = RuntimeChecker(XMLState(xml_data, ['flavor'])) with raises(KiwiRuntimeError) as issue: runtime_checker.check_kernel_flavors_installed(str(tmp_path)) assert 'kernel flavor(s): rt, default' in str(issue.value) assert 'kernel versions are:\nnone' in str(issue.value) for version in ['6.4.0-1-default', '6.4.0-1-64kb']: modules_dir = tmp_path / 'lib' / 'modules' / version modules_dir.mkdir(parents=True) (modules_dir / 'vmlinuz').touch() with raises(KiwiRuntimeError) as issue: runtime_checker.check_kernel_flavors_installed(str(tmp_path)) assert 'kernel flavor(s): rt\n' in str(issue.value) assert '6.4.0-1-64kb, 6.4.0-1-default' in str(issue.value) modules_dir = tmp_path / 'lib' / 'modules' / '6.4.0-2-rt' modules_dir.mkdir(parents=True) (modules_dir / 'vmlinuz').touch() runtime_checker.check_kernel_flavors_installed(str(tmp_path)) # nothing to check without kernel flavors RuntimeChecker( XMLState(xml_data, ['noFlavor']) ).check_kernel_flavors_installed(str(tmp_path / 'none')) def test_check_package_in_list(self): assert RuntimeChecker._package_in_list(['a', 'b'], ['b']) == 'b' assert RuntimeChecker._package_in_list(['a', 'b'], ['c']) == '' def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7680697 kiwi-11.1.8/test/unit/runtime_config_test.py0000644000000000000000000002656515273675667016120 0ustar00import logging import yaml from unittest.mock import patch, call from pytest import raises, fixture import pytest from kiwi.runtime_config import RuntimeConfig from kiwi.defaults import Defaults from kiwi.exceptions import ( KiwiRuntimeConfigFormatError, KiwiRuntimeConfigFileError, ) class TestRuntimeConfig: def setup(self): Defaults.set_custom_runtime_config_file(None) def setup_method(self, cls): self.setup() @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def test__get_attribute_raises_on_invalid_structure(self): with patch.dict('os.environ', {'HOME': '../data/kiwi_config/broken'}): runtime_config = RuntimeConfig(reread=True) with raises(KiwiRuntimeConfigFormatError): runtime_config._get_attribute('foo', 'bar') @patch('kiwi.defaults.CUSTOM_RUNTIME_CONFIG_FILE', 'some-config-file') def test_init_raises_custom_config_file_not_found(self): with patch('os.path.isfile', return_value=False): with raises(KiwiRuntimeConfigFileError): RuntimeConfig(reread=True) def test_merge_strategy(self): with open('../data/kiwi.yml', 'r') as config: master = yaml.safe_load(config) with open('../data/kiwi_merge_ok.yml', 'r') as config: slave_ok = yaml.safe_load(config) with open('../data/kiwi_merge_invalid_dict.yml', 'r') as config: slave_invalid_dict = yaml.safe_load(config) with open('../data/kiwi_merge_invalid_list.yml', 'r') as config: slave_invalid_list = yaml.safe_load(config) assert RuntimeConfig._merge(master, slave_ok) == { 'xz': {'options': '--foo'}, 'shasum': {'size': '256'}, 'bundle': {'shasum_size': '256', 'compress': False}, 'runtime_checks': { 'disable': [ 'check_boot_description_exists', 'check_container_tool_chain_installed', 'check_repositories_configured', ] }, } with raises(NotImplementedError): RuntimeConfig._merge(master, slave_invalid_dict) with raises(NotImplementedError): RuntimeConfig._merge(master, slave_invalid_list) def test_merge_strategy_on_self_referencing_config(self): # the yaml anchor and alias syntax allows to create data # that references itself. Both sides of the merge are read # from the same file but as two independent objects, like # it happens when two config files provide such data with open('../data/kiwi_merge_recursive.yml', 'r') as config: master = yaml.safe_load(config) with open('../data/kiwi_merge_recursive.yml', 'r') as config: slave = yaml.safe_load(config) with raises(KiwiRuntimeConfigFormatError): RuntimeConfig._merge(master, slave) @patch('yaml.safe_load') @patch('kiwi.defaults.CUSTOM_RUNTIME_CONFIG_FILE', 'some-custom-file') def test_reading_custom_config_file(self, mock_yaml): with patch('os.path.isfile', return_value=True): with patch('builtins.open') as m_open: RuntimeConfig(reread=True) m_open.assert_has_calls([call('some-custom-file', 'r')]) @pytest.mark.no_kiwi_yml_mock @patch('os.path.isfile') @patch('yaml.safe_load') @patch('os.path.isdir') @patch('os.listdir') def test_reading_system_wide_config_file_from_etc( self, mock_os_listdir, mock_os_path_isdir, mock_yaml, mock_os_path_isfile, ): mock_os_listdir.return_value = ['some.yml'] def os_path_isfile(config): if config == '/etc/kiwi.yml': return True return False def os_path_isdir(config): if config == '/etc/kiwi.yml.d': return True return False mock_os_path_isfile.side_effect = os_path_isfile mock_os_path_isdir.side_effect = os_path_isdir with patch('builtins.open') as m_open: RuntimeConfig(reread=True) assert m_open.call_args_list == [ call('/etc/kiwi.yml', 'r'), call('/etc/kiwi.yml.d/some.yml', 'r'), ] @pytest.mark.no_kiwi_yml_mock @patch('os.path.isfile') @patch('yaml.safe_load') @patch('os.path.isdir') @patch('os.listdir') def test_reading_system_wide_config_file_from_usr( self, mock_os_listdir, mock_os_path_isdir, mock_yaml, mock_os_path_isfile, ): mock_os_listdir.return_value = ['some.yml'] def os_path_isfile(config): if config == '/usr/share/kiwi/kiwi.yml': return True return False def os_path_isdir(config): if config == '/usr/share/kiwi/kiwi.yml.d': return True return False mock_os_path_isfile.side_effect = os_path_isfile mock_os_path_isdir.side_effect = os_path_isdir with patch('builtins.open') as m_open: RuntimeConfig(reread=True) assert m_open.call_args_list == [ call('/usr/share/kiwi/kiwi.yml', 'r'), call('/usr/share/kiwi/kiwi.yml.d/some.yml', 'r'), ] @patch('kiwi.defaults.ETC_RUNTIME_CONFIG_FILE', '../data/kiwi.yml') @patch('kiwi.defaults.ETC_RUNTIME_CONFIG_DIR', '../data/kiwi.yml.d') @patch('kiwi.runtime_checker.Defaults.is_buildservice_worker') def test_config_sections_from_system_wide_etc_config( self, mock_is_buildservice_worker ): mock_is_buildservice_worker.return_value = False runtime_config = RuntimeConfig(reread=True) assert runtime_config.get_xz_options() == ['-a', '-b', 'xxx'] assert runtime_config.get_mapper_tool() == 'partx' assert ( runtime_config.get_checksum_handler('../data/metalink').suffix == '.sha512' ) assert ( runtime_config.get_checksum_handler( '../data/metalink', bundle_lookup=True ).suffix == '.sha256' ) @patch('kiwi.defaults.ETC_RUNTIME_CONFIG_FILE', '') @patch('kiwi.defaults.ETC_RUNTIME_CONFIG_DIR', '') @patch('kiwi.defaults.USR_RUNTIME_CONFIG_FILE', '../data/kiwi.yml') @patch('kiwi.defaults.USR_RUNTIME_CONFIG_DIR', '../data/kiwi.yml.d') @patch('kiwi.runtime_checker.Defaults.is_buildservice_worker') def test_config_sections_from_system_wide_usr_config( self, mock_is_buildservice_worker ): mock_is_buildservice_worker.return_value = False runtime_config = RuntimeConfig(reread=True) assert runtime_config.get_xz_options() == ['-a', '-b', 'xxx'] assert runtime_config.get_mapper_tool() == 'partx' @patch('kiwi.runtime_checker.Defaults.is_buildservice_worker') def test_config_sections_from_home_base_config( self, mock_is_buildservice_worker ): mock_is_buildservice_worker.return_value = False with patch.dict('os.environ', {'HOME': '../data/kiwi_config/ok'}): runtime_config = RuntimeConfig(reread=True) assert runtime_config.get_xz_options() == ['-a', '-b', 'xxx'] assert runtime_config.is_obs_public() is True assert runtime_config.get_bundle_compression() is True assert ( runtime_config.get_obs_download_server_url() == 'http://example.com' ) assert ( runtime_config.get_obs_api_server_url() == 'https://api.example.com' ) assert runtime_config.get_container_compression() is False assert runtime_config.get_iso_tool_category() == 'xorriso' assert runtime_config.get_iso_media_tag_tool() == 'isomd5sum' assert runtime_config.get_oci_archive_tool() == 'umoci' assert runtime_config.get_mapper_tool() == 'partx' assert runtime_config.get_package_changes() is True assert runtime_config.get_sync_sparse() is True assert runtime_config.get_disabled_runtime_checks() == [ 'check_dracut_module_for_oem_install_in_package_list', 'check_container_tool_chain_installed', ] @patch('kiwi.runtime_checker.Defaults.is_buildservice_worker') @patch('kiwi.runtime_checker.Defaults.get_platform_name') def test_config_sections_defaults( self, mock_get_platform_name, mock_is_buildservice_worker ): mock_get_platform_name.return_value = 's390x' mock_is_buildservice_worker.return_value = True with patch.dict('os.environ', {'HOME': '../data/kiwi_config/defaults'}): runtime_config = RuntimeConfig(reread=True) assert runtime_config.get_bundle_compression(default=True) is True assert runtime_config.get_bundle_compression(default=False) is False assert runtime_config.is_obs_public() is True assert ( runtime_config.get_obs_download_server_url() == Defaults.get_obs_download_server_url() ) assert ( runtime_config.get_obs_api_server_url() == Defaults.get_obs_api_server_url() ) assert runtime_config.get_container_compression() is True assert runtime_config.get_iso_tool_category() == 'xorriso' assert runtime_config.get_iso_media_tag_tool() == 'checkmedia' assert runtime_config.get_sync_sparse() == Defaults.get_sync_sparse() assert runtime_config.get_oci_archive_tool() == 'umoci' assert runtime_config.get_mapper_tool() == 'kpartx' assert runtime_config.get_package_changes() is False assert ( runtime_config.get_credentials_verification_metadata_signing_key_file() == '' ) mock_get_platform_name.return_value = 'x86_64' with patch.dict('os.environ', {'HOME': '../data/kiwi_config/defaults'}): runtime_config = RuntimeConfig(reread=True) assert runtime_config.get_mapper_tool() == 'partx' assert ( runtime_config.get_checksum_handler('../data/metalink').suffix == '.sha256' ) def test_config_sections_invalid(self): with patch.dict('os.environ', {'HOME': '../data/kiwi_config/invalid'}): runtime_config = RuntimeConfig(reread=True) with self._caplog.at_level(logging.WARNING): assert runtime_config.get_container_compression() is True assert ( 'Skipping invalid container compression: foo' in self._caplog.text ) with self._caplog.at_level(logging.WARNING): assert runtime_config.get_iso_tool_category() == 'xorriso' assert ( 'Skipping invalid iso tool category: foo' in self._caplog.text ) with self._caplog.at_level(logging.WARNING): assert runtime_config.get_iso_media_tag_tool() == "checkmedia" assert ( 'Skipping invalid iso media tag tool: foo' in self._caplog.text ) def test_config_sections_other_settings(self): with patch.dict('os.environ', {'HOME': '../data/kiwi_config/other'}): runtime_config = RuntimeConfig(reread=True) assert runtime_config.get_container_compression() is True assert runtime_config.get_package_changes() is True assert runtime_config.get_sync_sparse() is False assert runtime_config.get_iso_media_tag_tool() == "checkmedia" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7680697 kiwi-11.1.8/test/unit/shell_test.py0000644000000000000000000000176515273675667014212 0ustar00from unittest.mock import patch from kiwi.system.shell import Shell from kiwi.defaults import Defaults class TestShell: def test_quote(self): assert Shell.quote(r'aa\!') == 'aa\\\\\\!' @patch('kiwi.path.Path.which') def test_quote_key_value_file(self, mock_which): mock_which.side_effect = ['cp', 'bash'] assert Shell.quote_key_value_file('../data/key_value') == [ "foo='bar'", "bar='xxx'", "name='bob'", "strange='$a_foo'", ] @patch('kiwi.system.shell.Command.run') def test_run_common_function(self, mock_command): Shell.run_common_function('foo', ['"param1"', '"param2"']) command_string = ' '.join( [ 'source', Defaults.project_file('config/functions.sh') + ';', 'foo', '"param1"', '"param2"', ] ) mock_command.assert_called_once_with(['bash', '-c', command_string]) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7680697 kiwi-11.1.8/test/unit/snapshot_manager/base_test.py0000644000000000000000000000132015273675667017331 0ustar00from pytest import raises from kiwi.snapshot_manager.base import SnapshotManagerBase class TestSnapshotManagerBase: def setup(self): self.manager = SnapshotManagerBase( '/dev/device', 'root_dir', 'mountpoint', '@', None ) def setup_method(self, cls): self.setup() def test_create_first_snapshot(self): with raises(NotImplementedError): self.manager.create_first_snapshot() def test_setup_first_snapshot(self): with raises(NotImplementedError): self.manager.setup_first_snapshot() def test_get_default_snapshot_name(self): with raises(NotImplementedError): self.manager.get_default_snapshot_name() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7683315 kiwi-11.1.8/test/unit/snapshot_manager/init_test.py0000644000000000000000000000143015273675667017364 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.snapshot_manager import SnapshotManager from kiwi.exceptions import KiwiSnapshotManagerSetupError class TestSnapshotManager: def test_snapshot_manager_not_implemented(self): with raises(KiwiSnapshotManagerSetupError): SnapshotManager.new( 'foo', '/dev/device', 'root_dir', 'mountpoint', '@', [Mock()] ) @patch('kiwi.snapshot_manager.snapper.SnapshotManagerSnapper') def test_snapshot_manager_snapper(self, mock_snapper): SnapshotManager.new( 'snapper', '/dev/device', 'root_dir', 'mountpoint', '@', None ) mock_snapper.assert_called_once_with( '/dev/device', 'root_dir', 'mountpoint', '@', None ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7683315 kiwi-11.1.8/test/unit/snapshot_manager/snapper_test.py0000644000000000000000000003314315273675667020077 0ustar00import datetime from unittest.mock import patch, call, Mock, mock_open from pytest import raises, fixture from lxml import etree from xml.dom import minidom from kiwi.snapshot_manager.snapper import SnapshotManagerSnapper from kiwi.exceptions import KiwiSnapshotManagerSetupError @fixture(autouse=True) def no_mountpoints_on_host(): """ The bind mounts of the chroot environment snapper runs in create their mountpoints below the root directory, which is relative to the working directory tests running in parallel share. Mountpoints must not be created there """ with patch('kiwi.mount_manager.Path.create'): yield class TestSnapshotManagerSnapper: def setup(self): self.snapper = SnapshotManagerSnapper( '/dev/device', 'root_dir', '/tmp/mountpoint', '@', {'quota_groups': True}, ) def setup_method(self, cls): self.setup() def test_post_init(self): self.snapper.post_init({'some-arg': 'some-val'}) assert self.snapper.custom_args['some-arg'] == 'some-val' assert not self.snapper.custom_args['quota_groups'] @patch('kiwi.snapshot_manager.snapper.MountManager') @patch('kiwi.snapshot_manager.snapper.Command.run') def test_create_first_snapshot_with_snapper_helper( self, mock_command, mock_mount ): def return_snapper_version(command=None, raise_on_error=None, *args): mock = Mock() snapperCmd = ['chroot', 'snapper', '--version'] subCmd = [element for element in command if element in snapperCmd] if snapperCmd == subCmd: mock.output = 'snapper 0.12.1' mock.return_code = 0 return mock mock_command.side_effect = return_snapper_version extra_mounts = self.snapper.create_first_snapshot() assert mock_mount.call_args_list == [ call( device='/dev/device', attributes={ 'subvol_path': '@/.snapshots', 'subvol_name': '@/.snapshots', }, mountpoint='/tmp/mountpoint/@/.snapshots/1/snapshot/.snapshots', ) ] assert mock_command.call_args_list == [ call(['chroot', 'root_dir', 'snapper', '--version']), call( command=['mountpoint', '-q', 'root_dir/tmp/mountpoint'], raise_on_error=False, ), call( [ 'mount', '-n', '--bind', '/tmp/mountpoint', 'root_dir/tmp/mountpoint', ] ), call( [ 'chroot', 'root_dir', '/usr/lib/snapper/installation-helper', '--root-prefix', '/tmp/mountpoint/@', '--step', 'filesystem', ], None, True, False, True, ), call( command=['mountpoint', '-q', 'root_dir/tmp/mountpoint'], raise_on_error=False, ), ] assert len(extra_mounts) == 1 @patch('os.chmod') @patch('kiwi.snapshot_manager.snapper.MountManager') @patch('kiwi.snapshot_manager.snapper.Command.run') def test_create_first_snapshot_without_snapper_helper( self, mock_command, mock_mount, mock_os_chmod ): def return_snapper_version(command=None, raise_on_error=None, *args): mock = Mock() snapperCmd = ['chroot', 'snapper', '--version'] subCmd = [element for element in command if element in snapperCmd] if snapperCmd == subCmd: mock.output = 'snapper 0.12.0' mock.return_code = 0 return mock mock_command.side_effect = return_snapper_version extra_mounts = self.snapper.create_first_snapshot() mock_os_chmod.assert_called_once_with( '/tmp/mountpoint/@/.snapshots', 0o700 ) assert mock_mount.call_args_list == [ call( device='/dev/device', attributes={ 'subvol_path': '@/.snapshots', 'subvol_name': '@/.snapshots', }, mountpoint='/tmp/mountpoint/@/.snapshots/1/snapshot/.snapshots', ) ] assert mock_command.call_args_list == [ call(['chroot', 'root_dir', 'snapper', '--version']), call( ['btrfs', 'subvolume', 'create', '/tmp/mountpoint/@/.snapshots'] ), call( [ 'btrfs', 'subvolume', 'create', '/tmp/mountpoint/@/.snapshots/1/snapshot', ] ), call( [ 'btrfs', 'subvolume', 'set-default', '/tmp/mountpoint/@/.snapshots/1/snapshot', ] ), ] assert len(extra_mounts) == 1 @patch('os.path.exists') @patch('shutil.copyfile') @patch('kiwi.snapshot_manager.snapper.SysConfig') @patch('kiwi.snapshot_manager.snapper.Command.run') def test_setup_first_snapshot_with_snapper_helper( self, mock_command, mock_sysconf, mock_copy, mock_os_exists ): def return_snapper_version(command=None, raise_on_error=None, *args): mock = Mock() snapperCmd = ['chroot', 'snapper', '--version'] subCmd = [element for element in command if element in snapperCmd] if snapperCmd == subCmd: mock.output = 'snapper 0.13.0' mock.return_code = 0 return mock mock_command.side_effect = return_snapper_version item = {'SNAPPER_CONFIGS': '""'} def getitem(key): return item[key] def setitem(key, value): item[key] = value def contains(key): return key in item def exists(name): if 'snapper/configs/root' in name: return False return True sysconf = Mock() sysconf.__contains__ = Mock(side_effect=contains) sysconf.__getitem__ = Mock(side_effect=getitem) sysconf.__setitem__ = Mock(side_effect=setitem) mock_sysconf.return_value = sysconf mock_os_exists.side_effect = exists self.snapper.setup_first_snapshot() snapshot_path = '/tmp/mountpoint/@/.snapshots/1/snapshot' assert mock_copy.call_args_list == [ call( f'{snapshot_path}/etc/snapper/config-templates/default', f'{snapshot_path}/etc/snapper/configs/root', ) ] assert mock_command.call_args_list == [ call( [ 'chroot', '/tmp/mountpoint/@/.snapshots/1/snapshot', 'snapper', '--version', ] ), call( command=[ 'mountpoint', '-q', 'root_dir/tmp/mountpoint/@/.snapshots/1/snapshot', ], raise_on_error=False, ), call( [ 'mount', '-n', '--bind', '/tmp/mountpoint/@/.snapshots/1/snapshot', 'root_dir/tmp/mountpoint/@/.snapshots/1/snapshot', ] ), call( command=[ 'mountpoint', '-q', 'root_dir/tmp/mountpoint/@/.snapshots/1/snapshot/.snapshots', ], raise_on_error=False, ), call( [ 'mount', '-n', '--bind', '/tmp/mountpoint/@/.snapshots/1/snapshot/.snapshots', 'root_dir/tmp/mountpoint/@/.snapshots/1/snapshot/.snapshots', ] ), call( [ 'chroot', 'root_dir', '/usr/lib/snapper/installation-helper', '--root-prefix', '/tmp/mountpoint/@/.snapshots/1/snapshot', '--step', 'config', '--description', 'first root filesystem', ], None, True, False, True, ), call( command=[ 'mountpoint', '-q', 'root_dir/tmp/mountpoint/@/.snapshots/1/snapshot/.snapshots', ], raise_on_error=False, ), call( command=[ 'mountpoint', '-q', 'root_dir/tmp/mountpoint/@/.snapshots/1/snapshot', ], raise_on_error=False, ), call(['btrfs', 'qgroup', 'create', '1/0', '/tmp/mountpoint']), call( [ 'chroot', '/tmp/mountpoint/@/.snapshots/1/snapshot', 'snapper', '--no-dbus', 'set-config', 'QGROUP=1/0', ], None, True, False, True, ), call( [ 'chroot', '/tmp/mountpoint/@/.snapshots/1/snapshot', 'snapper', '--no-dbus', 'modify', '--default', '1', ], None, True, False, True, ), ] @patch('os.path.exists') @patch('kiwi.snapshot_manager.snapper.Command.run') @patch.object(datetime, 'datetime', Mock(wraps=datetime.datetime)) def test_setup_first_snapshot_without_snapper_helper( self, mock_command, mock_os_exists ): self.snapper.post_init(None) def return_snapper_version(command=None, raise_on_error=None, *args): mock = Mock() snapperCmd = ['chroot', 'snapper', '--version'] subCmd = [element for element in command if element in snapperCmd] if snapperCmd == subCmd: mock.output = 'snapper 0.11.0' mock.return_code = 0 return mock mock_command.side_effect = return_snapper_version mock_os_exists.return_value = True xml_info = etree.tostring( etree.parse( '../data/info.xml', etree.XMLParser(remove_blank_text=True) ) ) datetime.datetime.now.return_value = datetime.datetime(2016, 1, 1) m_open = mock_open() with patch('builtins.open', m_open, create=True): self.snapper.setup_first_snapshot() assert m_open.call_args_list == [ call('/tmp/mountpoint/@/.snapshots/1/snapshot/../info.xml', 'w') ] assert m_open.return_value.write.call_args_list == [ call(minidom.parseString(xml_info).toprettyxml(indent=" ")) ] assert mock_command.call_args_list == [ call( [ 'chroot', '/tmp/mountpoint/@/.snapshots/1/snapshot', 'snapper', '--version', ] ), call( [ 'chroot', '/tmp/mountpoint/@/.snapshots/1/snapshot', 'snapper', '--no-dbus', 'modify', '--default', '1', ], None, True, False, True, ), ] @patch('os.path.exists') @patch('kiwi.snapshot_manager.snapper.SysConfig') @patch('kiwi.snapshot_manager.snapper.Command.run') def test_setup_first_snapshot_with_bad_sysconfig( self, mock_command, mock_sysconf, mock_os_exists ): def return_snapper_version(command=None, raise_on_error=None, *args): mock = Mock() snapperCmd = ['chroot', 'snapper', '--version'] subCmd = [element for element in command if element in snapperCmd] if snapperCmd == subCmd: mock.output = 'snapper 0.13.0' mock.return_code = 0 return mock mock_command.side_effect = return_snapper_version item = {'SNAPPER_CONFIGS': '"root foo"'} def getitem(key): return item[key] def setitem(key, value): item[key] = value def contains(key): return key in item sysconf = Mock() sysconf.__contains__ = Mock(side_effect=contains) sysconf.__getitem__ = Mock(side_effect=getitem) sysconf.__setitem__ = Mock(side_effect=setitem) mock_sysconf.return_value = sysconf mock_os_exists.return_value = True with raises(KiwiSnapshotManagerSetupError): self.snapper.setup_first_snapshot() def test_get_default_snapshot_name(self): default_snapshot = '/@/.snapshots/1/snapshot' assert self.snapper.get_default_snapshot_name() == default_snapshot ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7683315 kiwi-11.1.8/test/unit/solver/__init__.py0000644000000000000000000000000015273675667015072 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7684581 kiwi-11.1.8/test/unit/solver/repository/__init__.py0000644000000000000000000000000015273675667017311 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7684872 kiwi-11.1.8/test/unit/solver/repository/base_test.py0000644000000000000000000003765715273675667017557 0ustar00import io from unittest.mock import patch, call, mock_open, MagicMock, Mock from pytest import raises import os import unittest.mock as mock from lxml import etree from kiwi.defaults import Defaults from kiwi.solver.repository.base import SolverRepositoryBase from kiwi.exceptions import KiwiUriOpenError class TestSolverRepositoryBase: def setup(self): self.uri = mock.Mock() self.uri.uri = 'http://example.org/some/path' self.solver = SolverRepositoryBase(self.uri) def setup_method(self, cls): self.setup() def test_uri_has_credentials(self): self.uri = mock.Mock() self.uri.uri = 'http://user:pass@example.org/some/path' self.solver = SolverRepositoryBase(self.uri) assert self.solver.user == 'user' assert self.solver.secret == 'pass' assert self.solver.uri.uri == 'http://example.org/some/path' @patch.object(SolverRepositoryBase, '_get_repomd_xml') @patch.object(SolverRepositoryBase, '_get_deb_packages') @patch.object(SolverRepositoryBase, '_get_pacman_packages') def test_get_repo_type_not_detected( self, mock_get_pacman_packages, mock_get_deb_packages, mock_get_repomd_xml, ): mock_get_repomd_xml.side_effect = KiwiUriOpenError('error') mock_get_pacman_packages.side_effect = KiwiUriOpenError('error') mock_get_deb_packages.side_effect = KiwiUriOpenError('error') assert self.solver.get_repo_type() is None @patch.object(SolverRepositoryBase, '_get_repomd_xml') def test_get_repo_type_rpm_md(self, mock_get_repomd_xml): assert self.solver.get_repo_type() == 'rpm-md' @patch.object(SolverRepositoryBase, '_get_repomd_xml') @patch.object(SolverRepositoryBase, '_get_deb_packages') def test_get_repo_type_deb( self, mock_get_deb_packages, mock_get_repomd_xml ): mock_get_repomd_xml.side_effect = KiwiUriOpenError('error') assert self.solver.get_repo_type() == 'apt-deb' @patch.object(SolverRepositoryBase, '_get_repomd_xml') @patch.object(SolverRepositoryBase, '_get_deb_packages') @patch.object(SolverRepositoryBase, '_get_pacman_packages') def test_get_repo_type_pacman( self, mock_get_pacman_packages, mock_get_deb_packages, mock_get_repomd_xml, ): mock_get_repomd_xml.side_effect = KiwiUriOpenError('error') mock_get_deb_packages.side_effect = KiwiUriOpenError('error') mock_get_pacman_packages.return_value = '"some_repo.db.sig"' assert self.solver.get_repo_type() == 'pacman' def test__setup_repository_metadata(self): with raises(NotImplementedError): self.solver._setup_repository_metadata() def test__get_repomd_xpath(self): xml_data = etree.parse('../data/repomd.xml') assert ( self.solver._get_repomd_xpath( xml_data, 'repo:data[@type="primary"]/repo:location' )[0].get('href') == 'repodata/55f95a93-primary.xml.gz' ) @patch('kiwi.solver.repository.base.Temporary.new_file') @patch.object(SolverRepositoryBase, 'download_from_repository') @patch('os.path.isfile') def test__get_pacman_packages( self, mock_os_isfile, mock_download, mock_tmpfile ): Defaults.set_platform_name('x86_64') mock_os_isfile.return_value = True tmpfile = mock.Mock() tmpfile.name = 'tmpfile' mock_tmpfile.return_value = tmpfile with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = 'data' assert self.solver._get_pacman_packages() == 'data' mock_download.assert_called_once_with('x86_64', 'tmpfile') @patch('kiwi.solver.repository.base.Temporary.new_file') @patch.object(SolverRepositoryBase, 'download_from_repository') @patch('os.path.isfile') def test__get_packages_not_downloaded( self, mock_os_isfile, mock_download, mock_tmpfile ): # nothing is provided if the download did not produce a file mock_os_isfile.return_value = False mock_tmpfile.return_value.name = 'tmpfile' assert self.solver._get_pacman_packages() is None assert self.solver._get_deb_packages() is None def test__merge_solvables_without_solvables(self): self.solver.repository_solvable_dir = None assert self.solver._merge_solvables('target_dir') is None @patch('kiwi.solver.repository.base.Temporary.new_file') @patch.object(SolverRepositoryBase, 'download_from_repository') @patch('os.path.isfile') def test__get_deb_packages( self, mock_os_isfile, mock_download, mock_tmpfile ): mock_os_isfile.return_value = True tmpfile = mock.Mock() tmpfile.name = 'tmpfile' mock_tmpfile.return_value = tmpfile with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = 'data' assert self.solver._get_deb_packages() == 'data' mock_download.assert_called_once_with('Packages.gz', 'tmpfile') mock_download.reset_mock() assert ( self.solver._get_deb_packages('download_dir') == 'download_dir/Packages.gz' ) mock_download.assert_called_once_with( 'Packages.gz', 'download_dir/Packages.gz' ) @patch('kiwi.solver.repository.base.Temporary.new_file') @patch.object(SolverRepositoryBase, 'download_from_repository') @patch('lxml.etree.parse') def test__get_repomd_xml(self, mock_parse, mock_download, mock_tmpfile): tmpfile = mock.Mock() tmpfile.name = 'tmpfile' xml_data = mock.Mock() mock_parse.return_value = xml_data mock_tmpfile.return_value = tmpfile assert self.solver._get_repomd_xml() == xml_data mock_download.assert_called_once_with('repodata/repomd.xml', 'tmpfile') mock_parse.assert_called_once_with('tmpfile') @patch('kiwi.solver.repository.base.Temporary') def test__create_temporary_metadata_dir(self, mock_Temporary): self.solver._create_temporary_metadata_dir() assert self.solver.repository_metadata_dirs == [ mock_Temporary.return_value.new_dir.return_value ] mock_Temporary.assert_called_once_with(prefix='kiwi_metadata_dir.') @patch('os.path.exists') def test_is_uptodate_static_time(self, mock_exists): mock_exists.return_value = True self.uri.alias.return_value = 'repo-alias' m_open = mock_open(read_data='static') with patch('builtins.open', m_open, create=True): assert self.solver.is_uptodate() is False m_open.assert_called_once_with( '/var/tmp/kiwi/satsolver/repo-alias.timestamp' ) @patch('os.path.exists') @patch('kiwi.solver.repository.base.SolverRepositoryBase.timestamp') def test_is_uptodate_some_time(self, mock_timestamp, mock_exists): mock_exists.return_value = True mock_timestamp.return_value = 'some-time' self.uri.alias.return_value = 'repo-alias' m_open = mock_open(read_data='some-time') with patch('builtins.open', m_open, create=True): assert self.solver.is_uptodate() is True m_open.assert_called_once_with( '/var/tmp/kiwi/satsolver/repo-alias.timestamp' ) def test_timestamp(self): assert self.solver.timestamp() == 'static' @patch('kiwi.solver.repository.base.urlopen') @patch('kiwi.solver.repository.base.Request') def test_download_from_repository_with_credentials( self, mock_request, mock_urlopen ): request = mock.Mock() mock_request.return_value = request location = mock.Mock() location.read.return_value = 'data-from-network' mock_urlopen.return_value = location self.uri.is_remote.return_value = True self.uri.translate.return_value = 'http://myrepo/file' self.solver.user = 'user' self.solver.secret = 'secret' m_open = mock_open() with patch('builtins.open', m_open, create=True): self.solver.download_from_repository('repodata/file', 'target-file') mock_urlopen.assert_called_once_with(request) mock_request.assert_called_once_with('http://myrepo/file/repodata/file') request.add_header.assert_called_once_with( 'Authorization', 'Basic dXNlcjpzZWNyZXQ=' ) m_open.assert_called_once_with('target-file', 'wb') m_open.return_value.write.assert_called_once_with('data-from-network') @patch('kiwi.solver.repository.base.urlopen') @patch('kiwi.solver.repository.base.Request') def test_download_from_repository_remote(self, mock_request, mock_urlopen): request = mock.Mock() mock_request.return_value = request location = mock.Mock() location.read.return_value = 'data-from-network' mock_urlopen.return_value = location self.uri.is_remote.return_value = True self.uri.translate.return_value = 'http://myrepo/file' m_open = mock_open() with patch('builtins.open', m_open, create=True): self.solver.download_from_repository('repodata/file', 'target-file') mock_urlopen.assert_called_once_with(request) mock_request.assert_called_once_with('http://myrepo/file/repodata/file') m_open.assert_called_once_with('target-file', 'wb') m_open.return_value.write.assert_called_once_with('data-from-network') @patch('kiwi.solver.repository.base.urlopen') @patch('kiwi.solver.repository.base.Request') def test_download_from_repository_local(self, mock_request, mock_urlopen): request = mock.Mock() mock_request.return_value = request location = mock.Mock() location.read.return_value = 'data' mock_urlopen.return_value = location self.uri.is_remote.return_value = False self.uri.translate.return_value = '/my_local_repo/file' m_open = mock_open() with patch('builtins.open', m_open, create=True): self.solver.download_from_repository('repodata/file', 'target-file') mock_urlopen.assert_called_once_with(request) mock_request.assert_called_once_with( 'file:///my_local_repo/file/repodata/file' ) m_open.assert_called_once_with('target-file', 'wb') m_open.return_value.write.assert_called_once_with('data') @patch('kiwi.solver.repository.base.urlopen') def test_download_from_repository_raises(self, mock_urlopen): self.uri.is_remote.return_value = False self.uri.translate.return_value = '/my_local_repo/file' mock_urlopen.side_effect = Exception with raises(KiwiUriOpenError): self.solver.download_from_repository('repodata/file', 'target-file') @patch('kiwi.solver.repository.base.Temporary') @patch('kiwi.solver.repository.base.random.randrange') @patch('kiwi.solver.repository.base.Command.run') def test__create_solvables_rpms2_solv( self, mock_command, mock_rand, mock_Temporary ): mock_rand.return_value = 0xFE self.solver.repository_metadata_dirs = ['metadata_dir.XXXX'] mock_Temporary.return_value.new_dir.return_value.name = 'solv_dir.XX' self.solver._create_solvables('meta_dir.XX', 'rpms2solv') mock_command.assert_called_once_with( [ 'bash', '-c', 'rpms2solv meta_dir.XX/*.rpm > solv_dir.XX/solvable-fefefefe', ] ) @patch('kiwi.solver.repository.base.Temporary') @patch('kiwi.solver.repository.base.random.randrange') @patch('kiwi.solver.repository.base.Command.run') @patch('kiwi.solver.repository.base.glob.iglob') def test__create_solvables_rpmmd2_solv( self, mock_glob, mock_command, mock_rand, mock_Temporary ): mock_glob.return_value = [ 'some-solv-data-file', 'some-solv-data-file.zst', ] mock_rand.return_value = 0xFE self.solver.repository_metadata_dirs = ['metadata_dir.XXXX'] mock_Temporary.return_value.new_dir.return_value.name = 'solv_dir.XX' self.solver._create_solvables('meta_dir.XX', 'rpmmd2solv') mock_glob.assert_called_once_with('meta_dir.XX/*') assert mock_command.mock_calls == [ call( [ 'bash', '-c', ' '.join( [ 'gzip -cd --force some-solv-data-file', '|', 'rpmmd2solv > solv_dir.XX/solvable-fefefefe', ] ), ] ), call( [ 'bash', '-c', ' '.join( [ 'zstd -dcf some-solv-data-file.zst', '|', 'rpmmd2solv > solv_dir.XX/solvable-fefefefe', ] ), ] ), ] @patch('kiwi.solver.repository.base.Temporary') @patch('kiwi.solver.repository.base.random.randrange') @patch('kiwi.solver.repository.base.Command.run') @patch('kiwi.solver.repository.base.glob.iglob') def test__create_solvables_deb2_solv( self, mock_glob, mock_command, mock_rand, mock_Temporary ): mock_glob.return_value = ['some-solv-data-file'] mock_rand.return_value = 0xFE self.solver.repository_metadata_dirs = ['metadata_dir.XXXX'] mock_Temporary.return_value.new_dir.return_value.name = 'solv_dir.XX' self.solver._create_solvables('meta_dir.XX', 'deb2solv') mock_glob.assert_called_once_with('meta_dir.XX/*') mock_command.assert_called_once_with( [ 'bash', '-c', ' '.join( [ 'gzip -cd --force some-solv-data-file', '|', 'deb2solv -r > solv_dir.XX/solvable-fefefefe', ] ), ] ) @patch('kiwi.solver.repository.base.Command.run') @patch('kiwi.solver.repository.base.Path.wipe') @patch('kiwi.solver.repository.base.Path.create') @patch('kiwi.solver.repository.base.SolverRepositoryBase.is_uptodate') @patch.object(SolverRepositoryBase, '_setup_repository_metadata') def test_create_repository_solvable( self, mock_setup_repository_metadata, mock_is_uptodate, mock_path_create, mock_path_wipe, mock_command, ): mock_is_uptodate.return_value = False tempdir = Mock() tempdir.name = 'solvable_dir.XX' self.solver.repository_solvable_dir = tempdir self.uri.alias.return_value = 'repo-alias' self.uri.uri = 'repo-uri' m_open = mock_open() with patch('builtins.open', m_open, create=True): assert ( self.solver.create_repository_solvable('target_dir') == 'target_dir/repo-alias' ) mock_is_uptodate.assert_called_once_with('target_dir') mock_setup_repository_metadata.assert_called_once_with() mock_command.assert_called_once_with( [ 'bash', '-c', 'mergesolv solvable_dir.XX/* > target_dir/repo-alias', ] ) assert m_open.call_args_list == [ call('target_dir/repo-alias.info', 'w'), call('target_dir/repo-alias.timestamp', 'w'), ] assert m_open.return_value.write.call_args_list == [ call(''.join(['repo-uri', os.linesep])), call('static'), ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7684872 kiwi-11.1.8/test/unit/solver/repository/deb_test.py0000644000000000000000000000201315273675667017351 0ustar00from unittest.mock import patch, Mock from kiwi.solver.repository.deb import SolverRepositoryDeb from kiwi.solver.repository.base import SolverRepositoryBase class TestSolverRepositoryDeb: def setup(self): self.uri = Mock() self.uri.uri = 'http://example.org/some/path' self.solver = SolverRepositoryDeb(self.uri) def setup_method(self, cls): self.setup() @patch.object(SolverRepositoryBase, '_get_deb_packages') @patch.object(SolverRepositoryBase, '_create_solvables') @patch.object(SolverRepositoryBase, '_create_temporary_metadata_dir') def test__setup_repository_metadata( self, mock_mkdtemp, mock_create_solvables, mock_get_deb_packages ): mock_mkdtemp.return_value = 'metadata_dir.XX' self.solver._setup_repository_metadata() mock_get_deb_packages.assert_called_once_with( download_dir='metadata_dir.XX' ) mock_create_solvables.assert_called_once_with( 'metadata_dir.XX', 'deb2solv' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7684872 kiwi-11.1.8/test/unit/solver/repository/init_test.py0000644000000000000000000000304115273675667017564 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.solver.repository import SolverRepository from kiwi.exceptions import KiwiSolverRepositorySetupError class TestSolverRepository: def setup(self): self.uri = Mock() self.uri.repo_type = 'some-unknown-type' def setup_method(self, cls): self.setup() def test_solver_repository_type_not_implemented(self): with raises(KiwiSolverRepositorySetupError): SolverRepository.new(self.uri) @patch('kiwi.solver.repository.suse.SolverRepositorySUSE') def test_solver_repository_suse(self, mock_suse): self.uri.repo_type = 'yast2' SolverRepository.new(self.uri) mock_suse.assert_called_once_with(self.uri, None, None) @patch('kiwi.solver.repository.rpm_md.SolverRepositoryRpmMd') def test_solver_repository_rpm_md(self, mock_rpm_md): self.uri.repo_type = 'rpm-md' SolverRepository.new(self.uri) mock_rpm_md.assert_called_once_with(self.uri, None, None) @patch('kiwi.solver.repository.rpm_dir.SolverRepositoryRpmDir') def test_solver_repository_rpm_dir(self, mock_rpm_dir): self.uri.repo_type = 'rpm-dir' SolverRepository.new(self.uri) mock_rpm_dir.assert_called_once_with(self.uri, None, None) @patch('kiwi.solver.repository.deb.SolverRepositoryDeb') def test_solver_repository_apt(self, mock_deb): self.uri.repo_type = 'apt-deb' SolverRepository.new(self.uri) mock_deb.assert_called_once_with(self.uri, None, None) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7684872 kiwi-11.1.8/test/unit/solver/repository/rpm_dir_test.py0000644000000000000000000000307515273675667020264 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.solver.repository.rpm_dir import SolverRepositoryRpmDir from kiwi.solver.repository.base import SolverRepositoryBase from kiwi.exceptions import KiwiRpmDirNotRemoteError class TestSolverRepositoryRpmDir: def setup(self): self.uri = Mock() self.uri.uri = 'http://example.org/some/path' self.solver = SolverRepositoryRpmDir(self.uri) def setup_method(self, cls): self.setup() def test__setup_repository_metadata_raises(self): with raises(KiwiRpmDirNotRemoteError): self.solver._setup_repository_metadata() @patch.object(SolverRepositoryBase, 'download_from_repository') @patch.object(SolverRepositoryBase, '_create_solvables') @patch.object(SolverRepositoryBase, '_create_temporary_metadata_dir') @patch('kiwi.solver.repository.rpm_dir.glob.iglob') def test__setup_repository_metadata( self, mock_iglob, mock_mkdtemp, mock_create_solvables, mock_download_from_repository, ): self.uri.is_remote.return_value = False self.uri.translate.return_value = '/some/local/repo' mock_iglob.return_value = ['some-package.rpm'] mock_mkdtemp.return_value = 'metadata_dir.XX' self.solver._setup_repository_metadata() mock_download_from_repository.assert_called_once_with( 'some-package.rpm', 'metadata_dir.XX/some-package.rpm' ) mock_create_solvables.assert_called_once_with( 'metadata_dir.XX', 'rpms2solv' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7684872 kiwi-11.1.8/test/unit/solver/repository/rpm_md_test.py0000644000000000000000000000345015273675667020103 0ustar00from unittest.mock import patch, call import unittest.mock as mock from lxml import etree from kiwi.solver.repository.rpm_md import SolverRepositoryRpmMd from kiwi.solver.repository.base import SolverRepositoryBase class TestSolverRepositoryRpmMd: def setup(self): self.xml_data = etree.parse('../data/repomd.xml') self.uri = mock.Mock() self.uri.uri = 'http://example.org/some/path' self.solver = SolverRepositoryRpmMd(self.uri) def setup_method(self, cls): self.setup() @patch.object(SolverRepositoryBase, 'download_from_repository') @patch.object(SolverRepositoryBase, '_create_solvables') @patch.object(SolverRepositoryBase, '_create_temporary_metadata_dir') @patch.object(SolverRepositoryBase, '_get_repomd_xml') def test__setup_repository_metadata( self, mock_xml, mock_mkdtemp, mock_create_solvables, mock_download_from_repository, ): mock_mkdtemp.return_value = 'metadata_dir.XX' mock_xml.return_value = self.xml_data self.solver._setup_repository_metadata() assert mock_download_from_repository.call_args_list == [ call( 'repodata/55f95a93-primary.xml.gz', 'metadata_dir.XX/55f95a93-primary.xml.gz', ), call( 'repodata/0815-other.xml.gz', 'metadata_dir.XX/0815-other.xml.gz', ), ] assert mock_create_solvables.call_args_list == [ call('metadata_dir.XX', 'rpmmd2solv'), call('metadata_dir.XX', 'comps2solv'), ] @patch.object(SolverRepositoryBase, '_get_repomd_xml') def test_timestamp(self, mock_xml): mock_xml.return_value = self.xml_data assert self.solver.timestamp() == '1478352191' ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7684872 kiwi-11.1.8/test/unit/solver/repository/suse_test.py0000644000000000000000000000430015273675667017577 0ustar00from unittest.mock import patch import unittest.mock as mock from lxml import etree from kiwi.solver.repository.suse import SolverRepositorySUSE from kiwi.solver.repository.base import SolverRepositoryBase class TestSolverRepositorySUSE: def setup(self): self.xml_data = etree.parse('../data/repomd.xml') self.uri = mock.Mock() self.uri.uri = 'http://example.org/some/path' self.solver = SolverRepositorySUSE(self.uri) def setup_method(self, cls): self.setup() @patch.object(SolverRepositoryBase, 'download_from_repository') @patch.object(SolverRepositoryBase, '_create_solvables') @patch.object(SolverRepositoryBase, '_create_temporary_metadata_dir') @patch.object(SolverRepositoryBase, '_get_repomd_xml') def test__setup_repository_metadata_online( self, mock_xml, mock_mkdtemp, mock_create_solvables, mock_download_from_repository, ): mock_mkdtemp.return_value = 'metadata_dir.XX' mock_xml.return_value = self.xml_data self.solver._setup_repository_metadata() mock_download_from_repository.assert_called_once_with( 'suse/repodata/55f95a93-primary.xml.gz', 'metadata_dir.XX/55f95a93-primary.xml.gz', ) mock_create_solvables.assert_called_once_with( 'metadata_dir.XX', 'rpmmd2solv' ) @patch.object(SolverRepositoryBase, 'download_from_repository') @patch.object(SolverRepositoryBase, '_create_solvables') @patch.object(SolverRepositoryBase, '_get_repomd_xml') @patch.object(SolverRepositoryBase, '_create_temporary_metadata_dir') def test__setup_repository_metadata_media( self, mock_mkdtemp, mock_xml, mock_create_solvables, mock_download_from_repository, ): mock_xml.side_effect = Exception mock_mkdtemp.return_value = 'metadata_dir.XX' self.solver._setup_repository_metadata() mock_download_from_repository.assert_called_once_with( 'suse/setup/descr/packages.gz', 'metadata_dir.XX/packages.gz' ) mock_create_solvables.assert_called_once_with( 'metadata_dir.XX', 'susetags2solv' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7684872 kiwi-11.1.8/test/unit/solver/sat_test.py0000644000000000000000000001207215273675667015175 0ustar00import logging import importlib from unittest.mock import patch, Mock, MagicMock from pytest import raises, fixture from kiwi.defaults import Defaults from kiwi.solver.sat import Sat from kiwi.exceptions import ( KiwiSatSolverPluginError, KiwiSatSolverJobProblems, KiwiSatSolverJobError, ) class TestSat: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch.object(importlib, 'import_module') def setup(self, mock_import_module): self.sat = Sat() self.solver = MagicMock() self.transaction = Mock() self.transaction.newpackages = Mock(return_value=[Mock()]) self.selection = Mock() self.solver.transaction = Mock(return_value=self.transaction) self.sat.pool.Solver = Mock(return_value=self.solver) self.sat.pool.select = Mock(return_value=self.selection) mock_import_module.assert_called_once_with('solv') self.solv = mock_import_module.return_value self.sat.pool.setarch.assert_called_once_with() self.sat.pool.setarch.reset_mock() @patch.object(importlib, 'import_module') def setup_method(self, cls, mock_import_module): self.setup() @patch.object(importlib, 'import_module') def test_setup_no_sat_plugin(self, mock_import_module): mock_import_module.side_effect = Exception with raises(KiwiSatSolverPluginError): Sat() def test_set_dist_type_raises(self): Defaults.set_platform_name('x86_64') self.sat.pool.setdisttype.return_value = -1 with raises(KiwiSatSolverPluginError): self.sat.set_dist_type('deb') def test_set_dist_type_deb(self): Defaults.set_platform_name('x86_64') self.sat.pool.setdisttype.return_value = 0 self.sat.set_dist_type('deb') self.sat.pool.setdisttype.assert_called_once_with( self.solv.Pool.DISTTYPE_DEB ) self.sat.pool.setarch.assert_called_once_with('amd64') def test_add_repository(self): solver_repository = Mock() solver_repository.uri.uri = 'some-uri' solvable = Mock() solver_repository.create_repository_solvable.return_value = solvable pool_repository = Mock() self.sat.pool.add_repo.return_value = pool_repository self.sat.add_repository(solver_repository) solver_repository.create_repository_solvable.assert_called_once_with() self.sat.pool.add_repo.assert_called_once_with('some-uri') pool_repository.add_solv.assert_called_once_with(solvable) self.sat.pool.addfileprovides.assert_called_once_with() self.sat.pool.createwhatprovides.assert_called_once_with() @patch.object(Sat, '_setup_jobs') def test_solve_has_problems(self, mock_setup_jobs): packages = ['vim'] problem = Mock() problem.id = 42 info = Mock() info.problemstr = Mock(return_value='some-problem') findproblemrule = Mock() findproblemrule.info = Mock(return_value=info) problem.findproblemrule.return_value = findproblemrule option = Mock() option.str = Mock(return_value='some-option') solution = Mock() solution.id = 42 solution.elements = Mock(return_value=[option]) problem.solutions.return_value = [solution] self.solver.solve = Mock(return_value=[problem]) with raises(KiwiSatSolverJobProblems): self.sat.solve(packages) def test_solve_package_not_found_and_skipped(self): packages = ['vim'] self.solver.solve = Mock(return_value=None) self.sat.solv.Selection.SELECTION_PROVIDES = 0 self.selection.flags = 0 self.selection.isempty = Mock(return_value=True) with self._caplog.at_level(logging.INFO): self.sat.solve(packages, skip_missing=True) assert '--> Package vim not found: skipped' in self._caplog.text def test_solve_package_not_found_raises(self): packages = ['vim'] self.solver.solve = Mock(return_value=None) self.selection.isempty = Mock(return_value=True) with raises(KiwiSatSolverJobError): self.sat.solve(packages) def test_solve(self): packages = ['vim'] self.solver.solve = Mock(return_value=None) self.selection.isempty = Mock(return_value=False) self.selection.jobs = Mock(return_value=packages) self.sat.solve(packages) self.solver.solve.assert_called_once_with(['vim']) self.solver.transaction.assert_called_once_with() def test_solve_with_capabilities(self): packages = ['kernel-base'] self.solver.solve = Mock(return_value=None) self.sat.solv.Selection.SELECTION_PROVIDES = 1 self.selection.flags = 1 self.selection.isempty = Mock(return_value=False) self.selection.jobs = Mock(return_value=packages) with self._caplog.at_level(logging.INFO): self.sat.solve(packages) assert ( '--> Using capability match for kernel-base' in self._caplog.text ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7684872 kiwi-11.1.8/test/unit/stackbuild/__init__.py0000644000000000000000000000000015273675667015705 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687187 kiwi-11.1.8/test/unit/stackbuild/defaults_test.py0000644000000000000000000000116115273675667017025 0ustar00from kiwi.stackbuild.defaults import StackBuildDefaults class TestStackBuildDefaults: def test_get_stash_home(self): assert StackBuildDefaults.get_stash_home() == '/var/tmp/kiwi-stash' def test_is_container_name_valid(self): assert StackBuildDefaults.is_container_name_valid('foo') is True assert ( StackBuildDefaults.is_container_name_valid('Leap-15.3_appliance') is False ) def test_get_stash_exclude_list(self): assert StackBuildDefaults.get_stash_exclude_list() == [ 'dev/*', 'sys/*', 'proc/*', ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687187 kiwi-11.1.8/test/unit/storage/__init__.py0000644000000000000000000000000015273675667015224 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687826 kiwi-11.1.8/test/unit/storage/clone_device_test.py0000644000000000000000000001256415273675667017165 0ustar00import io from unittest.mock import patch, call, MagicMock, Mock from pytest import raises from kiwi.storage.clone_device import CloneDevice from kiwi.exceptions import KiwiRaidSetupError class TestCloneDevice: def setup(self): self.storage_device = Mock() self.storage_device.get_device = Mock(return_value='/dev/source-device') self.target_device = Mock() self.target_device.get_device = Mock(return_value='/dev/target-device') self.clone_id = Mock() self.clone_device = CloneDevice(self.storage_device, 'root_dir') def setup_method(self, cls): self.setup() @patch('kiwi.storage.clone_device.Command.run') @patch('kiwi.storage.clone_device.BlockID') @patch('kiwi.storage.clone_device.FileSystem.new') def test_clone_filesystem( self, mock_FileSystem_new, mock_BlockID, mock_Command_run ): self.clone_id.get_filesystem.return_value = 'ext3' mock_BlockID.return_value = self.clone_id self.clone_device.clone([self.target_device]) mock_Command_run.assert_called_once_with( ['dd', 'if=/dev/source-device', 'of=/dev/target-device', 'bs=1M'] ) mock_FileSystem_new.assert_called_once_with('ext3', self.target_device) mock_FileSystem_new.return_value.__enter__.return_value.set_uuid.assert_called_once_with() @patch('kiwi.storage.clone_device.Command.run') @patch('kiwi.storage.clone_device.BlockID') def test_clone_lvm(self, mock_BlockID, mock_Command_run): self.clone_id.get_filesystem.return_value = 'LVM2_member' mock_BlockID.return_value = self.clone_id self.clone_device.clone([self.target_device]) assert mock_Command_run.call_args_list == [ call( [ 'dd', 'if=/dev/source-device', 'of=/dev/target-device', 'bs=1M', ] ), call(['vgimportclone', '/dev/target-device']), ] @patch('kiwi.storage.clone_device.Command.run') @patch('kiwi.storage.clone_device.BlockID') @patch('uuid.uuid4') def test_clone_luks(self, mock_uuid4, mock_BlockID, mock_Command_run): self.clone_id.get_filesystem.return_value = 'crypto_LUKS' mock_BlockID.return_value = self.clone_id mock_uuid4.return_value = 'some-UUID' self.clone_device.clone([self.target_device]) assert mock_Command_run.call_args_list == [ call( [ 'dd', 'if=/dev/source-device', 'of=/dev/target-device', 'bs=1M', ] ), call( [ 'cryptsetup', '-q', 'luksUUID', '/dev/target-device', '--uuid', 'some-UUID', ] ), ] @patch('kiwi.storage.clone_device.Command.run') @patch('kiwi.storage.clone_device.BlockID') @patch('kiwi.storage.clone_device.FileSystem.new') @patch('kiwi.storage.clone_device.MappedDevice') def test_clone_raid( self, mock_MappedDevice, mock_FileSystem_new, mock_BlockID, mock_Command_run, ): self.clone_id.get_filesystem.return_value = 'linux_raid_member' mock_BlockID.return_value = self.clone_id with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.readline.return_value = ( 'ARRAY /dev/md0 metadata=1.2 name=asterix:0 UUID=...' ) self.clone_device.clone([self.target_device]) mock_open.assert_called_once_with('root_dir/etc/mdadm.conf') mock_FileSystem_new.assert_called_once_with( mock_BlockID.return_value.get_filesystem.return_value, mock_MappedDevice.return_value, ) mock_FileSystem_new.return_value.__enter__.return_value.set_uuid.assert_called_once_with() assert mock_Command_run.call_args_list == [ call( [ 'dd', 'if=/dev/source-device', 'of=/dev/target-device', 'bs=1M', ] ), call(['mdadm', '--stop', '/dev/md0']), call( [ 'mdadm', '--assemble', '--update=uuid', '--name', 'asterix:0', '/dev/md0', '/dev/target-device', ] ), call(['mdadm', '--stop', '/dev/md0']), call(['mdadm', '--assemble', '/dev/md0', '/dev/source-device']), ] @patch('kiwi.storage.clone_device.Command.run') @patch('kiwi.storage.clone_device.BlockID') def test_clone_raid_raises(self, mock_BlockID, mock_Command_run): self.clone_id.get_filesystem.return_value = 'linux_raid_member' mock_BlockID.return_value = self.clone_id with patch('builtins.open', create=True) as mock_open: mock_open.side_effect = Exception with raises(KiwiRaidSetupError): self.clone_device.clone([self.target_device]) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687826 kiwi-11.1.8/test/unit/storage/device_provider_test.py0000644000000000000000000000246015273675667017711 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.storage.device_provider import DeviceProvider from kiwi.exceptions import KiwiDeviceProviderError class TestDeviceProvider: def setup(self): self.provider = DeviceProvider() def setup_method(self, cls): self.setup() def test_get_device(self): with raises(KiwiDeviceProviderError): self.provider.get_device() @patch('kiwi.storage.device_provider.Command.run') def test_get_uuid(self, mock_command): uuid_call = Mock() uuid_call.output = '0815\n' mock_command.return_value = uuid_call assert self.provider.get_uuid('/dev/some-device') == '0815' mock_command.assert_called_once_with( ['blkid', '/dev/some-device', '-s', 'UUID', '-o', 'value'] ) @patch('kiwi.storage.device_provider.Command.run') def test_get_byte_size(self, mock_command): blockdev_call = Mock() blockdev_call.output = '1024\n' mock_command.return_value = blockdev_call assert self.provider.get_byte_size('/dev/some-device') == 1024 mock_command.assert_called_once_with( ['blockdev', '--getsize64', '/dev/some-device'] ) def test_is_loop(self): assert self.provider.is_loop() is False ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687826 kiwi-11.1.8/test/unit/storage/disk_test.py0000644000000000000000000005602415273675667015477 0ustar00import logging from unittest.mock import patch, mock_open, call, Mock from pytest import fixture, raises import unittest.mock as mock from kiwi.defaults import Defaults from kiwi.storage.disk import ptable_entry_type from kiwi.storage.disk import Disk from kiwi.exceptions import KiwiCustomPartitionConflictError, KiwiCommandError class TestDisk: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch.object(Disk, 'get_discoverable_partition_ids') @patch('kiwi.storage.disk.Partitioner.new') @patch('kiwi.storage.disk.RuntimeConfig') def setup( self, mock_RuntimeConfig, mock_partitioner, mock_get_discoverable_partition_ids, ): Defaults.set_platform_name('x86_64') runtime_config = Mock() runtime_config.get_mapper_tool.return_value = 'partx' mock_RuntimeConfig.return_value = runtime_config self.tempfile = mock.Mock() self.tempfile.name = 'tempfile' self.partitioner = mock.Mock() self.partitioner.create = mock.Mock() self.partitioner.get_id = mock.Mock(return_value=1) mock_partitioner.return_value = self.partitioner self.storage_provider = mock.Mock() self.storage_provider.is_loop = mock.Mock(return_value=True) self.storage_provider.get_device = mock.Mock(return_value='/dev/loop0') self.disk = Disk('gpt', self.storage_provider) @patch('kiwi.storage.disk.Partitioner.new') @patch('kiwi.storage.disk.RuntimeConfig') def setup_method(self, cls, mock_RuntimeConfig, mock_partitioner): self.setup() @patch('os.path.exists') def test_get_device(self, mock_exists): mock_exists.return_value = True self.disk.partition_map['root'] = '/dev/root-device' assert self.disk.get_device()['root'].get_device() == '/dev/root-device' def test_is_loop(self): self.disk.is_loop() self.storage_provider.is_loop.assert_called_once_with() @patch.object(Disk, 'get_discoverable_partition_ids') @patch('kiwi.storage.disk.Partitioner.new') @patch('kiwi.storage.disk.RuntimeConfig') def test_dps_codes_not_applied_by_default( self, mock_RuntimeConfig, mock_Partitioner, mock_get_discoverable_partition_ids, ): mock_Partitioner.return_value = self.partitioner self.partitioner.reset_mock() disk = Disk('gpt', self.storage_provider) assert disk.gUID == {} assert not mock_get_discoverable_partition_ids.called disk.create_root_partition('100') disk.create_boot_partition('100') disk.create_efi_partition('100') disk.create_swap_partition('100') assert not self.partitioner.set_uuid.called @patch.object(Disk, 'get_discoverable_partition_ids') @patch('kiwi.storage.disk.Partitioner.new') @patch('kiwi.storage.disk.RuntimeConfig') def test_dps_codes_applied_on_request( self, mock_RuntimeConfig, mock_Partitioner, mock_get_discoverable_partition_ids, ): mock_Partitioner.return_value = self.partitioner self.partitioner.reset_mock() mock_get_discoverable_partition_ids.return_value = { 'root': 'root-uuid', 'xbootldr': 'boot-uuid', 'esp': 'esp-uuid', 'swap': 'swap-uuid', } disk = Disk('gpt', self.storage_provider, apply_dps_codes=True) disk.create_root_partition('100') disk.create_boot_partition('100') disk.create_efi_partition('100') disk.create_swap_partition('100') assert self.partitioner.set_uuid.call_args_list == [ call('1', 'root-uuid'), call('1', 'boot-uuid'), call('1', 'esp-uuid'), call('1', 'swap-uuid'), ] # Applying the DPS type code resets the partition hex code, so # the hex code is set again afterwards. It has to be set on the # partition that was created, which is not the number from the # image description because that one is optional assert self.partitioner.set_flag.call_args_list == [ call('1', 't.efi'), call('1', 't.swap'), ] @patch.object(Disk, 'get_discoverable_partition_ids') @patch('kiwi.storage.disk.Partitioner.new') @patch('kiwi.storage.disk.RuntimeConfig') def test_dps_codes_applied_to_root_variants_and_custom_partitions( self, mock_RuntimeConfig, mock_Partitioner, mock_get_discoverable_partition_ids, ): mock_Partitioner.return_value = self.partitioner self.partitioner.reset_mock() mock_get_discoverable_partition_ids.return_value = { 'root': 'root-uuid', 'var': 'var-uuid', } disk = Disk('gpt', self.storage_provider, apply_dps_codes=True) disk.create_root_lvm_partition('100') disk.create_root_raid_partition('100') disk.create_root_readonly_partition('100') # a custom partition gets the type code of the DPS partition # type its partition name matches disk.create_custom_partitions( { 'var': ptable_entry_type( mbsize='100', clone=0, partition_name='var', partition_type='t.linux', partition_id=None, mountpoint='/var', filesystem='ext3', label='var', ), 'data': ptable_entry_type( mbsize='100', clone=0, partition_name='p.lxdata', partition_type='t.linux', partition_id=None, mountpoint='/data', filesystem='ext3', label='data', ), } ) assert self.partitioner.set_uuid.call_args_list == [ call('1', 'root-uuid'), call('1', 'root-uuid'), call('1', 'root-uuid'), call('1', 'var-uuid'), ] assert call('1', 't.lvm') in self.partitioner.set_flag.call_args_list assert call('1', 't.raid') in self.partitioner.set_flag.call_args_list assert call('1', 't.linux') in self.partitioner.set_flag.call_args_list def test_create_root_partition(self): self.disk.create_root_partition('100', 1) assert self.partitioner.create.call_args_list == [ call( name='p.lxrootclone1', mbsize='100', type_name='t.linux', partition_id=None, ), call( name='p.lxroot', mbsize='100', type_name='t.linux', partition_id=None, ), ] def test_create_root_which_is_also_boot_partition(self): self.disk.create_root_partition('200') self.partitioner.create.assert_called_once_with( name='p.lxroot', mbsize='200', type_name='t.linux', partition_id=None, ) assert self.disk.public_partition_id_map['kiwi_RootPart'] == 1 assert self.disk.public_partition_id_map['kiwi_BootPart'] == 1 def test_create_root_which_is_also_read_write_partition(self): self.disk.public_partition_id_map['kiwi_ROPart'] = 1 self.disk.create_root_partition('200') self.partitioner.create.assert_called_once_with( name='p.lxroot', mbsize='200', type_name='t.linux', partition_id=None, ) assert self.disk.public_partition_id_map['kiwi_RootPart'] == 1 assert self.disk.public_partition_id_map['kiwi_RWPart'] == 1 def test_create_root_lvm_partition(self): self.disk.create_root_lvm_partition('100', 1) assert self.partitioner.create.call_args_list == [ call( name='p.lxrootclone1', mbsize='100', type_name='t.lvm', partition_id=None, ), call( name='p.lxlvm', mbsize='100', type_name='t.lvm', partition_id=None, ), ] assert self.disk.public_partition_id_map['kiwi_rootPartClone1'] == 1 assert self.disk.public_partition_id_map['kiwi_RootPart'] == 1 def test_create_root_raid_partition(self): self.disk.create_root_raid_partition('100', 1) assert self.partitioner.create.call_args_list == [ call( name='p.lxrootclone1', mbsize='100', type_name='t.raid', partition_id=None, ), call( name='p.lxraid', mbsize='100', type_name='t.raid', partition_id=None, ), ] assert self.disk.public_partition_id_map['kiwi_rootPartClone1'] == 1 assert self.disk.public_partition_id_map['kiwi_RootPart'] == 1 assert self.disk.public_partition_id_map['kiwi_RaidPart'] == 1 def test_create_root_readonly_partition(self): self.disk.create_root_readonly_partition('100', 1) assert self.partitioner.create.call_args_list == [ call( name='p.lxrootclone1', mbsize='100', type_name='t.linux', partition_id=None, ), call( name='p.lxreadonly', mbsize='100', type_name='t.linux', partition_id=None, ), ] assert self.disk.public_partition_id_map['kiwi_rootPartClone1'] == 1 assert self.disk.public_partition_id_map['kiwi_ROPart'] == 1 def test_create_boot_partition(self): self.disk.create_boot_partition('100', 1) assert self.partitioner.create.call_args_list == [ call( name='p.lxbootclone1', mbsize='100', type_name='t.linux', partition_id=None, ), call( name='p.lxboot', mbsize='100', type_name='t.linux', partition_id=None, ), ] assert self.disk.public_partition_id_map['kiwi_bootPartClone1'] == 1 assert self.disk.public_partition_id_map['kiwi_BootPart'] == 1 def test_create_efi_csm_partition(self): self.disk.create_efi_csm_partition('100') self.partitioner.create.assert_called_once_with( name='p.legacy', mbsize='100', type_name='t.csm', partition_id=None ) assert self.disk.public_partition_id_map['kiwi_BiosGrub'] == 1 def test_create_efi_partition(self): self.disk.create_efi_partition('100') self.partitioner.create.assert_called_once_with( name='p.UEFI', mbsize='100', type_name='t.efi', partition_id=None ) assert self.disk.public_partition_id_map['kiwi_EfiPart'] == 1 def test_create_spare_partition(self): self.disk.create_spare_partition('42') self.partitioner.create.assert_called_once_with( name='p.spare', mbsize='42', type_name='t.linux', partition_id=None ) assert self.disk.public_partition_id_map['kiwi_SparePart'] == 1 def test_create_swap_partition(self): self.disk.create_swap_partition('42') self.partitioner.create.assert_called_once_with( name='p.swap', mbsize='42', type_name='t.swap', partition_id=None ) assert self.disk.public_partition_id_map['kiwi_SwapPart'] == 1 @patch('kiwi.storage.disk.Command.run') def test_create_prep_partition(self, mock_command): self.disk.create_prep_partition('8') self.partitioner.create.assert_called_once_with( name='p.prep', mbsize='8', type_name='t.prep', partition_id=None ) assert self.disk.public_partition_id_map['kiwi_PrepPart'] == 1 @patch('kiwi.storage.disk.Command.run') def test_create_custom_partitions(self, mock_command): table_entries = { 'var': ptable_entry_type( mbsize='100', clone=2, partition_name='p.lxvar', partition_type='t.linux', partition_id=None, mountpoint='/var', filesystem='ext3', label='var', ) } self.disk.create_custom_partitions(table_entries) assert self.partitioner.create.call_args_list == [ call( name='p.lxvarclone1', mbsize='100', type_name='t.linux', partition_id=None, ), call( name='p.lxvarclone2', mbsize='100', type_name='t.linux', partition_id=None, ), call( name='p.lxvar', mbsize='100', type_name='t.linux', partition_id=None, ), ] assert self.disk.public_partition_id_map['kiwi_varPartClone1'] == 1 assert self.disk.public_partition_id_map['kiwi_varPartClone2'] == 1 assert self.disk.public_partition_id_map['kiwi_VarPart'] == 1 @patch('kiwi.storage.disk.Command.run') def test_create_custom_partitions_with_custom_ID(self, mock_command): table_entries = { 'var': ptable_entry_type( mbsize='100', clone=2, partition_name='p.lxvar', partition_type='t.linux', partition_id=42, mountpoint='/var', filesystem='ext3', label='var', ) } self.disk.create_custom_partitions(table_entries) assert self.partitioner.create.call_args_list == [ call( name='p.lxvarclone43', mbsize='100', type_name='t.linux', partition_id=43, ), call( name='p.lxvarclone44', mbsize='100', type_name='t.linux', partition_id=44, ), call( name='p.lxvar', mbsize='100', type_name='t.linux', partition_id=42, ), ] assert self.disk.public_partition_id_map['kiwi_varPartClone43'] == 1 assert self.disk.public_partition_id_map['kiwi_varPartClone44'] == 1 assert self.disk.public_partition_id_map['kiwi_VarPart'] == 1 def test_create_custom_partitions_reserved_name(self): table_entries = { 'root': ptable_entry_type( mbsize='100', clone=0, partition_name='p.lxroot', partition_type='t.linux', partition_id=None, mountpoint='/', filesystem='ext3', label='root', ) } with raises(KiwiCustomPartitionConflictError): self.disk.create_custom_partitions(table_entries) @patch('kiwi.storage.disk.Command.run') def test_device_map_efi_partition_partx(self, mock_command): self.disk.create_efi_partition('100') self.disk.map_partitions() assert self.disk.partition_map == {'efi': '/dev/loop0p1'} self.disk.is_mapped = False @patch('kiwi.storage.disk.Command.run') def test_device_map_efi_partition_kpartx(self, mock_command): self.disk.partition_mapper = 'kpartx' self.disk.create_efi_partition('100') self.disk.map_partitions() assert self.disk.partition_map == {'efi': '/dev/mapper/loop0p1'} self.disk.is_mapped = False @patch('kiwi.storage.disk.Command.run') def test_device_map_prep_partition(self, mock_command): self.disk.create_prep_partition('8') self.disk.map_partitions() assert self.disk.partition_map == {'prep': '/dev/loop0p1'} self.disk.is_mapped = False @patch('kiwi.storage.disk.Command.run') def test_device_map_linux_dev_sda(self, mock_command): self.storage_provider.is_loop.return_value = False self.storage_provider.get_device = mock.Mock(return_value='/dev/sda') self.disk.create_efi_partition('100') self.disk.map_partitions() assert self.disk.partition_map == {'efi': '/dev/sda1'} self.disk.is_mapped = False @patch('kiwi.storage.disk.Command.run') def test_device_map_linux_dev_c0d0(self, mock_command): self.storage_provider.is_loop.return_value = False self.storage_provider.get_device = mock.Mock(return_value='/dev/c0d0') self.disk.create_efi_partition('100') self.disk.map_partitions() assert self.disk.partition_map == {'efi': '/dev/c0d0p1'} self.disk.is_mapped = False @patch('kiwi.storage.disk.Command.run') def test_activate_boot_partition_is_boot_partition(self, mock_command): self.disk.create_boot_partition('100') self.disk.create_root_partition('100') self.disk.activate_boot_partition() self.partitioner.set_flag(1, 'f.active') @patch('kiwi.storage.disk.Command.run') def test_activate_boot_partition_is_root_partition(self, mock_command): self.disk.create_root_partition('100') self.disk.activate_boot_partition() self.partitioner.set_flag(1, 'f.active') @patch('kiwi.storage.disk.Command.run') def test_activate_boot_partition_is_prep_partition(self, mock_command): self.disk.create_prep_partition('8') self.disk.activate_boot_partition() self.partitioner.set_flag(1, 'f.active') @patch('kiwi.storage.disk.Command.run') def test_wipe_gpt(self, mock_command): self.disk.wipe() mock_command.assert_called_once_with( ['sgdisk', '--zap-all', '/dev/loop0'] ) @patch('kiwi.storage.disk.Command.run') @patch('kiwi.storage.disk.Temporary.new_file') def test_wipe_dasd(self, mock_temp, mock_command): mock_command.side_effect = Exception self.disk.table_type = 'dasd' mock_temp.return_value = self.tempfile m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk.wipe() m_open.return_value.write.assert_called_once_with('y\n\nw\nq\n') with self._caplog.at_level(logging.DEBUG): mock_command.assert_called_once_with( ['bash', '-c', 'cat tempfile | fdasd -f /dev/loop0'] ) @patch('kiwi.storage.disk.Command.run') def test_map_partitions_loop_partx(self, mock_command): self.disk.map_partitions() mock_command.assert_called_once_with(['partx', '--add', '/dev/loop0']) self.disk.is_mapped = False @patch('kiwi.storage.disk.Command.run') def test_map_partitions_loop_kpartx(self, mock_command): self.disk.partition_mapper = 'kpartx' self.disk.map_partitions() mock_command.assert_called_once_with( ['kpartx', '-s', '-a', '/dev/loop0'] ) self.disk.is_mapped = False @patch('kiwi.storage.disk.Command.run') def test_map_partitions_other(self, mock_command): self.storage_provider.is_loop.return_value = False self.disk.map_partitions() mock_command.assert_called_once_with(['partprobe', '/dev/loop0']) @patch.object(Disk, 'get_discoverable_partition_ids') @patch('kiwi.storage.disk.Command.run') def test_context_manager_exit_partx_loop_cleanup_failed( self, mock_command, mock_get_discoverable_partition_ids ): mock_command.side_effect = Exception with Disk('gpt', self.storage_provider) as disk: disk.is_mapped = True disk.partition_map = {'root': '/dev/loop0p1'} with self._caplog.at_level(logging.WARNING): mock_command.assert_called_once_with( ['partx', '--delete', '/dev/loop0'] ) @patch.object(Disk, 'get_discoverable_partition_ids') @patch('kiwi.storage.disk.Command.run') def test_context_manager_exit_dm_loop_cleanup_failed( self, mock_command, mock_get_discoverable_partition_ids ): mock_command.side_effect = Exception with Disk('gpt', self.storage_provider) as disk: disk.partition_mapper = 'kpartx' disk.is_mapped = True disk.partition_map = {'root': '/dev/mapper/loop0p1'} with self._caplog.at_level(logging.WARNING): mock_command.assert_called_once_with( ['dmsetup', 'remove', '/dev/mapper/loop0p1'] ) @patch.object(Disk, 'get_discoverable_partition_ids') @patch('kiwi.storage.disk.Command.run') def test_context_manager_exit_partx( self, mock_command, mock_get_discoverable_partition_ids ): with Disk('gpt', self.storage_provider) as disk: disk.is_mapped = True disk.partition_map = {'root': '/dev/loop0p1'} assert mock_command.call_args_list == [ call(['partx', '--delete', '/dev/loop0']) ] @patch.object(Disk, 'get_discoverable_partition_ids') @patch('kiwi.storage.disk.Command.run') def test_context_manager_exit_kpartx( self, mock_command, mock_get_discoverable_partition_ids ): with Disk('gpt', self.storage_provider) as disk: disk.partition_mapper = 'kpartx' disk.is_mapped = True disk.partition_map = {'root': '/dev/mapper/loop0p1'} assert mock_command.call_args_list == [ call(['dmsetup', 'remove', '/dev/mapper/loop0p1']), call(['kpartx', '-d', '/dev/loop0']), ] def test_get_public_partition_id_map(self): assert self.disk.get_public_partition_id_map() == {} def test_create_hybrid_mbr(self): self.disk.create_hybrid_mbr() self.partitioner.set_hybrid_mbr.assert_called_once_with() def test_create_mbr(self): self.disk.create_mbr() self.partitioner.set_mbr.assert_called_once_with() def test_set_start_sector(self): self.disk.set_start_sector(4096) self.partitioner.set_start_sector.assert_called_once_with(4096) def test_parse_size(self): size, _ = self.disk._parse_size('100') assert size == '100' size, clone_size = self.disk._parse_size('all_free') assert size == 'all_free' assert clone_size == 'all_free' size, clone_size = self.disk._parse_size('clone:100:all_free') assert size == '100' assert clone_size == 'all_free' @patch('kiwi.storage.disk.Command.run') def test_get_discoverable_partition_ids(self, mock_Command_run): command = Mock() with open('../data/systemd-id128.out') as ids: command.output = ids.read() mock_Command_run.return_value = command assert ( self.disk.get_discoverable_partition_ids()['root'] == '4f68bce3e8cd4db196e7fbcaf984b709' ) mock_Command_run.side_effect = KiwiCommandError('issue') assert ( self.disk.get_discoverable_partition_ids().get('root') == '4f68bce3e8cd4db196e7fbcaf984b709' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687826 kiwi-11.1.8/test/unit/storage/integrity_device_test.py0000644000000000000000000002341515273675667020100 0ustar00import logging import io from textwrap import dedent from pytest import raises, fixture from unittest.mock import patch, Mock, call, MagicMock from kiwi.storage.integrity_device import ( IntegrityDevice, integrity_credentials_type, ) from kiwi.exceptions import KiwiOffsetError import kiwi.defaults as defaults class TestIntegrityDevice: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('os.path.getsize') def setup(self, mock_os_path_getsize): mock_os_path_getsize.return_value = 42 metadata_file = Mock() metadata_file.name = 'metadata_file' storage_device = Mock() storage_device.get_device = Mock(return_value='/dev/some-device') storage_device.is_loop = Mock(return_value=True) self.integrity = IntegrityDevice( storage_device, defaults.INTEGRITY_ALGORITHM ) self.integrity_hmac = IntegrityDevice( storage_device, defaults.INTEGRITY_ALGORITHM, integrity_credentials_type( keydescription=None, keyfile='/etc/pki/storage/dm-integrity-hmac-secret.bin', keyfile_algorithm=defaults.INTEGRITY_KEY_ALGORITHM, options=['legacy_hmac'], ), ) self.integrity.integrity_metadata_file = metadata_file @patch('os.path.getsize') def setup_method(self, cls, mock_os_path_getsize): self.setup() @patch('kiwi.storage.integrity_device.MappedDevice') def test_get_device(self, mock_MappedDevice): self.integrity.integrity_device = '/dev/some-device' assert self.integrity.get_device() == mock_MappedDevice.return_value self.integrity.integrity_device = None assert self.integrity.get_device() is None def test_is_loop(self): assert self.integrity.is_loop() is True @patch('kiwi.storage.integrity_device.Command.run') def test_create_dm_integrity(self, mock_Command_run): self.integrity.create_dm_integrity() assert mock_Command_run.call_args_list == [ call( [ 'integritysetup', '-v', '--batch-mode', 'format', '--integrity', 'sha256', '--sector-size', '512', '/dev/some-device', ] ), call( [ 'integritysetup', '-v', '--batch-mode', 'open', '--integrity', 'sha256', '/dev/some-device', 'integrityRoot', ] ), ] @patch('kiwi.storage.integrity_device.Command.run') def test_create_dm_integrity_with_hmac(self, mock_Command_run): self.integrity_hmac.create_dm_integrity() assert mock_Command_run.call_args_list == [ call( [ 'integritysetup', '-v', '--batch-mode', 'format', '--integrity', 'hmac-sha256', '--sector-size', '512', '--integrity-legacy-hmac', '--integrity-key-file', '/etc/pki/storage/dm-integrity-hmac-secret.bin', '--integrity-key-size', '42', '/dev/some-device', ] ), call( [ 'integritysetup', '-v', '--batch-mode', 'open', '--integrity', 'hmac-sha256', '--integrity-key-file', '/etc/pki/storage/dm-integrity-hmac-secret.bin', '--integrity-key-size', '42', '/dev/some-device', 'integrityRoot', ] ), ] @patch('kiwi.storage.integrity_device.Command.run') @patch('kiwi.storage.integrity_device.BlockID') def test_create_integrity_metadata(self, mock_BlockID, mock_Command_run): mock_BlockID.return_value.get_filesystem.return_value = 'xfs' mock_Command_run.return_value.output = dedent( '''\n Info for integrity device /dev/mapper/loop0p4. superblock_version 4 log2_interleave_sectors 15 integrity_tag_size 32 journal_sections 212 provided_data_sectors 2234096 sector_size 512 log2_blocks_per_bitmap 15 flags fix_padding ''' ) with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value # set by create_dm_integrity() self.integrity.integrity_device = '/dev/mapper/integrityRoot' self.integrity.create_integrity_metadata() assert file_handle.write.call_args_list == [ call(b'1 xfs rw integrity'), call(b'\xff'), call(b'2234096 512 2 internal_hash:sha256 fix_padding'), call(b'\xff'), call(b'\x00'), ] @patch('kiwi.storage.integrity_device.Command.run') @patch('kiwi.storage.integrity_device.BlockID') def test_create_integrity_metadata_with_hmac( self, mock_BlockID, mock_Command_run ): mock_BlockID.return_value.get_filesystem.return_value = 'xfs' mock_Command_run.return_value.output = dedent( '''\n Info for integrity device /dev/mapper/loop0p4. superblock_version 4 log2_interleave_sectors 15 integrity_tag_size 32 journal_sections 212 provided_data_sectors 2234096 sector_size 512 log2_blocks_per_bitmap 15 flags fix_padding ''' ) with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value # set by create_dm_integrity() self.integrity_hmac.integrity_device = '/dev/mapper/integrityRoot' self.integrity_hmac.create_integrity_metadata() assert file_handle.write.call_args_list == [ call(b'1 xfs rw integrity'), call(b'\xff'), call( b'2234096 512 2 internal_hash:' b'hmac(sha256)::dm-integrity-hmac-secret fix_padding' ), call(b'\xff'), call(b'\x00'), ] @patch('kiwi.storage.integrity_device.Signature') def test_sign_integrity_metadata(self, mock_Signature): self.integrity.sign_integrity_metadata() mock_Signature.return_value.sign.assert_called_once_with() @patch('os.path.getsize') def test_write_integrity_metadata_raises(self, mock_os_path_getsize): mock_os_path_getsize.return_value = 8192 with raises(KiwiOffsetError): self.integrity.write_integrity_metadata() @patch('os.path.getsize') def test_write_integrity_metadata(self, mock_os_path_getsize): mock_os_path_getsize.return_value = 4096 with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.integrity.write_integrity_metadata() assert mock_open.call_args_list == [ call('metadata_file', 'rb'), call('/dev/some-device', 'r+b'), ] file_handle.seek.assert_called_once_with( -defaults.DM_METADATA_OFFSET, 2 ) file_handle.write.assert_called_once_with(file_handle.read.return_value) @patch('kiwi.storage.integrity_device.BlockID') def test_create_integritytab(self, mock_BlockID): mock_BlockID.return_value.get_blkid.return_value = 'id' with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.integrity.create_integritytab('integritytab') file_handle.write.assert_called_once_with( 'integrityRoot PARTUUID=id - integrity-algorithm=sha256\n' ) @patch('kiwi.storage.integrity_device.BlockID') def test_create_integritytab_with_keyfile(self, mock_BlockID): mock_BlockID.return_value.get_blkid.return_value = 'id' with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.integrity_hmac.create_integritytab('integritytab') file_handle.write.assert_called_once_with( 'integrityRoot PARTUUID=id ' '/etc/pki/storage/dm-integrity-hmac-secret.bin ' 'integrity-algorithm=hmac-sha256\n' ) @patch('kiwi.storage.integrity_device.Command.run') @patch('kiwi.storage.integrity_device.log.warning') def test_context_manager_exit(self, mock_log_warn, mock_Command_run): mock_Command_run.side_effect = Exception with self._caplog.at_level(logging.ERROR): with IntegrityDevice( Mock(), defaults.INTEGRITY_ALGORITHM ) as integrity: integrity.integrity_device = '/dev/mapper/integrityRoot' mock_Command_run.assert_called_once_with( ['integritysetup', 'close', 'integrityRoot'] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687826 kiwi-11.1.8/test/unit/storage/loop_device_test.py0000644000000000000000000001111715273675667017027 0ustar00import logging from unittest.mock import patch, call from pytest import raises, fixture from kiwi.storage.loop_device import LoopDevice from kiwi.exceptions import KiwiLoopSetupError, KiwiCommandError class TestLoopDevice: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = False self.loop = LoopDevice('loop-file', 20, 4096) @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() def test_loop_setup_invalid(self): with raises(KiwiLoopSetupError): LoopDevice('loop-file-does-not-exist-and-no-size-given') def test_get_device(self): assert self.loop.get_device() == '' def test_is_loop(self): assert self.loop.is_loop() is True @patch('os.path.exists') @patch('kiwi.storage.loop_device.SparseFile.create') @patch('kiwi.storage.loop_device.Command.run') @patch('kiwi.storage.loop_device.CommandCapabilities.has_option_in_help') def test_create( self, mock_has_option_in_help, mock_command, mock_sparse_file_create, mock_exists, ): mock_has_option_in_help.return_value = True mock_exists.return_value = False self.loop.create() mock_sparse_file_create.assert_called_once_with('loop-file', '20M') assert mock_command.call_args_list[0] == call( ['losetup', '--sector-size', '4096', '-f', '--show', 'loop-file'] ) mock_has_option_in_help.return_value = False mock_command.reset_mock() mock_sparse_file_create.reset_mock() self.loop.create() mock_sparse_file_create.assert_called_once_with('loop-file', '20M') assert mock_command.call_args_list[0] == call( [ 'losetup', '--logical-blocksize', '4096', '-f', '--show', 'loop-file', ] ) self.loop.node_name = None @patch('kiwi.storage.loop_device.Command.run') @patch('os.path.exists') @patch('pathlib.Path.is_block_device') @patch('time.sleep') def test_context_manager_exit_loop_released( self, mock_time_sleep, mock_is_block_device, mock_os_path_exists, mock_command_run, ): is_block_device = [False, True] mock_os_path_exists.return_value = True mock_command_run.side_effect = KiwiCommandError('error') def Command_run(params): # raise on first command which is 'losetup -f ...' if params[1] == '-f': raise KiwiCommandError('issue') def Path_is_block_device(): return is_block_device.pop() mock_is_block_device.side_effect = Path_is_block_device mock_command_run.side_effect = Command_run with self._caplog.at_level(logging.ERROR): with LoopDevice('loop-file', 20) as loop_provider: loop_provider.node_name = '/dev/loop0' with raises(KiwiCommandError): loop_provider.create(overwrite=False) assert len(mock_is_block_device.call_args_list) == 2 assert mock_command_run.call_args_list == [ call(['losetup', '-f', '--show', 'loop-file']), call(['losetup', '-d', '/dev/loop0']), ] @patch('kiwi.storage.loop_device.Command.run') @patch('os.path.exists') @patch('pathlib.Path.is_block_device') @patch('time.sleep') def test_context_manager_exit_loop_not_released( self, mock_time_sleep, mock_is_block_device, mock_os_path_exists, mock_command_run, ): mock_os_path_exists.return_value = True mock_command_run.side_effect = KiwiCommandError('error') mock_is_block_device.return_value = True def Command_run(params): # raise on first command which is 'losetup -f ...' if params[1] == '-f': raise KiwiCommandError('issue') mock_command_run.side_effect = Command_run with self._caplog.at_level(logging.ERROR): with LoopDevice('loop-file', 20) as loop_provider: loop_provider.node_name = '/dev/loop0' with raises(KiwiCommandError): loop_provider.create(overwrite=False) assert mock_command_run.call_args_list == [ call(['losetup', '-f', '--show', 'loop-file']), call(['losetup', '-d', '/dev/loop0']), ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687826 kiwi-11.1.8/test/unit/storage/luks_device_test.py0000644000000000000000000003214215273675667017035 0ustar00import logging import io from unittest.mock import patch, call, MagicMock, Mock from pytest import raises, fixture from kiwi.exceptions import KiwiLuksSetupError from kiwi.storage.luks_device import LuksDevice class TestLuksDevice: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): storage_device = Mock() storage_device.get_byte_size = Mock(return_value=1048576) storage_device.get_uuid = Mock(return_value='0815') storage_device.get_device = Mock(return_value='/dev/some-device') storage_device.is_loop = Mock(return_value=True) self.luks = LuksDevice(storage_device) self.runtime_config = Mock() self.shasum = self.runtime_config.get_checksum_handler.return_value self.luks.runtime_config = self.runtime_config def setup_method(self, cls): self.setup() def test_create_crypto_luks_unsupported_os_options(self): with raises(KiwiLuksSetupError): self.luks.create_crypto_luks('passphrase', 'some-os') def test_luks_name_is_unique_per_instance(self): # Device mapper names are global to the host kernel, so two # concurrent builds must not share the luks map name assert self.luks.luks_name != LuksDevice(Mock()).luks_name assert self.luks.luks_name.startswith('luksRoot_') @patch('os.path.exists') def test_get_device(self, mock_path): mock_path.return_value = True self.luks.luks_device = '/dev/mapper/luksRoot' assert self.luks.get_device().get_device() == '/dev/mapper/luksRoot' self.luks.luks_device = None @patch('os.path.exists') def test_get_device_none(self, mock_path): mock_path.return_value = True self.luks.luks_device = None assert self.luks.get_device() is None @patch('kiwi.storage.luks_device.Command.run') @patch('os.chmod') def test_create_crypto_luks_empty_passphrase( self, mock_os_chmod, mock_command ): with patch('builtins.open', create=True): self.luks.create_crypto_luks( passphrase='', osname='sle12', keyfile='some-keyfile', root_dir='root', ) assert mock_command.call_args_list == [ call( [ 'dd', 'if=/dev/urandom', 'bs=1M', 'count=1', 'of=/dev/some-device', ] ), call( [ 'cryptsetup', '-q', '--key-file', '/dev/zero', '--cipher', 'aes-xts-plain64', '--key-size', '256', '--hash', 'sha1', '--keyfile-size', '32', 'luksFormat', '/dev/some-device', ] ), call( [ 'cryptsetup', '--key-file', '/dev/zero', '--keyfile-size', '32', 'luksAddKey', '/dev/some-device', 'root/some-keyfile', ] ), call( [ 'cryptsetup', '--key-file', '/dev/zero', '--keyfile-size', '32', 'luksHeaderBackup', '/dev/some-device', '--header-backup-file', 'root/root/.luks.header', ] ), call( [ 'cryptsetup', '--key-file', '/dev/zero', '--keyfile-size', '32', 'luksOpen', '/dev/some-device', self.luks.luks_name, ] ), ] self.shasum.digest.assert_called_once_with() self.luks.luks_device = None @patch('kiwi.storage.luks_device.LuksDevice') @patch('kiwi.storage.luks_device.Command.run') @patch('kiwi.storage.luks_device.Temporary.new_file') @patch('os.chmod') def test_create_crypto_luks_random_passphrase( self, mock_os_chmod, mock_tmpfile, mock_command, mock_LuksDevice ): tmpfile = Mock() tmpfile.name = 'tmpfile' mock_tmpfile.return_value = tmpfile with patch('builtins.open', create=True): self.luks.create_crypto_luks( passphrase='random', osname='sle12', keyfile='some-keyfile', root_dir='root', ) assert mock_command.call_args_list == [ call( [ 'dd', 'if=/dev/urandom', 'bs=1M', 'count=1', 'of=/dev/some-device', ] ), call( [ 'cryptsetup', '-q', '--key-file', 'root/some-keyfile', '--cipher', 'aes-xts-plain64', '--key-size', '256', '--hash', 'sha1', 'luksFormat', '/dev/some-device', ] ), call( [ 'cryptsetup', '--key-file', 'root/some-keyfile', 'luksHeaderBackup', '/dev/some-device', '--header-backup-file', 'root/root/.luks.header', ] ), call( [ 'cryptsetup', '--key-file', 'root/some-keyfile', 'luksOpen', '/dev/some-device', self.luks.luks_name, ] ), ] self.shasum.digest.assert_called_once_with() mock_LuksDevice.create_random_keyfile.assert_called_once_with( 'root/some-keyfile' ) assert self.luks.luks_keyfile == 'some-keyfile' self.luks.luks_device = '' @patch('kiwi.storage.luks_device.LuksDevice') @patch('kiwi.storage.luks_device.Command.run') @patch('kiwi.storage.luks_device.Temporary.new_file') @patch('os.chmod') def test_create_crypto_luks( self, mock_os_chmod, mock_tmpfile, mock_command, mock_LuksDevice ): tmpfile = Mock() tmpfile.name = 'tmpfile' mock_tmpfile.return_value = tmpfile with patch('builtins.open', create=True): self.luks.create_crypto_luks( passphrase='passphrase', osname='sle12', keyfile='some-keyfile', root_dir='root', ) assert mock_command.call_args_list == [ call( [ 'dd', 'if=/dev/urandom', 'bs=1M', 'count=1', 'of=/dev/some-device', ] ), call( [ 'cryptsetup', '-q', '--key-file', 'tmpfile', '--cipher', 'aes-xts-plain64', '--key-size', '256', '--hash', 'sha1', 'luksFormat', '/dev/some-device', ] ), call( [ 'cryptsetup', '--key-file', 'tmpfile', 'luksAddKey', '/dev/some-device', 'root/some-keyfile', ] ), call( [ 'cryptsetup', '--key-file', 'tmpfile', 'luksHeaderBackup', '/dev/some-device', '--header-backup-file', 'root/root/.luks.header', ] ), call( [ 'cryptsetup', '--key-file', 'tmpfile', 'luksOpen', '/dev/some-device', self.luks.luks_name, ] ), ] self.shasum.digest.assert_called_once_with() mock_LuksDevice.create_random_keyfile.assert_called_once_with( 'root/some-keyfile' ) assert self.luks.luks_keyfile == 'some-keyfile' self.luks.luks_device = '' @patch('kiwi.storage.luks_device.LuksDevice') @patch('kiwi.storage.luks_device.Command.run') @patch('kiwi.storage.luks_device.Temporary.new_file') @patch('os.chmod') def test_create_crypto_luks_header_digest_before_write( self, mock_os_chmod, mock_tmpfile, mock_command, mock_LuksDevice ): # The header backup file is also the file the checksum gets # written to. Opening it for writing truncates it, thus the # digest must be calculated before the file is opened tmpfile = Mock() tmpfile.name = 'tmpfile' mock_tmpfile.return_value = tmpfile order = [] def digest(): order.append('digest') return 'sum' def open_file(filename, mode): order.append(f'open:{filename}') return MagicMock(spec=io.IOBase) self.shasum.digest.side_effect = digest with patch('builtins.open', create=True) as mock_open: mock_open.side_effect = open_file self.luks.create_crypto_luks( passphrase='passphrase', osname='sle12', keyfile='some-keyfile', root_dir='root', ) assert order.index('digest') < order.index( 'open:root/root/.luks.header' ) self.luks.luks_device = '' def test_create_crypttab(self): self.luks.luks_device = '/dev/mapper/luksRoot' self.luks.luks_keyfile = None with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.luks.create_crypttab('crypttab') file_handle.write.assert_called_once_with('luks UUID=0815\n') self.luks.luks_device = None self.luks.luks_keyfile = 'some-keyfile' with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.luks.create_crypttab('crypttab') file_handle.write.assert_called_once_with( 'luks UUID=0815 /some-keyfile\n' ) self.luks.luks_device = None @patch('os.urandom') @patch('os.chmod') def test_create_random_keyfile(self, mock_os_chmod, mock_os_urandom): secret = b'secret' mock_os_urandom.return_value = secret with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value LuksDevice.create_random_keyfile('some-file') file_handle.write.assert_called_once_with('736563726574') mock_os_chmod.assert_called_once_with('some-file', 0o600) def test_is_loop(self): assert self.luks.is_loop() is True @patch('kiwi.storage.luks_device.Command.run') @patch('kiwi.storage.luks_device.log.warning') def test_context_manager_exit(self, mock_log_warn, mock_command): mock_command.side_effect = Exception with self._caplog.at_level(logging.ERROR): with LuksDevice(Mock()) as luks: luks.luks_device = '/dev/mapper/luksRoot' luks_name = luks.luks_name mock_command.assert_called_once_with( ['cryptsetup', 'luksClose', luks_name] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687826 kiwi-11.1.8/test/unit/storage/mapped_device_test.py0000644000000000000000000000165115273675667017326 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.storage.mapped_device import MappedDevice from kiwi.exceptions import KiwiMappedDeviceError class TestMappedDevice: @patch('os.path.exists') def setup(self, mock_path): mock_path.return_value = True self.device_provider = Mock() self.device_provider.is_loop = Mock() self.device = MappedDevice('/dev/foo', self.device_provider) @patch('os.path.exists') def setup_method(self, cls, mock_path): self.setup() @patch('os.path.exists') def test_device_not_existingr(self, mock_path): mock_path.return_value = False with raises(KiwiMappedDeviceError): MappedDevice('/dev/foo', Mock()) def test_get_device(self): assert self.device.get_device() == '/dev/foo' def test_is_loop(self): assert self.device.is_loop() == self.device_provider.is_loop() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687826 kiwi-11.1.8/test/unit/storage/raid_device_test.py0000644000000000000000000000656115273675667017004 0ustar00import logging from unittest.mock import patch, Mock, mock_open from pytest import raises, fixture from kiwi.storage.raid_device import RaidDevice from kiwi.exceptions import KiwiRaidSetupError class TestRaidDevice: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): storage_device = Mock() storage_device.get_device = Mock(return_value='/dev/some-device') storage_device.is_loop = Mock(return_value=True) self.raid = RaidDevice(storage_device) def setup_method(self, cls): self.setup() def test_create_degraded_raid_invalid_level(self): with raises(KiwiRaidSetupError): self.raid.create_degraded_raid('bogus-level') @patch('os.path.exists') def test_create_degraded_raid_no_free_device(self, mock_path): mock_path.return_value = True with raises(KiwiRaidSetupError): self.raid.create_degraded_raid('mirroring') @patch('os.path.exists') def test_get_device(self, mock_path): mock_path.return_value = True self.raid.raid_device = '/dev/md0' assert self.raid.get_device().get_device() == '/dev/md0' self.raid.raid_device = None def test_get_device_no_mapped_device(self): assert self.raid.get_device() is None @patch('kiwi.storage.raid_device.Command.run') @patch('os.path.exists') def test_create_degraded_raid(self, mock_path, mock_command): mock_path.return_value = False self.raid.create_degraded_raid('mirroring') mock_command.assert_called_once_with( [ 'mdadm', '--create', '--run', '/dev/md0', '--level', '1', '--raid-disks', '2', '/dev/some-device', 'missing', ] ) self.raid.raid_device = None @patch('kiwi.storage.raid_device.Command.run') def test_create_raid_config(self, mock_command): self.raid.raid_device = '/dev/md0' command_call = Mock() command_call.output = 'data' mock_command.return_value = command_call m_open = mock_open() with patch('builtins.open', m_open, create=True): self.raid.create_raid_config('mdadm.conf') mock_command.assert_called_once_with(['mdadm', '-Db', '/dev/md0']) m_open.return_value.write.assert_called_once_with('data') self.raid.raid_device = None @patch('kiwi.storage.raid_device.Command.run') def test_create_raid_config_without_raid_device(self, mock_command): self.raid.raid_device = None with raises(KiwiRaidSetupError) as raid_err_ctx: self.raid.create_raid_config('mdadm.conf') assert "No raid device" in str(raid_err_ctx.value) mock_command.assert_not_called() def test_is_loop(self): assert self.raid.is_loop() is True @patch('kiwi.storage.raid_device.Command.run') @patch('kiwi.storage.raid_device.log.warning') def test_context_manager_exit(self, mock_log_warn, mock_command): mock_command.side_effect = Exception with self._caplog.at_level(logging.ERROR): with RaidDevice(Mock()) as raid: raid.raid_device = '/dev/md0' mock_command.assert_called_once_with(['mdadm', '--stop', '/dev/md0']) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687826 kiwi-11.1.8/test/unit/storage/setup_test.py0000644000000000000000000002400115273675667015673 0ustar00import logging from unittest.mock import patch from pytest import fixture, raises import unittest.mock as mock import kiwi from kiwi.storage.setup import DiskSetup from kiwi.xml_state import XMLState from kiwi.xml_description import XMLDescription from kiwi.defaults import Defaults from kiwi.storage.disk import ptable_entry_type from kiwi.exceptions import KiwiVolumeTooSmallError, KiwiPartitionTooSmallError class TestDiskSetup: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): Defaults.set_platform_name('x86_64') self.size = mock.Mock() self.size.customize = mock.Mock(return_value=42) self.size.accumulate_mbyte_file_sizes = mock.Mock(return_value=42) kiwi.storage.setup.SystemSize = mock.Mock(return_value=self.size) description = XMLDescription('../data/example_disk_size_config.xml') self.setup = DiskSetup(XMLState(description.load()), 'root_dir') description = XMLDescription( '../data/example_disk_size_volume_config.xml' ) self.setup_volumes = DiskSetup(XMLState(description.load()), 'root_dir') description = XMLDescription( '../data/example_disk_size_oem_volume_config.xml' ) self.setup_oem_volumes = DiskSetup( XMLState(description.load()), 'root_dir' ) description = XMLDescription( '../data/example_disk_size_volume_too_small_config.xml' ) self.setup_volume_too_small = DiskSetup( XMLState(description.load()), 'root_dir' ) description = XMLDescription( '../data/example_disk_size_partition_too_small_config.xml' ) self.setup_partition_too_small = DiskSetup( XMLState(description.load()), 'root_dir' ) description = XMLDescription( '../data/example_disk_size_empty_vol_config.xml' ) self.setup_empty_volumes = DiskSetup( XMLState(description.load()), 'root_dir' ) description = XMLDescription( '../data/example_disk_size_vol_root_config.xml' ) self.setup_root_volume = DiskSetup( XMLState(description.load()), 'root_dir' ) description = XMLDescription( '../data/example_disk_size_partitions_config.xml' ) self.setup_partitions = DiskSetup( XMLState(description.load()), 'root_dir' ) Defaults.set_platform_name('ppc64') description = XMLDescription('../data/example_ppc_disk_size_config.xml') self.setup_ppc = DiskSetup(XMLState(description.load()), 'root_dir') Defaults.set_platform_name('arm64') description = XMLDescription('../data/example_arm_disk_size_config.xml') self.setup_arm = DiskSetup(XMLState(description.load()), 'root_dir') def setup_method(self, cls): self.setup() def test_need_boot_partition_on_request(self): self._init_bootpart_check() self.setup.bootpart_requested = True assert self.setup.need_boot_partition() is True self.setup.bootpart_requested = False assert self.setup.need_boot_partition() is False def test_need_boot_partition_mdraid(self): self._init_bootpart_check() self.setup.mdraid = True assert self.setup.need_boot_partition() is True def test_need_boot_partition_lvm(self): self._init_bootpart_check() self.setup.volume_manager = 'lvm' assert self.setup.need_boot_partition() is True def test_need_boot_partition_overlay(self): self._init_bootpart_check() self.setup.root_filesystem_is_overlay = True assert self.setup.need_boot_partition() is True def test_need_boot_partition_btrfs(self): self._init_bootpart_check() self.setup.volume_manager = 'btrfs' assert self.setup.need_boot_partition() is False def test_need_boot_partition_xfs(self): self._init_bootpart_check() self.setup.filesystem = 'xfs' assert self.setup.need_boot_partition() is False def test_boot_partition_size(self): self.setup.bootpart_requested = True assert ( self.setup.boot_partition_size() == Defaults.get_default_boot_mbytes() ) self.setup.bootpart_mbytes = 42 assert self.setup.boot_partition_size() == 42 def test_get_disksize_mbytes(self): self.setup.configured_size = mock.Mock() self.setup.configured_size.additive = False self.setup.configured_size.mbytes = 1024 assert ( self.setup.get_disksize_mbytes() == self.setup.configured_size.mbytes ) def test_get_disksize_mbytes_with_ppc_prep_partition(self): assert ( self.setup_ppc.get_disksize_mbytes() == Defaults.get_default_prep_mbytes() + self.size.accumulate_mbyte_file_sizes.return_value ) def test_get_disksize_mbytes_with_spare_partition(self): configured_spare_part_size = 42 assert ( self.setup_arm.get_disksize_mbytes() == configured_spare_part_size + Defaults.get_default_efi_boot_mbytes() + self.size.accumulate_mbyte_file_sizes.return_value ) def test_get_disksize_mbytes_configured_additive(self): self.setup.configured_size = mock.Mock() self.setup.configured_size.additive = True self.setup.configured_size.mbytes = 42 root_size = self.size.accumulate_mbyte_file_sizes.return_value assert ( self.setup.get_disksize_mbytes() == Defaults.get_default_legacy_bios_mbytes() + Defaults.get_default_efi_boot_mbytes() + Defaults.get_swapsize_mbytes() + root_size + 42 + 200 * 1.7 ) def test_get_disksize_mbytes_configured(self): self.setup.configured_size = mock.Mock() self.setup.configured_size.additive = False self.setup.configured_size.mbytes = 42 with self._caplog.at_level(logging.WARNING): assert ( self.setup.get_disksize_mbytes() == self.setup.configured_size.mbytes ) def test_get_disksize_mbytes_empty_volumes(self): assert ( self.setup_empty_volumes.get_disksize_mbytes() == Defaults.get_lvm_overhead_mbytes() + Defaults.get_default_legacy_bios_mbytes() + Defaults.get_default_efi_boot_mbytes() + Defaults.get_default_boot_mbytes() + self.size.accumulate_mbyte_file_sizes.return_value ) @patch('os.path.exists') def test_get_disksize_mbytes_volume_too_small(self, mock_os_path_exists): mock_os_path_exists.return_value = True with raises(KiwiVolumeTooSmallError): self.setup_volume_too_small.get_disksize_mbytes() @patch('os.path.exists') def test_get_disksize_mbytes_partition_too_small(self, mock_os_path_exists): mock_os_path_exists.return_value = True with raises(KiwiPartitionTooSmallError): self.setup_partition_too_small.get_disksize_mbytes() @patch('os.path.exists') def test_get_disksize_mbytes_volumes(self, mock_exists): mock_exists.side_effect = lambda path: path != 'root_dir/newfolder' assert self.setup_volumes.get_disksize_mbytes() == 2144 @patch('os.path.exists') def test_get_disksize_mbytes_partitions(self, mock_exists): mock_exists.side_effect = lambda path: path != 'root_dir/var/tmp' assert self.setup_partitions.get_disksize_mbytes() == 732 @patch('os.path.exists') def test_get_disksize_mbytes_clones(self, mock_exists): mock_exists.side_effect = lambda path: path != 'root_dir/var/tmp' self.setup_partitions.custom_partitions['var'] = ptable_entry_type( mbsize=100, clone=1, partition_name='var', partition_type='t.linux', partition_id=None, mountpoint='/var', filesystem='ext3', label='var', ) assert ( self.setup_partitions.get_disksize_mbytes( root_clone=1, boot_clone=1 ) == 842 ) @patch('os.path.exists') def test_get_disksize_mbytes_oem_volumes(self, mock_exists): mock_exists.return_value = True root_size = self.size.accumulate_mbyte_file_sizes.return_value assert ( self.setup_oem_volumes.get_disksize_mbytes() == Defaults.get_lvm_overhead_mbytes() + Defaults.get_default_legacy_bios_mbytes() + Defaults.get_default_efi_boot_mbytes() + Defaults.get_default_boot_mbytes() + root_size + 5 * Defaults.get_min_volume_mbytes('ext3') ) @patch('os.path.exists') def test_get_disksize_mbytes_root_volume(self, mock_exists): mock_exists.return_value = True root_size = self.size.accumulate_mbyte_file_sizes.return_value with self._caplog.at_level(logging.WARNING): assert ( self.setup_root_volume.get_disksize_mbytes() == Defaults.get_lvm_overhead_mbytes() + Defaults.get_default_legacy_bios_mbytes() + Defaults.get_default_efi_boot_mbytes() + Defaults.get_default_boot_mbytes() + root_size ) def test_get_boot_label(self): assert self.setup.get_boot_label() == 'BOOT' def test_get_efi_label(self): assert self.setup.get_efi_label() == 'EFI' def test_get_default_root_label(self): assert self.setup.get_root_label() == 'ROOT' def test_get_custom_root_label(self): assert self.setup_ppc.get_root_label() == 'MYLABEL' def _init_bootpart_check(self): self.setup.root_filesystem_is_overlay = None self.setup.bootpart_requested = None self.setup.mdraid = None self.setup.volume_manager = None self.setup.filesystem = None self.setup.bootloader = None ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7687826 kiwi-11.1.8/test/unit/storage/subformat/__init__.py0000644000000000000000000000000015273675667017226 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7692125 kiwi-11.1.8/test/unit/storage/subformat/base_test.py0000644000000000000000000001251215273675667017453 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.defaults import Defaults from kiwi.storage.subformat.base import DiskFormatBase import kiwi from kiwi.exceptions import KiwiFormatSetupError, KiwiResizeRawDiskError class TestDiskFormatBase: @patch('kiwi.storage.subformat.base.DiskFormatBase.post_init') def setup(self, mock_post_init): Defaults.set_platform_name('x86_64') xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') self.xml_state = Mock() self.xml_state.xml_data = xml_data self.xml_state.get_image_version = Mock(return_value='1.2.3') self.xml_state.get_luks_credentials = Mock(return_value=None) self.runtime_config = Mock() self.runtime_config.get_bundle_compression.return_value = True kiwi.storage.subformat.base.RuntimeConfig = Mock( return_value=self.runtime_config ) DiskFormatBase( self.xml_state, 'root_dir', 'target_dir', {'option': 'unhandled'} ) mock_post_init.assert_called_once_with({'option': 'unhandled'}) mock_post_init.reset_mock() self.disk_format = DiskFormatBase( self.xml_state, 'root_dir', 'target_dir' ) mock_post_init.assert_called_once_with({}) @patch('kiwi.storage.subformat.base.DiskFormatBase.post_init') def setup_method(self, cls, mock_post_init): self.setup() def test_create_image_format(self): with raises(NotImplementedError): self.disk_format.create_image_format() def test_get_target_file_path_for_format_invalid_format(self): with raises(KiwiFormatSetupError): self.disk_format.get_target_file_path_for_format('foo') def test_post_init(self): # in the base class this method just pass self.disk_format.post_init({}) def test_get_qemu_option_list(self): custom_args = {'subformat=format': None, 'adapter_type=type': None} assert self.disk_format.get_qemu_option_list(custom_args) == [ '-o', 'adapter_type=type', '-o', 'subformat=format', ] def test_get_target_file_path_for_format(self): assert ( self.disk_format.get_target_file_path_for_format('vhd') == 'target_dir/some-disk-image.x86_64-1.2.3.vhd' ) def test_store_to_result_default(self): result = Mock() self.disk_format.image_format = 'qcow2' self.disk_format.store_to_result(result) result.add.assert_called_once_with( compress=True, filename='target_dir/some-disk-image.x86_64-1.2.3.qcow2', key='disk_format_image', shasum=True, use_for_bundle=True, ) def test_store_to_result_with_luks(self): result = Mock() self.xml_state.get_luks_credentials = Mock(return_value='foo') self.disk_format.image_format = 'qcow2' self.disk_format.store_to_result(result) result.add.assert_called_once_with( compress=False, filename='target_dir/some-disk-image.x86_64-1.2.3.qcow2', key='disk_format_image', shasum=True, use_for_bundle=True, ) self.xml_state.get_luks_credentials = Mock(return_value=None) @patch('os.path.getsize') def test_resize_raw_disk_raises_on_shrink_disk(self, mock_getsize): mock_getsize.return_value = 42 with raises(KiwiResizeRawDiskError): self.disk_format.resize_raw_disk(10) @patch('os.path.getsize') @patch('kiwi.storage.subformat.base.Command.run') def test_resize_raw_disk(self, mock_command, mock_getsize): mock_getsize.return_value = 42 assert self.disk_format.resize_raw_disk(1024) is True mock_command.assert_called_once_with( [ 'qemu-img', 'resize', 'target_dir/some-disk-image.x86_64-1.2.3.raw', '1024', ] ) @patch('os.path.getsize') @patch('kiwi.storage.subformat.base.Command.run') def test_resize_raw_disk_append(self, mock_command, mock_getsize): mock_getsize.return_value = 42 assert self.disk_format.resize_raw_disk(1024, append=True) is True mock_command.assert_called_once_with( [ 'qemu-img', 'resize', 'target_dir/some-disk-image.x86_64-1.2.3.raw', '+1024', ] ) @patch('os.path.getsize') def test_resize_raw_disk_same_size(self, mock_getsize): mock_getsize.return_value = 42 assert self.disk_format.resize_raw_disk(42) is False @patch('os.path.exists') def test_has_raw_disk(self, mock_exists): mock_exists.return_value = True assert self.disk_format.has_raw_disk() is True mock_exists.assert_called_once_with( 'target_dir/some-disk-image.x86_64-1.2.3.raw' ) @patch('kiwi.storage.subformat.base.Path.wipe') @patch('os.path.exists') def test_context_manager_exit(self, mock_exists, mock_wipe): mock_exists.return_value = True with DiskFormatBase( self.xml_state, 'root_dir', 'target_dir' ) as disk_format: disk_format.temp_image_dir = 'tmpdir' mock_wipe.assert_called_once_with('tmpdir') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7692125 kiwi-11.1.8/test/unit/storage/subformat/gce_test.py0000644000000000000000000000542415273675667017303 0ustar00from unittest.mock import patch, call, mock_open import unittest.mock as mock import kiwi from kiwi.defaults import Defaults from kiwi.storage.subformat.gce import DiskFormatGce class TestDiskFormatGce: def setup(self): Defaults.set_platform_name('x86_64') xml_data = mock.Mock() xml_data.get_name = mock.Mock(return_value='some-disk-image') self.xml_state = mock.Mock() self.xml_state.xml_data = xml_data self.xml_state.get_image_version = mock.Mock(return_value='0.8.15') self.runtime_config = mock.Mock() self.runtime_config.get_bundle_compression.return_value = True kiwi.storage.subformat.base.RuntimeConfig = mock.Mock( return_value=self.runtime_config ) self.disk_format = DiskFormatGce( self.xml_state, 'root_dir', 'target_dir' ) def setup_method(self, cls): self.setup() def test_post_init(self): self.disk_format.post_init({'option': 'value', '--tag': 'tag'}) assert self.disk_format.tag == 'tag' def test_store_to_result(self): result = mock.Mock() self.disk_format.store_to_result(result) result.add.assert_called_once_with( compress=False, filename='target_dir/some-disk-image.x86_64-0.8.15.tar.gz', key='disk_format_image', shasum=True, use_for_bundle=True, ) @patch('kiwi.storage.subformat.gce.Command.run') @patch('kiwi.storage.subformat.gce.ArchiveTar') @patch('kiwi.storage.subformat.gce.Temporary') def test_create_image_format( self, mock_Temporary, mock_archive, mock_command ): mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' archive = mock.Mock() mock_archive.return_value = archive self.disk_format.tag = 'gce-license' m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_format.create_image_format() mock_command.assert_called_once_with( [ 'cp', 'target_dir/some-disk-image.x86_64-0.8.15.raw', 'tmpdir/disk.raw', ] ) assert m_open.call_args_list == [call('tmpdir/manifest.json', 'w')] assert m_open.return_value.write.call_args_list == [ call('{"licenses": ["gce-license"]}') ] mock_archive.assert_called_once_with( filename='target_dir/some-disk-image.x86_64-0.8.15.tar', file_list=['manifest.json', 'disk.raw'], ) archive.create_gnu_gzip_compressed.assert_called_once_with('tmpdir') assert ( self.disk_format.get_target_file_path_for_format('gce') == 'target_dir/some-disk-image.x86_64-0.8.15.tar.gz' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7692125 kiwi-11.1.8/test/unit/storage/subformat/init_test.py0000644000000000000000000001361415273675667017510 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.storage.subformat import DiskFormat from kiwi.exceptions import KiwiDiskFormatSetupError class TestDiskFormat: def setup(self): self.xml_state = Mock() self.xml_state.get_build_type_format_options.return_value = {} def setup_method(self, cls): self.setup() def test_format_not_implemented(self): with raises(KiwiDiskFormatSetupError): DiskFormat.new('foo', self.xml_state, 'root_dir', 'target_dir') def test_disk_format_vagrant_not_implemented(self): self.xml_state.get_build_type_vagrant_config_section = Mock( return_value=None ) with raises(KiwiDiskFormatSetupError): DiskFormat.new('vagrant', self.xml_state, 'root_dir', 'target_dir') @patch('kiwi.storage.subformat.qcow2.DiskFormatQcow2') def test_disk_format_qcow2(self, mock_qcow2): DiskFormat.new('qcow2', self.xml_state, 'root_dir', 'target_dir') mock_qcow2.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {} ) @patch('kiwi.storage.subformat.vdi.DiskFormatVdi') def test_disk_format_vdi(self, mock_vdi): DiskFormat.new('vdi', self.xml_state, 'root_dir', 'target_dir') mock_vdi.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {} ) @patch('kiwi.storage.subformat.vhd.DiskFormatVhd') def test_disk_format_vhd(self, mock_vhd): DiskFormat.new('vhd', self.xml_state, 'root_dir', 'target_dir') mock_vhd.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {} ) @patch('kiwi.storage.subformat.vhdx.DiskFormatVhdx') def test_disk_format_vhdx(self, mock_vhdx): DiskFormat.new('vhdx', self.xml_state, 'root_dir', 'target_dir') mock_vhdx.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {} ) @patch('kiwi.storage.subformat.vhdfixed.DiskFormatVhdFixed') def test_disk_format_vhdfixed(self, mock_vhdfixed): self.xml_state.build_type.get_vhdfixedtag = Mock( return_value='disk-tag' ) DiskFormat.new('vhd-fixed', self.xml_state, 'root_dir', 'target_dir') mock_vhdfixed.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {'--tag': 'disk-tag'} ) @patch('kiwi.storage.subformat.gce.DiskFormatGce') def test_disk_format_gce(self, mock_gce): self.xml_state.build_type.get_gcelicense = Mock( return_value='gce_license_tag' ) DiskFormat.new('gce', self.xml_state, 'root_dir', 'target_dir') mock_gce.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {'--tag': 'gce_license_tag'}, ) @patch('kiwi.storage.subformat.vmdk.DiskFormatVmdk') def test_disk_format_vmdk(self, mock_vmdk): vmdisk = Mock() vmdisk.get_controller = Mock(return_value='controller') vmdisk.get_diskmode = Mock(return_value='disk-mode') self.xml_state.get_build_type_vmdisk_section = Mock(return_value=vmdisk) DiskFormat.new('vmdk', self.xml_state, 'root_dir', 'target_dir') mock_vmdk.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {'adapter_type=controller': None, 'subformat=disk-mode': None}, ) @patch('kiwi.storage.subformat.ova.DiskFormatOva') def test_disk_format_ova(self, mock_ova): vmdisk = Mock() vmdisk.get_controller = Mock(return_value='controller') vmdisk.get_diskmode = Mock(return_value='disk-mode') self.xml_state.get_build_type_vmdisk_section = Mock(return_value=vmdisk) DiskFormat.new('ova', self.xml_state, 'root_dir', 'target_dir') mock_ova.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {'adapter_type=controller': None, 'subformat=disk-mode': None}, ) @patch('kiwi.storage.subformat.oci.DiskFormatOci') def test_disk_format_oci(self, mock_oci): DiskFormat.new('oci:raw', self.xml_state, 'root_dir', 'target_dir') mock_oci.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {'base_format': 'raw', 'container_format': 'oci'}, ) mock_oci.reset_mock() DiskFormat.new('docker:raw', self.xml_state, 'root_dir', 'target_dir') mock_oci.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {'base_format': 'raw', 'container_format': 'docker'}, ) @patch( 'kiwi.storage.subformat.vagrant_virtualbox.DiskFormatVagrantVirtualBox' ) @patch('kiwi.storage.subformat.vagrant_libvirt.DiskFormatVagrantLibVirt') def test_disk_format_vagrant_libvirt( self, mock_vagrant_libvirt, mock_vagrant_virt_box ): for provider_name, provider_mock in ( ('libvirt', mock_vagrant_libvirt), ('virtualbox', mock_vagrant_virt_box), ): vagrant_config = Mock() vagrant_config.get_provider = Mock(return_value=provider_name) self.xml_state.get_build_type_vagrant_config_section = Mock( return_value=vagrant_config ) DiskFormat.new('vagrant', self.xml_state, 'root_dir', 'target_dir') provider_mock.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {'vagrantconfig': vagrant_config}, ) @patch('kiwi.storage.subformat.base.DiskFormatBase') def test_disk_format_base(self, mock_base): DiskFormat.new('raw', self.xml_state, 'root_dir', 'target_dir') mock_base.assert_called_once_with( self.xml_state, 'root_dir', 'target_dir', {} ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7692125 kiwi-11.1.8/test/unit/storage/subformat/oci_test.py0000644000000000000000000001564615273675667017326 0ustar00from pytest import raises from unittest.mock import patch, Mock from kiwi.defaults import Defaults from kiwi.storage.subformat.oci import DiskFormatOci from kiwi.exceptions import KiwiContainerBuilderError from kiwi.system.uri import Uri class TestDiskFormatOci: def setup(self): Defaults.set_platform_name('x86_64') xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') self.xml_state = Mock() self.uri = Uri( 'docker-archive:/home/ms/alpine.tar', repo_type='container' ) self.xml_state.xml_data = xml_data self.xml_state.get_derived_from_image_uri = Mock( return_value=[self.uri] ) self.xml_state.get_image_version = Mock(return_value='1.2.3') self.disk_format = DiskFormatOci( self.xml_state, 'root_dir', 'target_dir' ) self.disk_format.base_format = 'raw' self.runtime_config = Mock() self.runtime_config.get_container_compression.return_value = True self.shasum = self.runtime_config.get_checksum_handler.return_value self.shasum.suffix = '.sha256' self.disk_format.runtime_config = self.runtime_config def setup_method(self, cls): self.setup() def test_post_init(self): self.disk_format.post_init({'base_format': 'raw'}) assert self.disk_format.base_container_uris == [self.uri] assert self.disk_format.base_format == 'raw' @patch('kiwi.storage.subformat.oci.Temporary.new_dir') @patch('kiwi.storage.subformat.oci.Command.run') @patch('kiwi.storage.subformat.oci.Defaults') @patch('kiwi.storage.subformat.oci.ContainerImage') @patch('kiwi.storage.subformat.oci.DiskFormat') @patch('kiwi.storage.subformat.oci.Path') @patch('kiwi.storage.subformat.oci.Result') @patch('os.chown') @patch('os.stat') def test_create_image_format_empty_root( self, mock_stat, mock_chown, mock_Result, mock_Path, mock_DiskFormat, mock_ContainerImage, mock_Defaults, mock_Command_run, mock_Temporary_new_dir, ): mock_Temporary_new_dir.return_value.name = 'root_dir' result = Mock() result.get_name_for_pattern.return_value = 'some_custom_name' mock_Result.return_value = result self.disk_format.bundle_format = 'some' self.disk_format.base_container_uris = [] mock_Defaults.get_imported_root_image.return_value = 'some-base' # test raw format self.disk_format.create_image_format() mock_Path.assert_called_once_with('root_dir/disk') mock_Command_run.assert_called_once_with( [ 'cp', '-a', 'target_dir/some-disk-image.x86_64-1.2.3.raw', 'root_dir/disk/some_custom_name.raw', ] ) mock_ContainerImage.new.assert_called_once_with( 'docker', 'root_dir', self.xml_state.get_container_config.return_value, ) mock_ContainerImage.new.return_value.create.assert_called_once_with( 'target_dir/some-disk-image.x86_64-1.2.3.docker.tar', '', True, True ) @patch('kiwi.storage.subformat.oci.Command.run') @patch('kiwi.storage.subformat.oci.Temporary.new_dir') @patch('kiwi.storage.subformat.oci.RootImport') @patch('kiwi.storage.subformat.oci.Defaults') @patch('kiwi.storage.subformat.oci.Checksum') @patch('kiwi.storage.subformat.oci.ContainerImage') @patch('kiwi.storage.subformat.oci.RootInit') @patch('kiwi.storage.subformat.oci.DiskFormat') @patch('kiwi.storage.subformat.oci.Path') @patch('kiwi.storage.subformat.oci.Result') @patch('os.chown') @patch('os.stat') def test_create_image_format_derived_from( self, mock_stat, mock_chown, mock_Result, mock_Path, mock_DiskFormat, mock_RootInit, mock_ContainerImage, mock_Checksum, mock_Defaults, mock_RootImport, mock_Temporary_new_dir, mock_Command_run, ): result = Mock() result.get_name_for_pattern.return_value = 'some_custom_name' mock_Result.return_value = result self.disk_format.bundle_format = 'some' mock_Defaults.get_imported_root_image.return_value = 'some-base' tmpdir = Mock() tmpdir.name = 'tmpdir' mock_Temporary_new_dir.return_value = tmpdir # test raw format self.disk_format.create_image_format() mock_RootInit.assert_called_once_with('tmpdir', allow_existing=True) mock_RootInit.return_value.create.assert_called_once_with() mock_RootImport.new.assert_called_once_with( 'tmpdir', [self.uri], 'docker' ) mock_RootImport.new.return_value.sync_data.assert_called_once_with() mock_Path.assert_called_once_with('tmpdir/disk') mock_Command_run.assert_called_once_with( [ 'cp', '-a', 'target_dir/some-disk-image.x86_64-1.2.3.raw', 'tmpdir/disk/some_custom_name.raw', ] ) mock_Checksum.return_value.matches.assert_called_once_with( self.shasum.digest.return_value, 'some-base.sha256' ) mock_ContainerImage.new.assert_called_once_with( 'docker', 'tmpdir', self.xml_state.get_container_config.return_value ) mock_ContainerImage.new.return_value.create.assert_called_once_with( 'target_dir/some-disk-image.x86_64-1.2.3.docker.tar', 'some-base', True, True, ) # test qcow2 format mock_Command_run.reset_mock() self.disk_format.base_format = 'qcow2' self.disk_format.create_image_format() mock_DiskFormat.new.assert_called_once_with( 'qcow2', self.xml_state, 'root_dir', 'target_dir' ) disk_format = mock_DiskFormat.new.return_value.__enter__.return_value disk_format.create_image_format.assert_called_once_with() mock_Command_run.assert_called_once_with( [ 'cp', '-a', disk_format.get_target_file_path_for_format.return_value, 'tmpdir/disk/some_custom_name.qcow2', ] ) # test checksum failed for base container mock_Checksum.return_value.matches.reset_mock() mock_Checksum.return_value.matches.return_value = False with raises(KiwiContainerBuilderError): self.disk_format.create_image_format() def test_store_to_result(self): result = Mock() self.disk_format.store_to_result(result) result.add.assert_called_once_with( compress=False, filename='target_dir/some-disk-image.x86_64-1.2.3.docker.tar', key='disk_format_image', shasum=True, use_for_bundle=True, ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7692125 kiwi-11.1.8/test/unit/storage/subformat/ova_test.py0000644000000000000000000002437115273675667017334 0ustar00from unittest.mock import patch, call, Mock from pytest import raises from kiwi.defaults import Defaults from kiwi.storage.subformat.ova import DiskFormatOva import kiwi from kiwi.exceptions import ( KiwiCommandNotFound, KiwiFormatSetupError, KiwiTemplateError, ) class TestDiskFormatOva: @patch('kiwi.storage.subformat.ova.FirmWare') def setup(self, mock_FirmWare): self.firmware = Mock() self.firmware.efi_mode = Mock(return_value='uefi') mock_FirmWare.return_value = self.firmware Defaults.set_platform_name('x86_64') self.context_manager_mock = Mock() self.file_mock = Mock() self.enter_mock = Mock() self.exit_mock = Mock() self.enter_mock.return_value = self.file_mock setattr(self.context_manager_mock, '__enter__', self.enter_mock) setattr(self.context_manager_mock, '__exit__', self.exit_mock) xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') xml_data.get_displayname = Mock(return_value=None) self.xml_state = Mock() self.xml_state.xml_data = xml_data self.xml_state.get_image_version = Mock(return_value='1.2.3') self.machine_setup = Mock() self.xml_state.get_build_type_machine_section = Mock( return_value=self.machine_setup ) self.machine_setup.get_HWversion = Mock(return_value='42') self.machine_setup.get_guestOS = Mock(return_value='suse') self.machine_setup.get_memory = Mock(return_value='4096') self.machine_setup.get_ncpus = Mock(return_value='2') self.iso_setup = Mock() self.xml_state.get_build_type_vmdvd_section = Mock( return_value=self.iso_setup ) self.xml_state.get_luks_credentials = Mock(return_value=None) self.iso_setup.get_controller = Mock(return_value='ide') self.iso_setup.get_id = Mock(return_value='0') self.network_setup = [Mock()] self.xml_state.get_build_type_vmnic_entries = Mock( return_value=self.network_setup ) self.network_setup[0].get_interface = Mock(return_value='0') self.network_setup[0].get_mac = Mock(return_value='98:90:96:a0:3c:58') self.network_setup[0].get_mode = Mock(return_value='bridged') self.network_setup[0].get_driver = Mock(return_value='e1000') self.disk_setup = Mock() self.xml_state.get_build_type_vmdisk_section = Mock( return_value=self.disk_setup ) self.disk_setup.get_controller = Mock(return_value='lsilogic') self.disk_setup.get_id = Mock(return_value='0') self.machine_setup.get_ovftype = Mock(return_value='vmware') self.runtime_config = Mock() self.runtime_config.get_bundle_compression.return_value = False kiwi.storage.subformat.base.RuntimeConfig = Mock( return_value=self.runtime_config ) self.disk_format = DiskFormatOva( self.xml_state, 'root_dir', 'target_dir' ) def setup_method(self, cls): self.setup() @patch('kiwi.storage.subformat.ova.FirmWare') def test_post_init(self, mock_FirmWare): self.disk_format.post_init({}) def test_post_init_bad_ovftype(self): self.machine_setup.get_ovftype.return_value = 'foobar' with raises(KiwiFormatSetupError): self.disk_format.post_init({}) def test_store_to_result(self): result = Mock() self.disk_format.store_to_result(result) assert result.add.call_args_list == [ call( compress=False, filename='target_dir/some-disk-image.x86_64-1.2.3.ova', key='disk_format_image', shasum=True, use_for_bundle=True, ) ] @patch('kiwi.storage.subformat.ova.Path.which') @patch('kiwi.storage.subformat.ova.Command.run') @patch('kiwi.storage.subformat.ova.DiskFormatVmdk.create_image_format') @patch('os.chdir') def test_create_image_format( self, mock_chdir, mock_create_image_format, mock_command, mock_which ): mock_which.return_value = 'ova-compose' with patch('builtins.open', create=True) as mock_open: self.disk_format.create_image_format() mock_open.assert_called_once_with( 'target_dir/some-disk-image.x86_64-1.2.3.meta', 'w' ) mock_command.assert_called_once_with( [ 'ova-compose', '--input-file', 'target_dir/some-disk-image.x86_64-1.2.3.meta', '--output-file', 'target_dir/some-disk-image.x86_64-1.2.3.ova', '--format', 'ova', ] ) @patch('kiwi.storage.subformat.ova.DiskFormatVmdk.create_image_format') @patch('kiwi.storage.subformat.ova.OvaComposeTemplate.get_template') @patch('kiwi.storage.subformat.ova.Command.run') @patch('kiwi.storage.subformat.ova.Path.which') def test_create_image_format_template_error( self, mock_Path_which, mock_Command_run, mock_OvaComposeTemplate_get_template, mock_DiskFormatVmdk_create_image_format, ): template = Mock() mock_Path_which.return_value = 'ova-compose' mock_OvaComposeTemplate_get_template.return_value = template template.substitute.side_effect = Exception with patch('builtins.open'): with raises(KiwiTemplateError): self.disk_format.create_image_format() @patch('kiwi.storage.subformat.ova.Path.which') def test_create_image_format_no_ova_compose(self, mock_Path_which): mock_Path_which.return_value = None with raises(KiwiCommandNotFound): self.disk_format.create_image_format() @patch('kiwi.storage.subformat.ova.OvaComposeTemplate.get_template') def test_create_ova_compose_meta_file_with_disk_controller( self, mock_get_template ): """Test that disk controller and disk id are passed to OvaComposeTemplate""" self.disk_setup.get_controller.return_value = 'lsilogic' self.disk_setup.get_id.return_value = '7' template = Mock() mock_get_template.return_value = template template.substitute.return_value = 'meta_content' with patch('builtins.open', create=True): self.disk_format._create_ova_compose_meta_file() # Verify OvaComposeTemplate.get_template was called with disk setup mock_get_template.assert_called_once() call_args = mock_get_template.call_args assert call_args[1]['disk_controller'] == 'lsilogic' assert call_args[1]['disk_id'] == '7' @patch('kiwi.storage.subformat.ova.OvaComposeTemplate.get_template') def test_create_ova_compose_meta_file_with_nic_driver( self, mock_get_template ): """Test that NIC settings are passed to OvaComposeTemplate""" self.network_setup[0].get_driver.return_value = 'e1000' self.network_setup[0].get_interface.return_value = '2' self.network_setup[0].get_mode.return_value = 'bridged' self.network_setup[0].get_mac.return_value = '00:11:22:33:44:55' template = Mock() mock_get_template.return_value = template template.substitute.return_value = 'meta_content' with patch('builtins.open', create=True): self.disk_format._create_ova_compose_meta_file() # Verify OvaComposeTemplate.get_template was called with network setup mock_get_template.assert_called_once() call_args = mock_get_template.call_args assert call_args[0][2] == { '2': { 'driver': 'e1000', 'connection_type': 'bridged', 'mac': '00:11:22:33:44:55', } } @patch('kiwi.storage.subformat.ova.OvaComposeTemplate.get_template') def test_create_ova_compose_meta_file_with_no_controllers( self, mock_get_template ): """Test that defaults are used when no optional setup is configured""" self.disk_setup.get_controller.return_value = None self.disk_setup.get_id.return_value = None self.iso_setup.get_controller.return_value = None self.iso_setup.get_id.return_value = None self.network_setup = [] self.xml_state.get_build_type_vmnic_entries.return_value = ( self.network_setup ) template = Mock() mock_get_template.return_value = template template.substitute.return_value = 'meta_content' with patch('builtins.open', create=True): self.disk_format._create_ova_compose_meta_file() # Verify OvaComposeTemplate.get_template was called with defaults mock_get_template.assert_called_once() call_args = mock_get_template.call_args assert call_args[1]['disk_controller'] is None assert call_args[1]['disk_id'] == '0' assert call_args[1]['iso_controller'] == 'ide' assert call_args[1]['iso_id'] == '0' assert call_args[0][2] == {} @patch('kiwi.storage.subformat.ova.OvaComposeTemplate.get_template') def test_create_ova_compose_meta_file_memory_cpu_extraction( self, mock_get_template ): """Test that memory and CPU configuration are correctly extracted""" self.machine_setup.get_memory.return_value = '8192' self.machine_setup.get_ncpus.return_value = '4' self.machine_setup.get_guestOS.return_value = 'ubuntu64Guest' template = Mock() mock_get_template.return_value = template template.substitute.return_value = 'meta_content' with patch('builtins.open', create=True) as mock_open: self.disk_format._create_ova_compose_meta_file() # Verify template.substitute was called with correct values template.substitute.assert_called_once() call_args = template.substitute.call_args[0][0] assert call_args['memory_size'] == '8192' assert call_args['number_of_cpus'] == '4' assert call_args['guest_os'] == 'ubuntu64Guest' # Verify meta file was opened for writing mock_open.assert_called_once() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7692125 kiwi-11.1.8/test/unit/storage/subformat/qcow2_test.py0000644000000000000000000000470015273675667017574 0ustar00from unittest.mock import patch, Mock, call import kiwi from kiwi.defaults import Defaults from kiwi.storage.subformat.qcow2 import DiskFormatQcow2 class TestDiskFormatQcow2: def setup(self): Defaults.set_platform_name('x86_64') xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') self.xml_state = Mock() self.xml_state.xml_data = xml_data self.xml_state.get_image_version = Mock(return_value='1.2.3') self.runtime_config = Mock() self.runtime_config.get_bundle_compression.return_value = False kiwi.storage.subformat.base.RuntimeConfig = Mock( return_value=self.runtime_config ) self.disk_format = DiskFormatQcow2( self.xml_state, 'root_dir', 'target_dir' ) def setup_method(self, cls): self.setup() def test_post_init(self): self.disk_format.post_init({'option': 'value'}) assert self.disk_format.options == ['-o', 'option=value'] @patch('kiwi.storage.subformat.qcow2.Command.run') @patch('kiwi.storage.subformat.qcow2.Temporary.new_file') def test_create_image_format(self, mock_Temporary_new_file, mock_command): tmpfile = Mock() tmpfile.name = 'tmpfile' mock_Temporary_new_file.return_value = tmpfile self.disk_format.create_image_format() assert mock_command.call_args_list == [ call( [ 'qemu-img', 'convert', '-f', 'raw', 'target_dir/some-disk-image.x86_64-1.2.3.raw', '-O', 'qcow2', 'tmpfile', ] ), call( [ 'qemu-img', 'convert', '-c', '-f', 'qcow2', 'tmpfile', '-O', 'qcow2', 'target_dir/some-disk-image.x86_64-1.2.3.qcow2', ] ), ] def test_store_to_result(self): result = Mock() self.disk_format.store_to_result(result) result.add.assert_called_once_with( compress=False, filename='target_dir/some-disk-image.x86_64-1.2.3.qcow2', key='disk_format_image', shasum=True, use_for_bundle=True, ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7692125 kiwi-11.1.8/test/unit/storage/subformat/template/__init__.py0000644000000000000000000000000015273675667021041 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/template/ova_compose_test.py0000644000000000000000000002630615273675667022674 0ustar00from pytest import raises from kiwi.storage.subformat.template.ova_compose import OvaComposeTemplate from kiwi.exceptions import KiwiTemplateError class TestOvaComposeTemplate: """Test OvaComposeTemplate hardware configuration""" def test_get_template_with_default_hardware(self): """Test template generation with default hardware (ide + VmxNet3)""" template = OvaComposeTemplate().get_template() rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'other4xLinux64Guest', 'firmware': 'bios', 'secure_boot': 'false', 'number_of_cpus': 2, 'memory_size': 4096, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) # Verify default hardware configuration (ide controller) assert 'parent: ide0' in rendered assert 'subtype: VmxNet3' in rendered assert 'rootdisk:' in rendered assert 'ethernet0:' in rendered def test_get_template_with_lsilogic_controller(self): """Test template generation with SCSI lsilogic controller""" template = OvaComposeTemplate().get_template(disk_controller='lsilogic') rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'other4xLinux64Guest', 'firmware': 'bios', 'secure_boot': 'false', 'number_of_cpus': 2, 'memory_size': 4096, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) # Verify lsilogic mapping to scsi0 assert 'parent: scsi0' in rendered def test_get_template_with_sata_controller(self): """Test template generation with SATA controller""" template = OvaComposeTemplate().get_template(disk_controller='sata') rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'other4xLinux64Guest', 'firmware': 'bios', 'secure_boot': 'false', 'number_of_cpus': 2, 'memory_size': 4096, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) # Verify sata mapping assert 'parent: sata0' in rendered def test_get_template_with_nvme_controller(self): """Test template generation with NVMe controller""" template = OvaComposeTemplate().get_template(disk_controller='nvme') rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'other4xLinux64Guest', 'firmware': 'bios', 'secure_boot': 'false', 'number_of_cpus': 2, 'memory_size': 4096, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) # Verify nvme mapping assert 'parent: nvme0' in rendered def test_get_template_with_e1000_nic_driver(self): """Test template generation with e1000 network driver""" template = OvaComposeTemplate().get_template( network_setup={ '0': { 'driver': 'e1000', 'connection_type': 'bridged', 'mac': 'generated', } } ) rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'other4xLinux64Guest', 'firmware': 'bios', 'secure_boot': 'false', 'number_of_cpus': 2, 'memory_size': 4096, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) # Verify e1000 driver assert 'subtype: e1000' in rendered def test_get_template_with_multiple_configurations(self): """Test template generation with both custom disk and nic config""" template = OvaComposeTemplate().get_template( disk_controller='lsilogic', memory_setup=True, cpu_setup=True, network_setup={ '0': { 'driver': 'e1000', 'connection_type': 'bridged', 'mac': 'generated', } }, ) rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'suse-64', 'firmware': 'efi', 'secure_boot': 'true', 'number_of_cpus': 4, 'memory_size': 8192, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) # Verify both configurations are applied assert 'parent: scsi0' in rendered assert 'subtype: e1000' in rendered assert 'cpus: 4' in rendered assert 'memory: 8192' in rendered assert 'os_vmw: "suse-64"' in rendered def test_get_template_controller_mapping(self): """Test all supported disk controller mappings""" controller_mappings = { 'ide': 'ide0', 'sata': 'sata0', 'scsi': 'scsi0', 'lsilogic': 'scsi0', 'buslogic': 'scsi0', 'nvme': 'nvme0', 'paravirtual': 'scsi0', 'pvscsi': 'scsi0', } for controller, expected_parent in controller_mappings.items(): template = OvaComposeTemplate().get_template( disk_controller=controller ) rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'other4xLinux64Guest', 'firmware': 'bios', 'secure_boot': 'false', 'number_of_cpus': 2, 'memory_size': 4096, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) assert ( f'parent: {expected_parent}' in rendered ), f"Controller '{controller}' should map to '{expected_parent}'" def test_get_template_controller_subtype_mapping(self): """Test SCSI controller names map to open-vmdk subtypes""" controller_subtypes = { 'scsi': 'VirtualSCSI', 'paravirtual': 'VirtualSCSI', 'pvscsi': 'VirtualSCSI', 'lsilogic': 'lsilogic', 'buslogic': 'buslogic', } for controller, expected_subtype in controller_subtypes.items(): template = OvaComposeTemplate().get_template( disk_controller=controller ) rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'other4xLinux64Guest', 'firmware': 'bios', 'secure_boot': 'false', 'number_of_cpus': 2, 'memory_size': 4096, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) assert ( f'type: scsi_controller\n subtype: {expected_subtype}\n' in rendered ), f"Controller '{controller}' should set subtype '{expected_subtype}'" def test_get_template_no_subtype_for_non_scsi_controllers(self): """Test that non SCSI controllers are rendered without subtype""" for controller in ('ide', 'sata', 'nvme'): template = OvaComposeTemplate().get_template( disk_controller=controller ) rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'other4xLinux64Guest', 'firmware': 'bios', 'secure_boot': 'false', 'number_of_cpus': 2, 'memory_size': 4096, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) assert f'type: {controller}_controller\n' in rendered assert f'subtype: {controller}' not in rendered def test_get_template_no_controller_defaults_to_nvme(self): """Test that no disk controller defaults to nvme0""" template = OvaComposeTemplate().get_template(disk_controller=None) rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'other4xLinux64Guest', 'firmware': 'bios', 'secure_boot': 'false', 'number_of_cpus': 2, 'memory_size': 4096, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) assert 'parent: nvme0' in rendered assert 'type: nvme_controller' in rendered def test_get_template_unsupported_controller_raises(self): """Test that controllers open-vmdk can't express are rejected""" for controller in ('lsisas1068', 'legacyESX', 'unknown_controller'): with raises(KiwiTemplateError) as issue: OvaComposeTemplate().get_template(disk_controller=controller) assert f'Controller "{controller}" is not supported' in str( issue.value ) def test_get_template_with_iso_controller_subtype(self): """Test that ISO controller subtype is rendered""" template = OvaComposeTemplate().get_template( iso_setup=True, iso_controller='lsilogic' ) rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'other4xLinux64Guest', 'firmware': 'bios', 'secure_boot': 'false', 'number_of_cpus': 2, 'memory_size': 4096, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) assert 'cdrom0:' in rendered assert 'parent: scsi0' in rendered assert 'subtype: lsilogic' in rendered def test_get_template_with_duplicate_controllers(self): """Test that duplicate controllers are deduplicated""" # Both disk and ISO use IDE controller - should only appear once template = OvaComposeTemplate().get_template( disk_controller='ide', iso_setup=True, iso_controller='ide' ) rendered = template.substitute( { 'display_name': 'test-vm', 'guest_os': 'other4xLinux64Guest', 'firmware': 'bios', 'secure_boot': 'false', 'number_of_cpus': 2, 'memory_size': 4096, 'vmdk_file': 'test.vmdk', 'virtual_hardware_version': '9', } ) # Count ide0 controller definitions - should appear only once ide_count = rendered.count('ide0:') assert ( ide_count == 1 ), f"IDE0 controller should appear exactly once, but appears {ide_count} times" ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/template/vagrant_config_test.py0000644000000000000000000000221315273675667023340 0ustar00from kiwi.storage.subformat.template.vagrant_config import VagrantConfigTemplate from textwrap import dedent class TestVagrantConfigTemplate: def setup(self): self.vagrant_config = VagrantConfigTemplate() def setup_method(self, cls): self.setup() def test_default_Vagrantfile(self): Vagrantfile = dedent( ''' Vagrant.configure("2") do |config| end ''' ).strip() assert self.vagrant_config.get_template() == Vagrantfile def test_customized_Vagrantfile(self): Vagrantfile = dedent( ''' Vagrant.configure("2") do |config| config.vm.hostname = "no-dead-beef" config.vm.provider :special do |special| special.secret_settings = "please_work" end end ''' ).strip() extra_settings = dedent( ''' config.vm.hostname = "no-dead-beef" config.vm.provider :special do |special| special.secret_settings = "please_work" end ''' ).strip() assert self.vagrant_config.get_template(extra_settings) == Vagrantfile ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/template/virtualbox_ovf_test.py0000644000000000000000000000230015273675667023417 0ustar00from lxml import objectify from kiwi.storage.subformat.template.virtualbox_ovf import VirtualboxOvfTemplate class TestVirtualboxOvfTemplate: def setup(self): self.ovf_template = VirtualboxOvfTemplate() def setup_method(self, cls): self.setup() def test_ovf_parameters(self): args = { 'vm_name': 'jumper', 'root_uuid': 'uuid', 'vm_description': 'Leap 15 image', 'disk_image_capacity': 21, } ovf_file = self.ovf_template.get_template().substitute(args) ovf = objectify.fromstring(ovf_file) for attr, value in ovf.DiskSection.Disk.items(): if 'capacity' in attr: assert value == str(args['disk_image_capacity']) vm_name_attr, vm_name_value = ovf.VirtualSystem.items()[0] assert 'id' in vm_name_attr and vm_name_value == args['vm_name'] cimos_id_attr, cimos_id_value = ( ovf.VirtualSystem.OperatingSystemSection.items()[0] ) assert 'id' in cimos_id_attr and int(cimos_id_value) == 101 assert ( ovf.VirtualSystem.OperatingSystemSection.Description == args['vm_description'] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/template/vmware_settings_test.py0000644000000000000000000000454015273675667023577 0ustar00from kiwi.storage.subformat.template.vmware_settings import ( VmwareSettingsTemplate, ) class TestVmwareSettingsTempla: def setup(self): self.vmware = VmwareSettingsTemplate() def setup_method(self, cls): self.setup() def test_get_template_default(self): assert self.vmware.get_template().substitute( virtual_hardware_version='8', display_name='some-display-name', guest_os='suse', disk_id='0', vmdk_file='myimage.vmdk', ) def test_get_template_with_periphery(self): assert self.vmware.get_template( memory_setup=True, cpu_setup=True, iso_setup=True ).substitute( virtual_hardware_version='8', display_name='some-display-name', guest_os='suse', disk_id='0', vmdk_file='myimage.vmdk', memory_size='4096', number_of_cpus='2', iso_id='0', ) def test_get_template_scsi_disk(self): assert self.vmware.get_template(disk_controller='lsilogic').substitute( virtual_hardware_version='8', display_name='some-display-name', guest_os='suse', disk_id='0', scsi_controller_name='lsilogic', vmdk_file='myimage.vmdk', ) def test_get_template_scsi_iso(self): assert self.vmware.get_template( iso_setup=True, iso_controller='scsi' ).substitute( virtual_hardware_version='8', display_name='some-display-name', guest_os='suse', disk_id='0', vmdk_file='myimage.vmdk', iso_id='0', ) def test_get_template_custom_network(self): assert self.vmware.get_template( network_setup={ '0': { 'driver': 'foo', 'connection_type': 'link', 'mac': '98:90:96:a0:3c:58', }, '1': { 'driver': 'foo', 'connection_type': 'link', 'mac': 'generated', }, } ).substitute( virtual_hardware_version='8', display_name='some-display-name', guest_os='suse', disk_id='0', vmdk_file='myimage.vmdk', ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/vagrant_base_test.py0000644000000000000000000001346115273675667021201 0ustar00import io from pytest import raises from unittest.mock import call, patch, mock_open from unittest.mock import Mock, MagicMock import kiwi from kiwi.defaults import Defaults from kiwi.exceptions import KiwiFormatSetupError from kiwi.storage.subformat.vagrant_base import DiskFormatVagrantBase from textwrap import dedent class TestDiskFormatVagrantBase: def setup(self): Defaults.set_platform_name('x86_64') xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') xml_data.description_dir = './' self.xml_state = Mock() self.xml_state.xml_data = xml_data self.xml_state.get_image_version = Mock(return_value='1.2.3') self.vagrantconfig = Mock() self.vagrantconfig.get_embedded_vagrantfile = Mock(return_value=None) self.vagrantconfig.get_virtualsize = Mock(return_value=42) self.runtime_config = Mock() self.runtime_config.get_bundle_compression.return_value = False kiwi.storage.subformat.base.RuntimeConfig = Mock( return_value=self.runtime_config ) self.disk_format = DiskFormatVagrantBase( self.xml_state, 'root_dir', 'target_dir', {'vagrantconfig': self.vagrantconfig}, ) assert self.disk_format.image_format == '' assert self.disk_format.provider is None def setup_method(self, cls): self.setup() def test_create_box_img_not_implemented(self): with raises(NotImplementedError): self.disk_format.create_box_img('arbitrary') def test_post_init_missing_custom_arguments(self): with raises(KiwiFormatSetupError): self.disk_format.post_init(custom_args=None) def test_post_init_missing_vagrantconfig(self): with raises(KiwiFormatSetupError): self.disk_format.post_init({'vagrantconfig': None}) def test_create_image_format_missing_provider_setup(self): with raises(NotImplementedError): self.disk_format.create_image_format() def test_store_to_result_missing_provider_setup(self): with raises(NotImplementedError): self.disk_format.store_to_result(Mock()) @patch('kiwi.storage.subformat.vagrant_base.Command.run') @patch('kiwi.storage.subformat.vagrant_base.Temporary') @patch.object(DiskFormatVagrantBase, 'create_box_img') def test_create_image_format( self, mock_create_box_img, mock_Temporary, mock_command ): # select an example provider self.disk_format.image_format = 'vagrant.libvirt.box' self.disk_format.provider = 'libvirt' metadata_json = dedent( ''' { "provider": "libvirt" } ''' ).strip() expected_vagrantfile = dedent( ''' Vagrant.configure("2") do |config| end ''' ).strip() mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' with patch('builtins.open', create=True) as mock_file: mock_file.return_value = MagicMock(spec=io.IOBase) file_handle = mock_file.return_value.__enter__.return_value self.disk_format.create_image_format() assert mock_file.call_args_list == [ call('tmpdir/metadata.json', 'w'), call('tmpdir/Vagrantfile', 'w'), ] assert file_handle.write.call_args_list == [ call(metadata_json), call(expected_vagrantfile), ] mock_command.assert_called_once_with( [ 'tar', '-C', 'tmpdir', '-czf', 'target_dir/some-disk-image.x86_64-1.2.3.vagrant.libvirt.box', 'metadata.json', 'Vagrantfile', ] ) @patch('kiwi.storage.subformat.vagrant_base.Command.run') @patch('kiwi.storage.subformat.vagrant_base.Temporary') @patch.object(DiskFormatVagrantBase, 'create_box_img') def test_user_provided_vagrantfile( self, mock_create_box_img, mock_Temporary, mock_cmd_run ): # select an example provider self.disk_format.image_format = 'vagrant.virtualbox.box' self.disk_format.provider = 'virtualbox' # deterministic tempdir: mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' self.vagrantconfig.get_embedded_vagrantfile = Mock( return_value='example_Vagrantfile' ) expected_vagrantfile = r"it's something" with patch( 'builtins.open', mock_open(read_data=expected_vagrantfile) ) as mock_file: self.disk_format.create_image_format() file_handle = mock_file.return_value.__enter__.return_value assert mock_file.call_args_list == [ call('tmpdir/metadata.json', 'w'), call('tmpdir/Vagrantfile', 'w'), call('./example_Vagrantfile', 'r'), ] assert file_handle.write.call_args_list[1] == call( expected_vagrantfile ) def test_get_additional_vagrant_config_settings(self): assert self.disk_format.get_additional_vagrant_config_settings() == '' def test_get_additional_metadata(self): assert self.disk_format.get_additional_metadata() == {} def test_store_to_result(self): # select an example provider self.disk_format.image_format = 'vagrant.libvirt.box' result = Mock() self.disk_format.store_to_result(result) result.add.assert_called_once_with( compress=False, filename='target_dir/' 'some-disk-image.x86_64-1.2.3.vagrant.libvirt.box', key='disk_format_image', shasum=True, use_for_bundle=True, ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/vagrant_libvirt_test.py0000644000000000000000000000673415273675667021747 0ustar00from textwrap import dedent from unittest.mock import patch, Mock, call, mock_open import kiwi from kiwi.defaults import Defaults from kiwi.storage.subformat.vagrant_libvirt import DiskFormatVagrantLibVirt class TestDiskFormatVagrantLibVirt: def setup(self): Defaults.set_platform_name('x86_64') xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') self.xml_state = Mock() self.xml_state.xml_data = xml_data self.xml_state.get_image_version = Mock(return_value='1.2.3') self.vagrantconfig = Mock() self.vagrantconfig.get_embedded_vagrantfile = Mock(return_value=None) self.vagrantconfig.get_virtualsize = Mock(return_value=42) self.runtime_config = Mock() self.runtime_config.get_bundle_compression.return_value = False kiwi.storage.subformat.base.RuntimeConfig = Mock( return_value=self.runtime_config ) self.disk_format = DiskFormatVagrantLibVirt( self.xml_state, 'root_dir', 'target_dir', {'vagrantconfig': self.vagrantconfig}, ) assert self.disk_format.image_format == 'vagrant.libvirt.box' assert self.disk_format.provider == 'libvirt' def setup_method(self, cls): self.setup() @patch('kiwi.storage.subformat.vagrant_libvirt.Command.run') @patch('kiwi.storage.subformat.vagrant_libvirt.DiskFormatQcow2') def test_create_box_img(self, mock_qcow, mock_command): qcow = Mock() qcow.image_format = 'qcow2' mock_qcow.return_value = qcow assert self.disk_format.create_box_img('tmpdir') == ['tmpdir/box.img'] qcow.create_image_format.assert_called_once_with() mock_command.assert_called_once_with( [ 'mv', 'target_dir/some-disk-image.x86_64-1.2.3.qcow2', 'tmpdir/box.img', ] ) def test_get_additional_metadata(self): assert self.disk_format.get_additional_metadata() == { 'format': 'qcow2', 'virtual_size': 42, } def test_get_additional_vagrant_config_settings(self): assert ( self.disk_format.get_additional_vagrant_config_settings() == dedent( ''' config.vm.synced_folder ".", "/vagrant", type: "rsync" config.vm.provider :libvirt do |libvirt| libvirt.driver = "kvm" end ''' ).strip() ) @patch('kiwi.storage.subformat.vagrant_base.Command.run') @patch('kiwi.storage.subformat.vagrant_base.Temporary') @patch.object(DiskFormatVagrantLibVirt, 'create_box_img') def test_create_image_format( self, mock_create_box_img, mock_Temporary, mock_command ): mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' mock_create_box_img.return_value = ['arbitrary'] m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_format.create_image_format() assert m_open.return_value.write.call_args_list[1] == call( dedent( ''' Vagrant.configure("2") do |config| config.vm.synced_folder ".", "/vagrant", type: "rsync" config.vm.provider :libvirt do |libvirt| libvirt.driver = "kvm" end end ''' ).strip() ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/vagrant_virtualbox_test.py0000644000000000000000000001222215273675667022460 0ustar00from unittest.mock import call, patch, Mock, MagicMock, mock_open import kiwi from textwrap import dedent from collections import namedtuple from kiwi.storage.subformat.vagrant_virtualbox import ( DiskFormatVagrantVirtualBox, ) from kiwi.defaults import Defaults class TestDiskFormatVagrantVirtualBox: def setup(self): Defaults.set_platform_name('x86_64') with open("../data/vagrant_virtualbox.ovf", "r") as ovf_file: self.Leap_15_ovf = ovf_file.read(-1) xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') self.xml_state = Mock() self.xml_state.xml_data = xml_data self.xml_state.get_root_filesystem_uuid = Mock(return_value='some-uuid') self.xml_state.get_image_version = Mock(return_value='1.2.3') self.vagrantconfig = Mock() self.vagrantconfig.get_virtualsize = Mock(return_value=42) self.vagrantconfig.get_embedded_vagrantfile = Mock(return_value=None) self.runtime_config = Mock() self.runtime_config.get_bundle_compression.return_value = False kiwi.storage.subformat.base.RuntimeConfig = Mock( return_value=self.runtime_config ) self.disk_format = DiskFormatVagrantVirtualBox( self.xml_state, 'root_dir', 'target_dir', {'vagrantconfig': self.vagrantconfig}, ) def setup_method(self, cls): self.setup() @patch('kiwi.storage.subformat.vagrant_virtualbox.Command.run') @patch('kiwi.storage.subformat.vagrant_virtualbox.DiskFormatVmdk') def test_create_box_img(self, mock_vmdk, mock_command): vmdk = Mock() vmdk.image_format = 'vmdk' mock_vmdk.return_value = vmdk # override the box settings to match those from the extracted ovf file self.xml_state.xml_data.name = "OpenSUSE-Leap-15.0" self.xml_state.get_description_section = MagicMock() self.xml_state.get_description_section.return_value = namedtuple( 'description_type', ['author', 'contact', 'specification'] )( author="not relevant", contact="not relevant", specification="OpenSUSE Leap 15.0", ) m_open = mock_open() with patch('builtins.open', m_open, create=True): assert self.disk_format.create_box_img('tmpdir') == [ 'tmpdir/box.vmdk', 'tmpdir/box.ovf', ] vmdk.create_image_format.assert_called_once_with() mock_command.assert_called_once_with( [ 'mv', 'target_dir/some-disk-image.x86_64-1.2.3.vmdk', 'tmpdir/box.vmdk', ] ) m_open.assert_called_once_with('tmpdir/box.ovf', 'w') assert m_open.return_value.write.call_args_list[0] == call( self.Leap_15_ovf ) @patch('kiwi.storage.subformat.vagrant_virtualbox.random.randrange') def test_get_additional_vagrant_config_settings(self, mock_rand): self.xml_state.get_vagrant_config_virtualbox_guest_additions.return_value = ( None ) expected_res = dedent( ''' config.vm.base_mac = "00163E010101" config.vm.synced_folder ".", "/vagrant", type: "rsync" ''' ).strip() assert ( self.disk_format.get_additional_vagrant_config_settings() == expected_res ) @patch('kiwi.storage.subformat.vagrant_base.Command.run') @patch('kiwi.storage.subformat.vagrant_base.Temporary') @patch('kiwi.storage.subformat.vagrant_virtualbox.random.randrange') @patch.object(DiskFormatVagrantVirtualBox, 'create_box_img') def test_create_image_format_with_and_without_guest_additions( self, mock_create_box_img, mock_rand, mock_Temporary, mock_command ): mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' mock_create_box_img.return_value = ['arbitrary'] # without guest additions self.xml_state.get_vagrant_config_virtualbox_guest_additions.return_value = ( Defaults.get_vagrant_config_virtualbox_guest_additions() ) m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_format.create_image_format() vagrantfile = dedent( ''' Vagrant.configure("2") do |config| config.vm.base_mac = "00163E010101" config.vm.synced_folder ".", "/vagrant", type: "rsync" end ''' ).strip() assert m_open.return_value.write.call_args_list[1] == call(vagrantfile) # without guest additions self.xml_state.get_vagrant_config_virtualbox_guest_additions.return_value = ( True ) vagrantfile = dedent( ''' Vagrant.configure("2") do |config| config.vm.base_mac = "00163E010101" end ''' ).strip() m_open.reset_mock() with patch('builtins.open', m_open, create=True): self.disk_format.create_image_format() assert m_open.return_value.write.call_args_list[1] == call(vagrantfile) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/vdi_test.py0000644000000000000000000000300315273675667017316 0ustar00from unittest.mock import patch from unittest.mock import Mock import kiwi from kiwi.defaults import Defaults from kiwi.storage.subformat.vdi import DiskFormatVdi class TestDiskFormatVdi: def setup(self): Defaults.set_platform_name('x86_64') xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') self.xml_state = Mock() self.xml_state.xml_data = xml_data self.xml_state.get_image_version = Mock(return_value='1.2.3') self.runtime_config = Mock() self.runtime_config.get_bundle_compression.return_value = False kiwi.storage.subformat.base.RuntimeConfig = Mock( return_value=self.runtime_config ) self.disk_format = DiskFormatVdi( self.xml_state, 'root_dir', 'target_dir' ) def setup_method(self, cls): self.setup() def test_post_init(self): self.disk_format.post_init({'option': 'value'}) assert self.disk_format.options == ['-o', 'option=value'] @patch('kiwi.storage.subformat.vdi.Command.run') def test_create_image_format(self, mock_command): self.disk_format.create_image_format() mock_command.assert_called_once_with( [ 'qemu-img', 'convert', '-f', 'raw', 'target_dir/some-disk-image.x86_64-1.2.3.raw', '-O', 'vdi', 'target_dir/some-disk-image.x86_64-1.2.3.vdi', ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/vhd_test.py0000644000000000000000000000275215273675667017327 0ustar00from unittest.mock import patch, Mock import kiwi from kiwi.defaults import Defaults from kiwi.storage.subformat.vhd import DiskFormatVhd class TestDiskFormatVhd: def setup(self): Defaults.set_platform_name('x86_64') xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') self.xml_state = Mock() self.xml_state.xml_data = xml_data self.xml_state.get_image_version = Mock(return_value='1.2.3') self.runtime_config = Mock() self.runtime_config.get_bundle_compression.return_value = False kiwi.storage.subformat.base.RuntimeConfig = Mock( return_value=self.runtime_config ) self.disk_format = DiskFormatVhd( self.xml_state, 'root_dir', 'target_dir' ) def setup_method(self, cls): self.setup() def test_post_init(self): self.disk_format.post_init({'option': 'value'}) assert self.disk_format.options == ['-o', 'option=value'] @patch('kiwi.storage.subformat.vhd.Command.run') def test_create_image_format(self, mock_command): self.disk_format.create_image_format() mock_command.assert_called_once_with( [ 'qemu-img', 'convert', '-f', 'raw', 'target_dir/some-disk-image.x86_64-1.2.3.raw', '-O', 'vpc', 'target_dir/some-disk-image.x86_64-1.2.3.vhd', ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/vhdfixed_test.py0000644000000000000000000001030015273675667020333 0ustar00import sys from builtins import bytes from unittest.mock import call, patch, Mock, mock_open from pytest import raises import kiwi from kiwi.defaults import Defaults from kiwi.storage.subformat.vhdfixed import DiskFormatVhdFixed from kiwi.exceptions import KiwiVhdTagError class TestDiskFormatVhdFixed: def setup(self): Defaults.set_platform_name('x86_64') xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') self.xml_state = Mock() self.xml_state.xml_data = xml_data self.xml_state.get_image_version = Mock(return_value='1.2.3') self.xml_state.get_luks_credentials = Mock(return_value=None) self.runtime_config = Mock() self.runtime_config.get_bundle_compression.return_value = True kiwi.storage.subformat.base.RuntimeConfig = Mock( return_value=self.runtime_config ) self.disk_format = DiskFormatVhdFixed( self.xml_state, 'root_dir', 'target_dir', {'force_size': None} ) def setup_method(self, cls): self.setup() def test_post_init(self): self.disk_format.post_init({'option': 'value', '--tag': 'tag'}) assert self.disk_format.options == [ '-o', 'option=value', '-o', 'subformat=fixed', ] assert self.disk_format.tag == 'tag' @patch('kiwi.storage.subformat.vhdfixed.Command.run') def test_create_image_format_invalid_tag(self, mock_command): self.disk_format.tag = 'invalid' with raises(KiwiVhdTagError): self.disk_format.create_image_format() @patch('kiwi.storage.subformat.vhdfixed.Command.run') def test_create_image_format(self, mock_command): self.disk_format.tag = '12345678-1234-1234-1234-123456789999' m_open = mock_open(read_data='dev_zero_data') with patch('builtins.open', m_open, create=True): self.disk_format.create_image_format() mock_command.assert_called_once_with( [ 'qemu-img', 'convert', '-f', 'raw', 'target_dir/some-disk-image.x86_64-1.2.3.raw', '-O', 'vpc', '-o', 'force_size', '-o', 'subformat=fixed', 'target_dir/some-disk-image.x86_64-1.2.3.vhdfixed', ] ) assert m_open.call_args_list == [ call('target_dir/some-disk-image.x86_64-1.2.3.vhdfixed', 'r+b'), call('/dev/zero', 'rb'), call('target_dir/some-disk-image.x86_64-1.2.3.vhdfixed', 'r+b'), ] assert m_open.return_value.write.call_args_list[0] == call( 'dev_zero_data' ) if sys.byteorder == 'little': # on little endian machines assert m_open.return_value.write.call_args_list[1] == call( bytes(b'xV4\x124\x124\x12\x124\x124Vx\x99\x99') ) else: # on big endian machines assert m_open.return_value.write.call_args_list[1] == call( bytes(b'\x124Vx\x124\x124\x124\x124Vx\x99\x99') ) assert m_open.return_value.seek.call_args_list == [ call(65536, 0), call(0, 2), call(65536, 0), call(0, 2), ] def test_store_to_result_default(self): result = Mock() self.disk_format.store_to_result(result) result.add.assert_called_once_with( compress=True, filename='target_dir/some-disk-image.x86_64-1.2.3.vhdfixed', key='disk_format_image', shasum=True, use_for_bundle=True, ) def test_store_to_result_with_luks(self): result = Mock() self.xml_state.get_luks_credentials = Mock(return_value='foo') self.disk_format.store_to_result(result) result.add.assert_called_once_with( compress=False, filename='target_dir/some-disk-image.x86_64-1.2.3.vhdfixed', key='disk_format_image', shasum=True, use_for_bundle=True, ) self.xml_state.get_luks_credentials = Mock(return_value=None) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/vhdx_test.py0000644000000000000000000000320215273675667017506 0ustar00from unittest.mock import patch, Mock import kiwi from kiwi.defaults import Defaults from kiwi.storage.subformat.vhdx import DiskFormatVhdx class TestDiskFormatVhdx: def setup(self): Defaults.set_platform_name('x86_64') xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') self.xml_state = Mock() self.xml_state.xml_data = xml_data self.xml_state.get_image_version = Mock(return_value='1.2.3') self.runtime_config = Mock() self.runtime_config.get_bundle_compression.return_value = False kiwi.storage.subformat.base.RuntimeConfig = Mock( return_value=self.runtime_config ) self.disk_format = DiskFormatVhdx( self.xml_state, 'root_dir', 'target_dir' ) def setup_method(self, cls): self.setup() def test_post_init(self): self.disk_format.post_init({'option': 'value'}) assert self.disk_format.options == [ '-o', 'option=value', '-o', 'subformat=dynamic', ] @patch('kiwi.storage.subformat.vhdx.Command.run') def test_create_image_format(self, mock_command): self.disk_format.create_image_format() mock_command.assert_called_once_with( [ 'qemu-img', 'convert', '-f', 'raw', 'target_dir/some-disk-image.x86_64-1.2.3.raw', '-O', 'vhdx', '-o', 'subformat=dynamic', 'target_dir/some-disk-image.x86_64-1.2.3.vhdx', ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/storage/subformat/vmdk_test.py0000644000000000000000000001675015273675667017512 0ustar00import os from unittest.mock import patch, call, Mock, mock_open from pytest import raises import kiwi from kiwi.defaults import Defaults from kiwi.storage.subformat.vmdk import DiskFormatVmdk from kiwi.exceptions import KiwiTemplateError class TestDiskFormatVmdk: def setup(self): Defaults.set_platform_name('x86_64') self.context_manager_mock = Mock() self.file_mock = Mock() self.enter_mock = Mock() self.exit_mock = Mock() self.enter_mock.return_value = self.file_mock setattr(self.context_manager_mock, '__enter__', self.enter_mock) setattr(self.context_manager_mock, '__exit__', self.exit_mock) xml_data = Mock() xml_data.get_name = Mock(return_value='some-disk-image') xml_data.get_displayname = Mock(return_value=None) self.xml_state = Mock() self.xml_state.xml_data = xml_data self.xml_state.get_image_version = Mock(return_value='1.2.3') self.xml_state.get_build_type_vmconfig_entries = Mock( return_value=['custom entry 1', 'custom entry 2'] ) self.machine_setup = Mock() self.xml_state.get_build_type_machine_section = Mock( return_value=self.machine_setup ) self.machine_setup.get_HWversion = Mock(return_value='42') self.machine_setup.get_guestOS = Mock(return_value='suse') self.machine_setup.get_memory = Mock(return_value='4096') self.machine_setup.get_ncpus = Mock(return_value='2') self.iso_setup = Mock() self.xml_state.get_build_type_vmdvd_section = Mock( return_value=self.iso_setup ) self.xml_state.get_luks_credentials = Mock(return_value=None) self.iso_setup.get_controller = Mock(return_value='ide') self.iso_setup.get_id = Mock(return_value='0') self.network_setup = [Mock()] self.xml_state.get_build_type_vmnic_entries = Mock( return_value=self.network_setup ) self.network_setup[0].get_interface = Mock(return_value='0') self.network_setup[0].get_mac = Mock(return_value='98:90:96:a0:3c:58') self.network_setup[0].get_mode = Mock(return_value='bridged') self.network_setup[0].get_driver = Mock(return_value='e1000') self.disk_setup = Mock() self.xml_state.get_build_type_vmdisk_section = Mock( return_value=self.disk_setup ) self.disk_setup.get_controller = Mock(return_value='lsilogic') self.disk_setup.get_id = Mock(return_value='0') self.runtime_config = Mock() self.runtime_config.get_bundle_compression.return_value = True kiwi.storage.subformat.base.RuntimeConfig = Mock( return_value=self.runtime_config ) self.disk_format = DiskFormatVmdk( self.xml_state, 'root_dir', 'target_dir' ) def setup_method(self, cls): self.setup() def test_post_init(self): self.disk_format.post_init( {'option': 'value', 'adapter_type=pvscsi': None} ) assert self.disk_format.options == [ '-o', 'adapter_type=lsilogic', '-o', 'option=value', ] def test_store_to_result_default(self): result = Mock() self.disk_format.store_to_result(result) assert result.add.call_args_list == [ call( compress=True, filename='target_dir/some-disk-image.x86_64-1.2.3.vmdk', key='disk_format_image', shasum=True, use_for_bundle=True, ), call( compress=False, filename='target_dir/some-disk-image.x86_64-1.2.3.vmx', key='disk_format_machine_settings', shasum=False, use_for_bundle=True, ), ] def test_store_to_result_with_luks(self): result = Mock() self.xml_state.get_luks_credentials = Mock(return_value='foo') self.disk_format.store_to_result(result) assert result.add.call_args_list == [ call( compress=False, filename='target_dir/some-disk-image.x86_64-1.2.3.vmdk', key='disk_format_image', shasum=True, use_for_bundle=True, ), call( compress=False, filename='target_dir/some-disk-image.x86_64-1.2.3.vmx', key='disk_format_machine_settings', shasum=False, use_for_bundle=True, ), ] self.xml_state.get_luks_credentials = Mock(return_value=None) @patch('kiwi.storage.subformat.vmdk.VmwareSettingsTemplate.get_template') @patch('kiwi.storage.subformat.vmdk.Command.run') @patch('os.path.exists') def test_create_image_format_template_error( self, mock_exists, mock_command, mock_get_template ): template = Mock() mock_get_template.return_value = template template.substitute.side_effect = Exception with patch('builtins.open'): with raises(KiwiTemplateError): self.disk_format.create_image_format() @patch('kiwi.storage.subformat.vmdk.Command.run') @patch('os.path.exists') def test_create_image_format(self, mock_exists, mock_command): mock_open.return_value = self.context_manager_mock mock_exists.return_value = True m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_format.create_image_format() m_open.assert_called_once_with( 'target_dir/some-disk-image.x86_64-1.2.3.vmx', 'w' ) @patch('kiwi.storage.subformat.vmdk.Command.run') @patch('os.path.exists') def test_create_image_format_encoding_exists( self, mock_exists, mock_command ): mock_exists.return_value = True m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_format.create_image_format() m_open.assert_called_once_with( 'target_dir/some-disk-image.x86_64-1.2.3.vmx', 'w' ) assert m_open.return_value.write.call_args_list[2] == call( 'custom entry 2' + os.linesep ) @patch('kiwi.storage.subformat.vmdk.Command.run') @patch('os.path.exists') def test_create_image_format_paravirtual_scsi( self, mock_exists, mock_command ): mock_exists.return_value = True for controller in ('scsi', 'paravirtual', 'pvscsi'): self.disk_setup.get_controller.return_value = controller m_open = mock_open() with patch('builtins.open', m_open, create=True): self.disk_format.create_image_format() vmx_data = ''.join( write_call.args[0] for write_call in m_open.return_value.write.call_args_list ) assert 'scsi0.virtualDev = "pvscsi"' in vmx_data @patch('kiwi.storage.subformat.vmdk.Command.run') @patch('os.path.exists') def test_create_image_format_unsupported_controller( self, mock_exists, mock_command ): mock_exists.return_value = True for controller in ('sata', 'nvme'): self.disk_setup.get_controller.return_value = controller with raises(KiwiTemplateError) as issue: self.disk_format.create_image_format() assert f'Controller "{controller}" is not supported' in str( issue.value ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7694988 kiwi-11.1.8/test/unit/system/__init__.py0000644000000000000000000000000015273675667015104 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7698917 kiwi-11.1.8/test/unit/system/identifier_test.py0000644000000000000000000000273715273675667016551 0ustar00from unittest.mock import patch, mock_open from kiwi.system.identifier import SystemIdentifier class TestSystemIdentifier: @patch('random.seed') def setup(self, mock_random_seed): with patch.dict('os.environ', {'SOURCE_DATE_EPOCH': '123456'}): self.identifier = SystemIdentifier() mock_random_seed.assert_called_once_with(123456) @patch('random.seed') def setup_method(self, cls, mock_random_seed): self.setup() def test_get_id(self): assert self.identifier.get_id() is None @patch('random.randrange') def test_calculate_id(self, mock_rand): mock_rand.return_value = 15 assert self.identifier.calculate_id() is None assert self.identifier.get_id() == '0x0f0f0f0f' def test_write(self): self.identifier.image_id = 'some-id' m_open = mock_open() with patch('builtins.open', m_open, create=True): assert self.identifier.write('mbrid-file') is None m_open.assert_called_once_with('mbrid-file', 'w') m_open.return_value.write.assert_called_once_with('some-id\n') @patch('kiwi.storage.device_provider.DeviceProvider') def test_write_to_disk(self, mock_device_provider): self.identifier.image_id = '1' mock_device_provider.get_device.return_value('device') m_open = mock_open() with patch('builtins.open', m_open, create=True): assert self.identifier.write_to_disk(mock_device_provider) is None ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7698917 kiwi-11.1.8/test/unit/system/kernel_test.py0000644000000000000000000002413315273675667015701 0ustar00import unittest.mock as mock import os from unittest.mock import patch from pytest import raises from kiwi.system.kernel import Kernel from kiwi.exceptions import KiwiKernelLookupError class TestKernel: @patch('os.listdir') @patch('os.path.isdir') def setup(self, mock_path_isdir, mock_listdir): mock_path_isdir.return_value = True mock_listdir.return_value = ['1.2.3-default'] self.kernel = Kernel('root-dir') @patch('os.listdir') @patch('os.path.isdir') def setup_method(self, cls, mock_path_isdir, mock_listdir): self.setup() def test_get_kernel_raises_if_no_kernel_found(self): self.kernel.kernel_names = [] with raises(KiwiKernelLookupError): self.kernel.get_kernel(raise_on_not_found=True) def test_get_kernel_returns_none(self): self.kernel.kernel_names = [] assert self.kernel.get_kernel() is None @patch('os.path.exists') @patch('os.path.realpath') def test_get_kernel(self, mock_os_path_realpath, mock_os_path_exists): mock_os_path_exists.return_value = True kernel = self.kernel.get_kernel() assert kernel.filename == 'root-dir/boot/uImage-1.2.3-default' assert kernel.version == '1.2.3-default' assert kernel.name == os.path.basename( mock_os_path_realpath.return_value ) @patch('os.path.exists') def test_get_xen_hypervisor(self, mock_os): mock_os.return_value = True data = self.kernel.get_xen_hypervisor() assert data.filename == 'root-dir/boot/xen.gz' assert data.name == 'xen.gz' @patch('os.path.exists') def test_get_xen_hypervisor_not_found(self, mock_os): mock_os.return_value = False assert self.kernel.get_xen_hypervisor() is None @patch('kiwi.system.kernel.Kernel.get_kernel') @patch('kiwi.command.Command.run') def test_copy_kernel(self, mock_run, mock_get_kernel): result = mock.MagicMock() result.version = '42' result.filename = 'kernel' mock_get_kernel.return_value = result assert self.kernel.copy_kernel('target-dir') is None mock_run.assert_called_once_with( ['cp', 'kernel', 'target-dir/kernel-42.kernel'] ) @patch('kiwi.system.kernel.Kernel.get_kernel') @patch('kiwi.command.Command.run') def test_copy_kernel_of_flavor(self, mock_run, mock_get_kernel): result = mock.MagicMock() result.version = '42-rt' result.filename = 'kernel' mock_get_kernel.return_value = result self.kernel.copy_kernel('target-dir', flavor='rt') mock_get_kernel.assert_called_once_with(flavor='rt') mock_run.assert_called_once_with( ['cp', 'kernel', 'target-dir/kernel-42-rt.kernel'] ) @patch('kiwi.system.kernel.Kernel.get_xen_hypervisor') @patch('kiwi.command.Command.run') def test_copy_xen_hypervisor(self, mock_run, mock_get_xen): result = mock.MagicMock() result.name = 'xen.gz' result.filename = 'some/xen.gz' mock_get_xen.return_value = result assert self.kernel.copy_xen_hypervisor('target-dir') is None mock_run.assert_called_once_with( ['cp', 'some/xen.gz', 'target-dir/hypervisor-xen.gz'] ) class TestKernelSelection: """ Kernel lookup in a root tree with more than one kernel """ def _install(self, root_dir, version, image, modules_dir='lib/modules'): (root_dir / modules_dir / version).mkdir(parents=True, exist_ok=True) if image.startswith('boot/'): (root_dir / 'boot').mkdir(exist_ok=True) (root_dir / image).touch() elif image: (root_dir / modules_dir / version / image).touch() def test_version_key(self): versions = [ '6.10.1-1-default', '6.4.0-150600.23.7-default', '6.9.12-1-default', '6.4.0-150600.23.25-default', '5.14.21-150500.55.19-default', ] assert sorted(versions, key=Kernel.version_key) == [ '5.14.21-150500.55.19-default', '6.4.0-150600.23.7-default', '6.4.0-150600.23.25-default', '6.9.12-1-default', '6.10.1-1-default', ] def test_latest_version_wins_over_name_order(self, tmp_path): self._install( tmp_path, '6.9.12-1-default', 'boot/vmlinuz-6.9.12-1-default' ) self._install( tmp_path, '6.10.1-1-default', 'boot/vmlinuz-6.10.1-1-default' ) kernel = Kernel(str(tmp_path)) assert kernel.get_kernel_versions() == [ '6.10.1-1-default', '6.9.12-1-default', ] data = kernel.get_kernel() assert data.version == '6.10.1-1-default' assert data.filename == f'{tmp_path}/boot/vmlinuz-6.10.1-1-default' def test_latest_version_wins_over_image_name(self, tmp_path): # Image is looked up before vmlinuz, still the later kernel # is used self._install(tmp_path, '6.4.0-1-default', 'boot/Image-6.4.0-1-default') self._install( tmp_path, '6.4.0-2-default', 'boot/vmlinuz-6.4.0-2-default' ) assert Kernel(str(tmp_path)).get_kernel().version == '6.4.0-2-default' def test_modules_dir_without_kernel_is_skipped(self, tmp_path): # a later modules directory without a kernel image, e.g left # behind by a removed kernel, does not change the version self._install(tmp_path, '6.4.0-1-default', 'vmlinuz') self._install(tmp_path, '6.4.0-9-default', '') data = Kernel(str(tmp_path)).get_kernel() assert data.version == '6.4.0-1-default' assert ( data.filename == f'{tmp_path}/lib/modules/6.4.0-1-default/vmlinuz' ) def test_usrmerge_and_boot_in_root_path(self, tmp_path): # lib is a link to usr/lib, a version is listed once. The path # of the root tree does not affect the version root_dir = tmp_path / 'boot' / 'image-root' root_dir.mkdir(parents=True) self._install(root_dir, '6.4.0-1-default', 'vmlinuz', 'usr/lib/modules') self._install(root_dir, '6.4.0-2-default', 'vmlinuz', 'usr/lib/modules') (root_dir / 'lib').symlink_to('usr/lib') kernel = Kernel(str(root_dir)) assert kernel.get_kernel_versions() == [ '6.4.0-2-default', '6.4.0-1-default', ] assert kernel.get_kernel().version == '6.4.0-2-default' def test_is_flavor(self): assert Kernel.is_flavor('6.4.0-150600.23.25-default', 'default') assert Kernel.is_flavor('6.4.0-150600.23.25-64kb', '64kb') assert Kernel.is_flavor('6.1.0-21-rt-amd64', 'rt-amd64') assert Kernel.is_flavor('5.14.0-427.13.1.el9_4.x86_64+rt', 'rt') # a flavor which only ends another flavor does not match assert not Kernel.is_flavor('6.1.0-21-rt-amd64', 'amd64') assert not Kernel.is_flavor('6.4.0-150600.23.25-default', 'rt') assert not Kernel.is_flavor('6.4.0-150600.23.25-64kb', 'kb') assert not Kernel.is_flavor('6.9.4-200.fc40.x86_64', 'x86_64') # the flavor is no regular expression assert not Kernel.is_flavor('6.4.0-1-default', 'def.ult') # the flavor none matches the versions without flavor assert Kernel.is_flavor('7.2.15-100.fc43.x86_64', 'none') assert Kernel.is_flavor('6.10.1-arch1-1', 'none') assert not Kernel.is_flavor('7.2.15-100.fc43.x86_64+rt', 'none') assert not Kernel.is_flavor('6.4.0-150600.23.25-default', 'none') assert not Kernel.is_flavor('6.4.0-150600.23.25-64kb', 'none') def test_has_flavor(self): assert Kernel.has_flavor('6.4.0-150600.23.25-default') assert Kernel.has_flavor('6.4.0-150600.23.25-64kb') assert Kernel.has_flavor('6.1.0-21-rt-amd64') assert Kernel.has_flavor('5.14.0-427.13.1.el9_4.x86_64+rt') assert not Kernel.has_flavor('7.2.15-100.fc43.x86_64') assert not Kernel.has_flavor('5.14.0-427.13.1.el9_4.x86_64') assert not Kernel.has_flavor('6.10.1-arch1-1') assert not Kernel.has_flavor('6.10') def test_get_kernel_of_flavor_none(self, tmp_path): # Fedora kernel and kernel-rt packages, the kernel package # provides no flavor self._install( tmp_path, '7.2.15-100.fc43.x86_64', 'vmlinuz', ) self._install( tmp_path, '7.2.17-100.fc43.x86_64+rt', 'vmlinuz', ) kernel = Kernel(str(tmp_path)) assert kernel.get_kernel().version == '7.2.17-100.fc43.x86_64+rt' assert kernel.get_kernel(flavor='none').version == ( '7.2.15-100.fc43.x86_64' ) assert kernel.get_kernel(flavor='rt').version == ( '7.2.17-100.fc43.x86_64+rt' ) def test_get_kernel_of_flavor(self, tmp_path): # The latest kernel of a flavor is found, no matter if a # kernel of another flavor is later self._install(tmp_path, '6.4.0-3-rt', 'boot/vmlinuz-6.4.0-3-rt') self._install(tmp_path, '6.4.0-5-rt', 'boot/vmlinuz-6.4.0-5-rt') self._install( tmp_path, '6.4.0-9-default', 'boot/vmlinuz-6.4.0-9-default' ) kernel = Kernel(str(tmp_path)) assert kernel.get_kernel().version == '6.4.0-9-default' assert kernel.get_kernel(flavor='rt').version == '6.4.0-5-rt' assert kernel.get_kernel(flavor='default').filename == ( f'{tmp_path}/boot/vmlinuz-6.4.0-9-default' ) assert kernel.get_kernel(flavor='64kb') is None with raises(KiwiKernelLookupError) as issue: kernel.get_kernel(raise_on_not_found=True, flavor='64kb') assert 'No kernel of flavor 64kb found' in str(issue.value) def test_get_version_in_name(self, tmp_path): self._install(tmp_path, '6.1', 'vmlinuz') self._install(tmp_path, '6.10', 'vmlinuz') kernel = Kernel(str(tmp_path)) assert kernel.get_version_in_name('initramfs-6.10.img') == '6.10' assert kernel.get_version_in_name('initramfs-6.1.img') == '6.1' assert kernel.get_version_in_name('initramfs-5.0.img') is None ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7698917 kiwi-11.1.8/test/unit/system/mount_test.py0000644000000000000000000001523715273675667015570 0ustar00import os from unittest.mock import patch, MagicMock, Mock, call from pytest import fixture from kiwi.defaults import Defaults from kiwi.system.mount import ImageSystem from kiwi.storage.mapped_device import MappedDevice from kiwi.storage.disk import ptable_entry_type class TestImageSystem: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('os.path.exists') def setup(self, mock_os_path_exists): Defaults.set_platform_name('x86_64') mock_os_path_exists.return_value = True self.device_map = { 'root': MappedDevice('/dev/root-device', Mock()), 'readonly': MappedDevice('/dev/readonly-root-device', Mock()), 'boot': MappedDevice('/dev/boot-device', Mock()), 'efi': MappedDevice('/dev/efi-device', Mock()), 'var': MappedDevice('/dev/var-device', Mock()), } volume_manager = Mock() volume_manager.get_mountpoint.return_value = 'volume_manager_root' self.volume_manager = volume_manager self.partitions = { 'var': ptable_entry_type( mbsize=100, clone=1, partition_name='p.lxvar', partition_type='t.linux', partition_id=None, mountpoint='/var', filesystem='ext3', label='var', ) } self.image_system = ImageSystem( self.device_map, 'root_dir', self.volume_manager, self.partitions ) @patch('os.path.exists') def setup_method(self, cls, mock_os_path_exists): self.setup() def test_mountpoint(self): assert self.image_system.mountpoint() == '' @patch('kiwi.system.mount.MountManager') def test_mount_with_volumes(self, mock_MountManager): self.image_system.mount() root_mount_mountpoint = self.image_system.mountpoint() self.volume_manager.mount_volumes.assert_called_once_with() assert mock_MountManager.call_args_list == [ call( device='/dev/boot-device', mountpoint=os.path.join(root_mount_mountpoint, 'boot'), ), call( device='/dev/efi-device', mountpoint=os.path.join(root_mount_mountpoint, 'boot', 'efi'), ), call( device='/dev/var-device', mountpoint=os.path.join(root_mount_mountpoint, 'var'), ), call( device='root_dir/image', mountpoint=os.path.join(root_mount_mountpoint, 'image'), ), call( device='tmpfs', mountpoint=os.path.join(root_mount_mountpoint, 'tmp'), ), call( device='tmpfs', mountpoint=os.path.join(root_mount_mountpoint, 'var', 'tmp'), ), call( device='/proc', mountpoint=os.path.join(root_mount_mountpoint, 'proc'), ), call( device='/sys', mountpoint=os.path.join(root_mount_mountpoint, 'sys'), ), call( device='/dev', mountpoint=os.path.join(root_mount_mountpoint, 'dev'), ), ] @patch('kiwi.system.mount.MountManager') def test_mount(self, mock_MountManager): self.image_system.volume_manager = None self.image_system.mount() root_mount_mountpoint = self.image_system.mountpoint() assert mock_MountManager.call_args_list == [ call(device='/dev/readonly-root-device'), call( device='/dev/boot-device', mountpoint=os.path.join(root_mount_mountpoint, 'boot'), ), call( device='/dev/efi-device', mountpoint=os.path.join(root_mount_mountpoint, 'boot', 'efi'), ), call( device='/dev/var-device', mountpoint=os.path.join(root_mount_mountpoint, 'var'), ), call( device='root_dir/image', mountpoint=os.path.join(root_mount_mountpoint, 'image'), ), call( device='tmpfs', mountpoint=os.path.join(root_mount_mountpoint, 'tmp'), ), call( device='tmpfs', mountpoint=os.path.join(root_mount_mountpoint, 'var', 'tmp'), ), call( device='/proc', mountpoint=os.path.join(root_mount_mountpoint, 'proc'), ), call( device='/sys', mountpoint=os.path.join(root_mount_mountpoint, 'sys'), ), call( device='/dev', mountpoint=os.path.join(root_mount_mountpoint, 'dev'), ), ] # readonly root partition is mounted read-only assert mock_MountManager.return_value.mount.call_args_list[0] == call( options=['ro'] ) @patch('kiwi.system.mount.MountManager') def test_mount_without_readonly_partition(self, mock_MountManager): del self.device_map['readonly'] self.image_system.volume_manager = None self.image_system.mount() assert mock_MountManager.call_args_list[0] == call( device='/dev/root-device' ) assert mock_MountManager.return_value.mount.call_args_list[0] == call( options=[] ) @patch('kiwi.system.mount.MountManager') def test_mount_s390(self, mock_MountManager): self.image_system.arch = 's390x' self.image_system.mount() root_mount_mountpoint = self.image_system.mountpoint() assert mock_MountManager.call_args_list[0] == call( device='/dev/boot-device', mountpoint=os.path.join(root_mount_mountpoint, 'boot', 'zipl'), ) def test_umount(self): some_mount = MagicMock() some_mount.is_mounted.return_value = True self.image_system.mount_list.append(some_mount) self.image_system.umount() some_mount.umount.assert_called_once_with() @patch('os.path.exists') @patch('kiwi.system.mount.MountManager') def test_context_manager_exit(self, mock_MountManager, mock_os_path_exists): mount = MagicMock() mount.is_mounted.return_value = True mock_os_path_exists.return_value = True mock_MountManager.return_value = mount device_map = {'root': MappedDevice('/dev/root-device', Mock())} with ImageSystem(device_map, 'root_dir') as system: system.mount() mount.umount.assert_called() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7698917 kiwi-11.1.8/test/unit/system/prepare_test.py0000644000000000000000000005422215273675667016061 0ustar00import logging import os from pytest import raises, fixture from unittest.mock import patch, call, Mock, MagicMock, ANY from kiwi.exceptions import ( KiwiBootStrapPhaseFailed, KiwiSystemUpdateFailed, KiwiSystemInstallPackagesFailed, KiwiSystemDeletePackagesFailed, KiwiInstallPhaseFailed, KiwiPackagesDeletePhaseFailed, ) from kiwi.defaults import Defaults from kiwi.system.prepare import SystemPrepare from kiwi.xml_description import XMLDescription from kiwi.xml_state import XMLState class TestSystemPrepare: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.system.prepare.RootInit') @patch('kiwi.system.prepare.RootBind') @patch('kiwi.logger.Logger.get_logfile') def setup(self, mock_get_logfile, mock_root_bind, mock_root_init): Defaults.set_platform_name('x86_64') mock_get_logfile.return_value = None description = XMLDescription( description='../data/example_config.xml', derived_from='derived/description', ) self.description_dir = os.path.dirname(description.description_origin) self.xml = description.load() self.manager = MagicMock(return_value=MagicMock()) self.manager.package_requests = ['foo'] self.manager.collection_requests = ['foo'] self.manager.product_requests = ['foo'] root_init = MagicMock() mock_root_init.return_value = root_init root_bind = MagicMock() root_bind.root_dir = 'root_dir' mock_root_bind.return_value = root_bind self.state = XMLState(self.xml) self.system = SystemPrepare( xml_state=self.state, root_dir='root_dir', allow_existing=True ) mock_root_init.assert_called_once_with('root_dir', True) root_init.create.assert_called_once_with() mock_root_bind.assert_called_once_with(root_init) root_bind.setup_intermediate_config.assert_called_once_with() root_bind.mount_kernel_file_systems.assert_called_once_with(None) @patch('kiwi.system.prepare.RootInit') @patch('kiwi.system.prepare.RootBind') @patch('kiwi.logger.Logger.get_logfile') def setup_method( self, cls, mock_get_logfile, mock_root_bind, mock_root_init ): self.setup() @patch('kiwi.system.prepare.RootImport.new') @patch('kiwi.system.prepare.RootInit') @patch('kiwi.system.prepare.RootBind') @patch('kiwi.logger.Logger.get_logfile') def test_init_with_derived_from_image( self, mock_get_logfile, mock_root_bind, mock_root_init, mock_root_import ): mock_get_logfile.return_value = 'logfile' description = XMLDescription( description='../data/example_config.xml', derived_from='derived/description', ) xml = description.load() root_init = MagicMock() mock_root_init.return_value = root_init root_import = Mock() root_import.sync_data = Mock() mock_root_import.return_value = root_import root_bind = MagicMock() root_bind.root_dir = 'root_dir' mock_root_bind.return_value = root_bind state = XMLState( xml, profiles=['containerFlavour'], build_type='docker' ) uri = Mock() get_derived_from_image_uri = Mock(return_value=uri) state.get_derived_from_image_uri = get_derived_from_image_uri system = SystemPrepare( xml_state=state, root_dir='root_dir', ) mock_root_init.assert_called_once_with('root_dir', False) root_init.create.assert_called_once_with() mock_root_import.assert_called_once_with( 'root_dir', uri, state.build_type.get_image() ) root_import.sync_data.assert_called_once_with() mock_root_bind.assert_called_once_with(root_init) root_bind.setup_intermediate_config.assert_called_once_with() root_bind.mount_kernel_file_systems.assert_called_once_with(None) assert system.issue_message == '{headline}: {reason}' @patch('kiwi.system.prepare.RootImport.new') @patch('kiwi.system.prepare.RootInit') @patch('kiwi.system.prepare.RootBind') @patch('kiwi.logger.Logger.get_logfile') def test_init_with_derived_from_image_for_delta_root( self, mock_get_logfile, mock_root_bind, mock_root_init, mock_root_import ): mock_get_logfile.return_value = 'logfile' description = XMLDescription( description='../data/example_config.xml', derived_from='derived/description', ) xml = description.load() root_init = MagicMock() mock_root_init.return_value = root_init root_import = Mock() root_import.overlay_data = Mock() mock_root_import.return_value = root_import root_bind = MagicMock() root_bind.root_dir = 'root_dir' mock_root_bind.return_value = root_bind state = XMLState( xml, profiles=['containerFlavour'], build_type='docker' ) uri = Mock() get_derived_from_image_uri = Mock(return_value=uri) get_delta_root = Mock(return_value=True) state.get_derived_from_image_uri = get_derived_from_image_uri state.build_type.get_delta_root = get_delta_root system = SystemPrepare( xml_state=state, root_dir='root_dir', ) mock_root_init.assert_called_once_with('root_dir', False) root_init.create.assert_called_once_with() mock_root_import.assert_called_once_with( 'root_dir', uri, state.build_type.get_image() ) root_import.overlay_data.assert_called_once_with() mock_root_bind.assert_called_once_with(root_init) root_bind.setup_intermediate_config.assert_called_once_with() root_bind.mount_kernel_file_systems.assert_called_once_with(True) assert system.issue_message == '{headline}: {reason}' @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') def test_install_bootstrap_packages_raises(self, mock_poll): self.manager.get_error_details.return_value = 'error-details' mock_poll.side_effect = Exception('some_error') with raises(KiwiBootStrapPhaseFailed) as issue: self.system.install_bootstrap(self.manager) assert issue.value.message == self.system.issue_message.format( headline='Bootstrap package installation failed', reason='some_error: error-details', ) @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') @patch('kiwi.system.prepare.ArchiveTar') def test_install_bootstrap_archives_raises(self, mock_tar, mock_poll): mock_tar.side_effect = Exception with raises(KiwiBootStrapPhaseFailed): self.system.install_bootstrap(self.manager) @patch('kiwi.system.prepare.CommandProcess.poll') def test_update_system_raises(self, mock_poll): mock_poll.side_effect = Exception with raises(KiwiSystemUpdateFailed): self.system.update_system(self.manager) @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') def test_install_packages_raises(self, mock_poll): mock_poll.side_effect = Exception with raises(KiwiSystemInstallPackagesFailed): self.system.install_packages(self.manager, ['package']) @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') def test_install_system_packages_raises(self, mock_poll): mock_poll.side_effect = Exception with raises(KiwiInstallPhaseFailed): self.system.install_system(self.manager) @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') @patch('kiwi.system.prepare.ArchiveTar') def test_install_system_archives_raises(self, mock_tar, mock_poll): mock_tar.side_effect = KiwiInstallPhaseFailed with raises(KiwiInstallPhaseFailed): self.system.install_system(self.manager) @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') def test_delete_packages_raises(self, mock_poll): mock_poll.side_effect = Exception with raises(KiwiSystemDeletePackagesFailed): self.system.delete_packages(self.manager, ['package']) @patch('kiwi.system.prepare.Repository.new') @patch('kiwi.system.prepare.Uri') @patch('kiwi.system.prepare.PackageManager') @patch('kiwi.xml_state.XMLState.get_package_manager') @patch('os.path.exists') def test_setup_repositories( self, mock_exists, mock_package_manager, mock_manager, mock_uri, mock_repo, ): mock_exists.return_value = True mock_package_manager.return_value = 'package-manager-name' uri = Mock() mock_uri.return_value = uri self.system.root_bind = Mock() uri.is_remote = Mock(return_value=False) uri.translate = Mock(return_value='uri') uri.alias = Mock(return_value='uri-alias') uri.credentials_file_name = Mock(return_value='credentials-file') repo = Mock() mock_repo.return_value.__enter__.return_value = repo self.system.setup_repositories( clear_cache=True, signing_keys=['key-file-a.asc', 'key-file-b.asc'], target_arch='x86_64', ) mock_repo.assert_called_once_with( self.system.root_bind, 'package-manager-name', [ 'check_signatures', 'exclude_docs', '_install_langs%POSIX:C:C.UTF-8:en_US:de_DE', '_target_arch%x86_64', ], ) # mock local repos will be translated and bind mounted assert uri.translate.call_args_list == [call(), call()] assert self.system.root_bind.mount_shared_directory.call_args_list == [ call('uri'), call('uri'), ] assert uri.alias.call_args_list == [call(), call()] assert repo.add_repo.call_args_list == [ call( 'uri-alias', 'uri', None, 42, None, None, None, None, 'credentials-file', None, None, 'baseurl', None, None, ), call( 'uri-alias', 'uri', 'rpm-md', None, None, None, None, None, 'credentials-file', None, None, None, '../data/script', None, ), ] assert repo.delete_repo_cache.call_args_list == [ call('uri-alias'), call('uri-alias'), ] repo.setup_package_database_configuration.assert_called_once_with() repo.import_trusted_keys.assert_called_once_with( ['key-file-a.asc', 'key-file-b.asc'] ) @patch('kiwi.system.prepare.Repository.new') @patch('kiwi.system.prepare.Uri') @patch('kiwi.system.prepare.PackageManager') @patch('kiwi.xml_state.XMLState.get_package_manager') @patch('os.path.exists') def test_setup_repositories_local_not_existing( self, mock_exists, mock_package_manager, mock_manager, mock_uri, mock_repo, ): mock_exists.return_value = False mock_package_manager.return_value = 'package-manager-name' uri = Mock() mock_uri.return_value = uri self.system.root_bind = Mock() uri.is_remote = Mock(return_value=False) uri.translate = Mock(return_value='uri') uri.alias = Mock(return_value='uri-alias') repo = Mock() mock_repo.return_value.__enter__.return_value = repo with self._caplog.at_level(logging.WARNING): self.system.setup_repositories() @patch('kiwi.xml_state.XMLState.get_bootstrap_collection_type') @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') @patch('kiwi.system.prepare.ArchiveTar') @patch('os.path.exists') def test_install_bootstrap( self, mock_exists, mock_tar, mock_poll, mock_collection_type ): mock_exists.return_value = True tar = Mock() tar.extract = Mock() mock_tar.return_value = tar mock_collection_type.return_value = 'onlyRequired' self.system.install_bootstrap(self.manager) self.manager.process_only_required.assert_called_once_with() self.manager.request_package.assert_any_call('filesystem') self.manager.request_package.assert_any_call('zypper') self.manager.request_collection.assert_called_once_with( 'bootstrap-collection' ) self.manager.request_product.assert_called_once_with('kiwi') self.manager.setup_repository_modules.assert_called_once_with( {'disable': ['mod_c'], 'enable': ['mod_a:stream', 'mod_b']} ) self.manager.process_install_requests_bootstrap.assert_called_once_with( self.system.root_bind, None ) mock_tar.assert_called_once_with( '{0}/bootstrap.tgz'.format(self.description_dir) ) tar.extract.assert_called_once_with('root_dir') self.manager.post_process_install_requests_bootstrap.assert_called_once_with( self.system.root_bind, None ) @patch('kiwi.system.prepare.RootInit') @patch('kiwi.system.prepare.RootBind') @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') @patch('kiwi.system.prepare.ArchiveTar') def test_install_bootstrap_archive_target_dir( self, mock_tar, mock_poll, mock_root_bind, mock_root_init ): Defaults.set_platform_name('x86_64') description = XMLDescription( description='../data/example_config_target_dir.xml' ) self.xml = description.load() root_bind = MagicMock() root_bind.root_dir = 'root_dir' mock_root_bind.return_value = root_bind self.state = XMLState(self.xml) self.system = SystemPrepare( xml_state=self.state, root_dir='root_dir', allow_existing=True ) tar = Mock() mock_tar.return_value = tar self.system.install_bootstrap(self.manager) assert tar.extract.call_args_list == [ call('root_dir/foo'), call('root_dir/etc'), ] @patch('kiwi.xml_state.XMLState.get_bootstrap_packages_sections') def test_install_bootstrap_skipped(self, mock_bootstrap_section): mock_bootstrap_section.return_value = [] self.system.install_bootstrap(self.manager) with self._caplog.at_level(logging.WARNING): mock_bootstrap_section.assert_called_once_with() @patch('kiwi.xml_state.XMLState.get_bootstrap_collection_type') @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') @patch('kiwi.system.prepare.ArchiveTar') @patch('os.path.exists') def test_install_bootstrap_archive_from_derived_description( self, mock_exists, mock_tar, mock_poll, mock_collection_type ): mock_exists.return_value = False self.system.install_bootstrap(self.manager) mock_tar.assert_called_once_with('derived/description/bootstrap.tgz') @patch('kiwi.xml_state.XMLState.get_system_collection_type') @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') @patch('kiwi.system.prepare.ArchiveTar') @patch('os.path.exists') def test_install_system( self, mock_exists, mock_tar, mock_poll, mock_collection_type ): mock_exists.return_value = True tar = Mock() tar.extract = Mock() mock_tar.return_value = tar mock_collection_type.return_value = 'onlyRequired' self.system.install_system(self.manager) self.manager.process_only_required.assert_called_once_with() self.manager.request_package.assert_any_call( 'plymouth-branding-openSUSE' ) self.manager.request_collection.assert_any_call('base') self.manager.request_product.assert_any_call('openSUSE') self.manager.request_package_exclusion.assert_any_call('foo') self.manager.process_install_requests.assert_called_once_with() mock_tar.assert_called_once_with('/absolute/path/to/image.tgz') tar.extract.assert_called_once_with('root_dir') @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') def test_install_packages(self, mock_poll): self.system.install_packages(self.manager, ['foo']) self.manager.request_package.assert_called_once_with('foo') @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') def test_delete_packages(self, mock_poll): self.system.delete_packages(self.manager, ['foo']) self.manager.request_package.assert_called_once_with('foo') @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') def test_pinch_system(self, mock_poll): self.system.pinch_system(self.manager, force=False) self.system.pinch_system(self.manager, force=True) self.manager.process_delete_requests.assert_has_calls( [call(False), call(True)] ) self.manager.post_process_delete_requests.assert_has_calls( [call(self.system.root_bind), call(self.system.root_bind)] ) @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') @patch('kiwi.system.prepare.Command.run') def test_pinch_system_in_delta_root_mode(self, mock_Command_run, mock_poll): self.system.delta_root = True self.system.pinch_system(self.manager) mock_Command_run.assert_called_once_with( ['rsync', '-a', 'root_dir_cow/', 'root_dir_cow_before_pinch'] ) @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') def test_pinch_system_raises(self, mock_poll): mock_poll.side_effect = Exception with raises(KiwiPackagesDeletePhaseFailed): self.system.pinch_system(self.manager) self.manager.process_delete_requests.assert_called_once_with(False) @patch( 'kiwi.package_manager.zypper.PackageManagerZypper.process_delete_requests' ) @patch('kiwi.system.prepare.Repository.new') @patch('kiwi.system.prepare.CommandProcess.poll_show_progress') def test_pinch_system_without_manager( self, mock_poll, mock_repo, mock_requests ): self.system.pinch_system() mock_repo.assert_called_once_with(ANY, 'zypper') mock_requests.assert_called_once_with(False) @patch('kiwi.system.prepare.CommandProcess.poll') def test_update_system(self, mock_poll): self.system.update_system(self.manager) self.manager.update.assert_called_once_with() @patch('kiwi.system.prepare.RootBind') @patch('kiwi.system.prepare.RootInit') @patch('kiwi.logger.Logger.get_logfile') def test_context_manager_exit( self, mock_get_logfile, mock_RootInit, mock_RootBind ): root_bind = Mock() mock_RootBind.return_value = root_bind root_import = Mock() with SystemPrepare( xml_state=self.state, root_dir='root_dir', allow_existing=True ) as system: system.root_import = root_import root_bind.cleanup.assert_called_once_with() root_import.overlay_finalize.assert_called_once_with(self.state) @patch('kiwi.system.prepare.Repository.new') @patch('kiwi.system.prepare.PackageManager.new') def test_clean_package_manager_leftovers(self, mock_manager, mock_repo): manager = Mock() mock_manager.return_value.__enter__.return_value = manager self.system.clean_package_manager_leftovers() manager.clean_leftovers.assert_called_once_with() @patch('kiwi.system.prepare.Path') @patch('os.path.isdir', return_value=True) @patch('os.path.exists', return_value=True) def test_setup_ca_certificates_name_exists_but_is_dir( self, mock_os_path_exists, mock_os_path_isdir, mock_Path ): with self._caplog.at_level(logging.WARNING): self.system.setup_ca_certificates() assert ( '/some/ca/filename: does not exist or is directory' in self._caplog.text ) def test_setup_ca_certificates_no_update_info(self): self.state.get_certificates_target_distribution = Mock( return_value=None ) with self._caplog.at_level(logging.WARNING): self.system.setup_ca_certificates() assert ( 'Could not determine CA update tool, skipping setup' in self._caplog.text ) @patch('kiwi.system.prepare.Command.run') @patch('kiwi.system.prepare.DataSync') @patch('os.path.exists', return_value=True) @patch('kiwi.system.prepare.Path') @patch('os.path.isdir', return_value=False) def test_setup_ca_certificates_success( self, mock_os_path_isdir, mock_Path, mock_os_path_exists, mock_DataSync, mock_Command_run, ): self.state.get_certificates_target_distribution = Mock( return_value='suse' ) mock_DataSync_instance = Mock() mock_DataSync.return_value = mock_DataSync_instance self.system.setup_ca_certificates() ca_chroot_path = 'root_dir/etc/pki/trust/anchors' mock_Path.create.assert_called_once_with(ca_chroot_path) mock_DataSync.assert_called_once_with( '/some/ca/filename', ca_chroot_path ) mock_Command_run.assert_called_once_with( ['chroot', 'root_dir', 'update-ca-certificates'] ) @patch('kiwi.system.prepare.Command.run') @patch('kiwi.system.prepare.DataSync') @patch('os.path.exists', return_value=True) @patch('kiwi.system.prepare.Path') @patch('os.path.isdir', return_value=False) def test_setup_ca_certificates_raises( self, mock_os_path_isdir, mock_Path, mock_os_path_exists, mock_DataSync, mock_Command_run, ): self.state.get_certificates_target_distribution = Mock( return_value='suse' ) mock_DataSync.side_effect = Exception with raises(KiwiBootStrapPhaseFailed): self.system.setup_ca_certificates() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7698917 kiwi-11.1.8/test/unit/system/profile_test.py0000644000000000000000000001665215273675667016070 0ustar00# vim: set fileencoding=utf-8 from unittest.mock import patch from pytest import fixture import os from kiwi.system.profile import Profile from kiwi.xml_state import XMLState from kiwi.xml_description import XMLDescription class TestProfile: @fixture(autouse=True) def setup_profile_file(self, tmp_path): # each test writes its profile to a directory of its own, # tests running in parallel share the working directory self.profile_file = str(tmp_path / 'tmpfile.profile') def setup(self): description = XMLDescription('../data/example_dot_profile_config.xml') self.profile = Profile(XMLState(description.load())) live_description = XMLDescription( '../data/example_dot_profile_live_config.xml' ) self.live_profile = Profile(XMLState(live_description.load())) def setup_method(self, cls): self.setup() @patch('kiwi.path.Path.which') def test_create_live(self, mock_which): mock_which.side_effect = ['cp', 'bash'] self.live_profile.create(self.profile_file) os.remove(self.profile_file) assert self.live_profile.dot_profile == { 'kiwi_iname': 'LiveImage', 'kiwi_displayname': 'Live', 'kiwi_profiles': '', 'kiwi_delete': '', 'kiwi_type': 'iso', 'kiwi_compressed': None, 'kiwi_boot_timeout': None, 'kiwi_wwid_wait_timeout': None, 'kiwi_hybridpersistent': True, 'kiwi_hybridpersistent_filesystem': 'ext4', 'kiwi_initrd_system': 'dracut', 'kiwi_ramonly': None, 'kiwi_target_blocksize': '512', 'kiwi_target_removable': None, 'kiwi_cmdline': 'console=ttyS0', 'kiwi_firmware': 'bios', 'kiwi_bootloader': 'grub2', 'kiwi_bootloader_console': 'default:default', 'kiwi_btrfs_root_is_snapshot': None, 'kiwi_btrfs_root_is_snapper_snapshot': None, 'kiwi_gpt_hybrid_mbr': None, 'kiwi_devicepersistency': None, 'kiwi_installboot': None, 'kiwi_bootkernel': None, 'kiwi_fsmountoptions': None, 'kiwi_bootprofile': None, 'kiwi_vga': 'auto', 'kiwi_startsector': 2048, 'kiwi_luks_empty_passphrase': False, 'kiwi_live_volid': 'CDROM', 'kiwi_iversion': '1.1.0', 'kiwi_showlicense': None, 'kiwi_keytable': 'us.map.gz', 'kiwi_timezone': 'Europe/Berlin', 'kiwi_language': 'en_US', 'kiwi_strip_delete': '', 'kiwi_strip_tools': '', 'kiwi_strip_libs': '', 'kiwi_drivers': '', 'kiwi_rootpartuuid': None, 'kiwi_shasum_suffix': '.sha256', } @patch('kiwi.path.Path.which') def test_create_oem(self, mock_which): mock_which.side_effect = ['cp', 'bash'] self.profile.create(self.profile_file) os.remove(self.profile_file) assert self.profile.dot_profile == { 'kiwi_Volume_1': 'usr_lib|size:1024|usr/lib', 'kiwi_Volume_2': 'etc_volume|freespace:30|etc', 'kiwi_Volume_3': 'bin_volume|size:all|/usr/bin', 'kiwi_Volume_4': 'usr_bin|freespace:30|usr/bin', 'kiwi_Volume_5': 'LVSwap|size:128|', 'kiwi_Volume_Root': 'LVRoot|freespace:500|', 'kiwi_bootkernel': None, 'kiwi_bootloader': 'grub2', 'kiwi_bootprofile': None, 'kiwi_target_removable': None, 'kiwi_boot_timeout': None, 'kiwi_cmdline': 'splash', 'kiwi_compressed': None, 'kiwi_delete': '', 'kiwi_devicepersistency': None, 'kiwi_bootloader_console': 'default:default', 'kiwi_displayname': 'schäfer', 'kiwi_drivers': '', 'kiwi_firmware': 'efi', 'kiwi_fsmountoptions': None, 'kiwi_hybridpersistent_filesystem': None, 'kiwi_hybridpersistent': None, 'kiwi_iname': 'LimeJeOS-openSUSE-13.2', 'kiwi_installboot': None, 'kiwi_iversion': '1.13.2', 'kiwi_keytable': 'us.map.gz', 'kiwi_language': 'en_US', 'kiwi_loader_theme': 'openSUSE', 'kiwi_lvm': 'true', 'kiwi_lvmgroup': 'systemVG', 'kiwi_oembootwait': None, 'kiwi_oemramdisksize': None, 'kiwi_oemdevicefilter': None, 'kiwi_oemnicfilter': None, 'kiwi_oemkboot': None, 'kiwi_oemmultipath_scan': None, 'kiwi_oempartition_install': None, 'kiwi_oemrebootinteractive': None, 'kiwi_oemreboot': None, 'kiwi_oemrecoveryID': None, 'kiwi_oemrecoveryInPlace': None, 'kiwi_oemrecovery': False, 'kiwi_oemrecoveryPartSize': None, 'kiwi_oemrootMB': 2048, 'kiwi_oemshutdowninteractive': None, 'kiwi_oemresizeonce': None, 'kiwi_oemshutdown': None, 'kiwi_oemsilentboot': None, 'kiwi_oemsilentinstall': None, 'kiwi_oemsilentverify': None, 'kiwi_oemskipverify': 'true', 'kiwi_oemswapMB': None, 'kiwi_oemtitle': 'schäfer', 'kiwi_oemunattended_id': None, 'kiwi_oemunattended': None, 'kiwi_oemvmcp_parmfile': None, 'kiwi_profiles': '', 'kiwi_ramonly': True, 'kiwi_initrd_system': 'dracut', 'kiwi_install_volid': 'INSTALL', 'kiwi_btrfs_root_is_snapshot': None, 'kiwi_btrfs_root_is_snapper_snapshot': None, 'kiwi_gpt_hybrid_mbr': None, 'kiwi_showlicense': None, 'kiwi_splash_theme': 'openSUSE', 'kiwi_strip_delete': '', 'kiwi_strip_libs': '', 'kiwi_strip_tools': '', 'kiwi_target_blocksize': '512', 'kiwi_timezone': 'Europe/Berlin', 'kiwi_type': 'oem', 'kiwi_vga': 'auto', 'kiwi_startsector': 2048, 'kiwi_luks_empty_passphrase': True, 'kiwi_wwid_wait_timeout': None, 'kiwi_xendomain': 'dom0', 'kiwi_rootpartuuid': None, 'kiwi_shasum_suffix': '.sha256', } @patch('kiwi.path.Path.which') def test_create_displayname_is_image_name(self, mock_which): mock_which.side_effect = ['cp', 'bash'] description = XMLDescription('../data/example_pxe_config.xml') profile = Profile(XMLState(description.load())) profile.create(self.profile_file) os.remove(self.profile_file) assert ( profile.dot_profile['kiwi_displayname'] == 'LimeJeOS-openSUSE-13.2' ) @patch('kiwi.path.Path.which') def test_create_cpio(self, mock_which): mock_which.side_effect = ['cp', 'bash'] description = XMLDescription('../data/example_dot_profile_config.xml') profile = Profile(XMLState(description.load(), None, 'cpio')) profile.create(self.profile_file) os.remove(self.profile_file) assert profile.dot_profile['kiwi_cpio_name'] == 'LimeJeOS-openSUSE-13.2' def test_add(self): self.profile.add('foo', 'bar') assert self.profile.dot_profile['foo'] == 'bar' def test_delete(self): self.profile.add('foo', 'bar') self.profile.delete('foo') assert 'foo' not in self.profile.dot_profile ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7698917 kiwi-11.1.8/test/unit/system/result_test.py0000644000000000000000000001025215273675667015734 0ustar00import logging from unittest.mock import patch, MagicMock, mock_open, call from pytest import raises, fixture from kiwi.system.result import Result from kiwi.exceptions import KiwiResultError class TestResult: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): self.xml_state = MagicMock() self.result = Result(self.xml_state) def setup_method(self, cls): self.setup() def test_add(self): assert self.result.add('foo', 'bar') is None result = self.result.get_results() assert isinstance(result, dict) assert result['foo'].filename == 'bar' assert result['foo'].use_for_bundle is True assert result['foo'].compress is False def test_print_results_no_data(self): assert self.result.print_results() is None assert not self._caplog.text def test_print_results_data_number_version(self): self.xml_state.get_image_version.return_value = '1.1.1' self.result.add('foo', 'bar') self.result.add_bundle_format('%N') with self._caplog.at_level(logging.INFO): self.result.print_results() def test_print_results_data_word_version(self): self.xml_state.get_image_version.return_value = 'test' self.result.add('foo', 'bar') self.result.add_bundle_format('%N') with self._caplog.at_level(logging.INFO): self.result.print_results() @patch('pickle.dump') @patch('simplejson.dumps') def test_dump(self, mock_simplejson_dumps, mock_pickle_dump): m_open = mock_open() with patch('builtins.open', m_open, create=True): assert self.result.dump('kiwi.result') is None assert m_open.call_args_list == [ call('kiwi.result', 'wb'), call('kiwi.result.json', 'w'), ] mock_pickle_dump.assert_called_once_with( self.result, m_open.return_value ) mock_simplejson_dumps.assert_called_once_with( self.result.result_files, sort_keys=True, indent=4 ) @patch('pickle.dump') def test_dump_failed(self, mock_pickle_dump): mock_pickle_dump.side_effect = Exception with patch('builtins.open'): with raises(KiwiResultError): self.result.dump('kiwi.result') @patch('pickle.load') @patch('os.path.exists') def test_load(self, mock_exists, mock_pickle_load): mock_exists.return_value = True m_open = mock_open() mock_pickle_load.return_value = Result with patch('builtins.open', m_open, create=True): assert Result.load('kiwi.result') is Result m_open.assert_called_once_with('kiwi.result', 'rb') mock_pickle_load.assert_called_once_with(m_open.return_value) @patch('os.path.exists') def test_load_result_not_present(self, mock_exists): mock_exists.return_value = False with raises(KiwiResultError): Result.load('kiwi.result') @patch('pickle.load') @patch('os.path.exists') def test_load_failed(self, mock_exists, mock_pickle_load): mock_exists.return_value = True mock_pickle_load.side_effect = Exception with raises(KiwiResultError): Result.load('kiwi.result') @patch('os.path.getsize') def test_build_constraint(self, mock_getsize): mock_getsize.return_value = 524288000 assert self.result.verify_image_size(524288000, 'foo') is None @patch('os.path.getsize') def test_build_constraint_failure(self, mock_getsize): mock_getsize.return_value = 524288000 with raises(KiwiResultError): self.result.verify_image_size(524287999, 'foo') def test_get_name_for_pattern(self): self.xml_state.get_image_version.return_value = '1.1.1' self.xml_state.xml_data.get_name.return_value = 'foo' self.xml_state.host_architecture = 'x86_64' self.xml_state.get_build_type_name.return_value = 'oem' self.result.add('foo', 'bar') self.result.add_bundle_format('%N_%I') assert ( self.result.get_name_for_pattern(command_args={'--id': '0'}) == 'foo_0' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7698917 kiwi-11.1.8/test/unit/system/root_bind_test.py0000644000000000000000000002647715273675667016415 0ustar00import sys import logging from unittest.mock import patch, call, Mock from pytest import raises, fixture from ..test_helper import argv_kiwi_tests from kiwi.system.root_bind import RootBind from kiwi.exceptions import ( KiwiMountKernelFileSystemsError, KiwiMountSharedDirectoryError, KiwiSetupIntermediateConfigError, ) class TestRootBind: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): root = Mock() root.root_dir = 'root-dir' self.bind_root = RootBind(root) # test expected real bind mount locations assert self.bind_root.bind_locations == [ '/proc', '/dev', '/var/run/dbus', '/sys', '/sys/fs/cgroup', ] # stub config files and bind locations self.bind_root.config_files = ['/etc/sysconfig/proxy'] self.bind_root.bind_locations = ['/proc'] # stub files/dirs and mountpoints to cleanup self.mount_manager = Mock() self.bind_root.cleanup_files = ['/etc/sysconfig/proxy.kiwi'] self.bind_root.mount_stack = [self.mount_manager] self.bind_root.dir_stack = ['/mountpoint'] self.runtime_config = Mock() self.shasum = self.runtime_config.get_checksum_handler.return_value self.bind_root.runtime_config = self.runtime_config def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() @patch('kiwi.mount_manager.Path.create') @patch('kiwi.system.root_bind.MountManager.bind_mount') @patch('kiwi.system.root_bind.RootBind.cleanup') @patch('os.path.exists') def test_kernel_file_systems_raises_error( self, mock_exists, mock_cleanup, mock_mount, mock_Path_create ): mock_exists.return_value = True mock_mount.side_effect = KiwiMountKernelFileSystemsError('mount-error') with raises(KiwiMountKernelFileSystemsError): self.bind_root.mount_kernel_file_systems() mock_cleanup.assert_called_once_with() @patch('kiwi.system.root_bind.MountManager.bind_mount') @patch('kiwi.system.root_bind.Path.create') @patch('kiwi.system.root_bind.RootBind.cleanup') def test_shared_directory_raises_error( self, mock_cleanup, mock_path, mock_mount ): mock_mount.side_effect = KiwiMountSharedDirectoryError('mount-error') with raises(KiwiMountSharedDirectoryError): self.bind_root.mount_shared_directory() mock_cleanup.assert_called_once_with() @patch('kiwi.command.Command.run') @patch('kiwi.system.root_bind.RootBind.cleanup') @patch('os.path.exists') def test_intermediate_config_raises_error( self, mock_exists, mock_cleanup, mock_command ): mock_exists.return_value = True mock_command.side_effect = KiwiSetupIntermediateConfigError( 'config-error' ) with raises(KiwiSetupIntermediateConfigError): self.bind_root.setup_intermediate_config() mock_cleanup.assert_called_once_with() @patch('kiwi.system.root_bind.os.path.exists') @patch('kiwi.system.root_bind.MountManager') def test_mount_kernel_file_systems(self, mock_mount, mock_exists): mock_exists.return_value = True shared_mount = Mock() mock_mount.return_value = shared_mount assert self.bind_root.mount_kernel_file_systems() is None assert mock_mount.call_args_list == [ call(device='root-dir', mountpoint='root-dir'), call(device='/proc', mountpoint='root-dir/proc'), ] assert shared_mount.bind_mount.call_args_list == [call(), call()] @patch('kiwi.system.root_bind.MountManager') def test_umount_kernel_file_systems(self, mock_mount): self.mount_manager.device = '/proc' self.mount_manager.is_mounted = Mock(return_value=True) assert self.bind_root.umount_kernel_file_systems() is None self.mount_manager.umount_lazy.assert_called_once_with() assert self.bind_root.mount_stack == [] @patch('kiwi.system.root_bind.MountManager') def test_umount_kernel_file_systems_raises_error(self, mock_mount): self.mount_manager.device = '/proc' self.mount_manager.is_mounted = Mock(return_value=True) self.mount_manager.umount_lazy = Mock(side_effect=Exception) assert self.bind_root.umount_kernel_file_systems() is None self.mount_manager.umount_lazy.assert_called_once_with() assert self.bind_root.mount_stack == [self.mount_manager] @patch('kiwi.system.root_bind.MountManager') @patch('kiwi.system.root_bind.Path.create') def test_mount_shared_directory(self, mock_path, mock_mount): shared_mount = Mock() mock_mount.return_value = shared_mount assert self.bind_root.mount_shared_directory() is None mock_path.call_args_list = [ call('root-dir/var/cache/kiwi'), call('/var/cache/kiwi'), ] mock_mount.assert_called_once_with( device='/var/cache/kiwi', mountpoint='root-dir/var/cache/kiwi' ) shared_mount.bind_mount.assert_called_once_with() @patch('kiwi.command.Command.run') @patch('kiwi.system.root_bind.Checksum') @patch('os.path.exists') def test_intermediate_config( self, mock_exists, mock_Checksum, mock_command ): checksum = Mock() mock_Checksum.return_value = checksum mock_exists.return_value = True with patch('builtins.open') as m_open: assert self.bind_root.setup_intermediate_config() is None m_open.assert_called_once_with( 'root-dir/etc/sysconfig/proxy.sha', 'w' ) assert mock_command.call_args_list == [ call( [ 'cp', '/etc/sysconfig/proxy', 'root-dir/etc/sysconfig/proxy.kiwi', ] ), call( ['ln', '-s', '-f', 'proxy.kiwi', 'root-dir/etc/sysconfig/proxy'] ), ] self.shasum.digest.assert_called_once_with() @patch('kiwi.command.Command.run') @patch('kiwi.system.root_bind.Path.create') def test_add_intermediate_config(self, mock_Path_create, mock_command): self.bind_root.config_files = [] self.bind_root.cleanup_files = [] with patch('builtins.open', create=True) as m_open: assert ( self.bind_root.add_intermediate_config( '/etc/sysconfig/proxy', 'PROXY_ENABLED="yes"' ) is None ) assert m_open.call_args_list == [ call('root-dir/etc/sysconfig/proxy.kiwi', 'w'), call('root-dir/etc/sysconfig/proxy.sha', 'w'), ] m_open.return_value.__enter__.return_value.write.assert_any_call( 'PROXY_ENABLED="yes"' ) mock_Path_create.assert_called_once_with('root-dir/etc/sysconfig') mock_command.assert_called_once_with( ['ln', '-s', '-f', 'proxy.kiwi', 'root-dir/etc/sysconfig/proxy'] ) self.runtime_config.get_checksum_handler.assert_called_once_with( source_filename='root-dir/etc/sysconfig/proxy.kiwi' ) assert self.bind_root.cleanup_files == ['/etc/sysconfig/proxy.kiwi'] assert self.bind_root.config_files == ['/etc/sysconfig/proxy'] @patch('kiwi.system.root_bind.Path.create') def test_add_intermediate_config_raises_error(self, mock_Path_create): mock_Path_create.side_effect = Exception with raises(KiwiSetupIntermediateConfigError): self.bind_root.add_intermediate_config( '/etc/sysconfig/proxy', 'PROXY_ENABLED="yes"' ) @patch('textwrap.dedent') @patch('kiwi.system.root_bind.Checksum') @patch('kiwi.system.root_bind.MountManager.is_mounted') @patch('kiwi.system.root_bind.Command.run') @patch('kiwi.system.root_bind.Path.remove_hierarchy') @patch('os.path.islink') @patch('os.path.exists') @patch('shutil.move') def test_cleanup( self, mock_move, mock_exists, mock_islink, mock_remove_hierarchy, mock_command, mock_is_mounted, mock_Checksum, mock_dedent, ): checksum = Mock() checksum.matches.return_value = False mock_Checksum.return_value = checksum os_exists_return_values = [False, True, True, False] def exists_side_effect(*args): return os_exists_return_values.pop() mock_is_mounted.return_value = False mock_exists.side_effect = exists_side_effect mock_islink.return_value = True with self._caplog.at_level(logging.WARNING): assert self.bind_root.cleanup() is None self.mount_manager.umount_lazy.assert_called_once_with() mock_remove_hierarchy.assert_called_once_with( root='root-dir', path='/mountpoint' ) assert mock_command.call_args_list == [ call(['rm', '-f', 'root-dir/etc/sysconfig/proxy']), call( [ 'cp', 'root-dir/usr/share/fillup-templates/sysconfig.proxy', 'root-dir/etc/sysconfig/proxy', ] ), call( [ 'rm', '-f', 'root-dir/etc/sysconfig/proxy.kiwi', 'root-dir/etc/sysconfig/proxy.sha', ] ), ] mock_move.assert_called_once_with( 'root-dir/etc/sysconfig/proxy.rpmnew', 'root-dir/etc/sysconfig/proxy', ) @patch('os.path.islink') @patch('kiwi.command.Command.run') @patch('kiwi.system.root_bind.Path.remove_hierarchy') @patch('kiwi.system.root_bind.Checksum') def test_cleanup_continue_on_error( self, mock_Checksum, mock_remove_hierarchy, mock_command, mock_islink ): mock_islink.return_value = True mock_remove_hierarchy.side_effect = Exception('rm') mock_command.side_effect = Exception self.mount_manager.umount_lazy.side_effect = Exception with self._caplog.at_level(logging.WARNING): self.bind_root.cleanup() assert ( 'Image root directory root-dir not cleanly umounted:' in self._caplog.text ) assert 'Failed to remove directory hierarchy ' 'root-dir/mountpoint: rm' in self._caplog.text assert ( 'Failed to cleanup intermediate config files' in self._caplog.text ) @patch('kiwi.command.Command.run') @patch('kiwi.system.root_bind.Path.remove_hierarchy') @patch('kiwi.system.root_bind.Checksum') def test_cleanup_nothing_mounted( self, mock_Checksum, mock_remove_hierarchy, mock_command ): self.mount_manager.is_mounted.return_value = False self.mount_manager.mountpoint = '/mountpoint' with self._caplog.at_level(logging.WARNING): assert self.bind_root.cleanup() is None assert 'Path /mountpoint not a mountpoint' in self._caplog.text ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7698917 kiwi-11.1.8/test/unit/system/root_import/__init__.py0000644000000000000000000000000015273675667017461 0ustar00././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.770255 kiwi-11.1.8/test/unit/system/root_import/base_test.py0000644000000000000000000001371215273675667017711 0ustar00import io import os from unittest.mock import patch, call, Mock, MagicMock from pytest import raises from kiwi.system.uri import Uri from kiwi.system.root_import.base import RootImportBase from kiwi.exceptions import KiwiRootImportError class TestRootImportBase: @patch('os.path.exists') @patch('kiwi.system.uri.Defaults.is_buildservice_worker') @patch('kiwi.system.uri.RuntimeConfig') def test_init(self, mock_RuntimeConfig, mock_buildservice, mock_path): mock_buildservice.return_value = False mock_path.return_value = True with patch.dict('os.environ', {'HOME': '../data'}): RootImportBase('root_dir', [Uri('file:///image.tar.xz')]) assert call('/image.tar.xz') in mock_path.call_args_list def test_init_remote_uri(self): with raises(KiwiRootImportError): RootImportBase('root_dir', [Uri('http://example.com/image.tar.xz')]) @patch('kiwi.system.root_import.base.log.warning') def test_init_unknown_uri(self, mock_log_warn): root = RootImportBase('root_dir', [Uri('docker://opensuse:leap')]) assert root.raw_urls == ['docker://opensuse:leap'] assert mock_log_warn.called @patch('os.path.exists') def test_init_non_existing(self, mock_path): mock_path.return_value = False with patch.dict('os.environ', {'HOME': '../data'}): with raises(KiwiRootImportError): RootImportBase('root_dir', [Uri('file:///image.tar.xz')]) @patch('os.path.exists') def test_data_sync(self, mock_path): mock_path.return_value = True with patch.dict('os.environ', {'HOME': '../data'}): root_import = RootImportBase( 'root_dir', [Uri('file:///image.tar.xz')] ) with raises(NotImplementedError): root_import.sync_data() @patch('os.path.exists') def test_overlay_data(self, mock_path): mock_path.return_value = True with patch.dict('os.environ', {'HOME': '../data'}): root_import = RootImportBase( 'root_dir', [Uri('docker://opensuse:leap')] ) with raises(NotImplementedError): root_import.overlay_data() @patch('os.path.exists') @patch('kiwi.system.uri.Defaults.is_buildservice_worker') @patch('kiwi.system.root_import.base.SystemSetup') @patch('kiwi.system.root_import.base.Path') @patch('kiwi.system.root_import.base.pathlib') @patch('kiwi.system.root_import.base.Command.run') @patch('kiwi.system.uri.RuntimeConfig') def test_overlay_finalize( self, mock_runtime_config, mock_Command_run, mock_pathlib, mock_Path, mock_SystemSetup, mock_buildservice, mock_path_exists, ): mock_path_exists.return_value = True mock_buildservice.return_value = False with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value xml_state = Mock() mock_Command_run.return_value.output = '/file_a\n/file_b' with patch.dict('os.environ', {'HOME': '../data'}): root = RootImportBase( 'root_dir', [Uri('docker://opensuse:leap')] ) root.overlay = Mock() mock_pathlib.Path = Mock() root_overlay_path_mock = Mock() mock_pathlib.Path.return_value = root_overlay_path_mock root.overlay_finalize(xml_state) # run config-overlay.sh mock_SystemSetup.return_value.call_config_overlay_script.assert_called_once_with() # run config-host-overlay.sh mock_SystemSetup.return_value.call_config_host_overlay_script.assert_called_once_with( working_directory='root_dir' ) # umount and create the new upper root.overlay.umount.assert_called_once_with() assert mock_Path.wipe.call_args_list == [ call('root_dir'), call('root_dir_cow_before_pinch'), call(root.overlay.lower), call(root.overlay.work), ] mock_pathlib.Path.assert_called_once_with(root.overlay.upper) root_overlay_path_mock.replace.assert_called_once_with( 'root_dir' ) # find files that got removed assert mock_Command_run.call_args_list == [ call( [ 'rsync', '-av', '--dry-run', '--out-format=%n', '--exclude', 'etc/hosts.kiwi', '--exclude', 'etc/hosts.sha', '--exclude', 'etc/resolv.conf.kiwi', '--exclude', 'etc/resolv.conf.sha', '--exclude', 'etc/sysconfig/proxy.kiwi', '--exclude', 'etc/sysconfig/proxy.sha', '--exclude', 'usr/lib/sysimage/rpm', 'root_dir_cow_before_pinch/', 'root_dir/', ] ), call(['find', 'root_dir', '-type', 'c', '-delete']), ] # create removed files metadata for later host provisioning assert file_handle.write.call_args_list == [ call('\n'), call('/file_a'), call(os.linesep), call('/file_b'), call(os.linesep), ] ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.770255 kiwi-11.1.8/test/unit/system/root_import/init_test.py0000644000000000000000000000200515273675667017733 0ustar00from unittest.mock import patch from pytest import raises from kiwi.system.root_import import RootImport from kiwi.exceptions import KiwiRootImportError class TestRootImport: @patch('kiwi.system.root_import.oci.RootImportOCI') def test_docker_import(self, mock_docker_import): RootImport.new('root_dir', 'file:///image.tar.xz', 'docker') mock_docker_import.assert_called_once_with( 'root_dir', 'file:///image.tar.xz', {'archive_transport': 'docker-archive'}, ) @patch('kiwi.system.root_import.oci.RootImportOCI') def test_oci_import(self, mock_oci_import): RootImport.new('root_dir', 'file:///image.tar.xz', 'oci') mock_oci_import.assert_called_once_with( 'root_dir', 'file:///image.tar.xz', {'archive_transport': 'oci-archive'}, ) def test_not_implemented_import(self): with raises(KiwiRootImportError): RootImport.new('root_dir', 'file:///image.tar.xz', 'foo') ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.770255 kiwi-11.1.8/test/unit/system/root_import/oci_test.py0000644000000000000000000001211115273675667017541 0ustar00import logging from unittest.mock import patch, Mock from pytest import raises, fixture from kiwi.system.uri import Uri from kiwi.system.root_import.oci import RootImportOCI from kiwi.exceptions import KiwiRootImportError class TestRootImportOCI: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('os.path.exists') def setup(self, mock_path): mock_path.return_value = True with patch.dict('os.environ', {'HOME': '../data'}): self.oci_import = RootImportOCI( 'root_dir', [Uri('file:///image.tar')], {'archive_transport': 'oci-archive'}, ) self.runtime_config = Mock() self.shasum = self.runtime_config.get_checksum_handler.return_value self.oci_import.runtime_config = self.runtime_config assert self.oci_import.image_files == ['/image.tar'] @patch('os.path.exists') def setup_method(self, cls, mock_path): self.setup() @patch('os.path.exists') def test_failed_init(self, mock_path): mock_path.return_value = False with raises(KiwiRootImportError): RootImportOCI( 'root_dir', [Uri('file:///image.tar.xz')], {'archive_transport': 'oci-archive'}, ) @patch('kiwi.system.root_import.oci.Compress') @patch('kiwi.system.root_import.oci.Path.create') @patch('kiwi.system.root_import.oci.OCI') def test_sync_data(self, mock_OCI, mock_path, mock_compress): oci = Mock() mock_OCI.new.return_value.__enter__.return_value = oci uncompress = Mock() uncompress.get_format = Mock(return_value=None) mock_compress.return_value = uncompress self.oci_import.sync_data() mock_OCI.new.assert_called_once_with() oci.unpack.assert_called_once_with() oci.import_rootfs.assert_called_once_with('root_dir') self.shasum.digest.assert_called_once_with() uncompress.get_format.assert_called_once_with() @patch('kiwi.system.root_import.oci.Compress') @patch('kiwi.system.root_import.oci.Path.create') @patch('kiwi.system.root_import.oci.pathlib.Path') @patch('kiwi.system.root_import.oci.MountManager') @patch('kiwi.system.root_import.oci.OCI') def test_overlay_data( self, mock_OCI, mock_MountManager, mock_Path, mock_path_create, mock_compress, ): oci = Mock() mock_OCI.new.return_value.__enter__.return_value = oci mock_pth = Mock() mock_Path.return_value = mock_pth self.oci_import.overlay_data() mock_OCI.new.assert_called_once_with() oci.import_container_image.assert_called_once_with( f'oci-archive:{mock_compress.return_value.uncompressed_filename}' ) oci.unpack.assert_called_once_with() oci.import_rootfs.assert_called_once_with('root_dir') mock_Path.assert_called_once_with('root_dir') mock_pth.replace.assert_called_once_with('root_dir_ro') mock_path_create.assert_called_once_with('root_dir') mock_MountManager.return_value.overlay_mount.assert_called_once_with( 'root_dir_ro' ) @patch('kiwi.system.root_import.oci.Compress') @patch('kiwi.system.root_import.oci.Path.create') @patch('kiwi.system.root_import.oci.OCI') def test_sync_data_compressed_image( self, mock_OCI, mock_path, mock_compress ): oci = Mock() mock_OCI.new.return_value.__enter__.return_value = oci uncompress = Mock() uncompress.get_format = Mock(return_value='xz') mock_compress.return_value = uncompress self.oci_import.sync_data() mock_OCI.new.assert_called_once_with() oci.unpack.assert_called_once_with() oci.import_rootfs.assert_called_once_with('root_dir') self.shasum.digest.assert_called_once_with() uncompress.get_format.assert_called_once_with() uncompress.uncompress.assert_called_once_with(True) @patch('os.path.exists') @patch('kiwi.system.root_import.oci.Path.create') @patch('kiwi.system.root_import.oci.OCI') def test_sync_data_unknown_uri(self, mock_OCI, mock_path, mock_exists): mock_exists.return_value = True oci = Mock() mock_OCI.new.return_value.__enter__.return_value = oci with patch.dict('os.environ', {'HOME': '../data'}): oci_import = RootImportOCI( 'root_dir', [Uri('docker:image:tag')], {'archive_transport': 'docker-archive'}, ) oci_import.runtime_config = self.runtime_config with self._caplog.at_level(logging.WARNING): oci_import.sync_data() mock_OCI.new.assert_called_once_with() oci.import_container_image.assert_called_once_with( 'docker:image:tag' ) oci.unpack.assert_called_once_with() oci.import_rootfs.assert_called_once_with('root_dir') self.shasum.digest.assert_called_once_with() ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.770255 kiwi-11.1.8/test/unit/system/root_init_test.py0000644000000000000000000001027415273675667016430 0ustar00import sys from unittest.mock import patch, call, Mock from pytest import raises from ..test_helper import argv_kiwi_tests from kiwi.system.root_init import RootInit from kiwi.exceptions import KiwiRootDirExists, KiwiRootInitCreationError class TestRootInit: @patch('os.path.exists') def test_init_raises_error(self, mock_path): mock_path.return_value = True with raises(KiwiRootDirExists): RootInit('root_dir') @patch('os.path.exists') @patch('os.makedirs') @patch('os.chown') @patch('os.symlink') @patch('os.chmod') @patch('kiwi.system.root_init.DataSync') @patch('kiwi.system.root_init.Temporary') @patch('kiwi.system.root_init.Path.create') def test_create_raises_error( self, mock_Path_create, mock_Temporary, mock_data_sync, mock_chmod, mock_symlink, mock_chwon, mock_makedirs, mock_path, ): mock_path.return_value = False mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' mock_data_sync.side_effect = Exception root = RootInit('root_dir') with raises(KiwiRootInitCreationError): root.create() mock_chmod.assert_called_once_with('root_dir', 0o755) @patch('os.path.exists') @patch('os.makedirs') @patch('os.chown') @patch('os.symlink') @patch('os.makedev') @patch('os.chmod') @patch('kiwi.path.Path.create') @patch('kiwi.system.root_init.copy') @patch('kiwi.system.root_init.DataSync') @patch('kiwi.system.root_init.Temporary') @patch('kiwi.system.root_init.Path.create') def test_create( self, mock_Path_create, mock_Temporary, mock_data_sync, mock_copy, mock_create, mock_chmod, mock_makedev, mock_symlink, mock_chwon, mock_makedirs, mock_path, ): data_sync = Mock() mock_data_sync.return_value = data_sync mock_makedev.return_value = 'makedev' mock_path_return = [ True, True, True, True, False, False, False, False, False, False, False, ] def path_exists(self): return mock_path_return.pop() mock_path.side_effect = path_exists mock_path.return_value = False mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' root = RootInit('root_dir', True) assert root.create() is None assert mock_makedirs.call_args_list == [ call('tmpdir/var/cache/kiwi'), call('tmpdir/dev/pts'), call('tmpdir/proc'), call('tmpdir/etc/sysconfig'), call('tmpdir/run'), call('tmpdir/sys'), call('tmpdir/var'), ] assert mock_chwon.call_args_list == [ call('tmpdir/var/cache/kiwi', 0, 0), call('tmpdir/dev/pts', 0, 0), call('tmpdir/proc', 0, 0), call('tmpdir/etc/sysconfig', 0, 0), call('tmpdir/run', 0, 0), call('tmpdir/sys', 0, 0), call('tmpdir/var', 0, 0), ] assert mock_symlink.call_args_list == [ call('/proc/self/fd', 'tmpdir/dev/fd'), call('fd/2', 'tmpdir/dev/stderr'), call('fd/0', 'tmpdir/dev/stdin'), call('fd/1', 'tmpdir/dev/stdout'), ] mock_data_sync.assert_called_once_with('tmpdir/', 'root_dir') data_sync.sync_data.assert_called_once_with( options=['-a', '--ignore-existing'] ) mock_copy.assert_called_once_with('/.buildenv', 'root_dir') mock_create.assert_called_once_with('root_dir') mock_chmod.assert_called_once_with('root_dir', 0o755) @patch('kiwi.path.Path.wipe') @patch('os.path.exists') def test_delete(self, mock_path, mock_wipe): mock_path.return_value = False root = RootInit('root_dir') assert root.delete() is None mock_wipe.assert_called_once_with('root_dir') def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.770255 kiwi-11.1.8/test/unit/system/setup_test.py0000644000000000000000000021717015273675667015566 0ustar00import sys import os import logging import io from unittest.mock import ANY, DEFAULT, patch, call, Mock, MagicMock, mock_open from pytest import raises, fixture from collections import namedtuple from ..test_helper import argv_kiwi_tests from kiwi.system.setup import SystemSetup from kiwi.xml_description import XMLDescription from kiwi.xml_state import XMLState from kiwi.defaults import Defaults from kiwi.exceptions import ( KiwiCommandError, KiwiScriptFailed, KiwiImportDescriptionError, KiwiFileNotFound, ) from kiwi.command import CommandT class TestSystemSetup: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.system.setup.RuntimeConfig') def setup(self, mock_RuntimeConfig): Defaults.set_platform_name('x86_64') self.runtime_config = Mock() self.runtime_config.get_package_changes = Mock(return_value=True) mock_RuntimeConfig.return_value = self.runtime_config self.xml_state = MagicMock() self.xml_state.get_package_manager = Mock(return_value='zypper') self.xml_state.build_type.get_selinux_policy = Mock(return_value=None) self.xml_state.build_type.get_filesystem = Mock(return_value='ext3') self.xml_state.xml_data.get_name = Mock(return_value='some-image') self.xml_state.get_image_version = Mock(return_value='1.2.3') self.xml_state.build_type.get_provide_system_files = Mock( return_value=True ) self.xml_state.xml_data.description_dir = 'description_dir' self.setup = SystemSetup(self.xml_state, 'root_dir') description = XMLDescription( description='../data/example_config.xml', derived_from='derived/description', ) self.description_dir = os.path.dirname(description.description_origin) self.setup_with_real_xml = SystemSetup( XMLState(description.load()), 'root_dir' ) command_run = namedtuple('command', ['output', 'error', 'returncode']) self.run_result = command_run( output='password-hash\n', error='stderr', returncode=0 ) self.selinux_policies = os.scandir( '../data/etc/selinux/targeted/policy' ) @patch('kiwi.system.setup.RuntimeConfig') def setup_method(self, cls, mock_RuntimeConfig): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def test_setup_ix86(self): Defaults.set_platform_name('i686') setup = SystemSetup(MagicMock(), 'root_dir') assert setup.arch == 'ix86' @patch('kiwi.system.setup.Path.create') @patch('kiwi.command.Command.run') @patch('os.path.exists') @patch('kiwi.system.setup.glob.iglob') def test_import_description( self, mock_iglob, mock_path, mock_command, mock_Path_create ): mock_iglob.return_value = ['config-cdroot.tar.xz'] mock_path.return_value = True with patch('builtins.open'): self.setup_with_real_xml.import_description() mock_iglob.assert_called_once_with( '{0}/config-cdroot.tar*'.format(self.description_dir) ) assert mock_command.call_args_list == [ call( [ 'cp', '{0}/config-host-overlay.sh'.format(self.description_dir), 'root_dir/image/config-host-overlay.sh', ] ), call( [ 'cp', '{0}/config-overlay.sh'.format(self.description_dir), 'root_dir/image/config-overlay.sh', ] ), call( [ 'cp', '{0}/config.sh'.format(self.description_dir), 'root_dir/image/config.sh', ] ), call( [ 'cp', '{0}/disk.sh'.format(self.description_dir), 'root_dir/image/disk.sh', ] ), call( [ 'cp', '{0}/my_edit_boot_script'.format(self.description_dir), 'root_dir/image/edit_boot_config.sh', ] ), call( [ 'cp', '/absolute/path/to/my_edit_boot_install', 'root_dir/image/edit_boot_install.sh', ] ), call( [ 'cp', '{0}/images.sh'.format(self.description_dir), 'root_dir/image/images.sh', ] ), call( [ 'cp', '{0}/post_bootstrap.sh'.format(self.description_dir), 'root_dir/image/post_bootstrap.sh', ] ), call( [ 'cp', '{0}/pre_disk_sync.sh'.format(self.description_dir), 'root_dir/image/pre_disk_sync.sh', ] ), call( [ 'cp', Defaults.project_file('config/functions.sh'), 'root_dir/.kconfig', ] ), call(['cp', '/absolute/path/to/image.tgz', 'root_dir/image/']), call( [ 'cp', '{0}/bootstrap.tgz'.format(self.description_dir), 'root_dir/image/', ] ), call( [ 'cp', '{0}/some'.format(self.description_dir), 'root_dir/image/', ] ), call(['cp', '/absolute/path/to/some', 'root_dir/image/']), call( [ 'cp', '{0}/some'.format(self.description_dir), 'root_dir/image/', ] ), call(['cp', 'config-cdroot.tar.xz', 'root_dir/image/']), ] @patch('kiwi.path.Path.create') @patch('kiwi.command.Command.run') @patch('os.path.exists') def test_import_description_archive_from_derived( self, mock_path, mock_command, mock_create ): path_return_values = [ True, True, True, False, True, False, True, True, True, True, True, True, True, True, True, True, ] def side_effect(arg): return path_return_values.pop() mock_path.side_effect = side_effect with patch('builtins.open'): self.setup_with_real_xml.import_description() assert mock_command.call_args_list == [ call( [ 'cp', '{0}/config-host-overlay.sh'.format(self.description_dir), 'root_dir/image/config-host-overlay.sh', ] ), call( [ 'cp', '{0}/config-overlay.sh'.format(self.description_dir), 'root_dir/image/config-overlay.sh', ] ), call( [ 'cp', '{0}/config.sh'.format(self.description_dir), 'root_dir/image/config.sh', ] ), call( [ 'cp', '{0}/disk.sh'.format(self.description_dir), 'root_dir/image/disk.sh', ] ), call( [ 'cp', '{0}/my_edit_boot_script'.format(self.description_dir), 'root_dir/image/edit_boot_config.sh', ] ), call( [ 'cp', '/absolute/path/to/my_edit_boot_install', 'root_dir/image/edit_boot_install.sh', ] ), call( [ 'cp', '{0}/images.sh'.format(self.description_dir), 'root_dir/image/images.sh', ] ), call( [ 'cp', '{0}/post_bootstrap.sh'.format(self.description_dir), 'root_dir/image/post_bootstrap.sh', ] ), call( [ 'cp', '{0}/pre_disk_sync.sh'.format(self.description_dir), 'root_dir/image/pre_disk_sync.sh', ] ), call( [ 'cp', Defaults.project_file('config/functions.sh'), 'root_dir/.kconfig', ] ), call(['cp', '/absolute/path/to/image.tgz', 'root_dir/image/']), call( ['cp', 'derived/description/bootstrap.tgz', 'root_dir/image/'] ), call(['cp', 'derived/description/some', 'root_dir/image/']), call(['cp', '/absolute/path/to/some', 'root_dir/image/']), call( [ 'cp', '{0}/some'.format(self.description_dir), 'root_dir/image/', ] ), ] mock_create.assert_called_once_with('root_dir/image') @patch('kiwi.system.setup.Path.create') @patch('kiwi.command.Command.run') @patch('os.path.exists') def test_import_description_configured_editboot_scripts_not_found( self, mock_path, mock_command, mock_Path_create ): path_return_values = [False, True, True, True, True, True] def side_effect(arg): return path_return_values.pop() mock_path.side_effect = side_effect with patch('builtins.open'): with raises(KiwiImportDescriptionError): self.setup_with_real_xml.import_description() @patch('kiwi.path.Path.create') @patch('kiwi.command.Command.run') @patch('os.path.exists') def test_import_description_configured_archives_not_found( self, mock_path, mock_command, mock_create ): path_return_values = [ False, False, True, True, True, True, True, True, True, True, ] def side_effect(arg): return path_return_values.pop() mock_path.side_effect = side_effect with patch('builtins.open'): with raises(KiwiImportDescriptionError): self.setup_with_real_xml.import_description() @patch('kiwi.path.Path.create') @patch('kiwi.command.Command.run') @patch('os.path.exists') def test_import_description_configured_files_not_found( self, mock_path, mock_command, mock_create ): path_return_values = [ False, False, True, True, True, True, True, True, True, True, True, True, True, ] def side_effect(arg): return path_return_values.pop() mock_path.side_effect = side_effect with patch('builtins.open'): with raises(KiwiImportDescriptionError): self.setup_with_real_xml.import_description() @patch('kiwi.command.Command.run') @patch('os.path.isdir') @patch('kiwi.system.setup.Path.wipe') @patch('kiwi.system.setup.MountManager') def test_cleanup( self, mock_MountManager, mock_Path_wipe, mock_os_path_isdir, mock_Command_run, ): image_meta = Mock() mock_MountManager.return_value = image_meta mock_os_path_isdir.return_value = True self.setup.cleanup() mock_Command_run.assert_called_once_with( [ 'chroot', 'root_dir', 'rm', '-f', '.kconfig', '.profile', 'config.bootoptions', ] ) mock_MountManager.assert_called_once_with( device='none', mountpoint='root_dir/image' ) image_meta.umount.assert_called_once_with() mock_Path_wipe.assert_called_once_with('root_dir/image') @patch('kiwi.system.setup.ArchiveTar') @patch('kiwi.system.setup.glob.iglob') def test_import_cdroot_files(self, mock_iglob, mock_ArchiveTar): archive = Mock() mock_ArchiveTar.return_value = archive mock_iglob.return_value = ['config-cdroot.tar.xz'] self.setup.import_cdroot_files('target_dir') mock_iglob.assert_called_once_with('description_dir/config-cdroot.tar*') mock_ArchiveTar.assert_called_once_with('config-cdroot.tar.xz') archive.extract.assert_called_once_with('target_dir') @patch('kiwi.command.Command.run') @patch('kiwi.system.setup.DataSync') @patch('kiwi.system.setup.Path.create') def test_import_files( self, mock_Path_create, mock_DataSync, mock_Command_run ): data = Mock() mock_DataSync.return_value = data self.setup_with_real_xml.import_files() assert mock_Command_run.call_args_list == [ call( [ 'chroot', 'root_dir', 'chown', 'bob:users', '/image//absolute/path/to/some', ] ), call( [ 'chroot', 'root_dir', 'chmod', 'u+x', '/image//absolute/path/to/some', ] ), ] mock_Path_create.assert_called_once_with('root_dir/some') assert data.sync_data.called @patch('kiwi.command.Command.run') @patch('kiwi.system.setup.DataSync') @patch('os.path.exists') def test_import_overlay_files_copy_links( self, mock_os_path, mock_DataSync, mock_command ): data = Mock() mock_DataSync.return_value = data mock_os_path.return_value = True self.setup.import_overlay_files( follow_links=True, preserve_owner_group=True ) mock_DataSync.assert_called_once_with( 'description_dir/root/', 'root_dir' ) data.sync_data.assert_called_once_with( options=[ '-r', '-p', '-t', '-D', '-H', '-X', '-A', '--one-file-system', '--copy-links', '-o', '-g', ] ) @patch('kiwi.command.Command.run') @patch('kiwi.system.setup.DataSync') @patch('os.path.exists') def test_import_overlay_files_links( self, mock_os_path, mock_DataSync, mock_command ): data = Mock() mock_DataSync.return_value = data mock_os_path.return_value = True self.setup.import_overlay_files( follow_links=False, preserve_owner_group=True ) mock_DataSync.assert_called_once_with( 'description_dir/root/', 'root_dir' ) data.sync_data.assert_called_once_with( options=[ '-r', '-p', '-t', '-D', '-H', '-X', '-A', '--one-file-system', '--links', '-o', '-g', ] ) @patch('kiwi.system.setup.ArchiveTar') @patch('os.path.exists') def test_import_overlay_files_from_archive( self, mock_os_path, mock_archive ): archive = Mock() mock_archive.return_value = archive exists_results = [True, False] def side_effect(arg): return exists_results.pop() mock_os_path.side_effect = side_effect self.setup.import_overlay_files() mock_archive.assert_called_once_with('description_dir/root.tar.gz') archive.extract.assert_called_once_with('root_dir') @patch('kiwi.system.setup.DataSync') @patch('os.path.exists') def test_import_overlay_files_from_profile( self, mock_os_path, mock_DataSync ): exists_results = [True, False, False] def side_effect(arg): return exists_results.pop() data = Mock() mock_DataSync.return_value = data mock_os_path.side_effect = side_effect self.xml_state.profiles = ['profile_root'] self.setup.import_overlay_files() mock_DataSync.assert_called_once_with( 'description_dir/profile_root/', 'root_dir' ) data.sync_data.assert_called_once_with( options=[ '-r', '-p', '-t', '-D', '-H', '-X', '-A', '--one-file-system', '--links', ] ) @patch('kiwi.system.setup.Shell.run_common_function') @patch('kiwi.system.setup.Command.run') @patch('os.path.exists') def test_setup_keyboard_map(self, mock_path, mock_run, mock_shell): mock_path.return_value = True self.setup.preferences['keytable'] = 'keytable' self.setup.setup_keyboard_map() mock_shell.assert_called_once_with( 'baseUpdateSysConfig', ['root_dir/etc/sysconfig/keyboard', 'KEYTABLE', '"keytable"'], ) @patch('kiwi.system.setup.CommandCapabilities.has_option_in_help') @patch('kiwi.system.setup.Shell.run_common_function') @patch('kiwi.system.setup.Command.run') @patch('os.path.exists') def test_setup_keyboard_map_with_systemd( self, mock_path, mock_run, mock_shell, mock_caps ): mock_caps.return_value = True mock_path.return_value = True mock_run.return_value = CommandT("", "", 0) self.setup.preferences['keytable'] = 'keytable' self.setup.setup_keyboard_map() mock_run.assert_has_calls( [ call(['rm', '-r', '-f', 'root_dir/etc/vconsole.conf']), call( [ 'chroot', 'root_dir', 'systemd-firstboot', '--keymap=keytable', ], raise_on_error=False, ), ] ) @patch('os.path.exists') @patch('kiwi.system.setup.CommandCapabilities.has_option_in_help') def test_setup_keyboard_skipped(self, mock_caps, mock_exists): mock_caps.return_value = False mock_exists.return_value = False self.setup.preferences['keytable'] = 'keytable' with self._caplog.at_level(logging.WARNING): self.setup.setup_keyboard_map() @patch('kiwi.system.setup.CommandCapabilities.has_option_in_help') @patch('kiwi.system.setup.Command.run') def test_setup_keyboard_skipped_systemd_incompatible( self, mock_run, mock_caps ): mock_caps.return_value = ( True # systemd-firstboot --keymap found in help ) self.setup.preferences['keytable'] = 'keytable' # mock the Command.run for `localectl list-keymaps` def side_effect(args, **kwargs): if args == [ 'chroot', ANY, 'systemd-firstboot', '--keymap=keytable', ]: return CommandT("", "Keymap us is not installed.", 1) return DEFAULT mock_run.side_effect = side_effect with raises(KiwiCommandError) as excinfo: self.setup.setup_keyboard_map() assert ( 'your system does not support the systemd way of managing keymaps' in str(excinfo.value) ) @patch('kiwi.system.setup.CommandCapabilities.has_option_in_help') @patch('kiwi.system.setup.Command.run') @patch('os.path.exists') def test_setup_locale(self, mock_path, mock_run, mock_caps): mock_caps.return_valure = True mock_path.return_value = True self.setup.preferences['locale'] = 'locale1,locale2' self.setup.setup_locale() mock_run.assert_has_calls( [ call(['rm', '-r', '-f', 'root_dir/etc/locale.conf']), call( [ 'chroot', 'root_dir', 'systemd-firstboot', '--locale=locale1.UTF-8', ] ), ] ) @patch('kiwi.system.setup.CommandCapabilities.has_option_in_help') @patch('kiwi.system.setup.Command.run') @patch('os.path.exists') def test_setup_locale_POSIX(self, mock_path, mock_run, mock_caps): mock_caps.return_valure = True mock_path.return_value = True self.setup.preferences['locale'] = 'POSIX,locale2' self.setup.setup_locale() mock_run.assert_has_calls( [ call(['rm', '-r', '-f', 'root_dir/etc/locale.conf']), call( [ 'chroot', 'root_dir', 'systemd-firstboot', '--locale=POSIX', ] ), ] ) @patch('kiwi.system.setup.Command.run') def test_setup_timezone(self, mock_command): self.setup.preferences['timezone'] = 'timezone' self.setup.setup_timezone() mock_command.assert_has_calls( [ call( [ 'chroot', 'root_dir', 'ln', '-s', '-f', '/usr/share/zoneinfo/timezone', '/etc/localtime', ] ) ] ) @patch('kiwi.system.setup.CommandCapabilities.has_option_in_help') @patch('kiwi.system.setup.Command.run') def test_setup_timezone_with_systemd(self, mock_command, mock_caps): mock_caps.return_value = True self.setup.preferences['timezone'] = 'timezone' self.setup.setup_timezone() mock_command.assert_has_calls( [ call( [ 'chroot', 'root_dir', 'systemd-firstboot', '--timezone=timezone', ] ) ] ) @patch('kiwi.system.setup.Users') def test_setup_groups(self, mock_users): users = Mock() users.group_exists = Mock(return_value=False) mock_users.return_value = users self.setup_with_real_xml.setup_groups() calls = [call('users'), call('kiwi'), call('admin')] users.group_exists.assert_has_calls(calls) calls = [ call('users', []), call('kiwi', []), call('admin', ['-g', '42']), ] users.group_add.assert_has_calls(calls) @patch('kiwi.system.setup.Users') @patch('kiwi.system.setup.Command.run') def test_setup_users_add(self, mock_command, mock_users): users = Mock() users.user_exists = Mock(return_value=False) mock_users.return_value = users mock_command.return_value = self.run_result self.setup_with_real_xml.setup_users() calls = [call('root'), call('tux'), call('kiwi')] users.user_exists.assert_has_calls(calls) calls = [ call( 'root', [ '-p', 'password-hash', '-s', '/bin/bash', '-u', '815', '-c', 'Bob', '-m', '-d', '/root', ], ), call( 'tux', ['-p', 'password-hash', '-g', 'users', '-m', '-d', '/home/tux'], ), call( 'kiwi', [ '-p', 'password-hash', '-g', 'kiwi', '-G', 'admin,users', '-m', ], ), ] users.user_add.assert_has_calls(calls) mock_command.assert_called_with( ['openssl', 'passwd', '-1', '-salt', 'xyz', 'mypwd'] ) @patch('kiwi.system.setup.Users') @patch('kiwi.system.setup.Command.run') def test_setup_users_modify(self, mock_command, mock_users): users = Mock() users.user_exists = Mock(return_value=True) mock_users.return_value = users mock_command.return_value = self.run_result self.setup_with_real_xml.setup_users() calls = [call('root'), call('tux'), call('kiwi')] users.user_exists.assert_has_calls(calls) calls = [ call( 'root', [ '-p', 'password-hash', '-s', '/bin/bash', '-u', '815', '-c', 'Bob', ], ), call('tux', ['-p', 'password-hash', '-g', 'users']), call( 'kiwi', ['-p', 'password-hash', '-g', 'kiwi', '-G', 'admin,users'], ), ] users.user_modify.assert_has_calls(calls) @patch('kiwi.system.setup.Path.which') @patch('kiwi.system.setup.Command.run') def test_setup_plymouth_splash(self, mock_command, mock_which): mock_which.return_value = 'plymouth-set-default-theme' preferences = Mock() preferences.get_bootsplash_theme = Mock(return_value=['some-theme']) self.xml_state.get_preferences_sections = Mock( return_value=[preferences] ) self.setup.setup_plymouth_splash() mock_which.assert_called_once_with( root_dir='root_dir', filename='plymouth-set-default-theme' ) mock_command.assert_called_once_with( ['chroot', 'root_dir', 'plymouth-set-default-theme', 'some-theme'] ) @patch('os.path.exists') def test_import_image_identifier(self, mock_os_path): self.xml_state.xml_data.get_id = Mock(return_value='42') mock_os_path.return_value = True m_open = mock_open() with patch('builtins.open', m_open, create=True): self.setup.import_image_identifier() m_open.assert_called_once_with('root_dir/etc/ImageID', 'w') m_open.return_value.write.assert_called_once_with('42\n') @patch.object(SystemSetup, 'setup_selinux_file_contexts') @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.stat') @patch('os.access') @patch('copy.deepcopy') def test_call_non_excutable_config_script( self, mock_copy_deepcopy, mock_access, mock_stat, mock_os_path, mock_watch, mock_command, mock_Profile, mock_setup_selinux_file_contexts, ): mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=0) mock_os_path.return_value = True mock_watch.return_value = mock_result mock_access.return_value = False self.setup.call_config_script() mock_copy_deepcopy.assert_called_once_with(os.environ) mock_command.assert_called_once_with( ['chroot', 'root_dir', 'bash', '/image/config.sh'], {} ) mock_setup_selinux_file_contexts.assert_called_once_with() @patch.object(SystemSetup, 'setup_selinux_file_contexts') @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.stat') @patch('os.access') @patch('copy.deepcopy') def test_call_excutable_config_script( self, mock_copy_deepcopy, mock_access, mock_stat, mock_os_path, mock_watch, mock_command, mock_Profile, mock_setup_selinux_file_contexts, ): mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=0) mock_os_path.return_value = True mock_watch.return_value = mock_result # pretend that the script is executable mock_access.return_value = True self.setup.call_config_script() mock_copy_deepcopy.assert_called_once_with(os.environ) mock_command.assert_called_once_with( ['chroot', 'root_dir', '/image/config.sh'], {} ) mock_setup_selinux_file_contexts.assert_called_once_with() @patch.object(SystemSetup, 'setup_selinux_file_contexts') @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.stat') @patch('os.access') @patch('copy.deepcopy') def test_call_excutable_post_bootstrap_script( self, mock_copy_deepcopy, mock_access, mock_stat, mock_os_path, mock_watch, mock_command, mock_Profile, mock_setup_selinux_file_contexts, ): mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=0) mock_os_path.return_value = True mock_watch.return_value = mock_result # pretend that the script is executable mock_access.return_value = True self.setup.call_post_bootstrap_script() mock_copy_deepcopy.assert_called_once_with(os.environ) mock_command.assert_called_once_with( ['chroot', 'root_dir', '/image/post_bootstrap.sh'], {} ) mock_setup_selinux_file_contexts.assert_called_once_with() @patch.object(SystemSetup, 'setup_selinux_file_contexts') @patch('kiwi.system.setup.Defaults.is_buildservice_worker') @patch('kiwi.logger.Logger.getLogFlags') @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.stat') @patch('os.access') @patch('copy.deepcopy') @patch('kiwi.system.setup.MountManager') def test_call_disk_script( self, mock_MountManager, mock_copy_deepcopy, mock_access, mock_stat, mock_os_path, mock_watch, mock_command, mock_Profile, mock_getLogFlags, mock_is_buildservice_worker, mock_setup_selinux_file_contexts, ): chroot_mount = Mock() chroot_mount.is_mounted.return_value = False mock_MountManager.return_value = chroot_mount mock_is_buildservice_worker.return_value = False mock_getLogFlags.return_value = {'run-scripts-in-screen': True} mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result_type', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=0) mock_os_path.return_value = True mock_watch.return_value = mock_result mock_access.return_value = False self.setup.call_disk_script() mock_copy_deepcopy.assert_called_once_with(os.environ) mock_command.assert_called_once_with( [ 'screen', '-t', '-X', 'chroot', 'root_dir', 'bash', '/image/disk.sh', ], {}, ) mock_setup_selinux_file_contexts.assert_called_once_with() mock_MountManager.assert_called_once_with( device='root_dir', mountpoint='root_dir' ) chroot_mount.bind_mount.assert_called_once_with() @patch.object(SystemSetup, 'setup_selinux_file_contexts') @patch('kiwi.system.setup.Defaults.is_buildservice_worker') @patch('kiwi.logger.Logger.getLogFlags') @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.stat') @patch('os.access') @patch('copy.deepcopy') def test_call_pre_disk_script( self, mock_copy_deepcopy, mock_access, mock_stat, mock_os_path, mock_watch, mock_command, mock_Profile, mock_getLogFlags, mock_is_buildservice_worker, mock_setup_selinux_file_contexts, ): mock_is_buildservice_worker.return_value = False mock_getLogFlags.return_value = {'run-scripts-in-screen': True} mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result_type', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=0) mock_os_path.return_value = True mock_watch.return_value = mock_result mock_access.return_value = False self.setup.call_pre_disk_script() mock_copy_deepcopy.assert_called_once_with(os.environ) mock_command.assert_called_once_with( [ 'screen', '-t', '-X', 'chroot', 'root_dir', 'bash', '/image/pre_disk_sync.sh', ], {}, ) mock_setup_selinux_file_contexts.assert_called_once_with() @patch.object(SystemSetup, 'setup_selinux_file_contexts') @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.stat') @patch('os.access') @patch('copy.deepcopy') def test_call_image_script( self, mock_copy_deepcopy, mock_access, mock_stat, mock_os_path, mock_watch, mock_command, mock_Profile, mock_setup_selinux_file_contexts, ): mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result_type', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=0) mock_os_path.return_value = True mock_watch.return_value = mock_result mock_access.return_value = False self.setup.call_image_script() mock_copy_deepcopy.assert_called_once_with(os.environ) mock_command.assert_called_once_with( ['chroot', 'root_dir', 'bash', '/image/images.sh'], {} ) mock_setup_selinux_file_contexts.assert_called_once_with() @patch.object(SystemSetup, 'setup_selinux_file_contexts') @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.stat') @patch('os.access') @patch('copy.deepcopy') def test_call_config_overlay_script( self, mock_copy_deepcopy, mock_access, mock_stat, mock_os_path, mock_watch, mock_command, mock_Profile, mock_setup_selinux_file_contexts, ): mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result_type', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=0) mock_os_path.return_value = True mock_watch.return_value = mock_result mock_access.return_value = False self.setup.call_config_overlay_script() mock_copy_deepcopy.assert_called_once_with(os.environ) mock_command.assert_called_once_with( ['chroot', 'root_dir', 'bash', '/image/config-overlay.sh'], {} ) mock_setup_selinux_file_contexts.assert_called_once_with() @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.path.abspath') @patch('copy.deepcopy') def test_call_config_host_overlay_script( self, mock_copy_deepcopy, mock_abspath, mock_exists, mock_watch, mock_command, mock_Profile, ): mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result_type', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=0) mock_exists.return_value = True mock_abspath.return_value = '/root_dir/image/config-host-overlay.sh' mock_watch.return_value = mock_result self.setup.call_config_host_overlay_script() mock_abspath.assert_called_once_with( 'root_dir/image/config-host-overlay.sh' ) mock_command.assert_called_once_with( [ 'bash', '-c', 'cd root_dir && bash --norc /root_dir/image/config-host-overlay.sh ', ], {}, ) @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.path.abspath') @patch('copy.deepcopy') def test_call_edit_boot_config_script( self, mock_copy_deepcopy, mock_abspath, mock_exists, mock_watch, mock_command, mock_Profile, ): mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result_type', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=0) mock_exists.return_value = True mock_abspath.return_value = '/root_dir/image/edit_boot_config.sh' mock_watch.return_value = mock_result self.setup.call_edit_boot_config_script('ext4', 1) mock_abspath.assert_called_once_with( 'root_dir/image/edit_boot_config.sh' ) mock_command.assert_called_once_with( [ 'bash', '-c', 'cd root_dir && bash --norc /root_dir/image/edit_boot_config.sh ' 'ext4 1', ], {}, ) @patch('kiwi.system.setup.Profile') @patch('kiwi.system.setup.Defaults.is_buildservice_worker') @patch('kiwi.logger.Logger.getLogFlags') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.path.abspath') @patch('copy.deepcopy') def test_call_edit_boot_install_script( self, mock_copy_deepcopy, mock_abspath, mock_exists, mock_watch, mock_command, mock_getLogFlags, mock_is_buildservice_worker, mock_Profile, ): mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} mock_is_buildservice_worker.return_value = False mock_getLogFlags.return_value = {'run-scripts-in-screen': True} result_type = namedtuple('result_type', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=0) mock_exists.return_value = True mock_abspath.return_value = '/root_dir/image/edit_boot_install.sh' mock_watch.return_value = mock_result self.setup.call_edit_boot_install_script( 'my_image.raw', '/dev/mapper/loop0p1' ) mock_abspath.assert_called_once_with( 'root_dir/image/edit_boot_install.sh' ) mock_command.assert_called_once_with( [ 'screen', '-t', '-X', 'bash', '-c', 'cd root_dir && bash --norc ' '/root_dir/image/edit_boot_install.sh ' 'my_image.raw /dev/mapper/loop0p1', ], {}, ) @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.stat') @patch('os.access') def test_call_image_script_raises( self, mock_access, mock_stat, mock_os_path, mock_watch, mock_command, mock_Profile, ): profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result_type', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=1) mock_os_path.return_value = True mock_watch.return_value = mock_result mock_access.return_value = False with raises(KiwiScriptFailed): self.setup.call_image_script() @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('copy.deepcopy') def test_call_edit_boot_install_script_raises( self, mock_copy_deepcopy, mock_os_path, mock_watch, mock_command, mock_Profile, ): mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result_type', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=1) mock_os_path.return_value = True mock_watch.return_value = mock_result with raises(KiwiScriptFailed): self.setup.call_edit_boot_install_script( 'my_image.raw', '/dev/mapper/loop0p1' ) @patch('kiwi.command.Command.run') def test_create_init_link_from_linuxrc(self, mock_command): self.setup.create_init_link_from_linuxrc() mock_command.assert_called_once_with( ['ln', 'root_dir/linuxrc', 'root_dir/init'] ) @patch('kiwi.command.Command.run') def test_create_recovery_archive_cleanup_only(self, mock_command): self.setup.oemconfig['recovery'] = False self.setup.create_recovery_archive() assert mock_command.call_args_list[0] == call( ['bash', '-c', 'rm -f root_dir/recovery.*'] ) @patch('os.path.exists') @patch('kiwi.system.setup.Path.wipe') @patch.object(SystemSetup, 'setup_selinux_file_contexts') @patch('kiwi.system.setup.Profile') @patch('kiwi.command.Command.call') @patch('kiwi.command.Command.run') @patch('kiwi.command_process.CommandProcess.poll_and_watch') @patch('os.path.exists') @patch('os.stat') @patch('os.access') @patch('copy.deepcopy') def test_create_fstab( self, mock_copy_deepcopy, mock_access, mock_stat, mock_os_path, mock_watch, mock_command_run, mock_command_call, mock_Profile, mock_setup_selinux_file_contexts, mock_wipe, mock_exists, ): fstab = Mock() mock_exists.return_value = True mock_copy_deepcopy.return_value = {} profile = Mock() mock_Profile.return_value = profile profile.get_settings.return_value = {} result_type = namedtuple('result_type', ['stderr', 'returncode']) mock_result = result_type(stderr='stderr', returncode=0) mock_os_path.return_value = True mock_watch.return_value = mock_result mock_access.return_value = True m_open = mock_open(read_data='append_entry') with patch('builtins.open', m_open, create=True): self.setup.create_fstab(fstab) fstab.export.assert_called_once_with('root_dir/etc/fstab') assert m_open.call_args_list == [ call('root_dir/etc/fstab', 'a'), call('root_dir/etc/fstab.append', 'r'), ] assert m_open.return_value.write.call_args_list == [ call('append_entry') ] mock_command_run.assert_called_once_with( ['patch', 'root_dir/etc/fstab', 'root_dir/etc/fstab.patch'] ) mock_command_call.assert_called_once_with( ['chroot', 'root_dir', '/etc/fstab.script'], {} ) assert mock_wipe.call_args_list == [ call('root_dir/etc/fstab.append'), call('root_dir/etc/fstab.patch'), call('root_dir/etc/fstab.script'), ] mock_setup_selinux_file_contexts.assert_called_once_with() @patch('kiwi.command.Command.run') @patch('pathlib.Path.touch') @patch('kiwi.system.setup.ArchiveTar') @patch('kiwi.system.setup.Compress') @patch('os.path.getsize') @patch('kiwi.system.setup.Path.wipe') def test_create_recovery_archive( self, mock_wipe, mock_getsize, mock_compress, mock_archive, mock_pathlib_Path_touch, mock_command, ): mock_getsize.return_value = 42 compress = Mock() mock_compress.return_value = compress archive = Mock() mock_archive.return_value = archive self.setup.oemconfig['recovery'] = True self.setup.oemconfig['recovery_inplace'] = True m_open = mock_open() with patch('builtins.open', m_open, create=True): self.setup.create_recovery_archive() assert mock_command.call_args_list[0] == call( ['bash', '-c', 'rm -f root_dir/recovery.*'] ) mock_archive.assert_called_once_with( create_from_file_list=False, filename='root_dir/recovery.tar' ) archive.create.assert_called_once_with( exclude=['dev', 'proc', 'sys'], options=[ '--numeric-owner', '--hard-dereference', '--preserve-permissions', ], source_dir='root_dir', ) assert m_open.call_args_list[0] == call( 'root_dir/recovery.tar.filesystem', 'w' ) assert m_open.return_value.write.call_args_list[0] == call('ext3') assert mock_command.call_args_list[1] == call( ['bash', '-c', 'tar -tf root_dir/recovery.tar | wc -l'] ) assert m_open.call_args_list[1] == call( 'root_dir/recovery.tar.files', 'w' ) assert mock_getsize.call_args_list[0] == call('root_dir/recovery.tar') assert m_open.return_value.write.call_args_list[1] == call('1\n') assert m_open.call_args_list[2] == call( 'root_dir/recovery.tar.size', 'w' ) assert m_open.return_value.write.call_args_list[2] == call('42') mock_compress.assert_called_once_with('root_dir/recovery.tar') compress.gzip.assert_called_once_with() assert mock_getsize.call_args_list[1] == call( 'root_dir/recovery.tar.gz' ) assert m_open.call_args_list[3] == call( 'root_dir/recovery.partition.size', 'w' ) assert m_open.return_value.write.call_args_list[3] == call('300') mock_wipe.assert_called_once_with('root_dir/recovery.tar.gz') @patch('kiwi.system.setup.Command.run') @patch('kiwi.system.setup.Path.create') @patch('kiwi.system.setup.DataSync') @patch('os.path.exists') def test_export_modprobe_setup( self, mock_exists, mock_DataSync, mock_path, mock_command ): data = Mock() mock_DataSync.return_value = data mock_exists.return_value = True self.setup.export_modprobe_setup('target_root_dir') mock_path.assert_called_once_with('target_root_dir/etc') mock_DataSync.assert_called_once_with( 'root_dir/etc/modprobe.d', 'target_root_dir/etc/' ) data.sync_data.assert_called_once_with(options=['-a']) @patch('kiwi.defaults.Defaults.get_default_packager_tool') def test_export_package_list_unknown_packager( self, mock_get_default_packager_tool ): assert self.setup.export_package_list('target_dir') == '' @patch('kiwi.defaults.Defaults.get_default_packager_tool') def test_export_flake_pilot_system_file_list_unknown_packager( self, mock_get_default_packager_tool ): assert ( self.setup.export_flake_pilot_system_file_list( 'target_dir', 'system_files' ) == '' ) @patch('kiwi.defaults.Defaults.get_default_packager_tool') def test_export_package_changes_unknown_packager( self, mock_get_default_packager_tool ): assert self.setup.export_package_changes('target_dir') == '' @patch('kiwi.defaults.Defaults.get_default_packager_tool') def test_export_package_verification_unknown_packager( self, mock_get_default_packager_tool ): assert self.setup.export_package_verification('target_dir') == '' @patch('kiwi.system.setup.Command.run') @patch('kiwi.system.setup.RpmDataBase') @patch('kiwi.system.setup.MountManager') def test_export_flake_pilot_system_file_list( self, mock_MountManager, mock_RpmDataBase, mock_command_run ): rpmdb = Mock() rpmdb.rpmdb_image.expand_query.return_value = 'image_dbpath' rpmdb.rpmdb_host.expand_query.return_value = 'host_dbpath' rpmdb.has_rpm.return_value = True mock_RpmDataBase.return_value = rpmdb self.xml_state.get_system_files_ignore_packages = Mock( return_value=['rpm', 'zypper'] ) mock_command_run.return_value = Mock(output='glibc\nzypper\n') with patch('builtins.open') as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value result = self.setup.export_flake_pilot_system_file_list( 'target_dir', 'system_files' ) mock_open.assert_called_once_with( 'target_dir/system_files', 'w', encoding='utf-8' ) assert file_handle.write.call_args_list == [ call('set -e\n'), call('rpm --noghost -ql glibc\n'), ] assert result == 'target_dir/system_files' mock_command_run.assert_called_once_with( [ 'rpm', '--root', 'root_dir', '-qa', '--qf', '%{NAME}\n', '--dbpath', 'image_dbpath', ] ) @patch('kiwi.system.setup.Command.run') @patch('kiwi.system.setup.RpmDataBase') @patch('kiwi.system.setup.MountManager') def test_export_package_list_rpm( self, mock_MountManager, mock_RpmDataBase, mock_command ): rpmdb = Mock() rpmdb.rpmdb_image.expand_query.return_value = 'image_dbpath' rpmdb.rpmdb_host.expand_query.return_value = 'host_dbpath' rpmdb.has_rpm.return_value = True mock_RpmDataBase.return_value = rpmdb command = Mock() command.output = 'packages_data' mock_command.return_value = command with patch('builtins.open') as m_open: result = self.setup.export_package_list('target_dir') m_open.assert_called_once_with( 'target_dir/some-image.x86_64-1.2.3.packages', 'w', encoding='utf-8', ) assert result == 'target_dir/some-image.x86_64-1.2.3.packages' mock_command.assert_called_once_with( [ 'rpm', '--root', 'root_dir', '-qa', '--qf', '%{NAME}|%{EPOCH}|%{VERSION}|%{RELEASE}|%{ARCH}|' '%{DISTURL}|%{LICENSE}\\n', '--dbpath', 'image_dbpath', ] ) rpmdb.has_rpm.return_value = False mock_command.reset_mock() with patch('builtins.open'): result = self.setup.export_package_list('target_dir') assert result == 'target_dir/some-image.x86_64-1.2.3.packages' mock_command.assert_called_once_with( [ 'rpm', '--root', 'root_dir', '-qa', '--qf', '%{NAME}|%{EPOCH}|%{VERSION}|%{RELEASE}|%{ARCH}|' '%{DISTURL}|%{LICENSE}\\n', '--dbpath', 'host_dbpath', ] ) @patch('kiwi.system.setup.os.path.exists') def test_setup_machine_id(self, mock_path_exists): # No /etc/machine-id -> no creation mock_path_exists.return_value = False with patch('builtins.open') as m_open: self.setup.setup_machine_id() m_open.assert_not_called() mock_path_exists.return_value = True # Empty /etc/machine-id -> truncate m_open = mock_open(read_data='') with patch('builtins.open', m_open): self.setup.setup_machine_id() m_open.assert_called_once_with('root_dir/etc/machine-id', 'r+') m_open().truncate.assert_called_once_with(0) # Filled /etc/machine-id -> truncate m_open = mock_open(read_data='9d75e31cca5943b3a527345e0684d5b6') with patch('builtins.open', m_open): self.setup.setup_machine_id() m_open.assert_called_once_with('root_dir/etc/machine-id', 'r+') m_open().truncate.assert_called_once_with(0) # Explicitly uninitialized /etc/machine-id -> keep m_open = mock_open(read_data='uninitialized') with patch('builtins.open', m_open): self.setup.setup_machine_id() m_open.assert_called_once_with('root_dir/etc/machine-id', 'r+') m_open().truncate.assert_not_called() @patch('kiwi.system.setup.Command.run') @patch('kiwi.system.setup.Path.which') def test_setup_permissions(self, mock_path_which, mock_command): mock_path_which.return_value = 'chkstat' self.setup.setup_permissions() mock_command.assert_called_once_with( ['chroot', 'root_dir', 'chkstat', '--system', '--set'] ) mock_path_which.return_value = None with self._caplog.at_level(logging.WARNING): self.setup.setup_permissions() @patch.object(SystemSetup, 'export_flake_pilot_system_file_list') def test_create_system_files( self, mock_export_flake_pilot_system_file_list ): self.setup.create_system_files() mock_export_flake_pilot_system_file_list.assert_called_once_with( 'root_dir', 'systemfiles' ) @patch('kiwi.system.setup.Command.run') def test_export_package_list_dpkg(self, mock_command): command = Mock() command.output = 'packages_data' mock_command.return_value = command self.xml_state.get_package_manager = Mock(return_value='apt') with patch('builtins.open') as m_open: result = self.setup.export_package_list('target_dir') m_open.assert_called_once_with( 'target_dir/some-image.x86_64-1.2.3.packages', 'w', encoding='utf-8', ) assert result == 'target_dir/some-image.x86_64-1.2.3.packages' mock_command.assert_called_once_with( [ 'dpkg-query', '--admindir', 'root_dir/var/lib/dpkg', '-W', '-f', '${Package}|None|${Version}|None|${Architecture}|None|None\\n', ] ) @patch('kiwi.system.setup.Command.run') def test_export_package_list_pacman(self, mock_command): command = Mock() command.output = 'packages_data' mock_command.return_value = command self.xml_state.get_package_manager = Mock(return_value='pacman') with patch('builtins.open') as m_open: result = self.setup.export_package_list('target_dir') m_open.assert_called_once_with( 'target_dir/some-image.x86_64-1.2.3.packages', 'w' ) assert result == 'target_dir/some-image.x86_64-1.2.3.packages' mock_command.assert_called_once_with( ['pacman', '--query', '--dbpath', 'root_dir/var/lib/pacman'] ) @patch('kiwi.system.setup.Command.run') @patch('kiwi.system.setup.RpmDataBase') @patch('kiwi.system.setup.MountManager') def test_export_package_changes_rpm( self, mock_MountManager, mock_RpmDataBase, mock_command ): rpmdb = Mock() rpmdb.rpmdb_image.expand_query.return_value = 'image_dbpath' rpmdb.rpmdb_host.expand_query.return_value = 'host_dbpath' rpmdb.has_rpm.return_value = True mock_RpmDataBase.return_value = rpmdb command = Mock() command.output = 'package|\nchanges' mock_command.return_value = command with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) result = self.setup.export_package_changes('target_dir') mock_open.assert_called_once_with( 'target_dir/some-image.x86_64-1.2.3.changes', 'w', encoding='utf-8', ) assert result == 'target_dir/some-image.x86_64-1.2.3.changes' mock_command.assert_called_once_with( [ 'rpm', '--root', 'root_dir', '-qa', '--qf', '%{NAME}|\\n', '--changelog', '--dbpath', 'image_dbpath', ] ) self.runtime_config.get_package_changes.assert_called_once_with() @patch('kiwi.system.setup.Command.run') @patch('os.path.exists') @patch('os.listdir') def test_export_package_changes_dpkg( self, mock_os_listdir, mock_os_path_exists, mock_command ): command = Mock() command.output = 'changes' mock_command.return_value = command self.xml_state.get_package_manager = Mock(return_value='apt') mock_os_listdir.return_value = ['package_b', 'package_a'] mock_os_path_exists.return_value = True with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) result = self.setup.export_package_changes('target_dir') file_handle = mock_open.return_value.__enter__.return_value mock_open.assert_called_once_with( 'target_dir/some-image.x86_64-1.2.3.changes', 'w', encoding='utf-8', ) assert result == 'target_dir/some-image.x86_64-1.2.3.changes' assert file_handle.write.call_args_list == [ call('package_a|\n'), call('changes\n'), call('package_b|\n'), call('changes\n'), ] self.runtime_config.get_package_changes.assert_called_once_with() @patch('kiwi.system.setup.Command.run') @patch('kiwi.system.setup.RpmDataBase') @patch('kiwi.system.setup.MountManager') def test_export_package_verification( self, mock_MountManager, mock_RpmDataBase, mock_command ): is_mounted_return = [True, False] def is_mounted(): return is_mounted_return.pop() shared_mount = Mock() shared_mount.is_mounted.side_effect = is_mounted mock_MountManager.return_value = shared_mount rpmdb = Mock() rpmdb.rpmdb_image.expand_query.return_value = 'image_dbpath' rpmdb.rpmdb_host.expand_query.return_value = 'host_dbpath' rpmdb.has_rpm.return_value = True mock_RpmDataBase.return_value = rpmdb command = Mock() command.output = 'verification_data' mock_command.return_value = command with patch('builtins.open') as m_open: result = self.setup.export_package_verification('target_dir') m_open.assert_called_once_with( 'target_dir/some-image.x86_64-1.2.3.verified', 'w', encoding='utf-8', ) assert result == 'target_dir/some-image.x86_64-1.2.3.verified' mock_command.assert_called_once_with( command=[ 'rpm', '--root', 'root_dir', '-Va', '--dbpath', 'image_dbpath', ], raise_on_error=False, ) mock_MountManager.assert_called_once_with( device='/dev', mountpoint='root_dir/dev' ) shared_mount.bind_mount.assert_called_once_with() shared_mount.umount_lazy.assert_called_once_with() rpmdb.has_rpm.return_value = False is_mounted_return = [True, False] mock_command.reset_mock() shared_mount.reset_mock() with patch('builtins.open'): result = self.setup.export_package_verification('target_dir') assert result == 'target_dir/some-image.x86_64-1.2.3.verified' mock_command.assert_called_once_with( command=[ 'rpm', '--root', 'root_dir', '-Va', '--dbpath', 'host_dbpath', ], raise_on_error=False, ) shared_mount.bind_mount.assert_called_once_with() shared_mount.umount_lazy.assert_called_once_with() @patch('kiwi.system.setup.Command.run') def test_export_package_verification_dpkg(self, mock_command): command = Mock() command.output = 'verification_data' mock_command.return_value = command self.xml_state.get_package_manager = Mock(return_value='apt') with patch('builtins.open') as m_open: result = self.setup.export_package_verification('target_dir') m_open.assert_called_once_with( 'target_dir/some-image.x86_64-1.2.3.verified', 'w', encoding='utf-8', ) assert result == 'target_dir/some-image.x86_64-1.2.3.verified' mock_command.assert_called_once_with( command=[ 'dpkg', '--root', 'root_dir', '-V', '--verify-format', 'rpm', ], raise_on_error=False, ) @patch('kiwi.system.setup.CommandCapabilities.has_option_in_help') @patch('kiwi.system.setup.Command.run') @patch('os.scandir') @patch('os.access') def test_set_selinux_file_contexts_new_version( self, mock_os_access, mock_os_scandir, mock_command, mock_has_option_in_help, ): mock_os_access.return_value = True mock_has_option_in_help.return_value = False mock_os_scandir.return_value = self.selinux_policies self.setup.set_selinux_file_contexts('security_context_file') mock_command.assert_called_once_with( [ 'chroot', 'root_dir', 'setfiles', '-T0', '-F', '-p', '-c', '/etc/selinux/targeted/policy/policy.some_policy', '-e', '/proc', '-e', '/sys', '-e', '/dev', 'security_context_file', '/', ] ) @patch('kiwi.system.setup.CommandCapabilities.has_option_in_help') @patch('kiwi.system.setup.Command.run') @patch('os.scandir') @patch('os.access') def test_set_selinux_file_contexts_read_only_root( self, mock_os_access, mock_os_scandir, mock_command, mock_has_option_in_help, ): mock_os_access.return_value = False mock_has_option_in_help.return_value = False mock_os_scandir.return_value = self.selinux_policies self.setup.set_selinux_file_contexts('security_context_file') assert not mock_command.called @patch('kiwi.system.setup.CommandCapabilities.has_option_in_help') @patch('kiwi.system.setup.Command.run') @patch('os.scandir') @patch('os.access') def test_set_selinux_file_contexts_old_version( self, mock_os_access, mock_os_scandir, mock_command, mock_has_option_in_help, ): mock_os_access.return_value = True mock_has_option_in_help.return_value = True mock_os_scandir.return_value = self.selinux_policies self.setup.set_selinux_file_contexts('security_context_file') assert mock_command.call_args_list == [ call( [ 'chroot', 'root_dir', 'setfiles', '-c', '/etc/selinux/targeted/policy/policy.some_policy', 'security_context_file', ] ), call( [ 'chroot', 'root_dir', 'setfiles', '-F', '-p', '-e', '/proc', '-e', '/sys', '-e', '/dev', 'security_context_file', '/', ] ), ] @patch('kiwi.system.setup.Command.run') @patch('os.scandir') @patch('os.access') def test_set_selinux_file_contexts_raises( self, mock_os_access, mock_os_scandir, mock_command ): mock_os_access.return_value = True mock_os_scandir.side_effect = Exception with raises(KiwiFileNotFound): self.setup.set_selinux_file_contexts('security_context_file') @patch('os.path.exists') @patch.object(SystemSetup, 'set_selinux_file_contexts') @patch('kiwi.system.setup.Path.which') def test_setup_selinux_file_contexts( self, mock_Path_which, mock_set_selinux_file_contexts, mock_os_path_exists, ): mock_os_path_exists.return_value = True mock_Path_which.return_value = 'setfiles' self.setup.setup_selinux_file_contexts() mock_set_selinux_file_contexts.assert_called_once_with( '/etc/selinux/targeted/contexts/files/file_contexts' ) mock_Path_which.return_value = None with self._caplog.at_level(logging.WARNING): self.setup.setup_selinux_file_contexts() assert 'setfiles tool not installed' in self._caplog.text @patch('kiwi.system.setup.Repository.new') @patch('kiwi.system.setup.Uri') def test_import_repositories_marked_as_imageinclude( self, mock_uri, mock_repo ): uri = Mock() mock_uri.return_value = uri uri.translate = Mock(return_value="uri") uri.alias = Mock(return_value="uri-alias") uri.credentials_file_name = Mock(return_value='kiwiRepoCredentials') mock_uri.return_value = uri repo = Mock() mock_repo.return_value.__enter__.return_value = repo self.setup_with_real_xml.import_repositories_marked_as_imageinclude() assert repo.add_repo.call_args_list[0] == call( 'uri-alias', 'uri', 'rpm-md', None, None, None, None, None, 'kiwiRepoCredentials', None, None, None, '../data/script', None, ) # only the imageonly repository provides a signing key, # which is stored in the image prior adding the repository assert [name for name, args, kwargs in repo.mock_calls] == [ 'use_default_location', 'add_repo', 'import_repository_signing_keys', 'add_repo', ] repo.import_repository_signing_keys.assert_called_once_with( 'uri-alias', [os.path.abspath(os.path.join(self.description_dir, 'key_b'))], ) @patch('os.path.exists') def test_script_exists(self, mock_path_exists): assert ( self.setup.script_exists('some-script') == mock_path_exists.return_value ) @patch('pathlib.Path') @patch('kiwi.system.setup.Command.run') def test_setup_registry_import(self, mock_Command_run, mock_Path): with patch('builtins.open'): self.setup_with_real_xml.setup_registry_import() assert mock_Command_run.call_args_list == [ call( [ 'chroot', 'root_dir', '/usr/bin/skopeo', 'copy', 'docker://registry.suse.com/home/mschaefer/images_pubcloud' '/pct/rmtserver:latest', 'oci-archive:/var/tmp/kiwi_containers/' 'rmtserver_latest:registry.suse.com/home/mschaefer/' 'images_pubcloud/pct/rmtserver:latest', ] ), call( [ 'chroot', 'root_dir', '/usr/bin/skopeo', 'copy', 'docker://registry.suse.com/some:latest', 'oci-archive:/var/tmp/kiwi_containers/' 'some_latest:registry.suse.com/some:latest', ] ), call( [ 'chroot', 'root_dir', '/usr/bin/skopeo', 'copy', 'docker://docker.io/foo:latest', 'oci-archive:/var/tmp/kiwi_containers/' 'foo_latest:docker.io/foo:latest', ] ), call( [ 'chroot', 'root_dir', '/usr/bin/skopeo', 'copy', 'docker://registry.example.com/test-app:v1.0', 'oci-archive:/var/tmp/kiwi_containers/' 'test-app_v1.0:registry.example.com/test-app:v1.0', ] ), call( ['chroot', 'root_dir', 'systemctl', 'enable', 'kiwi_containers'] ), ] ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.770255 kiwi-11.1.8/test/unit/system/shell_test.py0000644000000000000000000000141515273675667015526 0ustar00from pytest import raises from kiwi.system.shell import Shell from kiwi.exceptions import KiwiShellVariableValueError class TestSystemShell: def test_format_to_variable_value(self): assert Shell.format_to_variable_value('text') == 'text' assert Shell.format_to_variable_value(True) == 'true' assert Shell.format_to_variable_value(False) == 'false' assert Shell.format_to_variable_value('42') == '42' assert Shell.format_to_variable_value(0) == '0' assert Shell.format_to_variable_value(42) == '42' assert Shell.format_to_variable_value(None) == '' assert Shell.format_to_variable_value(b"42") == '42' with raises(KiwiShellVariableValueError): Shell.format_to_variable_value(['foo', 'bar']) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.770255 kiwi-11.1.8/test/unit/system/size_test.py0000644000000000000000000000275415273675667015400 0ustar00from unittest.mock import patch import unittest.mock as mock from kiwi.system.size import SystemSize class TestSystemSize: def setup(self): self.size = SystemSize('directory') def setup_method(self, cls): self.setup() def test_customize_ext(self): self.size.accumulate_files = mock.Mock(return_value=10000) assert self.size.customize(42, 'ext3') == 67 def test_customize_btrfs(self): assert self.size.customize(42, 'btrfs') == 63 def test_customize_xfs(self): assert self.size.customize(42, 'xfs') == 63 @patch('kiwi.system.size.Command.run') def test_accumulate_mbyte_file_sizes(self, mock_command): assert isinstance(self.size.accumulate_mbyte_file_sizes(['/foo']), int) mock_command.assert_called_once_with( [ 'du', '-s', '--apparent-size', '--block-size', '1', '--exclude', 'directory/proc', '--exclude', 'directory/sys', '--exclude', 'directory/dev', '--exclude', '/foo', 'directory', ] ) @patch('kiwi.system.size.Command.run') def test_accumulate_files(self, mock_command): assert isinstance(self.size.accumulate_files(), int) mock_command.assert_called_once_with( ['bash', '-c', 'find directory | wc -l'] ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.770255 kiwi-11.1.8/test/unit/system/uri_test.py0000644000000000000000000002427215273675667015224 0ustar00import logging import os from unittest.mock import patch, Mock from pytest import raises, fixture import unittest.mock as mock from kiwi.system.uri import Uri import kiwi from kiwi.exceptions import ( KiwiUriStyleUnknown, KiwiUriTypeUnknown, KiwiUriOpenError, ) class TestUri: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): self.mock_mkdtemp = mock.Mock() self.mock_manager = mock.Mock() self.runtime_config = Mock() self.runtime_config.get_obs_download_server_url = mock.Mock( return_value='obs_server' ) kiwi.system.uri.RuntimeConfig = Mock(return_value=self.runtime_config) def setup_method(self, cls): self.setup() def test_is_remote_raises_style_error(self): uri = Uri('xxx', 'rpm-md') with raises(KiwiUriStyleUnknown): uri.is_remote() def test_is_remote_raises_type_error(self): uri = Uri('xtp://download.example.com', 'rpm-md') with raises(KiwiUriTypeUnknown): uri.is_remote() def test_translate_unknown_style(self): uri = Uri('xxx', 'rpm-md') with raises(KiwiUriStyleUnknown): uri.translate() def test_translate_unsupported_style(self): uri = Uri('ms://foo', 'rpm-md') with raises(KiwiUriStyleUnknown): uri.translate() @patch('kiwi.system.uri.Defaults.is_buildservice_worker') def test_translate_obsrepositories_outside_buildservice( self, mock_buildservice ): mock_buildservice.return_value = False uri = Uri('obsrepositories:/') with raises(KiwiUriStyleUnknown): uri.translate() @patch('kiwi.system.uri.requests.get') @patch('kiwi.system.uri.Defaults.is_buildservice_worker') def test_translate_obs_uri_not_found( mock_buildservice, mock_request_get, self ): mock_buildservice.return_value = False mock_request_get.side_effect = Exception('error') uri = Uri('obs://openSUSE:Leap:42.2/standard', 'yast2') self.runtime_config.get_obs_download_server_url = mock.Mock( return_value='http://obs_server' ) uri.runtime_config = self.runtime_config with raises(KiwiUriOpenError) as exception_info: uri.translate(check_build_environment=False) assert ( f'{exception_info.value}' == 'http://obs_server/openSUSE:/Leap:/42.2/standard: error' ) @patch('kiwi.system.uri.Defaults.is_buildservice_worker') def test_translate_obs_uri_inside_buildservice(self, mock_buildservice): mock_buildservice.return_value = True uri = Uri('obs://openSUSE:Leap:42.2/standard', 'rpm-md') uri.runtime_config = self.runtime_config with self._caplog.at_level(logging.WARNING): assert ( uri.translate(False) == 'obs_server/openSUSE:/Leap:/42.2/standard' ) def test_get_fragment(self): uri = Uri('file:///myimage.tar#tag') assert uri.get_fragment() == 'tag' uri = Uri('file:///myimage.tar') assert uri.get_fragment() == '' def test_is_remote(self): uri = Uri('https://example.com', 'rpm-md') assert uri.is_remote() is True uri = Uri('dir:///path/to/repo', 'rpm-md') assert uri.is_remote() is False uri = Uri('/path/to/repo') assert uri.is_remote() is False def test_uri_needs_encoding(self): uri = Uri( 'https://user@mycompany.com:token_password@' 'artifactory-edge.mycompany.com/artifactory/' 'some_rpm_path/Base-Prod/sample.rpm' ) assert ( uri.translate(False) == 'https://user%40mycompany.com:token_password@' 'artifactory-edge.mycompany.com/artifactory/' 'some_rpm_path/Base-Prod/sample.rpm' ) @patch('kiwi.system.uri.Defaults.is_buildservice_worker') def test_is_remote_in_buildservice(self, mock_buildservice): mock_buildservice.return_value = True uri = Uri('obs://openSUSE:Leap:42.2/standard', 'yast2') assert uri.is_remote() is False @patch('kiwi.system.uri.requests') def test_is_public(self, mock_request): # unknown uri schema is considered not public uri = Uri('xxx', 'rpm-md') assert uri.is_public() is False # https is public uri = Uri('https://example.com', 'rpm-md') assert uri.is_public() is True # obs is private with obs_public set to false in config uri = Uri('obs://openSUSE:Leap:42.2/standard', 'yast2') self.runtime_config.is_obs_public = mock.Mock(return_value=False) uri.runtime_config = self.runtime_config assert uri.is_public() is False # unknown uri type considered not public uri = Uri('httpx://example.com', 'rpm-md') assert uri.is_public() is False def test_alias_is_str(self): uri = Uri('https://example.com', 'rpm-md') assert isinstance(uri.alias(), str) is True def test_alias_is_uniq(self): uri1 = Uri('https://example.com', 'rpm-md') uri2 = Uri('https://example.com', 'rpm-md') assert uri1.alias() != uri2.alias() def test_credentials_file_name(self): uri = Uri( 'http://example.com/foo?credentials=my_credentials&x=2', 'rpm-md' ) assert uri.credentials_file_name() == 'my_credentials' def test_credentials_default_file_name(self): uri = Uri('http://example.com/foo', 'rpm-md') assert uri.credentials_file_name() == 'kiwiRepoCredentials' def test_translate_http_path_with_token(self): uri = Uri('http://foo.bar/baz?asdf', 'rpm-md') assert uri.translate() == 'http://foo.bar/baz?asdf' def test_translate_http_path_with_credentials(self): uri = Uri( 'http://example.com/foo?credentials=kiwiRepoCredentials', 'rpm-md' ) assert uri.translate() == 'http://example.com/foo' @patch('kiwi.system.uri.requests.get') @patch('kiwi.defaults.Defaults.is_buildservice_worker') def test_translate_obs_project( self, mock_is_buildservice_worker, mock_request_get ): mock_is_buildservice_worker.return_value = False uri = Uri('obs://openSUSE:Leap:42.2/standard', 'yast2') uri.runtime_config = self.runtime_config uri.translate() mock_request_get.assert_called_once_with( 'obs_server/openSUSE:/Leap:/42.2/standard' ) def test_translate_dir_path(self): uri = Uri('dir:///some/path', 'rpm-md') assert uri.translate() == '/some/path' @patch('os.path.abspath') def test_translate_dir_relative_path(self, mock_abspath): mock_abspath.side_effect = lambda path: os.sep.join( ['/current/dir', path] ) uri = Uri('dir:some/path', 'rpm-md') assert uri.translate() == '/current/dir/some/path' def test_translate_http_path(self): uri = Uri('http://example.com/foo', 'rpm-md') assert uri.translate() == 'http://example.com/foo' def test_translate_https_path(self): uri = Uri('https://example.com/foo', 'rpm-md') assert uri.translate() == 'https://example.com/foo' def test_translate_ftp_path(self): uri = Uri('ftp://example.com/foo', 'rpm-md') assert uri.translate() == 'ftp://example.com/foo' @patch('kiwi.system.uri.Defaults.is_buildservice_worker') def test_translate_buildservice_path(self, mock_buildservice): mock_buildservice.return_value = True uri = Uri('obs://openSUSE:13.2/standard', 'yast2') assert ( uri.translate() == '/usr/src/packages/SOURCES/repos/openSUSE:13.2/standard' ) @patch('kiwi.system.uri.Defaults.is_buildservice_worker') def test_translate_buildservice_project(self, mock_buildservice): mock_buildservice.return_value = True uri = Uri('obs://Virtualization:/Appliances/CentOS_7', 'rpm-md') assert ( uri.translate() == '/usr/src/packages/SOURCES/repos/Virtualization:Appliances/CentOS_7' ) @patch('kiwi.system.uri.Defaults.is_buildservice_worker') def test_translate_buildservice_container_path(self, mock_buildservice): mock_buildservice.return_value = True uri = Uri('obs://project/repo/container#latest', 'container') assert ( uri.translate() == '/usr/src/packages/SOURCES/containers/project/repo/container#latest' ) @patch('kiwi.system.uri.Defaults.is_buildservice_worker') def test_translate_buildservice_obsrepositories_container_path( self, mock_buildservice ): mock_buildservice.return_value = True uri = Uri('obsrepositories:/container#latest', 'container') assert uri.translate() == ''.join( [ '/usr/src/packages/SOURCES/containers/', '_obsrepositories/container#latest', ] ) @patch('kiwi.system.uri.Defaults.is_buildservice_worker') def test_translate_buildservice_obsrepositories(self, mock_buildservice): mock_buildservice.return_value = True uri = Uri('obsrepositories:/') assert uri.translate() == '/usr/src/packages/SOURCES/repos' @patch('kiwi.system.uri.urlopen') @patch('kiwi.system.uri.Request') def test_translate_metalink_uri(self, mock_Request, mock_urlopen): with open('../data/metalink') as metalink: mock_urlopen.return_value = metalink uri = Uri('https://metalink.com/foo', source_type='metalink') assert ( uri.translate() == 'https://ftp.plusline.net/fedora/linux/releases/34/Everything/' 'x86_64/os/' ) mock_urlopen.side_effect = Exception with raises(KiwiUriOpenError): uri = Uri('https://metalink.com/foo', source_type='metalink') def test_print_sensitive(self): assert ( Uri.print_sensitive('https://user:pass@location') == 'https://******@location' ) assert ( Uri.print_sensitive('https://server.example.com/location') == 'https://server.example.com/location' ) ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.770255 kiwi-11.1.8/test/unit/system/users_test.py0000644000000000000000000001077715273675667015573 0ustar00from unittest.mock import patch from kiwi.system.users import Users class TestUsers: def setup(self): self.users = Users('root_dir') def setup_method(self, cls): self.setup() @patch('kiwi.system.users.Command.run') def test_user_exists(self, mock_command): assert self.users.user_exists('user') is True mock_command.assert_called_once_with( ['chroot', 'root_dir', 'grep', '-q', '^user:', '/etc/passwd'] ) @patch('kiwi.system.users.Command.run') def test_user_exists_return_value(self, mock_command): assert self.users.user_exists('user') is True mock_command.side_effect = Exception assert self.users.user_exists('user') is False @patch('kiwi.system.users.Command.run') def test_group_exists(self, mock_command): assert self.users.group_exists('group') is True mock_command.assert_called_once_with( ['chroot', 'root_dir', 'grep', '-q', '^group:', '/etc/group'] ) @patch('kiwi.system.users.Command.run') def test_group_add(self, mock_command): assert self.users.group_add('group', ['--option', 'value']) is None mock_command.assert_called_once_with( ['chroot', 'root_dir', 'groupadd', '--option', 'value', 'group'] ) @patch('kiwi.system.users.Command.run') def test_user_add(self, mock_command): assert self.users.user_add('user', ['--option', 'value']) is None mock_command.assert_called_once_with( ['chroot', 'root_dir', 'useradd', '--option', 'value', 'user'] ) @patch('kiwi.system.users.Command.run') def test_user_modify(self, mock_command): assert self.users.user_modify('user', ['--option', 'value']) is None mock_command.assert_called_once_with( ['chroot', 'root_dir', 'usermod', '--option', 'value', 'user'] ) @patch('kiwi.system.users.Command.run') def test_setup_home_for_user(self, mock_command): assert ( self.users.setup_home_for_user('user', 'group', '/home/path') is None ) mock_command.assert_called_once_with( ['chroot', 'root_dir', 'chown', '-R', 'user:group', '/home/path'] ) @patch('kiwi.system.users.Path.create') @patch('kiwi.system.users.Command.run') def test_user_add_creates_missing_home_parent( self, mock_command, mock_create ): assert ( self.users.user_add('newuser', ['-m', '-d', '/path/to/home']) is None ) mock_create.assert_called_once_with('root_dir/path/to') mock_command.assert_called_once_with( [ 'chroot', 'root_dir', 'useradd', '-m', '-d', '/path/to/home', 'newuser', ] ) @patch('kiwi.system.users.Path.create') @patch('kiwi.system.users.Command.run') def test_user_add_skips_parent_for_top_level_home( self, mock_command, mock_create ): self.users.user_add('newuser', ['-m', '-d', '/home']) mock_create.assert_not_called() mock_command.assert_called_once_with( ['chroot', 'root_dir', 'useradd', '-m', '-d', '/home', 'newuser'] ) @patch('kiwi.system.users.Path.create') @patch('kiwi.system.users.Command.run') def test_user_add_reads_home_from_equals_form( self, mock_command, mock_create ): self.users.user_add('newuser', ['-m', '--home-dir=/path/to/home']) mock_create.assert_called_once_with('root_dir/path/to') mock_command.assert_called_once_with( [ 'chroot', 'root_dir', 'useradd', '-m', '--home-dir=/path/to/home', 'newuser', ] ) @patch('kiwi.system.users.Path.create') @patch('kiwi.system.users.Command.run') def test_user_add_skips_relative_home(self, mock_command, mock_create): self.users.user_add('newuser', ['-m', '-d', 'relative/home']) mock_create.assert_not_called() @patch('os.path.isdir', return_value=True) @patch('kiwi.system.users.Path.create') @patch('kiwi.system.users.Command.run') def test_user_add_skips_existing_home_parent( self, mock_command, mock_create, mock_isdir ): self.users.user_add('newuser', ['-m', '--home', '/path/to/home']) mock_create.assert_not_called() mock_isdir.assert_called_once_with('root_dir/path/to') ././@PaxHeader0000000000000000000000000000003300000000000010211 xustar0027 mtime=1794079670.770255 kiwi-11.1.8/test/unit/tasks/__init__.py0000644000000000000000000000000015273675667014705 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/base_test.py0000644000000000000000000001602515273675667015135 0ustar00import sys from unittest.mock import patch, call from pytest import raises, fixture import logging from ..test_helper import argv_kiwi_tests import kiwi.xml_parse from kiwi.tasks.base import CliTask from kiwi.defaults import Defaults from kiwi.exceptions import KiwiConfigFileNotFound class TestCliTask: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.logger.Logger.setLogLevel') @patch('kiwi.logger.Logger.setLogFlag') @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.logger.Logger.set_log_socket') @patch('kiwi.logger.Logger.set_color_format') @patch('kiwi.cli.Cli.load_command') @patch('kiwi.cli.Cli.get_command_args') @patch('kiwi.cli.Cli.get_global_args') @patch('kiwi.runtime_config.RuntimeConfig') def setup( self, mock_runtime_config, mock_global_args, mock_command_args, mock_load_command, mock_color, mock_set_log_socket, mock_setlog, mock_setLogFlag, mock_setLogLevel, ): Defaults.set_platform_name('x86_64') mock_global_args.return_value = { '--debug': True, '--debug-run-scripts-in-screen': True, '--logfile': 'stdout', '--logsocket': 'log_socket', '--loglevel': None, '--color-output': True, '--profile': ['vmxFlavour'], '--setenv': ['SOURCE_DATE_EPOCH=42'], '--type': None, } mock_command_args.return_value = { 'system': True, 'prepare': True, '--description': 'description', '--root': 'directory', } self.task = CliTask() mock_load_command.assert_called_once_with() assert mock_command_args.call_args_list == [ call(raise_if_no_command=False), call(), ] mock_global_args.assert_called_once_with() assert mock_setLogLevel.call_args_list == [ call(logging.DEBUG), call(logging.CRITICAL, except_for=['file', 'socket']), ] mock_setLogFlag.assert_called_once_with('run-scripts-in-screen') mock_setlog.assert_called_once_with('stdout') mock_color.assert_called_once_with() mock_runtime_config.assert_called_once_with() mock_setLogLevel.reset_mock() mock_global_args.return_value = { '--debug': True, '--debug-run-scripts-in-screen': True, '--logfile': 'some', '--logsocket': 'log_socket', '--loglevel': None, '--color-output': True, '--profile': ['vmxFlavour'], '--setenv': [], '--type': None, } self.task = CliTask() assert mock_setLogLevel.call_args_list == [ call(logging.DEBUG), call(logging.DEBUG, only_for=['file', 'socket']), ] @patch('kiwi.logger.Logger.setLogLevel') @patch('kiwi.logger.Logger.setLogFlag') @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.logger.Logger.set_log_socket') @patch('kiwi.logger.Logger.set_color_format') @patch('kiwi.cli.Cli.load_command') @patch('kiwi.cli.Cli.get_command_args') @patch('kiwi.cli.Cli.get_global_args') @patch('kiwi.runtime_config.RuntimeConfig') def setup_method( self, cls, mock_runtime_config, mock_global_args, mock_command_args, mock_load_command, mock_color, mock_set_log_socket, mock_setlog, mock_setLogFlag, mock_setLogLevel, ): self.setup() @patch('kiwi.logger.Logger.setLogLevel') @patch('kiwi.cli.Cli.load_command') @patch('kiwi.cli.Cli.get_command_args') @patch('kiwi.cli.Cli.get_global_args') @patch('kiwi.runtime_config.RuntimeConfig') def test_setup_custom_log_level( self, mock_runtime_config, mock_global_args, mock_command_args, mock_load_command, mock_setLogLevel, ): Defaults.set_platform_name('x86_64') mock_global_args.return_value = { '--debug': None, '--logfile': None, '--logsocket': None, '--debug-run-scripts-in-screen': None, '--color-output': None, '--loglevel': '10', '--setenv': [], } self.task = CliTask() mock_setLogLevel.assert_called_once_with(10) @patch('kiwi.logger.Logger.setLogLevel') @patch('kiwi.cli.Cli.load_command') @patch('kiwi.cli.Cli.get_command_args') @patch('kiwi.cli.Cli.get_global_args') @patch('kiwi.runtime_config.RuntimeConfig') def test_setup_custom_log_level_invalid( self, mock_runtime_config, mock_global_args, mock_command_args, mock_load_command, mock_setLogLevel, ): Defaults.set_platform_name('x86_64') mock_global_args.return_value = { '--debug': None, '--logfile': None, '--logsocket': None, '--debug-run-scripts-in-screen': None, '--color-output': None, '--loglevel': 'bogus', '--setenv': [], } self.task = CliTask() mock_setLogLevel.assert_called_once_with(20) def test_eleventuple_token(self): assert self.task.eleventuple_token( 'a,b,,d,e,f,{1;2;3},x y z,jammy,false,metalink' ) == [ 'a', 'b', '', 'd', 'e', 'f', ['1', '2', '3'], 'x y z', 'jammy', False, 'metalink', ] assert self.task.eleventuple_token('a,b,,d,e,f,{1;2;3}') == [ 'a', 'b', '', 'd', 'e', 'f', ['1', '2', '3'], None, None, None, None, ] def test_attr_token(self): assert self.task.attr_token('a=b') == ['a', 'b'] @patch('kiwi.tasks.base.RuntimeChecker') def test_load_xml_description(self, mock_runtime_checker): self.task.load_xml_description('../data/description') mock_runtime_checker.assert_called_once_with(self.task.xml_state) assert self.task.config_file == '../data/description/config.xml' assert isinstance(self.task.xml_data, kiwi.xml_parse.image) assert self.task.xml_state.profiles == ['vmxFlavour'] def test_load_xml_description_buildservice(self): self.task.load_xml_description('../data/description.buildservice') assert ( self.task.config_file == '../data/description.buildservice/appliance.kiwi' ) def test_load_xml_description_raises(self): with raises(KiwiConfigFileNotFound): self.task.load_xml_description('foo') with raises(KiwiConfigFileNotFound): self.task.load_xml_description('path', 'custom_kiwi_file') def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/image_info_test.py0000644000000000000000000004110715273675667016317 0ustar00import sys from unittest.mock import patch, call, Mock, MagicMock import kiwi from ..test_helper import argv_kiwi_tests from kiwi.defaults import Defaults from kiwi.tasks.image_info import ImageInfoTask from collections import namedtuple, OrderedDict class TestImageInfoTask: def setup(self): sys.argv = [ sys.argv[0], 'image', 'info', '--description', '../data/image_info', '--resolve-package-list', ] result_type = namedtuple( 'result_type', ['uri', 'installsize_bytes', 'arch', 'version', 'checksum'], ) self.result_info = { 'image': 'LimeJeOS', 'resolved-packages': { 'packagename': { 'version': '0.8.15', 'arch': 'x86_64', 'source': 'uri', 'status': 'added_by_dependency_solver', 'installsize_bytes': 42, }, 'filesystem': { 'version': '42', 'arch': 'x86_64', 'source': 'uri', 'status': 'listed_in_kiwi_description', 'installsize_bytes': 0, }, }, } self.runtime_checker = Mock() kiwi.tasks.base.RuntimeChecker = Mock(return_value=self.runtime_checker) self.runtime_config = Mock() kiwi.tasks.base.RuntimeConfig = Mock(return_value=self.runtime_config) self.solver = MagicMock() self.solver.solve = Mock( return_value={ 'packagename': result_type( uri='uri', installsize_bytes=42, arch='x86_64', version='0.8.15', checksum='checksum', ), 'filesystem': result_type( uri='uri', installsize_bytes=0, arch='x86_64', version='42', checksum='checksum', ), } ) kiwi.tasks.image_info.Sat = Mock(return_value=self.solver) self.solver_repository = Mock() kiwi.tasks.image_info.SolverRepository = Mock( return_value=self.solver_repository ) kiwi.tasks.image_info.Help = Mock(return_value=Mock()) self.task = ImageInfoTask() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def _init_command_args(self): self.task.command_args = {} self.task.command_args['help'] = False self.task.command_args['info'] = False self.task.command_args['--description'] = '../data/image_info' self.task.command_args['--add-repo'] = [] self.task.command_args['--add-repo-credentials'] = [] self.task.command_args['--ignore-repos'] = False self.task.command_args['--resolve-package-list'] = False self.task.command_args['--list-profiles'] = False self.task.command_args['--print-kiwi-env'] = False self.task.command_args['--print-xml'] = False self.task.command_args['--print-yaml'] = False self.task.command_args['--print-toml'] = False @patch('kiwi.tasks.image_info.DataOutput') def test_process_image_info(self, mock_out): self._init_command_args() self.task.command_args['info'] = True self.task.process() self.runtime_checker.check_repositories_configured.assert_called_once_with() mock_out.assert_called_once_with({'image': 'LimeJeOS'}) @patch('kiwi.tasks.image_info.DataOutput') def test_process_image_info_color_output(self, mock_out): self._init_command_args() self.task.command_args['info'] = True self.task.global_args['--color-output'] = True self.task.process() mock_out.assert_called_once_with({'image': 'LimeJeOS'}, style='color') @patch('kiwi.tasks.image_info.DataOutput') def test_process_image_info_list_profiles(self, mock_out): self._init_command_args() self.task.command_args['info'] = True self.task.command_args['--list-profiles'] = True self.task.process() self.runtime_checker.check_repositories_configured.assert_called_once_with() mock_out.assert_called_once_with( {'image': 'LimeJeOS', 'profile_names': ['some']} ) @patch('kiwi.tasks.image_info.DataOutput') def test_process_image_info_print_kiwi_env(self, mock_out): self._init_command_args() self.task.command_args['info'] = True self.task.command_args['--print-kiwi-env'] = True self.task.process() self.runtime_checker.check_repositories_configured.assert_called_once_with() mock_out.assert_called_once_with( { 'image': 'LimeJeOS', 'kiwi_env': OrderedDict( [ ('kiwi_align', '1048576'), ('kiwi_boot_timeout', ''), ('kiwi_bootkernel', ''), ('kiwi_bootloader', 'grub2'), ('kiwi_bootloader_console', 'default:default'), ('kiwi_bootprofile', ''), ('kiwi_btrfs_root_is_snapper_snapshot', ''), ('kiwi_btrfs_root_is_snapshot', ''), ('kiwi_cmdline', ''), ('kiwi_compressed', ''), ('kiwi_delete', ''), ('kiwi_devicepersistency', ''), ('kiwi_displayname', 'Bob'), ('kiwi_drivers', ''), ('kiwi_firmware', ''), ('kiwi_fsmountoptions', ''), ('kiwi_gpt_hybrid_mbr', ''), ('kiwi_hybridpersistent', ''), ('kiwi_hybridpersistent_filesystem', ''), ('kiwi_iname', 'LimeJeOS'), ('kiwi_initrd_system', 'dracut'), ('kiwi_installboot', ''), ('kiwi_iversion', '1.13.2'), ('kiwi_keytable', 'us.map.gz'), ('kiwi_language', 'en_US'), ('kiwi_live_volid', 'CDROM'), ('kiwi_loader_theme', 'openSUSE'), ('kiwi_luks_empty_passphrase', 'false'), ('kiwi_profiles', ''), ('kiwi_ramonly', ''), ('kiwi_revision', '$Format:%H$'), ('kiwi_rootpartuuid', ''), ('kiwi_sectorsize', '512'), ('kiwi_shasum_suffix', '.sha256'), ('kiwi_showlicense', ''), ('kiwi_splash_theme', 'openSUSE'), ('kiwi_startsector', '2048'), ('kiwi_strip_delete', ''), ('kiwi_strip_libs', ''), ('kiwi_strip_tools', ''), ('kiwi_target_blocksize', '512'), ('kiwi_target_removable', ''), ('kiwi_timezone', 'Europe/Berlin'), ('kiwi_type', 'iso'), ('kiwi_vga', 'auto'), ('kiwi_wwid_wait_timeout', ''), ] ), } ) @patch('kiwi.tasks.image_info.DataOutput') @patch('kiwi.tasks.image_info.SolverRepository.new') @patch('kiwi.tasks.image_info.Uri') @patch('kiwi.tasks.image_info.SolverRepositoryBase.get_repo_type') def test_process_image_info_resolve_package_list( self, mock_get_repo_type, mock_uri, mock_solver_repo_new, mock_out ): uri = Mock() uri.uri = 'http://example.org/some/path' mock_uri.return_value = uri mock_get_repo_type.return_value = 'apt-deb' self.solver.set_dist_type.return_value = {'arch': 'amd64'} self._init_command_args() self.task.command_args['info'] = True self.task.command_args['--resolve-package-list'] = True self.task.process() assert self.solver.add_repository.called assert mock_uri.call_args_list == [ call(uri='http://us.archive.ubuntu.com/ubuntu/', source_type=''), call( 'http://us.archive.ubuntu.com/ubuntu/dists/focal/' 'main/binary-amd64', 'apt-deb', '', ), call( 'http://us.archive.ubuntu.com/ubuntu/dists/focal/' 'multiverse/binary-amd64', 'apt-deb', '', ), call( 'http://us.archive.ubuntu.com/ubuntu/dists/focal/' 'restricted/binary-amd64', 'apt-deb', '', ), call( 'http://us.archive.ubuntu.com/ubuntu/dists/focal/' 'universe/binary-amd64', 'apt-deb', '', ), call('obs://Devel:PubCloud:AmazonEC2/SLE_12_GA', 'rpm-md', ''), ] mock_out.assert_called_once_with(self.result_info) @patch('kiwi.tasks.image_info.DataOutput') @patch('kiwi.tasks.image_info.SolverRepository.new') @patch('kiwi.tasks.image_info.Uri') @patch('kiwi.tasks.image_info.SolverRepositoryBase.get_repo_type') def test_process_image_info_resolve_package_list_no_deb_arch( self, mock_get_repo_type, mock_uri, mock_solver_repo_new, mock_out ): # without a Debian name for the architecture the machine # name is used, as the solver does Defaults.set_platform_name('s390x') uri = Mock() uri.uri = 'http://example.org/some/path' mock_uri.return_value = uri mock_get_repo_type.return_value = 'apt-deb' self.solver.set_dist_type.return_value = None self._init_command_args() self.task.command_args['info'] = True self.task.command_args['--resolve-package-list'] = True self.task.process() assert mock_uri.call_args_list[1] == call( 'http://us.archive.ubuntu.com/ubuntu/dists/focal/' 'main/binary-s390x', 'apt-deb', '', ) @patch('kiwi.xml_state.XMLState.add_repository') @patch('kiwi.tasks.image_info.DataOutput') @patch('os.path.isfile') def test_process_image_info_add_repo( self, mock_os_path_is_file, mock_out, mock_add_repo ): self._init_command_args() mock_os_path_is_file.return_value = False self.task.command_args['--add-repo'] = [ 'http://example1.com,rpm-md,alias,99,true', 'http://example2.com,rpm-md,alias,99,false,true', 'http://example3.com,rpm-md,alias,99,false,true', 'http://example4.com,,alias,99,false,true', 'http://example5.com,,,99,false,true', ] self.task.process() assert mock_add_repo.call_args_list == [ call( 'http://example1.com', 'rpm-md', 'alias', '99', True, None, [], None, None, None, None, ), call( 'http://example2.com', 'rpm-md', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example3.com', 'rpm-md', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example4.com', None, 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example5.com', None, None, '99', False, True, [], None, None, None, None, ), ] self.task.command_args['--add-repo-credentials'] = [ 'user1:pass1', 'user2:pass2', ] mock_add_repo.reset_mock() self.task.process() assert mock_add_repo.call_args_list == [ call( 'http://user1:pass1@example1.com', 'rpm-md', 'alias', '99', True, None, [], None, None, None, None, ), call( 'http://user2:pass2@example2.com', 'rpm-md', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example3.com', 'rpm-md', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example4.com', None, 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example5.com', None, None, '99', False, True, [], None, None, None, None, ), ] self.task.command_args['--add-repo'] = [ 'http://example1.com,rpm-md,alias,99,true' ] self.task.command_args['--add-repo-credentials'] = [ '../data/credentials' ] mock_os_path_is_file.return_value = True mock_add_repo.reset_mock() self.task.process() mock_add_repo.assert_called_once_with( 'http://user:pass@example1.com', 'rpm-md', 'alias', '99', True, None, [], None, None, None, None, ) @patch('kiwi.xml_state.XMLState.delete_repository_sections') @patch('kiwi.tasks.image_info.DataOutput') def test_process_image_info_delete_repos(self, mock_out, mock_delete_repos): self._init_command_args() self.task.command_args['--ignore-repos'] = True self.task.process() mock_delete_repos.assert_called_once_with() def test_process_image_info_help(self): self._init_command_args() self.task.command_args['help'] = True self.task.command_args['info'] = True self.task.process() self.task.manual.show.assert_called_once_with('kiwi::image::info') @patch('kiwi.tasks.image_info.DataOutput') def test_process_image_info_print_xml(self, mock_out): self._init_command_args() self.task.command_args['--print-xml'] = True self.task.process() tmpfile, message = mock_out.display_file.call_args.args assert tmpfile.startswith('/var/tmp/kiwi_xslt-') assert message == 'Description(XML):' @patch('kiwi.tasks.image_info.DataOutput') def test_process_image_info_print_yaml(self, mock_out): self._init_command_args() self.task.command_args['--print-yaml'] = True self.task.process() tmpfile, message = mock_out.display_file.call_args.args assert tmpfile.startswith('/var/tmp/kiwi_xslt-') assert message == 'Description(YAML):' @patch('kiwi.tasks.image_info.DataOutput') def test_process_image_info_print_toml(self, mock_out): self._init_command_args() self.task.command_args['--print-toml'] = True self.task.process() tmpfile, message = mock_out.display_file.call_args.args assert tmpfile.startswith('/var/tmp/kiwi_xslt-') assert message == 'Description(TOML):' ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/image_resize_test.py0000644000000000000000000001722515273675667016671 0ustar00import logging import os import sys from unittest.mock import Mock, patch from pytest import raises, fixture from ..test_helper import argv_kiwi_tests import kiwi from kiwi.tasks.image_resize import ImageResizeTask from kiwi.exceptions import ( KiwiImageResizeError, KiwiSizeError, KiwiConfigFileNotFound, ) class TestImageResizeTask: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): sys.argv = [ sys.argv[0], '--profile', 'vmxSimpleFlavour', '--type', 'oem', 'image', 'resize', '--target-dir', 'target_dir', '--size', '20g', '--root', '../data/root-dir', ] self.abs_root_dir = os.path.abspath('../data/root-dir') kiwi.tasks.image_resize.Help = Mock(return_value=Mock()) self.firmware = Mock() self.firmware.get_partition_table_type = Mock(return_value='gpt') kiwi.tasks.image_resize.FirmWare = Mock(return_value=self.firmware) self.task = ImageResizeTask() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def _init_command_args(self): self.task.command_args = {} self.task.command_args['help'] = False self.task.command_args['resize'] = False self.task.command_args['--target-dir'] = 'target_dir' self.task.command_args['--size'] = '42g' self.task.command_args['--root'] = '../data/root-dir' def test_process_no_root_directory_specified(self): self.task.command_args['--root'] = None with raises(KiwiConfigFileNotFound): self.task.process() @patch('kiwi.tasks.image_resize.DiskFormat.new') def test_process_no_raw_disk_found(self, mock_DiskFormat): image_format = Mock() image_format.has_raw_disk.return_value = False mock_DiskFormat.return_value.__enter__.return_value = image_format self._init_command_args() self.task.command_args['resize'] = True with raises(KiwiImageResizeError): self.task.process() @patch('kiwi.tasks.image_resize.DiskFormat.new') def test_process_unsupported_size_format(self, mock_DiskFormat): image_format = Mock() image_format.has_raw_disk.return_value = True mock_DiskFormat.return_value.__enter__.return_value = image_format self._init_command_args() self.task.command_args['--size'] = '20x' self.task.command_args['resize'] = True with raises(KiwiSizeError): self.task.process() @patch('kiwi.tasks.image_resize.LoopDevice') @patch('kiwi.tasks.image_resize.DiskFormat.new') @patch('kiwi.tasks.image_resize.Partitioner.new') def test_process_image_resize_gb( self, mock_Partitioner, mock_DiskFormat, mock_LoopDevice ): loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider partitioner = Mock() mock_Partitioner.return_value = partitioner image_format = Mock() image_format.resize_raw_disk.return_value = True mock_DiskFormat.return_value.__enter__.return_value = image_format self._init_command_args() self.task.command_args['resize'] = True self.task.process() loop_provider.create.assert_called_once_with(overwrite=False) partitioner.resize_table.assert_called_once_with() image_format.resize_raw_disk.assert_called_once_with( 42 * 1024 * 1024 * 1024 ) image_format.create_image_format.assert_called_once_with() @patch('kiwi.tasks.image_resize.LoopDevice') @patch('kiwi.tasks.image_resize.DiskFormat.new') @patch('kiwi.tasks.image_resize.Partitioner.new') def test_process_image_resize_mb( self, mock_Partitioner, mock_DiskFormat, mock_LoopDevice ): loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider partitioner = Mock() mock_Partitioner.return_value = partitioner image_format = Mock() image_format.resize_raw_disk.return_value = True mock_DiskFormat.return_value.__enter__.return_value = image_format self._init_command_args() self.task.command_args['resize'] = True self.task.command_args['--size'] = '42m' self.task.process() loop_provider.create.assert_called_once_with(overwrite=False) partitioner.resize_table.assert_called_once_with() image_format.resize_raw_disk.assert_called_once_with(42 * 1024 * 1024) image_format.create_image_format.assert_called_once_with() @patch('kiwi.tasks.image_resize.LoopDevice') @patch('kiwi.tasks.image_resize.DiskFormat.new') @patch('kiwi.tasks.image_resize.Partitioner.new') def test_process_image_resize_bytes( self, mock_Partitioner, mock_DiskFormat, mock_LoopDevice ): loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider partitioner = Mock() mock_Partitioner.return_value = partitioner image_format = Mock() image_format.resize_raw_disk.return_value = True mock_DiskFormat.return_value.__enter__.return_value = image_format self._init_command_args() self.task.command_args['resize'] = True self.task.command_args['--size'] = '42' self.task.process() loop_provider.create.assert_called_once_with(overwrite=False) partitioner.resize_table.assert_called_once_with() image_format.resize_raw_disk.assert_called_once_with(42) image_format.create_image_format.assert_called_once_with() @patch('kiwi.tasks.image_resize.LoopDevice') @patch('kiwi.tasks.image_resize.DiskFormat.new') @patch('kiwi.tasks.image_resize.Partitioner.new') def test_process_image_resize_not_needed( self, mock_Partitioner, mock_DiskFormat, mock_LoopDevice ): loop_provider = Mock() mock_LoopDevice.return_value.__enter__.return_value = loop_provider partitioner = Mock() mock_Partitioner.return_value = partitioner image_format = Mock() image_format.resize_raw_disk.return_value = False mock_DiskFormat.return_value.__enter__.return_value = image_format self._init_command_args() self.task.command_args['resize'] = True self.task.command_args['--size'] = '42' with self._caplog.at_level(logging.INFO): self.task.process() loop_provider.create.assert_called_once_with(overwrite=False) partitioner.resize_table.assert_called_once_with() image_format.resize_raw_disk.assert_called_once_with(42) assert 'Loading XML description' in self._caplog.text assert ( '--> loaded {0}'.format( os.sep.join([self.abs_root_dir, 'image', 'config.xml']) ) in self._caplog.text ) assert '--> Selected build type: oem' in self._caplog.text assert ( '--> Selected profiles: vmxSimpleFlavour' in self._caplog.text ) assert 'Resizing raw disk to 42 bytes' in self._caplog.text assert 'Raw disk is already at 42 bytes' in self._caplog.text def test_process_image_resize_help(self): self._init_command_args() self.task.command_args['help'] = True self.task.command_args['resize'] = True self.task.process() self.task.manual.show.assert_called_once_with('kiwi::image::resize') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/result_bundle_test.py0000644000000000000000000006317215273675667017077 0ustar00import os import sys import logging from unittest.mock import patch, call, Mock, mock_open from pytest import raises, fixture from ..test_helper import argv_kiwi_tests import kiwi from kiwi.tasks.result_bundle import ResultBundleTask from kiwi.system.result import Result from kiwi.exceptions import KiwiBundleError class TestResultBundleTask: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): sys.argv = [ sys.argv[0], 'result', 'bundle', '--target-dir', 'target_dir', '--bundle-dir', 'bundle_dir', '--id', 'Build_42', ] self.abs_target_dir = os.path.abspath('target_dir') self.abs_bundle_dir = os.path.abspath('bundle_dir') self.xml_state = Mock() self.xml_state.get_image_version = Mock(return_value='1.2.3') self.xml_state.xml_data.get_name = Mock(return_value='test-image') self.result = Result(self.xml_state) self.result.add( key='keyname', filename='test-image-1.2.3', use_for_bundle=True, compress=True, shasum=True, ) kiwi.tasks.result_bundle.Help = Mock(return_value=Mock()) self.task = ResultBundleTask() runtime_config = Mock() runtime_config.is_bundle_compression_requested = Mock(return_value=True) self.task.runtime_config = runtime_config def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def _init_command_args(self): self.task.command_args = {} self.task.command_args['help'] = False self.task.command_args['bundle'] = False self.task.command_args['--target-dir'] = 'target_dir' self.task.command_args['--bundle-dir'] = 'bundle_dir' self.task.command_args['--id'] = 'Build_42' self.task.command_args['--zsync-source'] = None self.task.command_args['--package-as-rpm'] = None self.task.command_args['--bundle-format'] = None self.task.command_args['--no-compress'] = None def test_process_invalid_bundle_directory(self): self._init_command_args() self.task.command_args['--bundle-dir'] = self.task.command_args[ '--target-dir' ] self.task.command_args['bundle'] = True with raises(KiwiBundleError): self.task.process() @patch('kiwi.tasks.result_bundle.Result.load') @patch('kiwi.tasks.result_bundle.Command.run') @patch('kiwi.tasks.result_bundle.Path.create') @patch('kiwi.tasks.result_bundle.Path.which') @patch('kiwi.tasks.result_bundle.Compress') @patch('os.path.exists') @patch('os.path.islink') @patch('os.unlink') @patch('os.symlink') @patch('os.readlink') def test_process_result_bundle( self, mock_os_readlink, mock_os_symlink, mock_os_unlink, mock_os_path_islink, mock_exists, mock_compress, mock_path_which, mock_path_create, mock_command, mock_load, ): # This file won't be copied with build id self.result.add( key='noversion', filename='test-image-noversion', use_for_bundle=True, compress=False, shasum=False, ) compress = Mock() mock_path_which.return_value = 'zsyncmake' compress.xz.return_value = 'compressed_filename' mock_compress.return_value = compress mock_exists.return_value = False mock_load.return_value = self.result self._init_command_args() self.task.command_args['bundle'] = True self.task.command_args['--zsync-source'] = 'http://example.com/zsync' command_result = Mock() command_result.output = "some mime is text" mock_command.return_value = command_result mock_os_readlink.return_value = 'readlinked' m_open = mock_open() with patch('builtins.open', m_open, create=True): self.task.process() mock_load.assert_called_once_with( os.sep.join([self.abs_target_dir, 'kiwi.result']) ) mock_path_create.assert_called_once_with(self.abs_bundle_dir) assert mock_command.call_args_list == [ call( [ 'cp', 'test-image-1.2.3', os.sep.join( [self.abs_bundle_dir, 'test-image-1.2.3-Build_42'] ), ] ), call( [ 'cp', 'test-image-noversion', os.sep.join([self.abs_bundle_dir, 'test-image-noversion']), ] ), call( [ 'file', os.sep.join( [self.abs_bundle_dir, 'test-image-1.2.3-Build_42'] ), ] ), call( [ 'sed', '-ie', 's/test-image-1.2.3/readlinked/g', os.sep.join( [self.abs_bundle_dir, 'test-image-1.2.3-Build_42'] ), ] ), call( [ 'file', os.sep.join([self.abs_bundle_dir, 'test-image-noversion']), ] ), call( [ 'sed', '-ie', 's/test-image-1.2.3/readlinked/g', os.sep.join([self.abs_bundle_dir, 'test-image-noversion']), ] ), call( [ 'zsyncmake', '-e', '-u', 'http://example.com/zsync/compressed_filename', '-o', 'compressed_filename.zsync', 'compressed_filename', ] ), ] mock_compress.assert_called_once_with( os.sep.join([self.abs_bundle_dir, 'test-image-1.2.3-Build_42']) ) m_open.return_value.write.assert_called_once_with( '{0} compressed_filename{1}'.format( self.task.runtime_config.get_checksum_handler.return_value.digest.return_value, os.linesep, ) ) @patch('kiwi.tasks.result_bundle.Privileges.check_for_root_permissions') @patch('kiwi.tasks.result_bundle.Result.load') @patch('kiwi.tasks.result_bundle.Command.run') @patch('kiwi.tasks.result_bundle.Path.create') @patch('kiwi.tasks.result_bundle.Path.which') @patch('kiwi.tasks.result_bundle.Path.wipe') @patch('kiwi.tasks.result_bundle.Compress') @patch('os.path.exists') @patch('os.chdir') @patch('os.unlink') @patch('glob.iglob') @patch('os.path.islink') @patch('os.symlink') @patch('os.readlink') @patch('os.path.realpath') @patch('os.path.abspath') def test_process_result_bundle_as_rpm( self, mock_os_path_abspath, mock_os_path_realpath, mock_os_readlink, mock_os_symlink, mock_os_path_islink, mock_iglob, mock_unlink, mock_chdir, mock_exists, mock_compress, mock_path_wipe, mock_path_which, mock_path_create, mock_command, mock_load, mock_Privileges_check_for_root_permissions, ): def abspath(path): if path == 'target_dir': return 'target-dir' else: return 'bundle-dir' compress = Mock() mock_os_readlink.return_value = 'readlink' mock_os_path_abspath.side_effect = abspath mock_path_which.return_value = 'zsyncmake' compress.xz.return_value = 'compressed_filename' mock_compress.return_value = compress mock_exists.return_value = False mock_load.return_value = self.result self._init_command_args() self.task.command_args['bundle'] = True self.task.command_args['--package-as-rpm'] = True mock_iglob.return_value = [ os.sep.join([self.abs_bundle_dir, 'test-image-1.2.3-Build_42']) ] m_open = mock_open() with patch('builtins.open', m_open, create=True): self.task.process() mock_path_wipe.assert_called_once_with('bundle-dir') mock_Privileges_check_for_root_permissions.assert_called_once_with() assert mock_command.call_args_list == [ call( [ 'cp', 'test-image-1.2.3', os.sep.join(['bundle-dir', 'test-image-1.2.3-Build_42']), ] ), call( [ 'file', os.sep.join(['bundle-dir', 'test-image-1.2.3-Build_42']), ] ), call( [ 'rpmbuild', '--nodeps', '--nocheck', '--rmspec', '-bb', os.sep.join(['bundle-dir', 'test-image.spec']), ] ), call(['bash', '-c', 'mv noarch/*.rpm . && rmdir noarch']), ] mock_chdir.assert_called_once_with('bundle-dir') assert mock_unlink.called @patch('kiwi.tasks.result_bundle.Result.load') @patch('kiwi.tasks.result_bundle.Command.run') @patch('kiwi.tasks.result_bundle.Path.create') @patch('os.path.exists') @patch('os.path.islink') @patch('os.unlink') @patch('os.symlink') @patch('os.readlink') def test_process_result_bundle_with_bundle_format( self, mock_os_readlink, mock_os_symlink, mock_os_unlink, mock_os_path_islink, mock_exists, mock_path_create, mock_command, mock_load, ): self.xml_state.profiles = None self.xml_state.host_architecture = 'x86_64' self.xml_state.get_build_type_name = Mock(return_value='oem') self.xml_state.xml_data.get_name = Mock(return_value='Leap-15.2') result = Result(self.xml_state) result.add_bundle_format('%N-%T:%M') result.add( key='disk_image', filename='/tmp/mytest/Leap-15.2.x86_64-1.15.2.raw', use_for_bundle=True, compress=False, shasum=False, ) mock_exists.return_value = False mock_load.return_value = result self._init_command_args() self.task.process() assert mock_command.call_args_list == [ call( [ 'cp', '/tmp/mytest/Leap-15.2.x86_64-1.15.2.raw', os.sep.join([self.abs_bundle_dir, 'Leap-15.2-oem:1.raw']), ] ), call( [ 'file', os.sep.join([self.abs_bundle_dir, 'Leap-15.2-oem:1.raw']), ] ), ] @patch('kiwi.tasks.result_bundle.Result.load') @patch('kiwi.tasks.result_bundle.Command.run') @patch('kiwi.tasks.result_bundle.Path.create') @patch('os.path.exists') @patch('os.path.islink') @patch('os.unlink') @patch('os.symlink') @patch('os.readlink') def test_process_result_bundle_with_bundle_format_for_vagrant_types( self, mock_os_readlink, mock_os_symlink, mock_os_unlink, mock_os_path_islink, mock_exists, mock_path_create, mock_command, mock_load, ): self.xml_state.profiles = None self.xml_state.host_architecture = 'x86_64' self.xml_state.get_build_type_name = Mock(return_value='oem') self.xml_state.xml_data.get_name = Mock(return_value='Leap-15.2') result = Result(self.xml_state) result.add_bundle_format('%N-%T:%M') result.add( key='disk_image', filename='/tmp/mytest/Leap-15.2.x86_64-1.15.2.vagrant.virtualbox.box', use_for_bundle=True, compress=False, shasum=False, ) mock_exists.return_value = False mock_load.return_value = result self._init_command_args() self.task.process() assert mock_command.call_args_list == [ call( [ 'cp', '/tmp/mytest/Leap-15.2.x86_64-1.15.2.vagrant.virtualbox.box', os.sep.join( [ self.abs_bundle_dir, 'Leap-15.2-oem:1.vagrant.virtualbox.box', ] ), ] ), call( [ 'file', os.sep.join( [ self.abs_bundle_dir, 'Leap-15.2-oem:1.vagrant.virtualbox.box', ] ), ] ), ] @patch('kiwi.tasks.result_bundle.Result.load') @patch('kiwi.tasks.result_bundle.Command.run') @patch('kiwi.tasks.result_bundle.Path.create') @patch('os.path.exists') @patch('os.path.islink') @patch('os.unlink') @patch('os.symlink') @patch('os.readlink') def test_process_result_bundle_with_bundle_format_for_archive_types( self, mock_os_readlink, mock_os_symlink, mock_os_unlink, mock_os_path_islink, mock_exists, mock_path_create, mock_command, mock_load, ): self.xml_state.profiles = None self.xml_state.host_architecture = 'x86_64' self.xml_state.get_build_type_name = Mock(return_value='oem') self.xml_state.xml_data.get_name = Mock(return_value='Leap-15.2') result = Result(self.xml_state) result.add_bundle_format('%N-%T:%M') result.add( key='disk_image', filename='/tmp/mytest/Leap-15.2.x86_64-1.15.2.tar.xz', use_for_bundle=True, compress=False, shasum=False, ) mock_exists.return_value = False mock_load.return_value = result self._init_command_args() self.task.process() assert mock_command.call_args_list == [ call( [ 'cp', '/tmp/mytest/Leap-15.2.x86_64-1.15.2.tar.xz', os.sep.join( [self.abs_bundle_dir, 'Leap-15.2-oem:1.tar.xz'] ), ] ), call( [ 'file', os.sep.join( [self.abs_bundle_dir, 'Leap-15.2-oem:1.tar.xz'] ), ] ), ] @patch('kiwi.tasks.result_bundle.Result.load') @patch('kiwi.tasks.result_bundle.Command.run') @patch('kiwi.tasks.result_bundle.Path.create') @patch('os.path.exists') @patch('os.path.islink') @patch('os.unlink') @patch('os.symlink') @patch('os.readlink') def test_process_result_bundle_with_bundle_format_for_oci_types( self, mock_os_readlink, mock_os_symlink, mock_os_unlink, mock_os_path_islink, mock_exists, mock_path_create, mock_command, mock_load, ): self.xml_state.profiles = None self.xml_state.host_architecture = 'x86_64' self.xml_state.get_build_type_name = Mock(return_value='oci') self.xml_state.xml_data.get_name = Mock(return_value='Leap-15.2') result = Result(self.xml_state) result.add_bundle_format('%N-%T:%M') result.add( key='container', filename='/tmp/mytest/Leap-15.2.x86_64-1.15.2.oci.tar.xz', use_for_bundle=True, compress=False, shasum=False, ) mock_exists.return_value = False mock_load.return_value = result self._init_command_args() self.task.process() assert mock_command.call_args_list == [ call( [ 'cp', '/tmp/mytest/Leap-15.2.x86_64-1.15.2.oci.tar.xz', os.sep.join( [self.abs_bundle_dir, 'Leap-15.2-oci:1.oci.tar.xz'] ), ] ), call( [ 'file', os.sep.join( [self.abs_bundle_dir, 'Leap-15.2-oci:1.oci.tar.xz'] ), ] ), ] @patch('kiwi.tasks.result_bundle.Result.load') @patch('kiwi.tasks.result_bundle.Command.run') @patch('kiwi.tasks.result_bundle.Path.create') @patch('os.path.exists') @patch('os.path.islink') @patch('os.unlink') @patch('os.symlink') @patch('os.readlink') def test_process_result_bundle_with_bundle_format_for_docker_type( self, mock_os_readlink, mock_os_symlink, mock_os_unlink, mock_os_path_islink, mock_exists, mock_path_create, mock_command, mock_load, ): self.xml_state.profiles = None self.xml_state.host_architecture = 'x86_64' self.xml_state.get_build_type_name = Mock(return_value='docker') self.xml_state.xml_data.get_name = Mock(return_value='Leap-15.2') result = Result(self.xml_state) result.add_bundle_format('%N-%T:%M') result.add( key='container', filename='/tmp/mytest/Leap-15.2.x86_64-1.15.2.docker.tar', use_for_bundle=True, compress=False, shasum=False, ) mock_exists.return_value = False mock_load.return_value = result self._init_command_args() self.task.process() assert mock_command.call_args_list == [ call( [ 'cp', '/tmp/mytest/Leap-15.2.x86_64-1.15.2.docker.tar', os.sep.join( [self.abs_bundle_dir, 'Leap-15.2-docker:1.docker.tar'] ), ] ), call( [ 'file', os.sep.join( [self.abs_bundle_dir, 'Leap-15.2-docker:1.docker.tar'] ), ] ), ] @patch('kiwi.tasks.result_bundle.Result.load') @patch('kiwi.tasks.result_bundle.Command.run') @patch('kiwi.tasks.result_bundle.Path.create') @patch('os.path.exists') @patch('os.path.islink') @patch('os.unlink') @patch('os.symlink') @patch('os.readlink') def test_process_result_bundle_with_bundle_format_for_compressed_docker_type( self, mock_os_readlink, mock_os_symlink, mock_os_unlink, mock_os_path_islink, mock_exists, mock_path_create, mock_command, mock_load, ): self.xml_state.profiles = None self.xml_state.host_architecture = 'x86_64' self.xml_state.get_build_type_name = Mock(return_value='docker') self.xml_state.xml_data.get_name = Mock(return_value='Leap-15.2') result = Result(self.xml_state) result.add_bundle_format('%N-%T:%M') result.add( key='container', filename='/tmp/mytest/Leap-15.2.x86_64-1.15.2.docker.tar.xz', use_for_bundle=True, compress=False, shasum=False, ) mock_exists.return_value = False mock_load.return_value = result self._init_command_args() self.task.process() assert mock_command.call_args_list == [ call( [ 'cp', '/tmp/mytest/Leap-15.2.x86_64-1.15.2.docker.tar.xz', os.sep.join( [ self.abs_bundle_dir, 'Leap-15.2-docker:1.docker.tar.xz', ] ), ] ), call( [ 'file', os.sep.join( [ self.abs_bundle_dir, 'Leap-15.2-docker:1.docker.tar.xz', ] ), ] ), ] @patch('kiwi.tasks.result_bundle.Result.load') @patch('kiwi.tasks.result_bundle.Command.run') @patch('kiwi.tasks.result_bundle.Path.create') @patch('os.path.exists') @patch('os.path.islink') @patch('os.unlink') @patch('os.symlink') @patch('os.readlink') def test_process_result_bundle_with_bundle_format_from_commandline( self, mock_os_readlink, mock_os_symlink, mock_os_unlink, mock_os_path_islink, mock_exists, mock_path_create, mock_command, mock_load, ): self.xml_state.profiles = None self.xml_state.host_architecture = 'x86_64' self.xml_state.get_build_type_name = Mock(return_value='oem') self.xml_state.xml_data.get_name = Mock(return_value='Leap-15.2') result = Result(self.xml_state) result.add( key='disk_image', filename='/tmp/mytest/Leap-15.2.x86_64-1.15.2.raw', use_for_bundle=True, compress=False, shasum=False, ) mock_exists.return_value = False mock_load.return_value = result self._init_command_args() self.task.command_args['--bundle-format'] = '%N-%T:%M' self.task.process() assert mock_command.call_args_list == [ call( [ 'cp', '/tmp/mytest/Leap-15.2.x86_64-1.15.2.raw', os.sep.join([self.abs_bundle_dir, 'Leap-15.2-oem:1.raw']), ] ), call( [ 'file', os.sep.join([self.abs_bundle_dir, 'Leap-15.2-oem:1.raw']), ] ), ] @patch('kiwi.tasks.result_bundle.Result.load') @patch('kiwi.tasks.result_bundle.Command.run') @patch('kiwi.tasks.result_bundle.Path.create') @patch('os.path.exists') @patch('os.path.islink') @patch('os.unlink') @patch('os.symlink') @patch('os.readlink') def test_process_result_bundle_name_includes_version( self, mock_os_readlink, mock_os_symlink, mock_os_unlink, mock_os_path_islink, mock_exists, mock_path_create, mock_command, mock_load, ): result = Result(self.xml_state) result.add( key='nameincludesversion', filename='test-1.2.3-image-1.2.3', use_for_bundle=True, compress=False, shasum=False, ) self.xml_state.xml_data.get_name = Mock(return_value='test-1.2.3-image') mock_exists.return_value = False mock_load.return_value = result self._init_command_args() self.task.process() mock_load.assert_called_once_with( os.sep.join([self.abs_target_dir, 'kiwi.result']) ) mock_path_create.assert_called_once_with(self.abs_bundle_dir) assert mock_command.call_args_list == [ call( [ 'cp', 'test-1.2.3-image-1.2.3', os.sep.join( [self.abs_bundle_dir, 'test-1.2.3-image-1.2.3-Build_42'] ), ] ), call( [ 'file', os.sep.join( [self.abs_bundle_dir, 'test-1.2.3-image-1.2.3-Build_42'] ), ] ), ] @patch('kiwi.tasks.result_bundle.Result.load') @patch('kiwi.tasks.result_bundle.Command.run') @patch('kiwi.tasks.result_bundle.Path.create') @patch('kiwi.tasks.result_bundle.Path.which') @patch('kiwi.tasks.result_bundle.Compress') @patch('os.path.exists') @patch('os.path.islink') @patch('os.unlink') @patch('os.symlink') @patch('os.readlink') def test_process_result_bundle_zsyncmake_missing( self, mock_os_readlink, mock_os_symlink, mock_os_unlink, mock_os_path_islink, mock_exists, mock_compress, mock_path_which, mock_path_create, mock_command, mock_load, ): compress = Mock() mock_path_which.return_value = None compress.xz.return_value = 'compressed_filename' mock_compress.return_value = compress mock_exists.return_value = False mock_load.return_value = self.result self._init_command_args() self.task.command_args['bundle'] = True self.task.command_args['--zsync-source'] = 'http://example.com/zsync' with patch('builtins.open'): with self._caplog.at_level(logging.WARNING): self.task.process() assert ( '--> zsyncmake missing, zsync setup skipped' in self._caplog.text ) def test_process_result_bundle_help(self): self._init_command_args() self.task.command_args['help'] = True self.task.command_args['bundle'] = True self.task.process() self.task.manual.show.assert_called_once_with('kiwi::result::bundle') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/result_list_test.py0000644000000000000000000000313515273675667016572 0ustar00import sys import unittest.mock as mock import os from unittest.mock import patch import kiwi from ..test_helper import argv_kiwi_tests from kiwi.tasks.result_list import ResultListTask class TestResultListTask: def setup(self): sys.argv = [sys.argv[0], 'result', 'list', '--target-dir', 'directory'] self.abs_target_dir = os.path.abspath('directory') self.result = mock.Mock() kiwi.tasks.result_list.Help = mock.Mock(return_value=mock.Mock()) self.task = ResultListTask() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def _init_command_args(self): self.task.command_args = {} self.task.command_args['help'] = False self.task.command_args['list'] = False self.task.command_args['--target-dir'] = 'directory' @patch('kiwi.tasks.result_list.Result.load') def test_process_result_list(self, mock_load): mock_load.return_value = self.result self._init_command_args() self.task.command_args['list'] = True self.task.process() mock_load.assert_called_once_with( os.sep.join([self.abs_target_dir, 'kiwi.result']) ) self.result.print_results.assert_called_once_with() def test_process_result_list_help(self): self._init_command_args() self.task.command_args['help'] = True self.task.command_args['list'] = True self.task.process() self.task.manual.show.assert_called_once_with('kiwi::result::list') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/system_boxbuild_test.py0000644000000000000000000002707615273675667017447 0ustar00import sys import os from pytest import raises from unittest.mock import Mock, patch from ..test_helper import argv_kiwi_tests from kiwi.exceptions import KiwiBoxBuildError from kiwi.tasks.system_boxbuild import SystemBoxbuildTask class TestSystemBoxbuildTask: def setup(self): sys.argv = [ sys.argv[0], '--debug', '--profile', 'foo', '--type', 'oem', '--kiwi-file', 'appliance.kiwi', 'system', 'boxbuild', '--box', 'universal', '--box-memory', '4', '--box-console', 'ttyAMA0', '--box-smp-cpus', '4', 'kiwi', '--description', '../data/description', '--target-dir', '../data/target_dir', ] self.task = SystemBoxbuildTask() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def _init_command_args(self): self.task.command_args = {} self.task.command_args['help'] = False self.task.command_args['boxbuild'] = False self.task.command_args['--list-boxes'] = False self.task.command_args['--container'] = False self.task.command_args['--box'] = None self.task.command_args['--box-debug'] = False self.task.command_args['--kiwi-version'] = None self.task.command_args['--shared-path'] = None self.task.command_args['--9p-sharing'] = None self.task.command_args['--sshfs-sharing'] = None self.task.command_args['--ssh-port'] = '22' self.task.command_args['--virtiofs-sharing'] = None self.task.command_args['--cpu'] = None self.task.command_args['--machine'] = None self.task.command_args['system_build'] = [ '--description', 'foo', '--target-dir', 'xxx', '--add-package', 'a', '--add-package', 'b', '--allow-existing-root', ] @patch('kiwi.tasks.system_boxbuild.Help') def test_process_system_boxbuild_help(self, mock_kiwi_Help): Help = Mock() mock_kiwi_Help.return_value = Help self._init_command_args() self.task.command_args['help'] = True self.task.command_args['boxbuild'] = True self.task.process() Help.show.assert_called_once_with('kiwi::system::boxbuild') @patch('kiwi.tasks.system_boxbuild.BoxesConfig') def test_process_system_boxbuild_list_boxes(self, mock_BoxesConfig): plugin = Mock() mock_BoxesConfig.return_value = plugin self._init_command_args() self.task.command_args['boxbuild'] = True self.task.command_args['--list-boxes'] = True self.task.process() plugin.dump_config.assert_called_once_with() @patch('kiwi.tasks.system_boxbuild.BoxContainerBuild') def test_process_system_boxbuild_container(self, mock_BoxContainerBuild): self._init_command_args() self.task.command_args['boxbuild'] = True self.task.command_args['--box'] = 'universal' self.task.command_args['--container'] = True box_containerbuild = Mock() mock_BoxContainerBuild.return_value = box_containerbuild self.task.process() mock_BoxContainerBuild.assert_called_once_with( boxname='universal', arch='' ) box_containerbuild.run.assert_called_once_with( [ '--debug', '--type', 'oem', '--profile', 'foo', '--kiwi-file', 'appliance.kiwi', 'system', 'build', '--description', os.path.abspath(os.path.normpath('foo')), '--target-dir', os.path.abspath(os.path.normpath('xxx')), '--add-package', 'a', '--add-package', 'b', '--allow-existing-root', ], False, None, None, ) @patch('kiwi.tasks.system_boxbuild.BoxBuild') def test_process_system_boxbuild_from_commandline(self, mock_BoxBuild): box_build = Mock() mock_BoxBuild.return_value = box_build self.task.process() mock_BoxBuild.assert_called_once_with( boxname='universal', ram='4', console='ttyAMA0', smp='4', arch='', machine=None, cpu='host', sharing_backend='9p', ssh_key='id_rsa', ssh_port='10022', accel=True, ) box_build.run.assert_called_once_with( [ '--debug', '--type', 'oem', '--profile', 'foo', '--kiwi-file', 'appliance.kiwi', 'system', 'build', '--description', os.path.abspath(os.path.normpath('../data/description')), '--target-dir', os.path.abspath(os.path.normpath('../data/target_dir')), ], True, True, False, None, None, ) @patch('platform.machine') def test_process_system_boxbuild_no_kiwi_build_command( self, mock_platform_machine ): mock_platform_machine.return_value = 'x86_64' sys.argv = [sys.argv[0], 'system', 'boxbuild', '--box', 'universal'] task = SystemBoxbuildTask() with raises(KiwiBoxBuildError): task.process() @patch('kiwi.tasks.system_boxbuild.BoxBuild') def test_process_system_boxbuild(self, mock_BoxBuild): self._init_command_args() self.task.command_args['boxbuild'] = True self.task.command_args['--box'] = 'universal' box_build = Mock() mock_BoxBuild.return_value = box_build self.task.process() mock_BoxBuild.assert_called_once_with( boxname='universal', ram=None, console=None, smp=None, arch='', machine=None, cpu='host', sharing_backend='9p', ssh_key='id_rsa', ssh_port='22', accel=True, ) box_build.run.assert_called_once_with( [ '--debug', '--type', 'oem', '--profile', 'foo', '--kiwi-file', 'appliance.kiwi', 'system', 'build', '--description', os.path.abspath(os.path.normpath('foo')), '--target-dir', os.path.abspath(os.path.normpath('xxx')), '--add-package', 'a', '--add-package', 'b', '--allow-existing-root', ], True, True, False, None, None, ) @patch('kiwi.tasks.system_boxbuild.BoxBuild') def test_process_system_boxbuild_for_x86_64(self, mock_BoxBuild): self._init_command_args() self.task.command_args['boxbuild'] = True self.task.command_args['--box'] = 'universal' self.task.command_args['--x86_64'] = True box_build = Mock() mock_BoxBuild.return_value = box_build self.task.process() mock_BoxBuild.assert_called_once_with( boxname='universal', ram=None, console=None, smp=None, arch='x86_64', machine=None, cpu='host', sharing_backend='9p', ssh_key='id_rsa', ssh_port='22', accel=True, ) @patch('kiwi.tasks.system_boxbuild.BoxBuild') def test_process_system_boxbuild_for_aarch64(self, mock_BoxBuild): self._init_command_args() self.task.command_args['boxbuild'] = True self.task.command_args['--box'] = 'universal' self.task.command_args['--aarch64'] = True box_build = Mock() mock_BoxBuild.return_value = box_build self.task.process() mock_BoxBuild.assert_called_once_with( boxname='universal', ram=None, console=None, smp=None, arch='aarch64', machine=None, cpu='host', sharing_backend='9p', ssh_key='id_rsa', ssh_port='22', accel=True, ) @patch('kiwi.tasks.system_boxbuild.BoxBuild') def test_process_system_boxbuild_with_sharing_backend(self, mock_BoxBuild): self._init_command_args() self.task.command_args['boxbuild'] = True self.task.command_args['--box'] = 'universal' self.task.command_args['--9p-sharing'] = True box_build = Mock() mock_BoxBuild.return_value = box_build self.task.process() mock_BoxBuild.assert_called_once_with( boxname='universal', ram=None, console=None, smp=None, arch='', machine=None, cpu='host', sharing_backend='9p', ssh_key='id_rsa', ssh_port='22', accel=True, ) self.task.command_args['--9p-sharing'] = False self.task.command_args['--virtiofs-sharing'] = True mock_BoxBuild.reset_mock() self.task.process() mock_BoxBuild.assert_called_once_with( boxname='universal', ram=None, console=None, smp=None, arch='', machine=None, cpu='host', sharing_backend='virtiofs', ssh_key='id_rsa', ssh_port='22', accel=True, ) self.task.command_args['--9p-sharing'] = False self.task.command_args['--virtiofs-sharing'] = False self.task.command_args['--sshfs-sharing'] = True mock_BoxBuild.reset_mock() self.task.process() mock_BoxBuild.assert_called_once_with( boxname='universal', ram=None, console=None, smp=None, arch='', machine=None, cpu='host', sharing_backend='sshfs', ssh_key='id_rsa', ssh_port='22', accel=True, ) @patch('kiwi.tasks.system_boxbuild.BoxBuild') def test_validate_kiwi_build_command_raises_if_description_missing( self, mock_BoxBuild ): self._init_command_args() self.task.command_args['--box'] = 'leap' self.task.command_args['system_build'] = [ '--target-dir', 'xxx', '--add-package', 'a', ] box_build = Mock() mock_BoxBuild.return_value = box_build with raises(KiwiBoxBuildError): self.task.process() @patch('kiwi.tasks.system_boxbuild.BoxBuild') def test_validate_kiwi_build_command_raises_if_target_dir_missing( self, mock_BoxBuild ): self._init_command_args() self.task.command_args['--box'] = 'leap' self.task.command_args['system_build'] = [ '--description', 'xxx', '--add-package', 'a', ] box_build = Mock() mock_BoxBuild.return_value = box_build with raises(KiwiBoxBuildError): self.task.process() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/system_build_test.py0000644000000000000000000005133615273675667016732 0ustar00import logging import sys import os from pytest import fixture, raises from unittest.mock import patch, call, Mock, MagicMock import kiwi from kiwi.exceptions import KiwiCATargetDistributionError from ..test_helper import argv_kiwi_tests from kiwi.defaults import Defaults from kiwi.tasks.system_build import SystemBuildTask class TestSystemBuildTask: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): Defaults.set_platform_name('x86_64') sys.argv = [ sys.argv[0], '--profile', 'vmxFlavour', 'system', 'build', '--description', '../data/description', '--target-dir', 'some-target', ] self.abs_target_dir = os.path.abspath('some-target') kiwi.tasks.system_build.Privileges = Mock() kiwi.tasks.system_build.Path = Mock() kiwi.tasks.system_build.Help = Mock(return_value=Mock()) self.runtime_checker = Mock() kiwi.tasks.base.RuntimeChecker = Mock(return_value=self.runtime_checker) self.setup = Mock() kiwi.tasks.system_build.SystemSetup = Mock(return_value=self.setup) self.profile = Mock() self.profile.dot_profile = dict() kiwi.tasks.system_build.Profile = Mock(return_value=self.profile) self.result = Mock() self.builder = MagicMock() self.builder.create = Mock(return_value=self.result) kiwi.tasks.system_build.ImageBuilder.new = Mock( return_value=self.builder ) self.task = SystemBuildTask() self.task.runtime_config = MagicMock() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def _init_command_args(self): self.task.command_args = {} self.task.command_args['help'] = False self.task.command_args['build'] = False self.task.command_args['--set-type-attr'] = ['volid=some'] self.task.command_args['--set-release-version'] = '99' self.task.command_args['--allow-existing-root'] = True self.task.command_args['--description'] = '../data/description' self.task.command_args['--target-dir'] = 'some-target' self.task.command_args['--set-repo'] = None self.task.command_args['--set-repo-credentials'] = None self.task.command_args['--add-repo'] = [] self.task.command_args['--add-repo-credentials'] = [] self.task.command_args['--add-package'] = [] self.task.command_args['--add-bootstrap-package'] = [] self.task.command_args['--delete-package'] = [] self.task.command_args['--ignore-repos'] = False self.task.command_args['--ignore-repos-used-for-build'] = False self.task.command_args['--set-container-derived-from'] = None self.task.command_args['--set-container-tag'] = None self.task.command_args['--add-container-label'] = [] self.task.command_args['--clear-cache'] = False self.task.command_args['--signing-key'] = [] self.task.command_args['--ca-cert'] = [] self.task.command_args['--ca-target-distribution'] = None @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.xml_state.XMLState.get_repositories_signing_keys') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_build( self, mock_SystemPrepare, mock_keys, mock_log ): manager = MagicMock() system_prepare = Mock() system_prepare.setup_repositories = Mock(return_value=manager) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare mock_keys.return_value = ['some_key', 'some_other_key'] self._init_command_args() self.task.command_args['build'] = True self.task.process() self.runtime_checker.check_boot_description_exists.assert_called_once_with() self.runtime_checker.check_initrd_selection_required.assert_called_once_with() self.runtime_checker.check_consistent_kernel_in_boot_and_system_image.assert_called_once_with() self.runtime_checker.check_container_tool_chain_installed.assert_called_once_with() self.runtime_checker.check_volume_setup_defines_multiple_fullsize_volumes.assert_called_once_with() self.runtime_checker.check_volume_setup_has_no_root_definition.assert_called_once_with() self.runtime_checker.check_volume_label_used_with_lvm.assert_called_once_with() self.runtime_checker.check_swap_name_used_with_lvm.assert_called_once_with() self.runtime_checker.check_xen_uniquely_setup_as_server_or_guest.assert_called_once_with() self.runtime_checker.check_target_directory_not_in_shared_cache.assert_called_once_with( self.abs_target_dir ) self.runtime_checker.check_dracut_module_versions_compatible_to_kiwi.assert_called_once_with( self.abs_target_dir + '/build/image-root' ) self.runtime_checker.check_kernel_flavors_installed.assert_called_once_with( self.abs_target_dir + '/build/image-root' ) self.runtime_checker.check_kernel_flavor_supported.assert_called_once_with() self.runtime_checker.check_mediacheck_installed.assert_called_once_with() self.runtime_checker.check_checkmedia_used_with_msdos_table.assert_called_once_with() self.runtime_checker.check_dracut_module_for_live_iso_in_package_list.assert_called_once_with() self.runtime_checker.check_repositories_configured.assert_called_once_with() self.runtime_checker.check_dracut_module_for_disk_overlay_in_package_list.assert_called_once_with() self.runtime_checker.check_dracut_module_for_disk_oem_in_package_list.assert_called_once_with() self.runtime_checker.check_dracut_module_for_oem_install_in_package_list.assert_called_once_with() system_prepare.setup_repositories.assert_called_once_with( False, ['some_key', 'some_other_key'], None ) system_prepare.install_bootstrap.assert_called_once_with( manager.__enter__.return_value, [] ) system_prepare.setup_ca_certificates.assert_called_once_with() system_prepare.install_system.assert_called_once_with( manager.__enter__.return_value ) self.profile.create.assert_called_once_with( self.abs_target_dir + '/build/image-root/.profile' ) self.setup.import_description.assert_called_once_with() self.setup.import_overlay_files.assert_called_once_with() self.setup.import_repositories_marked_as_imageinclude.assert_called_once_with() self.setup.call_post_bootstrap_script.assert_called_once_with() self.setup.call_config_script.assert_called_once_with() self.setup.import_image_identifier.assert_called_once_with() self.setup.setup_groups.assert_called_once_with() self.setup.setup_users.assert_called_once_with() self.setup.setup_keyboard_map.assert_called_once_with() self.setup.setup_locale.assert_called_once_with() self.setup.setup_plymouth_splash.assert_called_once_with() self.setup.setup_timezone.assert_called_once_with() self.setup.setup_permissions.assert_called_once_with() self.setup.import_files.assert_called_once_with() self.setup.setup_registry_import.assert_called_once_with() self.setup.setup_selinux_file_contexts.assert_called_once_with() system_prepare.pinch_system.assert_has_calls( [call(force=False), call(force=True)] ) self.setup.create_system_files.assert_called_once_with() assert system_prepare.clean_package_manager_leftovers.called self.setup.call_image_script.assert_called_once_with() self.builder.create.assert_called_once_with() self.result.print_results.assert_called_once_with() self.result.dump.assert_called_once_with( os.sep.join([self.abs_target_dir, 'kiwi.result']) ) @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.xml_state.XMLState.get_repositories_signing_keys') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_build_add_package( self, mock_SystemPrepare, mock_keys, mock_log ): manager = MagicMock() system_prepare = Mock() system_prepare.setup_repositories = Mock(return_value=manager) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare mock_keys.return_value = ['some_key', 'some_other_key'] self._init_command_args() self.task.command_args['--add-package'] = ['vim'] self.task.process() system_prepare.setup_repositories.assert_called_once_with( False, ['some_key', 'some_other_key'], None ) system_prepare.install_packages.assert_called_once_with( manager.__enter__.return_value, ['vim'] ) @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.xml_state.XMLState.get_repositories_signing_keys') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_update_delete_package( self, mock_SystemPrepare, mock_keys, mock_log ): manager = MagicMock() system_prepare = Mock() system_prepare.setup_repositories = Mock(return_value=manager) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare mock_keys.return_value = ['some_key', 'some_other_key'] self._init_command_args() self.task.command_args['--delete-package'] = ['vim'] self.task.process() system_prepare.setup_repositories.assert_called_once_with( False, ['some_key', 'some_other_key'], None ) system_prepare.delete_packages.assert_called_once_with( manager.__enter__.return_value, ['vim'] ) @patch('kiwi.xml_state.XMLState.set_container_config_tag') @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_build_prepare_stage_set_container_tag( self, mock_SystemPrepare, mock_log, mock_set_container_tag ): self._init_command_args() self.task.command_args['--set-container-tag'] = 'new_tag' self.task.process() mock_set_container_tag.assert_called_once_with('new_tag') @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_build_invalid_type_attribute( self, mock_SystemPrepare, mock_log ): self._init_command_args() self.task.command_args['--set-type-attr'] = ['bogus=value'] with self._caplog.at_level(logging.ERROR): self.task.process() assert 'Failed to set type attribute' in self._caplog.text @patch('kiwi.xml_state.XMLState.get_repositories_signing_keys') @patch('kiwi.xml_state.XMLState.get_preferences_sections') @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_build_release_version_no_overwrite( self, mock_SystemPrepare, mock_logger, mock_get_preferences_sections, mock_get_repositories_signing_keys, ): preferences = MagicMock() preferences.get_release_version.return_value = None mock_get_preferences_sections.return_value = [preferences] self._init_command_args() self.task.command_args['--set-release-version'] = '42' self.task.process() preferences.add_release_version.assert_called_once_with('42') @patch('kiwi.xml_state.XMLState.add_container_config_label') @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_build_add_container_label( self, mock_SystemPrepare, mock_log, mock_add_container_label ): self._init_command_args() self.task.command_args['--add-container-label'] = [ 'newLabel=value', 'anotherLabel=my=crazy value', ] self.task.process() mock_add_container_label.assert_has_calls( [call('newLabel', 'value'), call('anotherLabel', 'my=crazy value')] ) @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_build_add_container_label_invalid_format( self, mock_SystemPrepare, mock_logger ): self._init_command_args() self.task.command_args['--add-container-label'] = ['newLabel:value'] with self._caplog.at_level(logging.WARNING): self.task.process() @patch('kiwi.xml_state.XMLState.set_derived_from_image_uri') @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_build_prepare_stage_set_derived_from_uri( self, mock_SystemPrepare, mock_log, mock_set_derived_from_uri ): self._init_command_args() self.task.command_args['--set-container-derived-from'] = 'file:///new' self.task.process() mock_set_derived_from_uri.assert_called_once_with('file:///new') @patch('kiwi.xml_state.XMLState.set_repository') @patch('kiwi.logger.Logger.set_logfile') @patch('os.path.isfile') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_build_prepare_stage_set_repo( self, mock_SystemPrepare, mock_os_path_is_file, mock_log, mock_set_repo ): mock_os_path_is_file.return_value = False self._init_command_args() self.task.command_args['--set-repo'] = 'http://example.com,yast2,alias' self.task.process() mock_set_repo.assert_called_once_with( 'http://example.com', 'yast2', 'alias', None, None, None, [], None, None, None, None, ) self.task.command_args['--set-repo-credentials'] = 'user:pass' mock_set_repo.reset_mock() self.task.process() mock_set_repo.assert_called_once_with( 'http://user:pass@example.com', 'yast2', 'alias', None, None, None, [], None, None, None, None, ) self.task.command_args['--set-repo-credentials'] = '../data/credentials' mock_os_path_is_file.return_value = True mock_set_repo.reset_mock() self.task.process() mock_set_repo.assert_called_once_with( 'http://user:pass@example.com', 'yast2', 'alias', None, None, None, [], None, None, None, None, ) @patch('kiwi.xml_state.XMLState.add_repository') @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_build_prepare_stage_add_repo( self, mock_SystemPrepare, mock_log, mock_add_repo ): self._init_command_args() self.task.command_args['--add-repo'] = [ 'http://example1.com,yast2,alias,99,false,true', 'http://example2.com,yast2,alias,99,false,true', 'http://example3.com,yast2,alias,99,false,true', 'http://example4.com,,alias,99,false,true', 'http://example5.com,,,99,false,true', ] self.task.process() assert mock_add_repo.call_args_list == [ call( 'http://example1.com', 'yast2', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example2.com', 'yast2', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example3.com', 'yast2', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example4.com', None, 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example5.com', None, None, '99', False, True, [], None, None, None, None, ), ] self.task.command_args['--add-repo-credentials'] = [ 'user1:pass1', 'user2:pass2', ] mock_add_repo.reset_mock() self.task.process() assert mock_add_repo.call_args_list == [ call( 'http://user1:pass1@example1.com', 'yast2', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://user2:pass2@example2.com', 'yast2', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example3.com', 'yast2', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example4.com', None, 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example5.com', None, None, '99', False, True, [], None, None, None, None, ), ] def test_process_system_build_help(self): self._init_command_args() self.task.command_args['help'] = True self.task.command_args['build'] = True self.task.process() self.task.manual.show.assert_called_once_with('kiwi::system::build') @patch('kiwi.xml_state.XMLState.delete_repository_sections') @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_prepare_ignore_repos( self, mock_SystemPrepare, mock_log, mock_delete_repos ): self._init_command_args() self.task.command_args['--ignore-repos'] = True self.task.process() mock_delete_repos.assert_called_once_with() @patch('kiwi.xml_state.XMLState.delete_repository_sections_used_for_build') @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.tasks.system_build.SystemPrepare') def test_process_system_prepare_ignore_repos_used_for_build( self, mock_SystemPrepare, mock_log, mock_delete_repos ): self._init_command_args() self.task.command_args['--ignore-repos-used-for-build'] = True self.task.process() mock_delete_repos.assert_called_once_with() @patch('kiwi.xml_state.XMLState.add_certificate') @patch('kiwi.tasks.system_build.SystemPrepare') @patch('kiwi.logger.Logger.set_logfile') def test_process_system_prepare_with_custom_ca_certs( self, mock_log, mock_SystemPrepare, mock_add_certificate ): system_prepare = Mock() system_prepare.setup_repositories = Mock(return_value=MagicMock()) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare self._init_command_args() self.task.command_args['--ca-cert'] = ['/some/ca/filename'] with raises(KiwiCATargetDistributionError): self.task.process() self.task.command_args['--ca-target-distribution'] = 'suse' self.task.process() mock_add_certificate.assert_called_once_with( '/some/ca/filename', 'suse' ) system_prepare.setup_ca_certificates.assert_called_once_with() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/system_create_test.py0000644000000000000000000000622615273675667017074 0ustar00import sys from unittest.mock import Mock, MagicMock import os import kiwi from ..test_helper import argv_kiwi_tests from kiwi.defaults import Defaults from kiwi.tasks.system_create import SystemCreateTask class TestSystemCreateTask: def setup(self): Defaults.set_platform_name('x86_64') sys.argv = [ sys.argv[0], '--profile', 'vmxFlavour', 'system', 'create', '--root', '../data/root-dir', '--target-dir', 'some-target', ] self.abs_root_dir = os.path.abspath('../data/root-dir') self.abs_target_dir = os.path.abspath('some-target') kiwi.tasks.system_create.Path = Mock() kiwi.tasks.system_create.Privileges = Mock() kiwi.tasks.system_create.Help = Mock(return_value=Mock()) self.runtime_checker = Mock() kiwi.tasks.base.RuntimeChecker = Mock(return_value=self.runtime_checker) self.runtime_config = Mock() self.runtime_config.get_disabled_runtime_checks.return_value = [] kiwi.tasks.base.RuntimeConfig = Mock(return_value=self.runtime_config) self.setup = Mock() kiwi.tasks.system_create.SystemSetup = Mock(return_value=self.setup) self.result = Mock() self.builder = MagicMock() self.builder.create = Mock(return_value=self.result) kiwi.tasks.system_create.ImageBuilder.new = Mock( return_value=self.builder ) self.task = SystemCreateTask() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def _init_command_args(self): self.task.command_args = {} self.task.command_args['help'] = False self.task.command_args['create'] = False self.task.command_args['--root'] = '../data/root-dir' self.task.command_args['--target-dir'] = 'some-target' self.task.command_args['--signing-key'] = ['some-key-file'] def test_process_system_create(self): self._init_command_args() self.task.command_args['create'] = True self.task.process() self.runtime_checker.check_target_directory_not_in_shared_cache.assert_called_once_with( self.abs_root_dir ) self.runtime_checker.check_dracut_module_versions_compatible_to_kiwi.assert_called_once_with( self.abs_root_dir ) self.runtime_checker.check_kernel_flavors_installed.assert_called_once_with( self.abs_root_dir ) self.setup.call_image_script.assert_called_once_with() self.builder.create.assert_called_once_with() self.result.print_results.assert_called_once_with() self.result.dump.assert_called_once_with( os.sep.join([self.abs_target_dir, 'kiwi.result']) ) def test_process_system_create_help(self): self._init_command_args() self.task.command_args['help'] = True self.task.command_args['create'] = True self.task.process() self.task.manual.show.assert_called_once_with('kiwi::system::create') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/system_prepare_test.py0000644000000000000000000004431715273675667017272 0ustar00import logging import sys import os from pytest import fixture, raises from unittest.mock import patch, call, Mock, MagicMock import kiwi from kiwi.exceptions import KiwiCATargetDistributionError from ..test_helper import argv_kiwi_tests from kiwi.defaults import Defaults from kiwi.tasks.system_prepare import SystemPrepareTask class TestSystemPrepareTask: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): Defaults.set_platform_name('x86_64') sys.argv = [ sys.argv[0], '--profile', 'vmxFlavour', 'system', 'prepare', '--description', '../data/description', '--root', '../data/root-dir', ] self.abs_root_dir = os.path.abspath('../data/root-dir') self.command = Mock() kiwi.tasks.system_prepare.Command = self.command kiwi.tasks.system_prepare.Privileges = Mock() self.runtime_checker = Mock() kiwi.tasks.base.RuntimeChecker = Mock(return_value=self.runtime_checker) self.setup = Mock() kiwi.tasks.system_prepare.SystemSetup = Mock(return_value=self.setup) self.profile = Mock() self.profile.dot_profile = dict() kiwi.tasks.system_prepare.Profile = Mock(return_value=self.profile) kiwi.tasks.system_prepare.Help = Mock(return_value=Mock()) self.task = SystemPrepareTask() self.task.runtime_config = MagicMock() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def _init_command_args(self): self.task.command_args = {} self.task.command_args['help'] = False self.task.command_args['prepare'] = False self.task.command_args['--description'] = '../data/description' self.task.command_args['--root'] = '../data/root-dir' self.task.command_args['--set-type-attr'] = ['volid=some'] self.task.command_args['--set-release-version'] = '99' self.task.command_args['--allow-existing-root'] = False self.task.command_args['--set-repo'] = None self.task.command_args['--set-repo-credentials'] = None self.task.command_args['--add-repo'] = [] self.task.command_args['--add-repo-credentials'] = [] self.task.command_args['--add-package'] = [] self.task.command_args['--add-bootstrap-package'] = [] self.task.command_args['--delete-package'] = [] self.task.command_args['--ignore-repos'] = False self.task.command_args['--ignore-repos-used-for-build'] = False self.task.command_args['--clear-cache'] = False self.task.command_args['--set-container-derived-from'] = None self.task.command_args['--set-container-tag'] = None self.task.command_args['--add-container-label'] = [] self.task.command_args['--signing-key'] = [] self.task.command_args['--ca-cert'] = [] self.task.command_args['--ca-target-distribution'] = None @patch('kiwi.xml_state.XMLState.get_repositories_signing_keys') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_prepare(self, mock_SystemPrepare, mock_keys): manager = MagicMock() system_prepare = Mock() system_prepare.setup_repositories = Mock(return_value=manager) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare mock_keys.return_value = ['some_key', 'some_other_key'] self._init_command_args() self.task.command_args['prepare'] = True self.task.command_args['--clear-cache'] = True self.task.process() self.runtime_checker.check_boot_description_exists.assert_called_once_with() self.runtime_checker.check_initrd_selection_required.assert_called_once_with() self.runtime_checker.check_consistent_kernel_in_boot_and_system_image.assert_called_once_with() self.runtime_checker.check_container_tool_chain_installed.assert_called_once_with() self.runtime_checker.check_volume_setup_defines_multiple_fullsize_volumes.assert_called_once_with() self.runtime_checker.check_volume_setup_has_no_root_definition.assert_called_once_with() self.runtime_checker.check_volume_label_used_with_lvm.assert_called_once_with() self.runtime_checker.check_swap_name_used_with_lvm.assert_called_once_with() self.runtime_checker.check_xen_uniquely_setup_as_server_or_guest.assert_called_once_with() self.runtime_checker.check_target_directory_not_in_shared_cache.assert_called_once_with( self.abs_root_dir ) self.runtime_checker.check_mediacheck_installed.assert_called_once_with() self.runtime_checker.check_checkmedia_used_with_msdos_table.assert_called_once_with() self.runtime_checker.check_dracut_module_for_live_iso_in_package_list.assert_called_once_with() self.runtime_checker.check_repositories_configured.assert_called_once_with() self.runtime_checker.check_dracut_module_for_disk_overlay_in_package_list.assert_called_once_with() self.runtime_checker.check_dracut_module_for_disk_oem_in_package_list.assert_called_once_with() self.runtime_checker.check_dracut_module_for_oem_install_in_package_list.assert_called_once_with() system_prepare.setup_repositories.assert_called_once_with( True, ['some_key', 'some_other_key'], None ) system_prepare.install_bootstrap.assert_called_once_with( manager.__enter__.return_value, [] ) system_prepare.install_system.assert_called_once_with( manager.__enter__.return_value ) self.profile.create.assert_called_once_with( self.abs_root_dir + '/.profile' ) self.setup.import_description.assert_called_once_with() self.setup.import_overlay_files.assert_called_once_with() self.setup.import_repositories_marked_as_imageinclude.assert_called_once_with() self.setup.call_post_bootstrap_script.assert_called_once_with() self.setup.call_config_script.assert_called_once_with() self.setup.import_image_identifier.assert_called_once_with() self.setup.setup_groups.assert_called_once_with() self.setup.setup_users.assert_called_once_with() self.setup.setup_keyboard_map.assert_called_once_with() self.setup.setup_locale.assert_called_once_with() self.setup.setup_plymouth_splash.assert_called_once_with() self.setup.setup_timezone.assert_called_once_with() self.setup.setup_permissions.assert_called_once_with() self.setup.import_files.assert_called_once_with() self.setup.setup_registry_import.assert_called_once_with() self.setup.setup_selinux_file_contexts.assert_called_once_with() system_prepare.pinch_system.assert_has_calls( [call(force=False), call(force=True)] ) self.setup.create_system_files.assert_called_once_with() assert system_prepare.clean_package_manager_leftovers.called @patch('kiwi.xml_state.XMLState.get_repositories_signing_keys') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_prepare_add_package( self, mock_SystemPrepare, mock_keys ): manager = MagicMock() system_prepare = Mock() system_prepare.setup_repositories = Mock(return_value=manager) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare mock_keys.return_value = ['some_key', 'some_other_key'] self._init_command_args() self.task.command_args['--add-package'] = ['vim'] self.task.process() system_prepare.setup_repositories.assert_called_once_with( False, ['some_key', 'some_other_key'], None ) system_prepare.install_packages.assert_called_once_with( manager.__enter__.return_value, ['vim'] ) @patch('kiwi.xml_state.XMLState.get_repositories_signing_keys') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_prepare_delete_package( self, mock_SystemPrepare, mock_keys ): manager = MagicMock() system_prepare = Mock() system_prepare.setup_repositories = Mock(return_value=manager) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare mock_keys.return_value = ['some_key', 'some_other_key'] self._init_command_args() self.task.command_args['--delete-package'] = ['vim'] self.task.process() system_prepare.setup_repositories.assert_called_once_with( False, ['some_key', 'some_other_key'], None ) system_prepare.delete_packages.assert_called_once_with( manager.__enter__.return_value, ['vim'] ) @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_build_invalid_type_attribute( self, mock_SystemPrepare, mock_log ): self._init_command_args() self.task.command_args['--set-type-attr'] = ['bogus=value'] with self._caplog.at_level(logging.ERROR): self.task.process() assert 'Failed to set type attribute' in self._caplog.text @patch('kiwi.xml_state.XMLState.get_repositories_signing_keys') @patch('kiwi.xml_state.XMLState.get_preferences_sections') @patch('kiwi.logger.Logger.set_logfile') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_build_release_version_no_overwrite( self, mock_SystemPrepare, mock_logger, mock_get_preferences_sections, mock_get_repositories_signing_keys, ): preferences = MagicMock() preferences.get_release_version.return_value = None mock_get_preferences_sections.return_value = [preferences] self._init_command_args() self.task.command_args['--set-release-version'] = '42' self.task.process() preferences.add_release_version.assert_called_once_with('42') @patch('kiwi.xml_state.XMLState.set_container_config_tag') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_prepare_set_container_tag( self, mock_SystemPrepare, mock_set_container_tag ): self._init_command_args() self.task.command_args['--set-container-tag'] = 'new_tag' self.task.process() mock_set_container_tag.assert_called_once_with('new_tag') @patch('kiwi.xml_state.XMLState.add_container_config_label') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_prepare_add_container_label( self, mock_SystemPrepare, mock_add_container_label ): self._init_command_args() self.task.command_args['--add-container-label'] = ['newLabel=value'] self.task.process() mock_add_container_label.assert_called_once_with('newLabel', 'value') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_prepare_add_container_label_invalid_format( self, mock_SystemPrepare ): self._init_command_args() self.task.command_args['--add-container-label'] = ['newLabel:value'] with self._caplog.at_level(logging.WARNING): self.task.process() @patch('kiwi.xml_state.XMLState.set_derived_from_image_uri') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_prepare_set_derived_from_uri( self, mock_SystemPrepare, mock_set_derived_from_uri ): self._init_command_args() self.task.command_args['--set-container-derived-from'] = 'file:///new' self.task.process() mock_set_derived_from_uri.assert_called_once_with('file:///new') @patch('kiwi.xml_state.XMLState.set_repository') @patch('os.path.isfile') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_prepare_set_repo( self, mock_SystemPrepare, mock_os_path_is_file, mock_set_repo ): mock_os_path_is_file.return_value = False self._init_command_args() self.task.command_args['--set-repo'] = ( 'http://example.com,yast2,alias,prio,imageinclude,' + 'package_gpgcheck,{file:///key.asc},components,dist,' + 'repo_gpgcheck,repo_sourcetype' ) self.task.process() mock_set_repo.assert_called_once_with( 'http://example.com', 'yast2', 'alias', 'prio', 'imageinclude', 'package_gpgcheck', ['file:///key.asc'], 'components', 'dist', 'repo_gpgcheck', 'repo_sourcetype', ) self.task.command_args['--set-repo-credentials'] = 'user:pass' mock_set_repo.reset_mock() self.task.process() mock_set_repo.assert_called_once_with( 'http://user:pass@example.com', 'yast2', 'alias', 'prio', 'imageinclude', 'package_gpgcheck', ['file:///key.asc'], 'components', 'dist', 'repo_gpgcheck', 'repo_sourcetype', ) self.task.command_args['--set-repo-credentials'] = '../data/credentials' mock_os_path_is_file.return_value = True mock_set_repo.reset_mock() self.task.process() mock_set_repo.assert_called_once_with( 'http://user:pass@example.com', 'yast2', 'alias', 'prio', 'imageinclude', 'package_gpgcheck', ['file:///key.asc'], 'components', 'dist', 'repo_gpgcheck', 'repo_sourcetype', ) @patch('kiwi.xml_state.XMLState.add_repository') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_prepare_add_repo( self, mock_SystemPrepare, mock_add_repo ): self._init_command_args() self.task.command_args['--add-repo'] = [ 'http://example1.com,yast2,alias,99,true', 'http://example2.com,yast2,alias,99,false,true', 'http://example3.com,yast2,alias,99,false,true', ] self.task.process() assert mock_add_repo.call_args_list == [ call( 'http://example1.com', 'yast2', 'alias', '99', True, None, [], None, None, None, None, ), call( 'http://example2.com', 'yast2', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example3.com', 'yast2', 'alias', '99', False, True, [], None, None, None, None, ), ] self.task.command_args['--add-repo-credentials'] = [ 'user1:pass1', 'user2:pass2', ] mock_add_repo.reset_mock() self.task.process() assert mock_add_repo.call_args_list == [ call( 'http://user1:pass1@example1.com', 'yast2', 'alias', '99', True, None, [], None, None, None, None, ), call( 'http://user2:pass2@example2.com', 'yast2', 'alias', '99', False, True, [], None, None, None, None, ), call( 'http://example3.com', 'yast2', 'alias', '99', False, True, [], None, None, None, None, ), ] def test_process_system_prepare_help(self): self._init_command_args() self.task.command_args['help'] = True self.task.command_args['prepare'] = True self.task.process() self.task.manual.show.assert_called_once_with('kiwi::system::prepare') @patch('kiwi.xml_state.XMLState.delete_repository_sections') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_prepare_delete_repos( self, mock_SystemPrepare, mock_delete_repos ): self._init_command_args() self.task.command_args['--ignore-repos'] = True self.task.process() mock_delete_repos.assert_called_once_with() @patch('kiwi.xml_state.XMLState.delete_repository_sections_used_for_build') @patch('kiwi.tasks.system_prepare.SystemPrepare') def test_process_system_prepare_delete_repos_used_for_build( self, mock_SystemPrepare, mock_delete_repos ): self._init_command_args() self.task.command_args['--ignore-repos-used-for-build'] = True self.task.process() mock_delete_repos.assert_called_once_with() @patch('kiwi.xml_state.XMLState.add_certificate') @patch('kiwi.tasks.system_prepare.SystemPrepare') @patch('kiwi.logger.Logger.set_logfile') def test_ca_certs_path_handling( self, mock_log, mock_SystemPrepare, mock_add_certificate ): system_prepare = Mock() system_prepare.setup_repositories = Mock(return_value=MagicMock()) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare self._init_command_args() self.task.command_args['--ca-cert'] = ['/some/ca/filename'] with raises(KiwiCATargetDistributionError): self.task.process() self.task.command_args['--ca-target-distribution'] = 'suse' self.task.process() mock_add_certificate.assert_called_once_with( '/some/ca/filename', 'suse' ) system_prepare.setup_ca_certificates.assert_called_once_with() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/system_stackbuild_test.py0000644000000000000000000002462515273675667017761 0ustar00import sys from pytest import raises from unittest.mock import Mock, patch, call from ..test_helper import argv_kiwi_tests from kiwi.tasks.system_stackbuild import SystemStackbuildTask from kiwi.exceptions import ( KiwiStackBuildTargetDirExists, KiwiStackBuildRootSyncFailed, ) class TestSystemStackbuildTask: def setup(self): sys.argv = [ sys.argv[0], '--profile', 'a', '--profile', 'b', '--type', 'iso', 'system', 'stackbuild', '--stash', 'name', '--target-dir', 'some-target-dir', 'kiwi', '--signing-key', 'some-key', ] self.task = SystemStackbuildTask() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def _init_command_args(self): self.task.command_args = {} self.task.command_args['help'] = False self.task.command_args['stackbuild'] = False self.task.command_args['--stash'] = [] self.task.command_args['--from-registry'] = None self.task.command_args['--target-dir'] = None self.task.command_args['--description'] = None self.task.command_args['system_build_or_create'] = [ '--signing-key', 'some-key', ] @patch('kiwi.tasks.system_stackbuild.Help') def test_process_help(self, mock_Help): Help = Mock() mock_Help.return_value = Help self._init_command_args() self.task.command_args['help'] = True self.task.command_args['stackbuild'] = True self.task.process() Help.show.assert_called_once_with('kiwi::system::stackbuild') @patch('kiwi.tasks.system_stackbuild.Privileges') @patch('os.path.exists') def test_process_target_dir_exists( self, mock_os_path_exists, mock_Privileges ): self._init_command_args() self.task.command_args['stackbuild'] = True self.task.command_args['--stash'] = ['name'] self.task.command_args['--target-dir'] = '/some/target-dir' mock_os_path_exists.return_value = True with raises(KiwiStackBuildTargetDirExists): self.task.process() @patch('kiwi.tasks.system_stackbuild.DataSync') @patch('kiwi.tasks.system_stackbuild.Privileges') @patch('kiwi.tasks.system_stackbuild.Path.create') @patch('kiwi.tasks.system_stackbuild.Command.run') @patch('kiwi.tasks.system_stackbuild.SystemCreateTask') @patch('os.path.exists') def test_process_root_sync_failed( self, mock_os_path_exists, mock_SystemCreateTask, mock_Command_run, mock_Path_create, mock_Privileges, mock_DataSync, ): self._init_command_args() self.task.command_args['stackbuild'] = True self.task.command_args['--stash'] = ['name'] self.task.command_args['--target-dir'] = '/some/target-dir' mock_os_path_exists.return_value = False mock_DataSync.side_effect = Exception kiwi_task = Mock() mock_SystemCreateTask.return_value = kiwi_task with raises(KiwiStackBuildRootSyncFailed): self.task.process() @patch('kiwi.tasks.system_stackbuild.Privileges') @patch('kiwi.tasks.system_stackbuild.Path.create') @patch('kiwi.tasks.system_stackbuild.Command.run') @patch('kiwi.tasks.system_stackbuild.SystemCreateTask') @patch('os.path.exists') @patch('kiwi.tasks.system_stackbuild.patch.object') def test_process_rebuild_typer_commandline( self, mock_patch_object, mock_os_path_exists, mock_SystemCreateTask, mock_Command_run, mock_Path_create, mock_Privileges, ): self._init_command_args() self.task.command_args['stackbuild'] = True self.task.command_args['--stash'] = ['name'] self.task.command_args['--target-dir'] = '/some/target-dir' self.task.command_args['--from-registry'] = 'registry.uri' mock_os_path_exists.return_value = False mock_Command_run.return_value.output = '/podman/mount/path' kiwi_task = Mock() mock_SystemCreateTask.return_value = kiwi_task self.task.process() assert mock_Command_run.call_args_list == [ call(['podman', 'pull', 'registry.uri/name']), call(['podman', 'image', 'mount', 'name']), call( [ 'rsync', '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', '/podman/mount/path/', '/some/target-dir/build/image-root', ] ), call( ['podman', 'image', 'umount', '--force', 'name'], raise_on_error=False, ), ] mock_SystemCreateTask.assert_called_once_with( should_perform_task_setup=False ) kiwi_task.process.assert_called_once_with() mock_patch_object.assert_called_once_with( sys, 'argv', [ 'kiwi-ng', '--type', 'iso', '--profile', 'a', '--profile', 'b', 'system', 'create', '--root', '/some/target-dir/build/image-root', '--target-dir', '/some/target-dir', '--signing-key', 'some-key', ], ) @patch('kiwi.tasks.system_stackbuild.Privileges') @patch('kiwi.tasks.system_stackbuild.Path.create') @patch('kiwi.tasks.system_stackbuild.Command.run') @patch('kiwi.tasks.system_stackbuild.SystemBuildTask') @patch('os.path.exists') @patch('kiwi.tasks.system_stackbuild.patch.object') def test_process_new_build_typer_commandline( self, mock_patch_object, mock_os_path_exists, mock_SystemBuildTask, mock_Command_run, mock_Path_create, mock_Privileges, ): self._init_command_args() self.task.command_args['stackbuild'] = True self.task.command_args['--stash'] = ['name'] self.task.command_args['--target-dir'] = '/some/target-dir' self.task.command_args['--description'] = '/path/to/kiwi/description' self.task.command_args['--from-registry'] = 'registry.uri' mock_os_path_exists.return_value = False mock_Command_run.return_value.output = '/podman/mount/path' kiwi_task = Mock() mock_SystemBuildTask.return_value = kiwi_task self.task.process() assert mock_Command_run.call_args_list == [ call(['podman', 'pull', 'registry.uri/name']), call(['podman', 'image', 'mount', 'name']), call( [ 'rsync', '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', '/podman/mount/path/', '/some/target-dir/build/image-root', ] ), call( ['podman', 'image', 'umount', '--force', 'name'], raise_on_error=False, ), ] mock_SystemBuildTask.assert_called_once_with( should_perform_task_setup=False ) kiwi_task.process.assert_called_once_with() mock_patch_object.assert_called_once_with( sys, 'argv', [ 'kiwi-ng', '--type', 'iso', '--profile', 'a', '--profile', 'b', 'system', 'build', '--description', '/path/to/kiwi/description', '--target-dir', '/some/target-dir', '--allow-existing-root', '--signing-key', 'some-key', ], ) @patch('kiwi.tasks.system_stackbuild.Privileges') @patch('kiwi.tasks.system_stackbuild.Path.create') @patch('kiwi.tasks.system_stackbuild.Command.run') @patch('kiwi.tasks.system_stackbuild.DataSync') @patch('kiwi.tasks.system_stackbuild.SystemBuildTask') @patch('os.path.exists') @patch('kiwi.tasks.system_stackbuild.patch.object') def test_process_new_build_no_kiwi_subcommand( self, mock_patch_object, mock_os_path_exists, mock_SystemBuildTask, mock_DataSync, mock_Command_run, mock_Path_create, mock_Privileges, ): self._init_command_args() self.task.global_args = {'--kiwi-file': 'appliance.kiwi'} self.task.command_args['system_build_or_create'] = None self.task.command_args['--stash'] = ['base', 'layer'] self.task.command_args['--target-dir'] = '/some/target-dir' self.task.command_args['--description'] = '/path/to/kiwi/description' mock_os_path_exists.return_value = False mock_Command_run.return_value.output = '/podman/mount/path' self.task.process() assert mock_Command_run.call_args_list == [ call(['podman', 'image', 'mount', 'base']), call( ['podman', 'image', 'umount', '--force', 'base'], raise_on_error=False, ), call(['podman', 'image', 'mount', 'layer']), call( ['podman', 'image', 'umount', '--force', 'layer'], raise_on_error=False, ), ] assert mock_DataSync.return_value.sync_data.call_count == 2 mock_patch_object.assert_called_once_with( sys, 'argv', [ 'kiwi-ng', '--kiwi-file', 'appliance.kiwi', 'system', 'build', '--description', '/path/to/kiwi/description', '--target-dir', '/some/target-dir', '--allow-existing-root', ], ) mock_SystemBuildTask.return_value.process.assert_called_once_with() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/system_stash_test.py0000644000000000000000000001317615273675667016755 0ustar00import sys from pytest import raises from unittest.mock import Mock, patch from tempfile import NamedTemporaryFile from ..test_helper import argv_kiwi_tests from kiwi.tasks.system_stash import SystemStashTask from kiwi.exceptions import KiwiStackBuildContainerNameInvalid class TestSystemStashTask: def setup(self): sys.argv = [sys.argv[0], 'system', 'stash', '--root', 'some-root-dir'] self.task = SystemStashTask() self.tmpfile = NamedTemporaryFile() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def _init_command_args(self): self.task.command_args = {} self.task.command_args['help'] = False self.task.command_args['stash'] = False self.task.command_args['--root'] = None self.task.command_args['--tag'] = None self.task.command_args['--container-name'] = None @patch('kiwi.tasks.system_stash.Help') def test_process_help(self, mock_Help): Help = Mock() mock_Help.return_value = Help self._init_command_args() self.task.command_args['help'] = True self.task.command_args['stash'] = True self.task.process() Help.show.assert_called_once_with('kiwi::system::stash') @patch('kiwi.tasks.system_stash.DataOutput') @patch('kiwi.tasks.system_stash.Privileges') @patch('os.listdir') def test_process_stash_list( self, mock_os_listdir, mock_Privileges, mock_DataOutput ): mock_os_listdir.return_value = ['name'] stashes = Mock() mock_DataOutput.return_value = stashes self._init_command_args() self.task.command_args['stash'] = True self.task.command_args['--list'] = True self.task.process() stashes.display.assert_called_once_with() @patch('kiwi.tasks.system_stash.Privileges') def test_process_invalid_container_name(self, mock_Privileges): self._init_command_args() self.task.command_args['--root'] = ( '../data/stackbuild/image-root-invalid-name' ) with raises(KiwiStackBuildContainerNameInvalid): self.task.process() @patch('kiwi.tasks.system_stash.Command.run') @patch('kiwi.tasks.system_stash.OCI.new') @patch('kiwi.tasks.system_stash.Privileges') @patch('kiwi.tasks.system_stash.Path') @patch('os.path.isfile') def test_process_build_initial_layer( self, mock_os_path_isfile, mock_Path, mock_Privileges, mock_OCI_new, mock_Command_run, ): self._init_command_args() self.task.command_args['--root'] = '../data/stackbuild/image-root' oci = Mock() mock_OCI_new.return_value = oci mock_os_path_isfile.return_value = False container_config = { 'container_name': 'tumbleweed', 'container_tag': 'latest', 'entry_command': ['/bin/sh'], 'labels': { 'io.osinside.kiwi.maintainer': 'Marcus Schaefer', 'io.osinside.kiwi.meta': 'KIWI - https://github.com/OSInside/kiwi', }, 'history': { 'created_by': 'KIWI - https://github.com/OSInside/kiwi', 'comment': 'KIWI Root Tree Stash', 'author': 'Marcus Schaefer', }, } self.task.process() mock_Privileges.check_for_root_permissions.assert_called_once_with() oci.init_container.assert_called_once_with() oci.unpack.assert_called_once_with() oci.sync_rootfs.assert_called_once_with( '../data/stackbuild/image-root', ['dev/*', 'sys/*', 'proc/*'] ) oci.repack.assert_called_once_with(container_config) oci.set_config.assert_called_once_with(container_config) oci.post_process.assert_called_once_with() oci.export_container_image.assert_called_once_with( '/var/tmp/kiwi-stash/tumbleweed/tumbleweed.tar', 'oci-archive', 'tumbleweed:latest', ) mock_Command_run.assert_called_once_with( [ 'podman', 'load', '-i', '/var/tmp/kiwi-stash/tumbleweed/tumbleweed.tar', ] ) @patch('kiwi.tasks.system_stash.Command.run') @patch('kiwi.tasks.system_stash.OCI.new') @patch('kiwi.tasks.system_stash.Privileges') @patch('kiwi.tasks.system_stash.Path') @patch('os.path.isfile') @patch('os.path.abspath') @patch('kiwi.utils.temporary.NamedTemporaryFile') def test_process_build_additional_layer( self, mock_NamedTemporaryFile, mock_os_path_abspath, mock_os_path_isfile, mock_Path, mock_Privileges, mock_OCI_new, mock_Command_run, ): tempfile = Mock() tempfile.name = self.tmpfile.name mock_NamedTemporaryFile.return_value = tempfile self._init_command_args() self.task.command_args['--root'] = '../data/stackbuild/image-root' oci = Mock() mock_OCI_new.return_value = oci mock_os_path_isfile.return_value = True mock_os_path_abspath.return_value = 'absolute_root_dir_path' self.task.process() oci.import_container_image.assert_called_once_with( 'oci-archive:/var/tmp/kiwi-stash/' 'tumbleweed/tumbleweed.tar:tumbleweed:latest' ) mock_Command_run.assert_called_once_with( [ 'podman', 'load', '-i', '/var/tmp/kiwi-stash/tumbleweed/tumbleweed.tar', ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/tasks/system_update_test.py0000644000000000000000000000722215273675667017110 0ustar00import sys import os from unittest.mock import patch, Mock, MagicMock import kiwi from ..test_helper import argv_kiwi_tests from kiwi.defaults import Defaults from kiwi.tasks.system_update import SystemUpdateTask class TestSystemUpdateTask: def setup(self): Defaults.set_platform_name('x86_64') sys.argv = [ sys.argv[0], '--profile', 'vmxFlavour', 'system', 'update', '--root', '../data/root-dir', ] self.abs_target_dir = os.path.abspath('some-target') kiwi.tasks.system_update.Privileges = Mock() kiwi.tasks.system_update.Path = Mock() kiwi.tasks.system_update.Help = Mock(return_value=Mock()) self.task = SystemUpdateTask() def setup_method(self, cls): self.setup() def teardown(self): sys.argv = argv_kiwi_tests def teardown_method(self, cls): self.teardown() def _init_command_args(self): self.task.command_args = {} self.task.command_args['help'] = False self.task.command_args['update'] = False self.task.command_args['--add-package'] = [] self.task.command_args['--delete-package'] = [] self.task.command_args['--root'] = '../data/root-dir' @patch('kiwi.tasks.system_update.SystemPrepare') def test_process_system_update(self, mock_SystemPrepare): manager = MagicMock() system_prepare = Mock() system_prepare.setup_repositories = Mock(return_value=manager) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare self._init_command_args() self.task.command_args['update'] = True self.task.process() system_prepare.setup_repositories.assert_called_once_with( target_arch=None ) system_prepare.update_system.assert_called_once_with( manager.__enter__.return_value ) @patch('kiwi.tasks.system_update.SystemPrepare') def test_process_system_update_add_package(self, mock_SystemPrepare): manager = MagicMock() system_prepare = Mock() system_prepare.setup_repositories = Mock(return_value=manager) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare self._init_command_args() self.task.command_args['update'] = True self.task.command_args['--add-package'] = ['vim'] self.task.process() system_prepare.setup_repositories.assert_called_once_with( target_arch=None ) system_prepare.install_packages.assert_called_once_with( manager.__enter__.return_value, ['vim'] ) @patch('kiwi.tasks.system_update.SystemPrepare') def test_process_system_update_delete_package(self, mock_SystemPrepare): manager = MagicMock() system_prepare = Mock() system_prepare.setup_repositories = Mock(return_value=manager) mock_SystemPrepare.return_value.__enter__.return_value = system_prepare self._init_command_args() self.task.command_args['update'] = True self.task.command_args['--delete-package'] = ['vim'] self.task.process() system_prepare.setup_repositories.assert_called_once_with( target_arch=None ) system_prepare.delete_packages.assert_called_once_with( manager.__enter__.return_value, ['vim'] ) def test_process_system_update_help(self): self._init_command_args() self.task.command_args['help'] = True self.task.command_args['update'] = True self.task.process() self.task.manual.show.assert_called_once_with('kiwi::system::update') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/test_helper.py0000644000000000000000000000035215273675667014351 0ustar00import sys # default commandline used for any test, overwrite when needed sys.argv = [ sys.argv[0], 'system', 'prepare', '--description', 'description', '--root', 'directory', ] argv_kiwi_tests = sys.argv ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7706094 kiwi-11.1.8/test/unit/utils/__init__.py0000644000000000000000000000000015273675667014720 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/block_test.py0000644000000000000000000000331715273675667015330 0ustar00from unittest.mock import Mock, patch from kiwi.utils.block import BlockID class TestBlockID: def setup(self): self.blkid = BlockID('device') def setup_method(self, cls): self.setup() @patch('kiwi.utils.block.Command.run') def test_setup_with_uuid_format(self, mock_command): BlockID('UUID=uuid') mock_command.assert_called_once_with(['blkid', '--uuid', 'uuid']) @patch('kiwi.utils.block.Command.run') def test_get_blkid(self, mock_command): self.blkid.get_blkid('LABEL') mock_command.assert_called_once_with( ['blkid', 'device', '-s', 'LABEL', '-o', 'value'], raise_on_error=False, ) @patch('kiwi.utils.block.BlockID.get_blkid') def test_get_filesystem(self, mock_get_blkid): self.blkid.get_filesystem() mock_get_blkid.assert_called_once_with('TYPE') @patch('kiwi.utils.block.BlockID.get_blkid') def test_get_label(self, mock_get_blkid): self.blkid.get_label() mock_get_blkid.assert_called_once_with('LABEL') @patch('kiwi.utils.block.BlockID.get_blkid') def test_get_uuid(self, mock_get_blkid): self.blkid.get_uuid() mock_get_blkid.assert_called_once_with('UUID') @patch('kiwi.utils.block.BlockID.get_blkid') def test_get_ptuuid(self, mock_get_blkid): self.blkid.get_ptuuid() mock_get_blkid.assert_called_once_with('PTUUID') @patch('kiwi.utils.block.Command.run') def test_get_partition_count(self, mock_Command_run): lsblk_call = Mock() lsblk_call.output = "NAME TYPE\nsda disk\nsda4 part \nsda3 part" mock_Command_run.return_value = lsblk_call assert self.blkid.get_partition_count() == 2 ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/checksum_test.py0000644000000000000000000001427015273675667016040 0ustar00from builtins import bytes import encodings.ascii as encoding from unittest.mock import patch, call, Mock, mock_open from pytest import raises from kiwi.utils.checksum import Checksum from kiwi.exceptions import KiwiFileNotFound class TestChecksum: @patch('os.path.exists') def setup(self, mock_exists): self.ascii = encoding.getregentry().name read_results = [bytes(b''), bytes(b'data'), bytes(b''), bytes(b'data')] def side_effect(arg): return read_results.pop() self.m_open = mock_open() self.m_open.return_value.read.side_effect = side_effect mock_exists.return_value = True self.checksum = Checksum('some-file') @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() def test_checksum_file_not_found(self): with raises(KiwiFileNotFound): Checksum('some-file') @patch('os.path.exists') def test_matches_checksum_file_does_not_exist(self, mock_exists): mock_exists.return_value = False assert self.checksum.matches('sum', 'some-file') is False @patch('os.path.exists') def test_matches(self, mock_exists): mock_exists.return_value = True self.m_open.return_value.read.side_effect = None self.m_open.return_value.read.return_value = 'sum' with patch('builtins.open', self.m_open, create=True): assert self.checksum.matches('sum', 'some-file') is True self.m_open.assert_called_once_with('some-file', encoding=self.ascii) with patch('builtins.open', self.m_open, create=True): assert self.checksum.matches('foo', 'some-file') is False @patch('kiwi.path.Path.which') @patch('kiwi.utils.checksum.Compress') @patch('hashlib.sha256') @patch('os.path.getsize') def test_sha256_xz(self, mock_size, mock_sha256, mock_compress, mock_which): checksum = Mock checksum.uncompressed_filename = 'some-file-uncompressed' mock_which.return_value = 'factor' compress = Mock() digest = Mock() digest.block_size = 1024 digest._calculate_hash_hexdigest = Mock(return_value=checksum) digest.hexdigest = Mock(return_value='sum') compress.get_format = Mock(return_value='xz') mock_size.return_value = 1343225856 mock_sha256.return_value = digest mock_compress.return_value = compress with patch('builtins.open', self.m_open, create=True): self.checksum.sha256('outfile') assert self.m_open.call_args_list == [ call('some-file', 'rb'), call('some-file-uncompressed', 'rb'), call('outfile', encoding=self.ascii, mode='w'), ] self.m_open.return_value.write.assert_called_once_with( 'sum 163968 8192 163968 8192\n' ) @patch('kiwi.path.Path.which') @patch('kiwi.utils.checksum.Compress') @patch('hashlib.sha512') @patch('os.path.getsize') def test_sha512_xz(self, mock_size, mock_sha512, mock_compress, mock_which): checksum = Mock checksum.uncompressed_filename = 'some-file-uncompressed' mock_which.return_value = 'factor' compress = Mock() digest = Mock() digest.block_size = 1024 digest._calculate_hash_hexdigest = Mock(return_value=checksum) digest.hexdigest = Mock(return_value='sum') compress.get_format = Mock(return_value='xz') mock_size.return_value = 1343225856 mock_sha512.return_value = digest mock_compress.return_value = compress with patch('builtins.open', self.m_open, create=True): self.checksum.sha512('outfile') assert self.m_open.call_args_list == [ call('some-file', 'rb'), call('some-file-uncompressed', 'rb'), call('outfile', encoding=self.ascii, mode='w'), ] self.m_open.return_value.write.assert_called_once_with( 'sum 163968 8192 163968 8192\n' ) @patch('kiwi.path.Path.which') @patch('kiwi.utils.checksum.Compress') @patch('hashlib.sha256') @patch('os.path.getsize') def test_sha256_file( self, mock_size, mock_sha256, mock_compress, mock_which ): mock_which.return_value = 'factor' compress = Mock() digest = Mock() digest.block_size = 1024 digest.hexdigest = Mock(return_value='sum') compress.get_format = Mock(return_value=None) mock_size.return_value = 1343225856 mock_sha256.return_value = digest mock_compress.return_value = compress with patch('builtins.open', self.m_open, create=True): self.checksum.sha256('outfile') assert self.m_open.call_args_list == [ call('some-file', 'rb'), call('outfile', encoding=self.ascii, mode='w'), ] self.m_open.return_value.write.assert_called_once_with( 'sum 163968 8192\n' ) @patch('kiwi.path.Path.which') @patch('kiwi.utils.checksum.Compress') @patch('hashlib.sha256') @patch('os.path.getsize') def test_sha256(self, mock_size, mock_sha256, mock_compress, mock_which): mock_which.return_value = 'factor' compress = Mock() digest = Mock() digest.block_size = 1024 digest.hexdigest = Mock(return_value='sum') compress.get_format = Mock(return_value=None) mock_size.return_value = 1343225856 mock_sha256.return_value = digest mock_compress.return_value = compress with patch('builtins.open', self.m_open, create=True): self.checksum.sha256('outfile') assert self.m_open.call_args_list == [ call('some-file', 'rb'), call('outfile', encoding=self.ascii, mode='w'), ] self.m_open.return_value.write.assert_called_once_with( 'sum 163968 8192\n' ) @patch('hashlib.sha256') def test_sha256_plain(self, mock_sha256): digest = Mock() digest.block_size = 1024 digest.hexdigest = Mock(return_value='sum') mock_sha256.return_value = digest with patch('builtins.open', self.m_open, create=True): assert self.checksum.sha256() == digest.hexdigest.return_value ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/codec_test.py0000644000000000000000000000354615273675667015317 0ustar00import logging from unittest.mock import patch from pytest import raises, fixture from kiwi.utils.codec import Codec from kiwi.exceptions import KiwiDecodingError class TestCodec: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): self.literal = bytes(b'\xc3\xbc') def setup_method(self, cls): self.setup() @patch('kiwi.utils.codec.Codec._wrapped_decode') def test_decode_ascii_failure(self, mock_decode): msg = 'utf-8 compatible string' def mocked_decode(literal, encoding, error_handling_schema): if encoding: return msg else: raise KiwiDecodingError('ascii decoding failure') mock_decode.side_effect = mocked_decode with self._caplog.at_level(logging.WARNING): assert msg == Codec.decode(self.literal) def test_decode_None_literal(self): assert '' == Codec.decode(None) @patch('kiwi.utils.codec.Codec._wrapped_decode') def test_decode(self, mock_decode): msg = 'utf-8 compatible string' mock_decode.return_value = msg assert msg == Codec.decode(self.literal) @patch('kiwi.utils.codec.Codec._wrapped_decode') def test_decode_utf8_failure(self, mock_decode): def mocked_decode(literal, encoding, error_handling_schema): if encoding: raise KiwiDecodingError('utf-8 decoding failure') else: raise KiwiDecodingError('ascii decoding failure') mock_decode.side_effect = mocked_decode with raises(KiwiDecodingError): with self._caplog.at_level(logging.WARNING): Codec.decode(self.literal) def test_wrapped_decode(self): assert self.literal.decode() == Codec._wrapped_decode( self.literal, 'utf-8' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/command_capabilities_test.py0000644000000000000000000001413615273675667020366 0ustar00import logging from unittest.mock import patch, call from pytest import raises, fixture from collections import namedtuple from kiwi.utils.command_capabilities import CommandCapabilities from kiwi.exceptions import KiwiCommandCapabilitiesError class TestCommandCapabilities: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('kiwi.command.Command.run') @patch('kiwi.utils.command_capabilities.Path.which') def test_has_option_in_help(self, mock_Path_which, mock_run): command_type = namedtuple('command', ['output', 'error']) mock_run.return_value = command_type( output="Dummy line\n\t--some-flag\n\t--some-other-flag", error="Dummy line\n\t--error-flag\n\t--some-other-flag", ) assert ( CommandCapabilities.has_option_in_help('command', '--some-flag') is True ) assert ( CommandCapabilities.has_option_in_help('command', '--error-flag') is True ) assert ( CommandCapabilities.has_option_in_help( 'command', '--some-flag', help_flags=['subcommand', '-h'] ) is True ) assert ( CommandCapabilities.has_option_in_help( 'command', '--some-other-flag', help_flags=['subcommand', '-h'], root='root_dir', ) is True ) assert ( CommandCapabilities.has_option_in_help( 'command', '--non-existing-flag', raise_on_error=False ) is False ) mock_run.assert_has_calls( [ call(['command', '--help'], raise_on_error=False), call(['command', '--help'], raise_on_error=False), call(['command', 'subcommand', '-h'], raise_on_error=False), call( ['chroot', 'root_dir', 'command', 'subcommand', '-h'], raise_on_error=False, ), call(['command', '--help'], raise_on_error=False), ] ) @patch('kiwi.command.Command.run') @patch('kiwi.utils.command_capabilities.Path.which') def test_has_option_in_help_command_failure_warning( self, mock_Path_which, mock_run ): mock_run.return_value.output = '' mock_run.return_value.error = '' with self._caplog.at_level(logging.WARNING): CommandCapabilities.has_option_in_help( 'command_that_fails', '--non-existing-flag', raise_on_error=False, ) @patch('kiwi.command.Command.run') @patch('kiwi.utils.command_capabilities.Path.which') def test_has_option_in_help_command_failure_exception( self, mock_Path_which, mock_run ): mock_run.return_value.output = '' mock_run.return_value.error = '' with raises(KiwiCommandCapabilitiesError): CommandCapabilities.has_option_in_help( 'command_that_fails', '--non-existing-flag' ) @patch('kiwi.command.Command.run') @patch('kiwi.utils.command_capabilities.Path.which') def test_has_option_in_help_command_failure_command_not_found_exception( self, mock_Path_which, mock_run ): mock_Path_which.return_value = False with raises(KiwiCommandCapabilitiesError): CommandCapabilities.has_option_in_help( 'command_that_does_not_exist', '--help' ) @patch('kiwi.command.Command.run') def test_check_version(self, mock_run): command_type = namedtuple('command', ['output']) mock_run.return_value = command_type( output="Dummy line\ncommand v1.2.3\n" ) assert CommandCapabilities.check_version('command', (1, 2, 3)) assert CommandCapabilities.check_version('command', (1, 1, 3)) assert not CommandCapabilities.check_version('command', (1, 3)) assert CommandCapabilities.check_version( 'command', (1, 2, 3), version_flags=['-v'] ) assert CommandCapabilities.check_version( 'command', (1, 2, 3), version_flags=['-v'], root='root_dir' ) mock_run.assert_has_calls( [ call(['command', '--version']), call(['command', '--version']), call(['command', '--version']), call(['command', '-v']), call(['chroot', 'root_dir', 'command', '-v']), ] ) @patch('kiwi.command.Command.run') def test_check_version_complex_pattern(self, mock_run): command_type = namedtuple('command', ['output']) mock_run.return_value = command_type( output="grub2-mkconfig (GRUB2) 2.02\n" ) assert CommandCapabilities.check_version('command', (2, 2)) is True assert CommandCapabilities.check_version('command', (2, 4)) is False @patch('kiwi.command.Command.run') def test_check_version_no_match(self, mock_run): command_type = namedtuple('command', ['output']) mock_run.return_value = command_type( output="Dummy line\ncommand someother stuff\n" ) with raises(KiwiCommandCapabilitiesError): CommandCapabilities.check_version('command', (1, 2, 3)) @patch('kiwi.command.Command.run') def test_check_version_failure_warning(self, mock_run): def side_effect(): raise Exception("Something went wrong") mock_run.side_effect = side_effect with self._caplog.at_level(logging.WARNING): CommandCapabilities.check_version( 'command_that_fails', (1, 2), raise_on_error=False ) @patch('kiwi.command.Command.run') def test_check_version_failure_exception(self, mock_run): def side_effect(): raise Exception("Something went wrong") mock_run.side_effect = side_effect with raises(KiwiCommandCapabilitiesError): CommandCapabilities.check_version( 'command_that_fails', '--non-existing-flag' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/compress_test.py0000644000000000000000000000734515273675667016076 0ustar00import logging from unittest.mock import patch, Mock from pytest import raises, fixture from kiwi.utils.compress import Compress from kiwi.exceptions import KiwiFileNotFound, KiwiCompressionFormatUnknown class TestCompress: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('os.path.exists') def setup(self, mock_exists): mock_exists.return_value = True self.compress = Compress('some-file', True) @patch('os.path.exists') def setup_method(self, cls, mock_exists): self.setup() def test_source_file_not_found(self): with raises(KiwiFileNotFound): Compress('some-file') @patch('kiwi.command.Command.run') def test_xz(self, mock_command): assert self.compress.xz() == 'some-file.xz' mock_command.assert_called_once_with( ['xz', '-f', '--threads=0', '--keep', 'some-file'] ) assert self.compress.compressed_filename == 'some-file.xz' @patch('kiwi.command.Command.run') def test_xz_with_custom_options(self, mock_command): assert self.compress.xz(options=['foo', 'bar']) == 'some-file.xz' mock_command.assert_called_once_with( ['xz', '-f', 'foo', 'bar', '--keep', 'some-file'] ) assert self.compress.compressed_filename == 'some-file.xz' @patch('kiwi.command.Command.run') def test_gzip(self, mock_command): assert self.compress.gzip() == 'some-file.gz' mock_command.assert_called_once_with( ['gzip', '-f', '-9', '--keep', 'some-file'] ) assert self.compress.compressed_filename == 'some-file.gz' @patch('kiwi.command.Command.run') @patch('kiwi.utils.compress.Temporary.new_file') @patch('kiwi.utils.compress.Compress.get_format') def test_uncompress(self, mock_format, mock_temp, mock_command): mock_format.return_value = 'xz' self.compress.uncompress() mock_command.assert_called_once_with(['xz', '-d', 'some-file']) assert self.compress.uncompressed_filename == 'some-file' @patch('kiwi.command.Command.run') @patch('kiwi.utils.compress.Temporary.new_file') @patch('kiwi.utils.compress.Compress.get_format') def test_uncompress_temporary(self, mock_format, mock_temp, mock_command): tempfile = Mock() tempfile.name = 'tempfile' mock_temp.return_value = tempfile mock_format.return_value = 'xz' self.compress.uncompress(temporary=True) mock_command.assert_called_once_with( ['bash', '-c', 'xz -c -d some-file > tempfile'] ) assert self.compress.uncompressed_filename == 'tempfile' @patch('kiwi.utils.compress.Compress.get_format') def test_uncompress_unknown_format(self, mock_format): mock_format.return_value = None with raises(KiwiCompressionFormatUnknown): self.compress.uncompress() @patch('kiwi.path.Path.which') def test_get_format(self, mock_which): mock_which.side_effect = ['xz'] xz = Compress('../data/xz_data.xz') assert xz.get_format() == 'xz' mock_which.side_effect = ['xz', 'gzip'] gzip = Compress('../data/gz_data.gz') assert gzip.get_format() == 'gzip' @patch('kiwi.command.Command.run') def test_get_format_invalid_format(self, mock_run): result = Mock() result.returncode = 1 mock_run.return_value = result invalid = Compress("../data/gz_data.gz") invalid.supported_zipper = ["mock_zip"] with self._caplog.at_level(logging.DEBUG): assert invalid.get_format() is None mock_run.assert_called_once_with( ['mock_zip', '-l', '../data/gz_data.gz'], raise_on_error=False ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/dir_files_test.py0000644000000000000000000000376615273675667016206 0ustar00from unittest.mock import Mock, patch, call from kiwi.utils.dir_files import DirFiles class TestDirFiles: @patch('kiwi.utils.dir_files.Path') def setup(self, mock_Path): self.dir_manager = DirFiles('box_dir') mock_Path.wipe.assert_called_once_with('box_dir.tmp') @patch('kiwi.utils.dir_files.Path') def setup_method(self, cls, mock_Path): self.setup() @patch('kiwi.utils.dir_files.NamedTemporaryFile') def test_register(self, mock_NamedTemporaryFile): tmpfile = Mock() tmpfile.name = 'tmp_a' mock_NamedTemporaryFile.return_value = tmpfile self.dir_manager.register('/some/path/to/file_a') assert self.dir_manager.collection == {'file_a': 'tmp_a'} @patch('kiwi.utils.dir_files.NamedTemporaryFile') def test_deregister(self, mock_NamedTemporaryFile): tmpfile = Mock() tmpfile.name = 'tmp_a' mock_NamedTemporaryFile.return_value = tmpfile self.dir_manager.register('/some/path/to/file_a') assert self.dir_manager.collection == {'file_a': 'tmp_a'} self.dir_manager.deregister('/some/path/to/some/not/present') assert self.dir_manager.collection == {'file_a': 'tmp_a'} self.dir_manager.deregister('/some/path/to/file_a') assert self.dir_manager.collection == {} @patch('kiwi.utils.dir_files.Path') @patch('kiwi.utils.dir_files.Command.run') def test_commit(self, mock_Command_run, mock_Path): self.dir_manager.collection = {'file_a': 'tmp_a'} self.dir_manager.commit() mock_Path.create.assert_called_once_with('box_dir.tmp') assert mock_Command_run.call_args_list == [ call( ['bash', '-c', 'cp -a box_dir/* box_dir.tmp'], raise_on_error=False, ), call(['mv', 'tmp_a', 'box_dir.tmp/file_a']), call(['mv', 'box_dir', 'box_dir.wipe']), call(['mv', 'box_dir.tmp', 'box_dir']), call(['rm', '-rf', 'box_dir.wipe']), ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/fetch_files_test.py0000644000000000000000000000656315273675667016517 0ustar00import io import requests from pytest import raises from unittest.mock import Mock, MagicMock, patch from kiwi.utils.fetch_files import FetchFiles from kiwi.exceptions import KiwiUriOpenError class TestFetchFiles: def setup(self): self.fetcher = FetchFiles() def setup_method(self, cls): self.setup() @patch('kiwi.utils.fetch_files.requests') @patch('kiwi.utils.fetch_files.progressbar') def test_wget(self, mock_progressbar, mock_requests): response = Mock() response.headers.get.return_value = 4 response.iter_content.return_value = [b'data'] mock_requests.request.return_value = response with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.fetcher.wget('http://foo', 'bar') mock_open.assert_called_once_with('bar', 'wb') file_handle.write.assert_called_once_with(b'data') mock_progressbar.ProgressBar.assert_called_once_with( maxval=4, widgets=[ 'Loading: ', mock_progressbar.Percentage.return_value, ' ', mock_progressbar.Bar(marker='#', left='[', right=']'), ' ', mock_progressbar.ETA.return_value, ' ', mock_progressbar.FileTransferSpeed.return_value, ], ) @patch('kiwi.utils.fetch_files.requests.request') @patch('kiwi.utils.fetch_files.progressbar') def test_wget_unknown_length(self, mock_progressbar, mock_request): response = Mock() response.headers.get.return_value = None response.iter_content.return_value = [b'data'] mock_request.return_value = response with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.fetcher.wget('http://foo', 'bar') file_handle.write.assert_called_once_with(b'data') mock_progressbar.ProgressBar.assert_called_once_with( maxval=mock_progressbar.UnknownLength, widgets=[ 'Loading: ', mock_progressbar.FileTransferSpeed.return_value, ], ) @patch('kiwi.utils.fetch_files.requests.request') def test_wget_http_error(self, mock_request): response = Mock() response.raise_for_status.side_effect = requests.exceptions.HTTPError( '404 Client Error: Not Found for url: http://foo' ) mock_request.return_value = response with raises(KiwiUriOpenError) as issue: self.fetcher.wget('http://foo', 'bar') assert 'Download of http://foo failed: HTTPError: 404' in str( issue.value ) @patch('kiwi.utils.fetch_files.requests.request') def test_wget_connection_error(self, mock_request): mock_request.side_effect = requests.exceptions.ConnectionError( 'Name or service not known' ) with raises(KiwiUriOpenError) as issue: self.fetcher.wget('http://foo', 'bar') assert 'ConnectionError: Name or service not known' in str(issue.value) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/fstab_test.py0000644000000000000000000001026515273675667015335 0ustar00import io import logging from pytest import fixture from unittest.mock import MagicMock, patch, call from kiwi.utils.fstab import Fstab from kiwi.utils.fstab import fstab_entry_type class TestFstab(object): @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): self.fstab = Fstab() self.fstab.read('../data/fstab') def setup_method(self, cls): self.setup() def test_read(self): with self._caplog.at_level(logging.WARNING): self.fstab.read('../data/fstab') assert ( format( 'Mountpoint for "LABEL=bar /home xfs defaults 0 0" ' 'in use by "LABEL=foo /home ext4 defaults 0 0", skipped' ) in self._caplog.text ) def test_get_devices(self): assert self.fstab.get_devices() == [ fstab_entry_type( fstype='ext4', mountpoint='/', device_path='/dev/disk/' 'by-uuid/bd604632-663b-4d4c-b5b0-8d8686267ea2', device_spec='UUID=bd604632-663b-4d4c-b5b0-8d8686267ea2', options='acl,user_xattr', dump='0', fs_passno='1', ), fstab_entry_type( fstype='swap', mountpoint='swap', device_path='/dev/disk/' 'by-uuid/daa5a8c3-5c72-4343-a1d4-bb74ec4e586e', device_spec='UUID=daa5a8c3-5c72-4343-a1d4-bb74ec4e586e', options='defaults', dump='0', fs_passno='0', ), fstab_entry_type( fstype='vfat', mountpoint='/boot/efi', device_path='/dev/disk/by-uuid/FCF7-B051', device_spec='UUID=FCF7-B051', options='defaults', dump='0', fs_passno='0', ), fstab_entry_type( fstype='xfs', mountpoint='/boot', device_path='/dev/disk/by-label/BOOT', device_spec='LABEL=BOOT', options='defaults', dump='0', fs_passno='0', ), fstab_entry_type( fstype='ext4', mountpoint='/home', device_path='/dev/disk/by-label/foo', device_spec='LABEL=foo', options='defaults', dump='0', fs_passno='0', ), fstab_entry_type( fstype='ext4', mountpoint='/bar', device_path='/dev/disk/by-partuuid/3c8bd108-01', device_spec='PARTUUID=3c8bd108-01', options='defaults', dump='0', fs_passno='0', ), fstab_entry_type( fstype='ext4', mountpoint='/foo', device_path='/dev/mynode', device_spec='/dev/mynode', options='defaults', dump='0', fs_passno='0', ), ] def test_export_and_canonical_order(self): with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) self.fstab.export('filename') file_handle = mock_open.return_value.__enter__.return_value mock_open.assert_called_once_with('filename', 'w') assert file_handle.write.call_args_list == [ call( 'UUID=daa5a8c3-5c72-4343-a1d4-bb74ec4e586e swap ' 'swap defaults 0 0\n' ), call( 'UUID=bd604632-663b-4d4c-b5b0-8d8686267ea2 / ' 'ext4 acl,user_xattr 0 1\n' ), call('PARTUUID=3c8bd108-01 /bar ext4 defaults 0 0\n'), call('LABEL=BOOT /boot xfs defaults 0 0\n'), call('/dev/mynode /foo ext4 defaults 0 0\n'), call('LABEL=foo /home ext4 defaults 0 0\n'), call('UUID=FCF7-B051 /boot/efi vfat defaults 0 0\n'), ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/os_release_test.py0000644000000000000000000000074415273675667016360 0ustar00from pytest import raises from kiwi.utils.os_release import OsRelease from kiwi.exceptions import KiwiOSReleaseImportError class TestOsRelease(object): def setup(self): self.os_release = OsRelease('../data') def setup_method(self, cls): self.setup() def test_setup_raises(self): with raises(KiwiOSReleaseImportError): OsRelease('does-not-exist') def test_get(self): assert self.os_release.get('ID') == 'opensuse-leap' ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/output_test.py0000644000000000000000000000364415273675667015601 0ustar00import logging from pytest import fixture from unittest.mock import patch from kiwi.utils.output import DataOutput import json import unittest.mock as mock class TestDataOutput: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): test_data = {'some-name': 'some-data'} self.expected_out = json.dumps( test_data, sort_keys=True, indent=4, separators=(',', ': ') ) self.out = DataOutput(test_data) def setup_method(self, cls): self.setup() @patch('sys.stdout') def test_display(self, mock_stdout): self.out.display() mock_stdout.write.assert_any_call(self.expected_out) def test_display_file(self): with self._caplog.at_level(logging.INFO): with patch('builtins.open', create=True) as mock_open: file_handle = mock_open.return_value.__enter__.return_value DataOutput.display_file('some-file', 'some-message') mock_open.assert_called_once_with('some-file') file_handle.read.assert_called_once_with() @patch('sys.stdout') @patch('os.system') @patch('kiwi.utils.output.Temporary.new_file') def test_display_color(self, mock_temp, mock_system, mock_stdout): out_file = mock.Mock() out_file.name = 'tmpfile' mock_temp.return_value = out_file self.out.style = 'color' self.out.color_json = True self.out.display() mock_system.assert_called_once_with('cat tmpfile | pjson') @patch('sys.stdout') def test_display_color_no_pjson(self, mock_stdout): self.out.style = 'color' self.out.color_json = False with self._caplog.at_level(logging.WARNING): self.out.display() assert 'pjson for color output not installed' in self._caplog.text assert 'run: pip install pjson' in self._caplog.text ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/primes_test.py0000644000000000000000000000220115273675667015524 0ustar00from pytest import mark from kiwi.utils.primes import primes, factors class TestPrimes: @mark.parametrize( 'highest,number,tail', [ [10, 4, [3, 5, 7]], [11, 5, [5, 7, 11]], [100, 25, [83, 89, 97]], [1000, 168, [983, 991, 997]], [8192, 1028, [8171, 8179, 8191]], [9000, 1117, [8969, 8971, 8999]], ], ) def test_primes(self, highest, number, tail): _primes = list(primes(highest)) assert number == len(_primes) assert tail == _primes[-3:] @mark.parametrize( 'number,threshold,result', [ [1, None, []], [3, None, [3]], [21, None, [3, 7]], [100, None, [2, 2, 5, 5]], [1000, None, [2, 2, 2, 5, 5, 5]], [8191, None, [8191]], [8191, 8192, [8191]], [8999, None, [8999]], [8999, 8192, []], [9000, None, [2, 2, 2, 3, 3, 5, 5, 5]], ], ) def test_factors(self, number, threshold, result): _result = list(factors(number, threshold)) assert result == _result ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/proxy_test.py0000644000000000000000000001245015273675667015415 0ustar00import os from unittest.mock import patch, Mock from pytest import fixture, mark from kiwi.utils.proxy import HostProxy @mark.no_host_proxy_mock class TestHostProxy: @fixture(autouse=True) def inject_fixtures(self, caplog, monkeypatch): self._caplog = caplog for name in HostProxy.proxy_names: monkeypatch.delenv(name, raising=False) monkeypatch.delenv(name.upper(), raising=False) self.monkeypatch = monkeypatch def test_no_proxy(self): host_proxy = HostProxy('../data/nonexisting') assert host_proxy.has_proxy() is False assert host_proxy.get_env() == {} assert ( host_proxy.get_sysconfig_data() == os.linesep.join( [ '# kiwi generated proxy config file', 'PROXY_ENABLED="no"', 'HTTP_PROXY=""', 'HTTPS_PROXY=""', 'FTP_PROXY=""', 'NO_PROXY=""', ] ) + os.linesep ) def test_no_proxy_server(self): self.monkeypatch.setenv('no_proxy', 'localhost') assert HostProxy('../data/nonexisting').has_proxy() is False def test_proxy_from_env(self): self.monkeypatch.setenv('http_proxy', 'http://proxy:3128') self.monkeypatch.setenv('HTTPS_PROXY', 'http://proxy:3129') host_proxy = HostProxy('../data/nonexisting') assert host_proxy.has_proxy() is True assert host_proxy.get_env() == { 'http_proxy': 'http://proxy:3128', 'HTTP_PROXY': 'http://proxy:3128', 'https_proxy': 'http://proxy:3129', 'HTTPS_PROXY': 'http://proxy:3129', } def test_proxy_from_sysconfig(self): host_proxy = HostProxy('../data/sysconfig_proxy') assert host_proxy.has_proxy() is True assert host_proxy.get_env() == { 'http_proxy': 'http://sysconfig-proxy:3128', 'HTTP_PROXY': 'http://sysconfig-proxy:3128', 'https_proxy': 'http://sysconfig-proxy:3129', 'HTTPS_PROXY': 'http://sysconfig-proxy:3129', 'no_proxy': 'localhost, 127.0.0.1', 'NO_PROXY': 'localhost, 127.0.0.1', } def test_proxy_from_default_sysconfig(self): self.monkeypatch.setattr( 'kiwi.defaults.HOST_SYSCONFIG_PROXY', '../data/sysconfig_proxy' ) assert HostProxy().proxy['http_proxy'] == 'http://sysconfig-proxy:3128' def test_proxy_env_precedes_sysconfig(self): self.monkeypatch.setenv('http_proxy', 'http://proxy:3128') host_proxy = HostProxy('../data/sysconfig_proxy') assert host_proxy.proxy['http_proxy'] == 'http://proxy:3128' assert host_proxy.proxy['https_proxy'] == 'http://sysconfig-proxy:3129' def test_proxy_sysconfig_disabled(self): host_proxy = HostProxy('../data/sysconfig_proxy_disabled') assert host_proxy.has_proxy() is False @patch('kiwi.utils.proxy.Command.run') @patch('kiwi.utils.proxy.Path.which') def test_get_apt_config(self, mock_which, mock_run): mock_which.return_value = '/usr/bin/apt-config' mock_run.return_value = Mock( returncode=0, output=os.linesep.join( [ 'APT "";', 'Acquire "";', 'Acquire::http "";', 'Acquire::http::Proxy "http://proxy:3128/";', 'Acquire::http::Proxy::deb.example.com "DIRECT";', 'Acquire::http::Proxy-Auto-Detect "/usr/bin/detect";', 'Acquire::https::Proxy "http://proxy:3129/";', 'Acquire::Retries "3";', ] ), ) assert HostProxy.get_apt_config() == [ 'Acquire::http::Proxy "http://proxy:3128/";', 'Acquire::http::Proxy::deb.example.com "DIRECT";', 'Acquire::https::Proxy "http://proxy:3129/";', ] mock_run.assert_called_once_with( ['apt-config', 'dump'], raise_on_error=False ) @patch('kiwi.utils.proxy.Command.run') @patch('kiwi.utils.proxy.Path.which') def test_get_apt_config_failed(self, mock_which, mock_run): mock_which.return_value = '/usr/bin/apt-config' mock_run.return_value = Mock(returncode=1, output='') assert HostProxy.get_apt_config() == [] @patch('kiwi.utils.proxy.Path.which') def test_get_apt_config_no_apt(self, mock_which): mock_which.return_value = None assert HostProxy.get_apt_config() == [] def test_get_dnf_config(self): assert HostProxy.get_dnf_config('../data/dnf_proxy.conf') == { 'proxy': 'http://dnf-proxy:3128', 'proxy_username': 'user', 'proxy_password': 'secret', } def test_get_dnf_config_default(self): self.monkeypatch.setattr( 'kiwi.defaults.HOST_DNF_CONFIG', '../data/dnf_proxy.conf' ) assert HostProxy.get_dnf_config()['proxy'] == 'http://dnf-proxy:3128' def test_get_dnf_config_no_config(self): assert HostProxy.get_dnf_config('../data/nonexisting') == {} def test_get_dnf_config_broken(self): assert HostProxy.get_dnf_config('../data/dnf_broken.conf') == {} assert 'Failed to read proxy setup from' in self._caplog.text ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/rpm_database_test.py0000644000000000000000000001257215273675667016663 0ustar00from unittest.mock import patch, Mock, call from kiwi.utils.rpm_database import RpmDataBase class TestRpmDataBase: def setup(self): self.rpmdb = RpmDataBase('root_dir') self.rpmdb.rpmdb_host = Mock() self.rpmdb.rpmdb_image = Mock() def setup_method(self, cls): self.setup() @patch('kiwi.utils.rpm_database.Path.which') def test_has_rpm(self, mock_Path_which): mock_Path_which.return_value = None assert self.rpmdb.has_rpm() is False mock_Path_which.assert_called_once_with( 'rpmdb', access_mode=1, root_dir='root_dir' ) mock_Path_which.return_value = 'rpm' assert self.rpmdb.has_rpm() is True @patch('kiwi.command.Command.run') def test_rebuild_database(self, mock_Command_run): self.rpmdb.rebuild_database() mock_Command_run.assert_called_once_with( ['chroot', 'root_dir', 'rpmdb', '--rebuilddb'] ) @patch('kiwi.command.Command.run') def test_init_database(self, mock_Command_run): self.rpmdb.init_database() mock_Command_run.assert_called_once_with( ['rpm', '--root', 'root_dir', '--initdb'] ) def test_set_database_to_host_path(self): self.rpmdb.set_database_to_host_path() self.rpmdb.rpmdb_image.set_config_value.assert_called_once_with( '_dbpath', self.rpmdb.rpmdb_host.get_query.return_value ) self.rpmdb.rpmdb_image.write_config.assert_called_once_with() self.rpmdb.rpmdb_host.get_query.assert_called_once_with('_dbpath') @patch('kiwi.utils.rpm_database.Path.create') @patch('kiwi.command.Command.run') @patch('os.path.exists') def test_link_database_to_host_path( self, mock_exists, mock_Command_run, mock_Path_create ): self.rpmdb.rpmdb_image.expand_query.return_value = '/var/lib/rpm' self.rpmdb.rpmdb_host.expand_query.return_value = ( '/usr/lib/sysimage/rpm' ) mock_exists.return_value = False self.rpmdb.link_database_to_host_path() mock_Path_create.assert_called_once_with('root_dir/usr/lib/sysimage') assert mock_Command_run.call_args_list == [ call( [ 'ln', '-s', '../../../var/lib/rpm', 'root_dir/usr/lib/sysimage/rpm', ] ) ] @patch('kiwi.utils.rpm_database.Path.wipe') @patch('kiwi.command.Command.run') @patch('os.path.islink') @patch('os.path.exists') @patch('os.unlink') def test_set_database_to_image_path( self, mock_os_unlink, mock_os_exists, mock_os_islink, mock_Command_run, mock_Path_wipe, ): mock_os_exists.return_value = True link = [False, False] def mocked_islink(path): return link.pop() mock_os_islink.side_effect = mocked_islink self.rpmdb.rpmdb_image.expand_query.return_value = '/var/lib/rpm' self.rpmdb.rpmdb_host.expand_query.return_value = ( '/usr/lib/sysimage/rpm' ) self.rpmdb.set_database_to_image_path() self.rpmdb.rpmdb_image.expand_query.assert_called_once_with('%_dbpath') assert self.rpmdb.rpmdb_image.set_config_value.call_args_list == [ call('_dbpath', self.rpmdb.rpmdb_host.expand_query.return_value), call( '_dbpath_rebuild', self.rpmdb.rpmdb_image.get_query.return_value ), ] assert mock_Path_wipe.call_args_list == [ call('root_dir/var/lib/rpm'), call('root_dir/usr/lib/sysimage/rpm'), ] self.rpmdb.rpmdb_image.write_config.assert_called_once_with() assert mock_Command_run.call_args_list == [ call(['chroot', 'root_dir', 'rpmdb', '--rebuilddb']), call( [ 'mv', 'root_dir/usr/lib/sysimage/rpm/alternatives', 'root_dir/var/lib/rpm', ] ), ] assert self.rpmdb.rpmdb_image.wipe_config.call_count == 2 link = [True, False] mock_os_islink.side_effect = mocked_islink self.rpmdb.set_database_to_image_path() mock_os_unlink.assert_called_once_with('root_dir/var/lib/rpm') link = [True, True] mock_os_islink.side_effect = mocked_islink self.rpmdb.set_database_to_image_path() assert mock_Command_run.call_args_list[-1] == call( ['chroot', 'root_dir', 'rpmdb', '--rebuilddb'] ) def test_set_macro_from_string(self): self.rpmdb.set_macro_from_string('_install_langs%en_US:de_DE') self.rpmdb.rpmdb_image.set_config_value.assert_called_once_with( '_install_langs', 'en_US:de_DE' ) def test_write_config(self): self.rpmdb.write_config() self.rpmdb.rpmdb_image.write_config.assert_called_once_with() @patch('kiwi.command.Command.run') def test_import_signing_key_to_image(self, mock_Command_run): self.rpmdb.import_signing_key_to_image('key') mock_Command_run.assert_called_once_with( [ 'rpm', '--root', 'root_dir', '--import', 'key', '--dbpath', self.rpmdb.rpmdb_host.expand_query.return_value, ] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/rpm_test.py0000644000000000000000000000605515273675667015036 0ustar00import os from unittest.mock import patch, Mock, call, mock_open from kiwi.utils.rpm import Rpm from kiwi.defaults import Defaults class TestRpm: def setup(self): self.rpm_host = Rpm() self.rpm_image = Rpm('root_dir') self.macro_file = os.sep.join( [ Defaults.get_custom_rpm_macros_path(), Defaults.get_custom_rpm_bootstrap_macro_name(), ] ) def setup_method(self, cls): self.setup() @patch('kiwi.utils.rpm.Command.run') def test_expand_query(self, mock_Command_run): self.rpm_host.expand_query('foo') mock_Command_run.assert_called_once_with(['rpm', '-E', 'foo']) mock_Command_run.reset_mock() self.rpm_image.expand_query('foo') mock_Command_run.assert_called_once_with( ['chroot', 'root_dir', 'rpm', '-E', 'foo'] ) @patch('kiwi.utils.rpm.Command.run') def test_get_query_not_found(self, mock_Command_run): mock_Command_run.return_value.output = '%_dbpath %{_usr}/lib/rpm' assert self.rpm_host.get_query('_unknown') is None @patch('kiwi.utils.rpm.Command.run') def test_get_query(self, mock_Command_run): rpmdb_call = Mock() rpmdb_call.output = '%_dbpath %{_usr}/lib/sysimage/rpm' mock_Command_run.return_value = rpmdb_call assert self.rpm_host.get_query('_dbpath') == '%{_usr}/lib/sysimage/rpm' mock_Command_run.assert_called_once_with(['rpmdb', '--showrc']) mock_Command_run.reset_mock() assert self.rpm_image.get_query('_dbpath') == '%{_usr}/lib/sysimage/rpm' mock_Command_run.assert_called_once_with( ['chroot', 'root_dir', 'rpmdb', '--showrc'] ) def test_set_config_value(self): self.rpm_host.set_config_value('key', 'value') assert self.rpm_host.custom_config[0] == '%key\tvalue' @patch('kiwi.utils.rpm.Path.wipe') def test_wipe_config(self, mock_Path_wipe): self.rpm_host.wipe_config() mock_Path_wipe.assert_called_once_with(os.sep + self.macro_file) mock_Path_wipe.reset_mock() self.rpm_image.wipe_config() mock_Path_wipe.assert_called_once_with( os.sep.join(['root_dir', self.macro_file]) ) @patch('kiwi.utils.rpm.Path.create') def test_write_config(self, mock_Path_create): self.rpm_host.set_config_value('key', 'value') m_open = mock_open() with patch('builtins.open', m_open, create=True): self.rpm_host.write_config() m_open.assert_called_once_with(os.sep + self.macro_file, 'w') assert m_open.return_value.write.call_args_list == [ call('%key\tvalue\n') ] self.rpm_image.set_config_value('foo', 'bar') m_open.reset_mock() with patch('builtins.open', m_open, create=True): self.rpm_image.write_config() m_open.assert_called_once_with( os.sep.join(['root_dir', self.macro_file]), 'w' ) assert m_open.return_value.write.call_args_list == [call('%foo\tbar\n')] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/signature_test.py0000644000000000000000000000442315273675667016236 0ustar00import io from pytest import raises from unittest.mock import patch, Mock, MagicMock, call from kiwi.utils.signature import Signature from kiwi.exceptions import KiwiCredentialsError class TestSignature: def setup(self): self.signature = Signature('/some/file') def setup_method(self, cls): self.setup() @patch('kiwi.utils.signature.RuntimeConfig') def test_sign_raises(self, mock_RuntimeConfig): runtime_config = Mock() runtime_config.get_credentials_verification_metadata_signing_key_file = Mock( return_value=None ) mock_RuntimeConfig.return_value = runtime_config with raises(KiwiCredentialsError): self.signature.sign() @patch('kiwi.utils.signature.RuntimeConfig') @patch('kiwi.utils.signature.Command') @patch('kiwi.utils.signature.Temporary.new_file') def test_sign_verification_metadata( self, mock_Temporary_new_file, mock_Command, mock_RuntimeConfig ): signature_file = Mock() signature_file.name = 'signature_file' mock_Temporary_new_file.return_value = signature_file runtime_config = Mock() runtime_config.get_credentials_verification_metadata_signing_key_file = Mock( return_value='signing_key_file' ) mock_RuntimeConfig.return_value = runtime_config with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.signature.sign() mock_Command.run.assert_called_once_with( [ 'openssl', 'dgst', '-sha256', '-sigopt', 'rsa_padding_mode:pss', '-sigopt', 'rsa_pss_saltlen:-1', '-sigopt', 'rsa_mgf1_md:sha256', '-sign', 'signing_key_file', '-out', 'signature_file', '/some/file', ] ) assert mock_open.call_args_list == [ call('signature_file', 'rb'), call('/some/file', 'ab'), ] file_handle.write.assert_called_once_with(file_handle.read.return_value) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/size_test.py0000644000000000000000000000212115273675667015200 0ustar00from pytest import raises from kiwi.utils.size import StringToSize from kiwi.exceptions import KiwiSizeError class TestStringToSize: def test_to_bytes(self): assert StringToSize.to_bytes('1m') == 1048576 assert StringToSize.to_bytes('1M') == 1048576 assert StringToSize.to_bytes('1g') == 1073741824 assert StringToSize.to_bytes('1G') == 1073741824 assert StringToSize.to_bytes('1234') == 1234 def test_to_bytes_returns_int(self): # The byte value must be returned as int. Returning a float # leads to ugly format output like '1073741824.0' when the # value is interpolated into shell commands or log messages assert isinstance(StringToSize.to_bytes('1'), int) assert isinstance(StringToSize.to_bytes('1m'), int) assert isinstance(StringToSize.to_bytes('1M'), int) assert isinstance(StringToSize.to_bytes('1g'), int) assert isinstance(StringToSize.to_bytes('1G'), int) def test_to_bytes_wrong_format(self): with raises(KiwiSizeError): StringToSize.to_bytes('1mb') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/sparse_test.py0000644000000000000000000000153015273675667015526 0ustar00from unittest.mock import patch from kiwi.utils.sparse import SparseFile class TestSparseFile: @patch('kiwi.utils.sparse.Path.which') @patch('kiwi.utils.sparse.Command.run') def test_create_with_qemu_img(self, mock_command_run, mock_which): mock_which.return_value = '/usr/bin/qemu-img' SparseFile.create('disk.raw', '20M') mock_command_run.assert_called_once_with( ['qemu-img', 'create', 'disk.raw', '20M'] ) @patch('kiwi.utils.sparse.Path.which') @patch('kiwi.utils.sparse.Command.run') def test_create_with_dd_fallback(self, mock_command_run, mock_which): mock_which.return_value = None SparseFile.create('disk.raw', '20M') mock_command_run.assert_called_once_with( ['dd', 'if=/dev/null', 'of=disk.raw', 'bs=1', 'count=0', 'seek=20M'] ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/sync_test.py0000644000000000000000000001704715273675667015217 0ustar00import os import errno import logging from pytest import fixture from stat import ST_MODE from unittest.mock import patch, Mock from kiwi.utils.sync import DataSync class TestDataSync: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): self.sync = DataSync('source_dir', 'target_dir') def setup_method(self, cls): self.setup() @patch('kiwi.utils.sync.RuntimeConfig') @patch('kiwi.utils.sync.Command.run') @patch('kiwi.utils.sync.DataSync.target_supports_extended_attributes') @patch('os.chmod') @patch('os.stat') def test_sync_data( self, mock_stat, mock_chmod, mock_xattr_support, mock_command, mock_RuntimeConfig, ): mock_RuntimeConfig.return_value.get_sync_sparse.return_value = False mock_stat.return_value = os.stat('.') mock_xattr_support.return_value = False with self._caplog.at_level(logging.WARNING): self.sync.sync_data( options=[ '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', ], exclude=['exclude_me'], ) mock_command.assert_called_once_with( [ 'rsync', '--archive', '--hard-links', '--one-file-system', '--exclude', '/exclude_me', 'source_dir', 'target_dir', ] ) mock_chmod.assert_called_once_with( 'target_dir', mock_stat.return_value[ST_MODE] ) @patch('kiwi.utils.sync.RuntimeConfig') @patch('kiwi.utils.sync.DataSync._rsync_supports_sparse_inplace') @patch('kiwi.utils.sync.Command.run') @patch('kiwi.utils.sync.DataSync.target_supports_extended_attributes') @patch('os.chmod') @patch('os.stat') def test_sync_data_sparse( self, mock_stat, mock_chmod, mock_xattr_support, mock_command, mock_sparse_inplace, mock_RuntimeConfig, ): mock_RuntimeConfig.return_value.get_sync_sparse.return_value = True mock_sparse_inplace.return_value = True mock_xattr_support.return_value = True mock_stat.return_value = os.stat('.') self.sync.sync_data(options=['--archive', '--inplace']) mock_command.assert_called_once_with( [ 'rsync', '--archive', '--inplace', '--sparse', 'source_dir', 'target_dir', ] ) @patch('kiwi.utils.sync.RuntimeConfig') @patch('kiwi.utils.sync.Command.run') @patch('kiwi.utils.sync.DataSync.target_supports_extended_attributes') @patch('os.chmod') @patch('os.stat') def test_sync_data_sparse_already_requested( self, mock_stat, mock_chmod, mock_xattr_support, mock_command, mock_RuntimeConfig, ): mock_RuntimeConfig.return_value.get_sync_sparse.return_value = True mock_xattr_support.return_value = True mock_stat.return_value = os.stat('.') self.sync.sync_data(options=['--archive', '--sparse']) mock_command.assert_called_once_with( ['rsync', '--archive', '--sparse', 'source_dir', 'target_dir'] ) @patch('kiwi.utils.sync.RuntimeConfig') @patch('kiwi.utils.sync.Command.run') @patch('kiwi.utils.sync.DataSync.target_supports_extended_attributes') @patch('os.chmod') @patch('os.stat') def test_sync_data_sparse_skipped_for_preallocate( self, mock_stat, mock_chmod, mock_xattr_support, mock_command, mock_RuntimeConfig, ): mock_RuntimeConfig.return_value.get_sync_sparse.return_value = True mock_xattr_support.return_value = True mock_stat.return_value = os.stat('.') with self._caplog.at_level(logging.WARNING): self.sync.sync_data(options=['--archive', '--preallocate']) assert 'incompatible with --preallocate' in self._caplog.text mock_command.assert_called_once_with( ['rsync', '--archive', '--preallocate', 'source_dir', 'target_dir'] ) @patch('kiwi.utils.sync.RuntimeConfig') @patch('kiwi.utils.sync.DataSync._rsync_supports_sparse_inplace') @patch('kiwi.utils.sync.Command.run') @patch('kiwi.utils.sync.DataSync.target_supports_extended_attributes') @patch('os.chmod') @patch('os.stat') def test_sync_data_sparse_skipped_for_old_rsync( self, mock_stat, mock_chmod, mock_xattr_support, mock_command, mock_sparse_inplace, mock_RuntimeConfig, ): mock_RuntimeConfig.return_value.get_sync_sparse.return_value = True mock_sparse_inplace.return_value = False mock_xattr_support.return_value = True mock_stat.return_value = os.stat('.') with self._caplog.at_level(logging.WARNING): self.sync.sync_data(options=['--archive', '--inplace']) assert 'rsync too old' in self._caplog.text mock_command.assert_called_once_with( ['rsync', '--archive', '--inplace', 'source_dir', 'target_dir'] ) @patch('kiwi.utils.sync.Command.run') def test_rsync_supports_sparse_inplace(self, mock_command): mock_command.return_value = Mock( output='rsync version 3.4.0 protocol version 32' ) assert DataSync._rsync_supports_sparse_inplace() is True mock_command.return_value = Mock( output='rsync version 3.1.2 protocol version 31' ) assert DataSync._rsync_supports_sparse_inplace() is False mock_command.return_value = Mock(output='no version information') assert DataSync._rsync_supports_sparse_inplace() is False @patch('kiwi.utils.sync.Command.run') def test_rsync_supports_sparse_inplace_detection_failed(self, mock_command): mock_command.side_effect = Exception('rsync not found') with self._caplog.at_level(logging.WARNING): assert DataSync._rsync_supports_sparse_inplace() is False assert 'Could not detect rsync version' in self._caplog.text @patch('kiwi.utils.sync.RuntimeConfig') @patch('kiwi.utils.sync.Command.run') @patch('os.chmod') @patch('os.stat') def test_sync_data_force_trailing_slash( self, mock_stat, mock_chmod, mock_command, mock_RuntimeConfig ): mock_RuntimeConfig.return_value.get_sync_sparse.return_value = False mock_stat.return_value = os.stat('.') self.sync.sync_data(force_trailing_slash=True) mock_command.assert_called_once_with( ['rsync', 'source_dir/', 'target_dir'] ) @patch('os.getxattr') def test_target_supports_extended_attributes(self, mock_getxattr): assert self.sync.target_supports_extended_attributes() is True mock_getxattr.assert_called_once_with('target_dir', 'user.mime_type') @patch('os.getxattr') def test_target_does_not_support_extended_attributes(self, mock_getxattr): effect = OSError() effect.errno = errno.ENOTSUP mock_getxattr.side_effect = effect assert self.sync.target_supports_extended_attributes() is False effect = NotImplemented mock_getxattr.side_effect = effect assert self.sync.target_supports_extended_attributes() is True ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/sysconfig_test.py0000644000000000000000000000270515273675667016242 0ustar00from unittest.mock import call, mock_open, patch from kiwi.utils.sysconfig import SysConfig class TestSysConfig: def setup(self): self.sysconfig = SysConfig('../data/sysconfig_example.txt') def setup_method(self, cls): self.setup() def test_get_item(self): assert self.sysconfig['name'] == ' "Marcus"' assert self.sysconfig.get('name') == ' "Marcus"' def test_set_item_existing(self): self.sysconfig['name'] = 'Bob' assert self.sysconfig['name'] == 'Bob' def test_set_item_not_existing(self): self.sysconfig['foo'] = '"bar"' assert self.sysconfig['foo'] == '"bar"' assert self.sysconfig.data_list[-1] == 'foo' def test_set_item_number(self): # values are kept in the string format they are written in self.sysconfig['timeout'] = 10 assert self.sysconfig['timeout'] == '10' def test_contains(self): assert 'non_existing_key' not in self.sysconfig assert 'name' in self.sysconfig def test_write(self): m_open = mock_open() with patch('builtins.open', m_open, create=True): self.sysconfig.write() assert m_open.return_value.write.call_args_list == [ call('# some name'), call('\n'), call('name= "Marcus"'), call('\n'), call(''), call('\n'), call('some_key= some-value'), call('\n'), ] ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/temporary_test.py0000644000000000000000000000131415273675667016253 0ustar00from unittest.mock import patch from kiwi.utils.temporary import Temporary class TestTemporary: def setup(self): self.temporary = Temporary() def setup_method(self, cls): self.setup() @patch('kiwi.utils.temporary.NamedTemporaryFile') def test_new_file(self, mock_NamedTemporaryFile): self.temporary.new_file() mock_NamedTemporaryFile.assert_called_once_with( dir='/var/tmp', prefix='kiwi_' ) @patch('kiwi.utils.temporary.TemporaryDirectory') def test_new_dir(self, mock_TemporaryDirectory): self.temporary.new_dir() mock_TemporaryDirectory.assert_called_once_with( dir='/var/tmp', prefix='kiwi_' ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/toenv_test.py0000644000000000000000000000066515273675667015374 0ustar00from pytest import raises import os from kiwi.utils.toenv import ToEnv from kiwi.exceptions import KiwiEnvImportError class TestToEnv(object): def setup(self): ToEnv('../data', 'some.env') assert os.environ['ZYPP_MODALIAS_SYSFS'] == '' def setup_method(self, cls): self.setup() def test_setup_raises(self): with raises(KiwiEnvImportError): ToEnv('../data', 'some_broken.env') ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/utils/veritysetup_test.py0000644000000000000000000001573515273675667016650 0ustar00import io from textwrap import dedent from pytest import raises from unittest.mock import patch, Mock, MagicMock, call from kiwi.utils.veritysetup import VeritySetup from kiwi.exceptions import KiwiOffsetError import kiwi.defaults as defaults class TestVeritySetup: @patch('os.path.getsize') def setup(self, mock_os_path_getsize): mock_os_path_getsize.return_value = 4096 self.veritysetup = VeritySetup('image_file', data_blocks=10) self.veritysetup_full = VeritySetup('image_file') self.verity_dict = { 'UUID': '', 'Hashtype': '1', 'Datablocks': '10', 'Datablocksize': '4096', 'Hashblocksize': '4096', 'Hashalgorithm': 'sha256', 'Salt': 'fb074d1db50...', 'Roothash': 'e2728628377...', } @patch('os.path.getsize') def setup_method(self, cls, mock_os_path_getsize): self.setup() @patch('kiwi.utils.veritysetup.Command.run') def test_format(self, mock_Command_run): self.veritysetup.format() mock_Command_run.assert_called_once_with( [ 'veritysetup', 'format', 'image_file', 'image_file', '--hash-offset=4096', '--hash-block-size=4096', '--data-blocks=10', '--data-block-size=4096', ] ) @patch('kiwi.utils.veritysetup.Command.run') @patch('kiwi.utils.veritysetup.Temporary.new_file') @patch('os.path.getsize') def test_get_hash_byte_size( self, mock_os_path_getsize, mock_Temporary_new_file, mock_Command_run ): tempfile = Mock() tempfile.name = 'tempfile' mock_Temporary_new_file.return_value = tempfile assert ( self.veritysetup.get_hash_byte_size() == mock_os_path_getsize.return_value ) mock_Command_run.assert_called_once_with( [ 'veritysetup', 'format', 'image_file', 'tempfile', '--hash-block-size=4096', '--data-blocks=10', '--data-block-size=4096', ] ) @patch('kiwi.utils.veritysetup.Command.run') def test_format_full(self, mock_Command_run): verity_call = Mock() verity_call.output = dedent( '''\n VERITY header information for mysquash.img UUID: Hash type: 1 Data blocks: 10 Data block size: 4096 Hash block size: 4096 Hash algorithm: sha256 Salt: fb074d1db50... Root hash: e2728628377... ''' ) mock_Command_run.return_value = verity_call assert self.veritysetup_full.format() == self.verity_dict mock_Command_run.assert_called_once_with( [ 'veritysetup', 'format', 'image_file', 'image_file', '--hash-offset=4096', '--hash-block-size=4096', ] ) def test_store_credentials(self): self.veritysetup.verity_call = Mock() self.veritysetup.verity_dict = self.verity_dict target_block_id = Mock() target_block_id.get_blkid.return_value = 'uuid' with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.veritysetup.store_credentials( 'credentials_file', target_block_id ) assert file_handle.write.call_args_list == [ call('Datablocks: 10\n'), call('Datablocksize: 4096\n'), call('Hashalgorithm: sha256\n'), call('Hashblocksize: 4096\n'), call('Hashtype: 1\n'), call('Roothash: e2728628377...\n'), call('Salt: fb074d1db50...\n'), call('UUID: \n'), call('Root hashoffset: 4096'), call('\n'), call('Superblock:'), call('\n'), ] @patch('kiwi.utils.veritysetup.BlockID') def test_get_block_storage_filesystem(self, mock_BlockID): block_id = Mock() mock_BlockID.return_value = block_id block_id.get_filesystem.return_value = 'ext3' assert self.veritysetup.get_block_storage_filesystem() == 'ext3' block_id.get_filesystem.side_effect = Exception assert self.veritysetup.get_block_storage_filesystem() == '' @patch('os.path.getsize') def test_write_verification_metadata_raises(self, mock_os_path_getsize): mock_os_path_getsize.return_value = 8192 metadata_file = Mock() self.veritysetup.verification_metadata_file = metadata_file with raises(KiwiOffsetError): self.veritysetup.write_verification_metadata('/some/device') @patch('os.path.getsize') def test_write_verification_metadata(self, mock_os_path_getsize): mock_os_path_getsize.return_value = 4096 metadata_file = Mock() metadata_file.name = 'metadata_file' self.veritysetup.verification_metadata_file = metadata_file with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.veritysetup.write_verification_metadata('/some/device') assert mock_open.call_args_list == [ call('metadata_file', 'rb'), call('/some/device', 'r+b'), ] file_handle.seek.assert_called_once_with( -defaults.DM_METADATA_OFFSET, 2 ) file_handle.write.assert_called_once_with(file_handle.read.return_value) @patch.object(VeritySetup, 'get_block_storage_filesystem') def test_create_verity_verification_metadata( self, mock_get_block_storage_filesystem ): mock_get_block_storage_filesystem.return_value = 'ext4' self.veritysetup.verity_dict = self.verity_dict with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value self.veritysetup.create_verity_verification_metadata() assert file_handle.write.call_args_list == [ call(b'1 ext4 ro verity'), call(b'\xff'), call(b'1 4096 4096 10 1 sha256 e2728628377... fb074d1db50...'), call(b'\xff'), call(b'\x00'), ] @patch('kiwi.utils.veritysetup.Signature') def test_sign_verification_metadata(self, mock_Signature): metadata_file = Mock() metadata_file.name = 'metadata_file' self.veritysetup.verification_metadata_file = metadata_file self.veritysetup.sign_verification_metadata() mock_Signature.return_value.sign.assert_called_once_with() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7712228 kiwi-11.1.8/test/unit/volume_manager/__init__.py0000644000000000000000000000000015273675667016561 0ustar00././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7719254 kiwi-11.1.8/test/unit/volume_manager/base_test.py0000644000000000000000000002640115273675667017010 0ustar00from collections import namedtuple from unittest.mock import patch, Mock from pytest import raises from kiwi.volume_manager.base import VolumeManagerBase from kiwi.exceptions import KiwiVolumeManagerSetupError class TestVolumeManagerBase: @patch('os.path.exists') def setup(self, mock_path): self.volume_type = namedtuple( 'volume_type', [ 'name', 'size', 'realpath', 'mountpoint', 'fullsize', 'attributes', 'is_root_volume', ], ) mock_path.return_value = True self.device_map = {'root': Mock()} self.device_map['root'].is_loop = Mock(return_value=True) self.device_map['root'].get_device = Mock(return_value='/dev/storage') self.volume_manager = VolumeManagerBase( self.device_map, 'root_dir', Mock() ) self.volume_manager.volumes = [ self.volume_type( name='LVetc', size='freespace:200', realpath='/etc', mountpoint='/etc', fullsize=False, attributes=[], is_root_volume=False, ), self.volume_type( name='LVRoot', size='size:500', realpath='/', mountpoint='/', fullsize=True, attributes=[], is_root_volume=True, ), ] @patch('os.path.exists') def setup_method(self, cls, mock_path): self.setup() def test_get_root_volume_name(self): assert self.volume_manager.get_root_volume_name() == '/' @patch('os.path.exists') def test_init_custom_args(self, mock_exists): mock_exists.return_value = True volume_manager = VolumeManagerBase( self.device_map, 'root_dir', Mock(), { 'fs_create_options': 'create-opts', 'fs_mount_options': 'mount-opts', }, ) assert ( volume_manager.custom_filesystem_args['mount_options'] == 'mount-opts' ) assert ( volume_manager.custom_filesystem_args['create_options'] == 'create-opts' ) @patch('os.path.exists') def test_root_dir_does_not_exist(self, mock_exists): mock_exists.return_value = False with raises(KiwiVolumeManagerSetupError): VolumeManagerBase(self.device_map, 'root_dir', Mock()) def test_is_loop(self): assert ( self.volume_manager.is_loop() == self.device_map['root'].is_loop() ) @patch('os.path.exists') def test_get_device(self, mock_exists): mock_exists.return_value = True assert ( self.volume_manager.get_device()['root'].get_device() == '/dev/storage' ) def test_setup(self): with raises(NotImplementedError): self.volume_manager.setup() def test_create_volumes(self): with raises(NotImplementedError): self.volume_manager.create_volumes('ext3') def test_get_fstab(self): with raises(NotImplementedError): self.volume_manager.get_fstab('by-label', 'ext3') @patch('kiwi.volume_manager.base.Path.create') @patch('os.path.exists') def test_create_volume_paths_in_root_dir(self, mock_os_path, mock_path): mock_os_path.return_value = False self.volume_manager.create_volume_paths_in_root_dir() mock_path.assert_called_once_with('root_dir/etc') def test_get_canonical_volume_list(self): volume_list = self.volume_manager.get_canonical_volume_list() assert volume_list.volumes[0].name == 'LVetc' assert volume_list.full_size_volume.name == 'LVRoot' @patch('kiwi.volume_manager.base.SystemSize') @patch('os.path.exists') def test_get_volume_mbsize(self, mock_os_path_exists, mock_size): mock_os_path_exists.return_value = True size = Mock() size.customize = Mock(return_value=42) mock_size.return_value = size assert ( self.volume_manager.get_volume_mbsize( self.volume_manager.volumes[0], self.volume_manager.volumes, 'ext3', ) == 272 ) @patch('kiwi.volume_manager.base.SystemSize') @patch('os.path.exists') def test_get_volume_mbsize_for_oem_type( self, mock_os_path_exists, mock_size ): mock_os_path_exists.return_value = True size = Mock() size.customize = Mock(return_value=42) mock_size.return_value = size assert ( self.volume_manager.get_volume_mbsize( self.volume_manager.volumes[0], self.volume_manager.volumes, 'ext3', True, ) == 72 ) @patch('kiwi.volume_manager.base.SystemSize') @patch('os.path.exists') def test_get_volume_mbsize_nested_volumes( self, mock_os_path_exists, mock_size ): mock_os_path_exists.return_value = True size = Mock() size.customize = Mock(return_value=42) mock_size.return_value = size self.volume_manager.volumes = [ self.volume_type( name='LVusr', size='freespace:200', realpath='/usr', mountpoint='/usr', fullsize=False, attributes=[], is_root_volume=False, ), self.volume_type( name='LVusr_lib', size='freespace:100', realpath='/usr/lib', mountpoint='/usr/lib', fullsize=False, attributes=[], is_root_volume=False, ), ] assert ( self.volume_manager.get_volume_mbsize( self.volume_manager.volumes[0], self.volume_manager.volumes, 'ext3', ) == 272 ) size.accumulate_mbyte_file_sizes.assert_called_once_with( ['root_dir/usr/lib'] ) @patch('kiwi.volume_manager.base.SystemSize') @patch('os.path.exists') def test_get_volume_mbsize_root_volume( self, mock_os_path_exists, mock_size ): mock_os_path_exists.return_value = True size = Mock() size.customize = Mock(return_value=42) mock_size.return_value = size self.volume_manager.volumes = [ self.volume_type( name='LVusr', size='freespace:200', realpath='/usr', mountpoint='/usr', fullsize=False, attributes=[], is_root_volume=False, ), self.volume_type( name='LVusr_lib', size='freespace:100', realpath='/usr/lib', mountpoint='/usr/lib', fullsize=False, attributes=[], is_root_volume=False, ), self.volume_type( name='LVRoot', size='size:500', realpath='/', mountpoint='/', fullsize=True, attributes=[], is_root_volume=True, ), ] assert ( self.volume_manager.get_volume_mbsize( self.volume_manager.volumes[2], self.volume_manager.volumes, 'ext3', True, ) == 72 ) size.accumulate_mbyte_file_sizes.assert_called_once_with( ['root_dir/usr', 'root_dir/usr/lib'] ) def test_mount_volumes(self): with raises(NotImplementedError): self.volume_manager.mount_volumes() def test_mount(self): with raises(NotImplementedError): self.volume_manager.mount() def test_umount_volumes(self): with raises(NotImplementedError): self.volume_manager.umount_volumes() def test_umount(self): with raises(NotImplementedError): self.volume_manager.umount() def test_get_volumes(self): with raises(NotImplementedError): self.volume_manager.get_volumes() def test_get_mountpoint(self): assert self.volume_manager.get_mountpoint() is None @patch('kiwi.mount_manager.Path.create') @patch('kiwi.volume_manager.base.DataSync') @patch('kiwi.volume_manager.base.MountManager.is_mounted') @patch('kiwi.volume_manager.base.VolumeManagerBase.mount_volumes') def test_sync_data( self, mock_mount_volumes, mock_mounted, mock_sync, mock_Path_create ): data_sync = Mock() mock_sync.return_value = data_sync mock_mounted.return_value = False self.volume_manager.mountpoint = 'mountpoint' self.volume_manager.sync_data(['exclude_me']) mock_mount_volumes.assert_called_once_with() mock_sync.assert_called_once_with('root_dir', 'mountpoint') data_sync.sync_data.assert_called_once_with( exclude=['exclude_me'], options=[ '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', ], ) assert self.volume_manager.get_mountpoint() == 'mountpoint' @patch('kiwi.volume_manager.base.MountManager.is_mounted') def test_sync_data_without_mountpoint(self, mock_mounted): self.volume_manager.mountpoint = '' assert self.volume_manager.sync_data() is None mock_mounted.assert_not_called() def test_create_verity_layer(self): with raises(NotImplementedError): self.volume_manager.create_verity_layer() def test_create_verification_metadata(self): with raises(NotImplementedError): self.volume_manager.create_verification_metadata('/some/device') @patch('kiwi.volume_manager.base.Temporary') def test_setup_mountpoint(self, mock_Temporary): mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' self.volume_manager.setup_mountpoint() assert self.volume_manager.mountpoint == 'tmpdir' def test_set_property_readonly_root(self): with raises(KiwiVolumeManagerSetupError): self.volume_manager.set_property_readonly_root() @patch('kiwi.volume_manager.base.Command.run') def test_apply_attributes_on_volume(self, mock_command): self.volume_manager.apply_attributes_on_volume( 'toplevel', self.volume_type( name='LVetc', size='freespace:200', realpath='/etc', mountpoint='/etc', fullsize=False, attributes=['no-copy-on-write'], is_root_volume=False, ), ) mock_command.assert_called_once_with(['chattr', '+C', 'toplevel/etc']) @patch('os.path.exists') def test_context_manager_exit(self, mock_os_path_exists): mock_os_path_exists.return_value = True with VolumeManagerBase(self.device_map, 'root_dir', Mock()): pass # just pass ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7719254 kiwi-11.1.8/test/unit/volume_manager/btrfs_test.py0000644000000000000000000005015715273675667017223 0ustar00import datetime from unittest.mock import patch, call, Mock, mock_open from pytest import raises, fixture import pytest from kiwi.volume_manager.btrfs import VolumeManagerBtrfs from kiwi.xml_state import volume_type from kiwi.exceptions import KiwiVolumeRootIDError, KiwiVolumeManagerSetupError class TestVolumeManagerBtrfs: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('os.path.exists') def setup(self, mock_path): self.volumes = [ volume_type( name='@', parent='', size='freespace:100', realpath='/', mountpoint=None, fullsize=False, label=None, attributes=[], is_root_volume=True, ), volume_type( name='etc', parent='', size='freespace:200', realpath='/etc', mountpoint='/etc', fullsize=False, label=None, attributes=['quota=2G'], is_root_volume=False, ), volume_type( name='myvol', parent='', size='size:500', realpath='/data', mountpoint='LVdata', fullsize=False, label=None, attributes=[], is_root_volume=False, ), volume_type( name='home', parent='', size=None, realpath='/home', mountpoint='/home', fullsize=True, label=None, attributes=[], is_root_volume=False, ), ] mock_path.return_value = True self.device_map = {'root': Mock()} self.device_map['root'].is_loop = Mock(return_value=True) self.device_map['root'].get_device = Mock(return_value='/dev/storage') self.volume_manager = VolumeManagerBtrfs( self.device_map, 'root_dir', self.volumes ) self.volume_manager.mountpoint = '/var/tmp/kiwi_volumes.XXX' @patch('os.path.exists') def setup_method(self, cls, mock_path): self.setup() def test_get_root_volume_name(self): assert self.volume_manager.get_root_volume_name() == '@' def test_post_init(self): self.volume_manager.post_init({'some-arg': 'some-val'}) assert self.volume_manager.custom_args['some-arg'] == 'some-val' def test_post_init_root_is_snapper_snapshot_without_root_volume(self): self.volume_manager.volumes = [ volume_type( name='/', parent='', size='freespace:100', realpath='/', mountpoint=None, fullsize=False, label=None, attributes=[], is_root_volume=True, ) ] self.volume_manager.post_init({'root_is_snapper_snapshot': True}) assert ( self.volume_manager.custom_args['root_is_snapper_snapshot'] is False ) def test_fails_to_get_mountpoint_without_mountpoint(self): self.volume_manager.mountpoint = '' with pytest.raises(KiwiVolumeManagerSetupError): self.volume_manager.get_mountpoint() @patch('os.path.exists') @patch('kiwi.volume_manager.btrfs.Command.run') @patch('kiwi.volume_manager.btrfs.FileSystem.new') @patch('kiwi.volume_manager.btrfs.MappedDevice') @patch('kiwi.volume_manager.btrfs.MountManager') @patch('kiwi.volume_manager.base.Temporary') def test_setup_no_snapshot( self, mock_Temporary, mock_mount, mock_mapped_device, mock_fs, mock_command, mock_os_exists, ): mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' toplevel_mount = Mock() mock_mount.return_value = toplevel_mount command_call = Mock() command_call.output = 'ID 256 gen 23 top level 5 path @' mock_mapped_device.return_value = 'mapped_device' mock_os_exists.return_value = False mock_command.return_value = command_call self.volume_manager.setup() assert mock_mount.call_args_list == [ call(device='/dev/storage', mountpoint='tmpdir'), call(device='tmpdir/@', mountpoint='tmpdir/@'), ] toplevel_mount.mount.assert_called_once_with([]) assert mock_command.call_args_list == [ call(['btrfs', 'subvolume', 'create', 'tmpdir/@']), call(['btrfs', 'subvolume', 'list', 'tmpdir']), call(['btrfs', 'subvolume', 'set-default', '256', 'tmpdir']), ] @patch('os.path.exists') @patch('kiwi.volume_manager.btrfs.Command.run') @patch('kiwi.volume_manager.btrfs.SnapshotManager.new') @patch('kiwi.volume_manager.btrfs.FileSystem.new') @patch('kiwi.volume_manager.btrfs.MappedDevice') @patch('kiwi.volume_manager.btrfs.MountManager') @patch('kiwi.volume_manager.base.Temporary') def test_setup_with_snapshot( self, mock_Temporary, mock_mount, mock_mapped_device, mock_fs, mock_snapshot_mngr, mock_command, mock_os_exists, ): snapper = Mock() snapper.create_first_snapshot = Mock(return_value=[mock_mount]) snapper.get_default_snapshot_name = Mock() mock_snapshot_mngr.return_value = snapper mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' toplevel_mount = Mock() mock_mount.return_value = toplevel_mount mock_mapped_device.return_value = 'mapped_device' mock_os_exists.return_value = False self.volume_manager.custom_args['root_is_snapper_snapshot'] = True self.volume_manager.custom_args['quota_groups'] = True self.volume_manager.setup() assert mock_mount.call_args_list == [ call(device='/dev/storage', mountpoint='tmpdir'), call( device='tmpdir/@/.snapshots/1/snapshot', mountpoint='tmpdir/@/.snapshots/1/snapshot', ), ] toplevel_mount.mount.assert_called_once_with([]) snapper.create_first_snapshot.assert_called_once_with() snapper.get_default_snapshot_name.assert_called_once_with() assert mock_command.call_args_list == [ call(['btrfs', 'quota', 'enable', 'tmpdir']), call(['btrfs', 'subvolume', 'create', 'tmpdir/@']), ] @patch('os.path.exists') @patch('kiwi.volume_manager.btrfs.Command.run') @patch('kiwi.volume_manager.btrfs.FileSystem.new') @patch('kiwi.volume_manager.btrfs.MappedDevice') @patch('kiwi.volume_manager.btrfs.MountManager') @patch('kiwi.volume_manager.base.Temporary') def test_setup_volume_id_not_detected( self, mock_Temporary, mock_mount, mock_mapped_device, mock_fs, mock_command, mock_os_exists, ): command_call = Mock() command_call.output = 'id-string-invalid' mock_mapped_device.return_value = 'mapped_device' mock_os_exists.return_value = False mock_command.return_value = command_call with raises(KiwiVolumeRootIDError): self.volume_manager.setup() @patch('os.path.exists') @patch('kiwi.volume_manager.btrfs.Command.run') @patch('kiwi.volume_manager.btrfs.MountManager') @patch('kiwi.volume_manager.btrfs.Path.create') @patch( 'kiwi.volume_manager.base.VolumeManagerBase.apply_attributes_on_volume' ) def test_create_volumes_no_root_volume( self, mock_attrs, mock_path, mock_mount, mock_command, mock_os_exists ): volume_mount = Mock() mock_mount.return_value = volume_mount self.volume_manager.mountpoint = 'tmpdir' self.volume_manager.custom_args['root_is_snapper_snapshot'] = False mock_os_exists.return_value = False self.volume_manager.root_volume_name = '/' self.volume_manager.volumes = [ volume_type( name='/', parent='', size='freespace:100', realpath='/', mountpoint=None, fullsize=False, label=None, attributes=[], is_root_volume=True, ), volume_type( name='home', parent='/', size=None, realpath='/home', mountpoint='/home', fullsize=True, label=None, attributes=[], is_root_volume=False, ), ] self.volume_manager.create_volumes('btrfs') assert mock_path.call_args_list == [ call('root_dir/home'), call('tmpdir'), ] mock_command.assert_called_once_with( ['btrfs', 'subvolume', 'create', 'tmpdir/home'] ) mock_mount.assert_called_once_with( device='/dev/storage', attributes={ 'parent': '/', 'subvol_path': 'home', 'subvol_name': 'home', }, mountpoint='tmpdir/home', ) @patch('os.path.exists') @patch('kiwi.volume_manager.btrfs.Command.run') @patch('kiwi.volume_manager.btrfs.MountManager') @patch('kiwi.volume_manager.btrfs.Path.create') @patch( 'kiwi.volume_manager.base.VolumeManagerBase.apply_attributes_on_volume' ) def test_create_volumes( self, mock_attrs, mock_path, mock_mount, mock_command, mock_os_exists ): volume_mount = Mock() mock_mount.return_value = volume_mount self.volume_manager.mountpoint = 'tmpdir' self.volume_manager.custom_args['root_is_snapper_snapshot'] = True mock_os_exists.return_value = False self.volume_manager.create_volumes('btrfs') assert mock_attrs.call_args_list == [ call( 'tmpdir/@', volume_type( name='myvol', parent='', size='size:500', realpath='/data', mountpoint='LVdata', fullsize=False, label=None, attributes=[], is_root_volume=False, ), ), call( 'tmpdir/@', volume_type( name='etc', parent='', size='freespace:200', realpath='/etc', mountpoint='/etc', fullsize=False, label=None, attributes=['quota=2G'], is_root_volume=False, ), ), call( 'tmpdir/@', volume_type( name='home', parent='', size=None, realpath='/home', mountpoint='/home', fullsize=True, label=None, attributes=[], is_root_volume=False, ), ), ] assert mock_path.call_args_list == [ call('root_dir/etc'), call('root_dir/data'), call('root_dir/home'), call('tmpdir/@'), call('tmpdir/@'), call('tmpdir/@'), ] assert mock_command.call_args_list == [ call(['btrfs', 'subvolume', 'create', 'tmpdir/@/data']), call(['btrfs', 'subvolume', 'create', 'tmpdir/@/etc']), call(['btrfs', 'quota', 'enable', '--simple', 'tmpdir/@/etc']), call(['btrfs', 'qgroup', 'limit', '2G', 'tmpdir/@/etc']), call(['btrfs', 'subvolume', 'create', 'tmpdir/@/home']), ] assert mock_mount.call_args_list == [ call( device='/dev/storage', mountpoint='tmpdir/@/.snapshots/1/snapshot/data', attributes={'subvol_path': '@/data', 'subvol_name': '@/data'}, ), call( device='/dev/storage', mountpoint='tmpdir/@/.snapshots/1/snapshot/etc', attributes={'subvol_path': '@/etc', 'subvol_name': '@/etc'}, ), call( device='/dev/storage', mountpoint='tmpdir/@/.snapshots/1/snapshot/home', attributes={'subvol_path': '@/home', 'subvol_name': '@/home'}, ), ] def test_get_volumes(self): volume_mount = Mock() volume_mount.mountpoint = ( '/var/tmp/kiwi_volumes.xx/@/.snapshots/1/snapshot/boot/grub2' ) volume_mount.device = 'device' volume_mount.get_attributes.return_value = { 'subvol_path': '@/boot/grub2' } self.volume_manager.subvol_mount_list = [volume_mount] self.volume_manager.custom_args['root_is_snapper_snapshot'] = True assert self.volume_manager.get_volumes() == { '/boot/grub2': { 'volume_options': 'subvol=@/boot/grub2', 'volume_device': 'device', } } @patch('kiwi.volume_manager.btrfs.Command.run') def test_get_fstab(self, mock_command): blkid_result = Mock() blkid_result.output = 'id' mock_command.return_value = blkid_result volume_mount = Mock() volume_mount.mountpoint = ( '/var/tmp/kiwi_volumes.XXX/@/.snapshots/1/snapshot/var/tmp' ) volume_mount.device = 'device' volume_mount.get_attributes.return_value = { 'subvol_path': '@/var/tmp', 'parent': 'subvol_takes_precedence', } self.volume_manager.subvol_mount_list = [volume_mount] self.volume_manager.custom_args['root_is_snapper_snapshot'] = True assert self.volume_manager.get_fstab() == [ 'LABEL=id /var/tmp btrfs defaults,subvol=@/var/tmp 0 0' ] self.volumes.append( volume_type( name='device', parent='', size='freespace:100', realpath='/var/tmp', mountpoint=volume_mount.mountpoint, fullsize=False, label=None, attributes=['enable-for-filesystem-check'], is_root_volume=False, ) ) assert self.volume_manager.get_fstab() == [ 'LABEL=id /var/tmp btrfs defaults,subvol=@/var/tmp 0 2' ] @patch('os.path.exists') @patch('kiwi.volume_manager.btrfs.Path.create') def test_mount_volumes(self, mock_path, mock_os_exists): self.volume_manager.toplevel_mount = Mock() self.volume_manager.toplevel_mount.is_mounted = Mock(return_value=False) mock_os_exists.return_value = False self.volume_manager.snapshots_root_mount = Mock() volume_mount = Mock() volume_mount.mountpoint = ( '/var/tmp/kiwi_volumes.xx/@/.snapshots/1/snapshot/var/tmp' ) volume_mount.get_attributes.return_value = {'subvol_path': '@/var/tmp'} self.volume_manager.custom_args['root_is_snapper_snapshot'] = True self.volume_manager.subvol_mount_list = [volume_mount] self.volume_manager.mount_volumes() self.volume_manager.snapshots_root_mount.bind_mount.assert_called_once_with() self.volume_manager.toplevel_mount.mount.assert_called_once_with([]) mock_path.assert_called_once_with(volume_mount.mountpoint) volume_mount.mount.assert_called_once_with(options=['subvol=@/var/tmp']) def test_umount_volumes(self): self.volume_manager.toplevel_mount = Mock() self.volume_manager.root_volume_mount = Mock() volume_mount = Mock() volume_mount.is_mounted = Mock(return_value=True) self.volume_manager.toplevel_mount.is_mounted = Mock(return_value=True) self.volume_manager.snapshots_root_mount = Mock() self.volume_manager.snapshots_root_mount.is_mounted = Mock( return_value=True ) self.volume_manager.subvol_mount_list = [volume_mount] self.volume_manager.umount_volumes() volume_mount.is_mounted.assert_called_once_with() volume_mount.umount.assert_called_once_with() self.volume_manager.snapshots_root_mount.is_mounted.assert_called_once_with() self.volume_manager.snapshots_root_mount.umount.assert_called_once_with() self.volume_manager.toplevel_mount.is_mounted.assert_called_once_with() self.volume_manager.root_volume_mount.umount.assert_called_once_with() self.volume_manager.toplevel_mount.umount.assert_called_once_with() @patch('kiwi.volume_manager.btrfs.DataSync') def test_sync_data(self, mock_sync): self.volume_manager.custom_args['quota_groups'] = True snapper = Mock() snapper.setup_first_snapshot = Mock() self.volume_manager.snapper = snapper self.volume_manager.toplevel_mount = Mock() self.volume_manager.mountpoint = 'tmpdir' self.volume_manager.custom_args['root_is_snapper_snapshot'] = True sync = Mock() mock_sync.return_value = sync self.volume_manager.sync_data(['exclude_me']) root_path = 'tmpdir/@/.snapshots/1/snapshot' mock_sync.assert_called_once_with('root_dir', root_path) sync.sync_data.assert_called_once_with( exclude=['exclude_me'], options=[ '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', ], ) @patch('kiwi.volume_manager.btrfs.DataSync') @patch('kiwi.volume_manager.btrfs.Command.run') @patch('os.path.exists') @patch.object(datetime, 'datetime', Mock(wraps=datetime.datetime)) def test_sync_data_no_root_snapshot( self, mock_exists, mock_command, mock_sync ): self.volume_manager.custom_args['quota_groups'] = True mock_exists.return_value = True datetime.datetime.now.return_value = datetime.datetime(2016, 1, 1) self.volume_manager.toplevel_mount = Mock() self.volume_manager.mountpoint = 'tmpdir' self.volume_manager.custom_args['root_is_snapper_snapshot'] = False sync = Mock() mock_sync.return_value = sync m_open = mock_open(read_data='') with patch('builtins.open', m_open, create=True): self.volume_manager.sync_data(['exclude_me']) mock_sync.assert_called_once_with('root_dir', 'tmpdir/@') sync.sync_data.assert_called_once_with( exclude=['exclude_me'], options=[ '--archive', '--hard-links', '--xattrs', '--acls', '--one-file-system', '--inplace', ], ) @patch('kiwi.volume_manager.btrfs.Command.run') def test_set_property_readonly_root(self, mock_command): self.volume_manager.mountpoint = 'tmpdir' self.volume_manager.custom_args['root_is_snapper_snapshot'] = True self.volume_manager.custom_args['root_is_readonly_snapshot'] = True self.volume_manager.set_property_readonly_root() mock_command.assert_called_once_with( [ 'btrfs', 'property', 'set', 'tmpdir/@/.snapshots/1/snapshot', 'ro', 'true', ] ) @patch('kiwi.volume_manager.btrfs.VolumeManagerBtrfs.umount_volumes') @patch('os.path.exists') def test_context_manager_exit( self, mock_os_path_exists, mock_VolumeManagerBtrfs_umount_volumes ): mock_os_path_exists.return_value = True with VolumeManagerBtrfs( self.device_map, 'root_dir', self.volumes ) as volume_manager: volume_manager.toplevel_mount = Mock() volume_manager.root_volume_mount = Mock() mock_VolumeManagerBtrfs_umount_volumes.assert_called_once_with() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7719254 kiwi-11.1.8/test/unit/volume_manager/init_test.py0000644000000000000000000000176115273675667017043 0ustar00from unittest.mock import patch, Mock from pytest import raises from kiwi.volume_manager import VolumeManager from kiwi.exceptions import KiwiVolumeManagerSetupError class TestVolumeManager: def test_volume_manager_not_implemented(self): with raises(KiwiVolumeManagerSetupError): VolumeManager.new('foo', Mock(), 'root_dir', [Mock()]) @patch('kiwi.volume_manager.lvm.VolumeManagerLVM') def test_volume_manager_lvm(self, mock_lvm): device_map = Mock() volumes = [Mock()] VolumeManager.new('lvm', device_map, 'root_dir', volumes) mock_lvm.assert_called_once_with(device_map, 'root_dir', volumes, None) @patch('kiwi.volume_manager.btrfs.VolumeManagerBtrfs') def test_volume_manager_btrfs(self, mock_btrfs): device_map = Mock() volumes = [Mock()] VolumeManager.new('btrfs', device_map, 'root_dir', volumes) mock_btrfs.assert_called_once_with( device_map, 'root_dir', volumes, None ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7719254 kiwi-11.1.8/test/unit/volume_manager/lvm_test.py0000644000000000000000000004231015273675667016671 0ustar00import logging from unittest.mock import patch, call, Mock from pytest import raises, fixture from kiwi.volume_manager.lvm import VolumeManagerLVM from kiwi.defaults import Defaults from kiwi.exceptions import KiwiVolumeGroupConflict, KiwiCommandError from kiwi.xml_state import volume_type class TestVolumeManagerLVM: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog @patch('os.path.exists') def setup(self, mock_path): self.volumes = [ volume_type( name='LVRoot', parent='', size='freespace:100', realpath='/', mountpoint=None, fullsize=False, label=None, attributes=[], is_root_volume=True, ), volume_type( name='LVSwap', parent='', size='size:100', realpath='swap', mountpoint=None, fullsize=False, label='SWAP', attributes=[], is_root_volume=False, ), volume_type( name='LVetc', parent='', size='freespace:200', realpath='/etc', mountpoint='/etc', fullsize=False, label='etc', attributes=[], is_root_volume=False, ), volume_type( name='myvol', parent='', size='size:500', realpath='/data', mountpoint='LVdata', fullsize=False, label=None, attributes=[], is_root_volume=False, ), volume_type( name='LVhome', parent='', size=None, realpath='/home', mountpoint='/home', fullsize=True, label=None, attributes=[], is_root_volume=False, ), ] mock_path.return_value = True self.device_map = {'root': Mock()} self.device_map['root'].is_loop = Mock(return_value=True) self.device_map['root'].get_device = Mock(return_value='/dev/storage') self.volume_manager = VolumeManagerLVM( self.device_map, 'root_dir', self.volumes, {'some-arg': 'some-val', 'fs_mount_options': ['a,b,c']}, ) assert self.volume_manager.mount_options == 'a,b,c' @patch('os.path.exists') def setup_method(self, cls, mock_path): self.setup() def test_post_init_custom_args(self): self.volume_manager.post_init({'some-arg': 'some-val'}) assert self.volume_manager.custom_args['some-arg'] == 'some-val' def test_post_init_no_additional_custom_args(self): self.volume_manager.post_init(None) assert self.volume_manager.custom_args == { 'root_label': 'ROOT', 'resize_on_boot': False, } def test_post_init_no_mount_options(self): self.volume_manager.custom_filesystem_args['mount_options'] = None self.volume_manager.post_init(None) assert self.volume_manager.mount_options == 'defaults' @patch('os.path.exists') def test_get_device(self, mock_path): mock_path.return_value = True self.volume_manager.volume_map = { 'LVRoot': '/dev/lvroot', 'LVx': '/dev/lvx', 'LVSwap': '/dev/lvswap', 'LVs': '/dev/lvs', } assert ( self.volume_manager.get_device()['LVx'].get_device() == '/dev/lvx' ) assert ( self.volume_manager.get_device()['root'].get_device() == '/dev/lvroot' ) assert ( self.volume_manager.get_device()['swap'].get_device() == '/dev/lvswap' ) @patch('kiwi.volume_manager.lvm.Command.run') @patch('kiwi.volume_manager.base.Temporary') def test_setup(self, mock_Temporary, mock_command): mock_Temporary.return_value.new_dir.return_value.name = 'tmpdir' command = Mock() # no output for commands to mock empty information for # vgs command, indicating the volume group is not in use command.output = '' mock_command.return_value = command self.volume_manager.setup('volume_group') call = mock_command.call_args_list[0] assert mock_command.call_args_list[0] == call( ['vgs', '--noheadings', '--select', 'vg_name=volume_group'] ) call = mock_command.call_args_list[1] assert mock_command.call_args_list[1] == call( command=['vgremove'] + self.volume_manager.lvm_tool_options + ['--force', 'volume_group'], raise_on_error=False, ) call = mock_command.call_args_list[2] assert mock_command.call_args_list[2] == call( ['pvcreate'] + self.volume_manager.lvm_tool_options + ['/dev/storage'] ) call = mock_command.call_args_list[3] assert mock_command.call_args_list[3] == call( ['vgcreate'] + self.volume_manager.lvm_tool_options + ['volume_group', '/dev/storage'] ) assert self.volume_manager.volume_group == 'volume_group' self.volume_manager.volume_group = None @patch('kiwi.volume_manager.lvm.Command.run') @patch('kiwi.volume_manager.base.Temporary') def test_setup_volume_group_host_conflict( self, mock_Temporary, mock_command ): command = Mock() command.output = 'some_data_about_volume_group' mock_command.return_value = command with raises(KiwiVolumeGroupConflict): self.volume_manager.setup('volume_group') @patch('os.path.exists') @patch('kiwi.path.Path.create') @patch('kiwi.volume_manager.base.SystemSize') @patch('kiwi.volume_manager.lvm.Command.run') @patch('kiwi.volume_manager.lvm.FileSystem.new') @patch('kiwi.volume_manager.lvm.MappedDevice') @patch('kiwi.volume_manager.lvm.MountManager') @patch( 'kiwi.volume_manager.base.VolumeManagerBase.apply_attributes_on_volume' ) def test_create_volumes( self, mock_attrs, mock_mount, mock_mapped_device, mock_fs, mock_command, mock_size, mock_create, mock_os_exists, ): mock_os_exists_return_list = [True, True, False, False, False] def mock_os_exists_return(path): return mock_os_exists_return_list.pop() mock_os_exists.side_effect = mock_os_exists_return filesystem = Mock() mock_fs.return_value.__enter__.return_value = filesystem self.volume_manager.mountpoint = 'tmpdir' mock_mapped_device.return_value = 'mapped_device' size = Mock() size.customize = Mock(return_value=42) mock_size.return_value = size self.volume_manager.volume_group = 'volume_group' self.volume_manager.create_volumes('ext3') assert self.volume_manager.filesystem_name == 'ext3' myvol_size = 500 etc_size = 200 + 42 + Defaults.get_min_volume_mbytes('ext3') root_size = 100 + 42 + Defaults.get_min_volume_mbytes('ext3') assert mock_attrs.call_args_list == [ call( 'root_dir', volume_type( name='LVSwap', parent='', size='size:100', realpath='swap', mountpoint=None, fullsize=False, label='SWAP', attributes=[], is_root_volume=False, ), ), call( 'root_dir', volume_type( name='LVRoot', parent='', size='freespace:100', realpath='/', mountpoint=None, fullsize=False, label=None, attributes=[], is_root_volume=True, ), ), call( 'root_dir', volume_type( name='myvol', parent='', size='size:500', realpath='/data', mountpoint='LVdata', fullsize=False, label=None, attributes=[], is_root_volume=False, ), ), call( 'root_dir', volume_type( name='LVetc', parent='', size='freespace:200', realpath='/etc', mountpoint='/etc', fullsize=False, label='etc', attributes=[], is_root_volume=False, ), ), ] assert mock_mount.call_args_list == [ call(device='/dev/volume_group/LVRoot', mountpoint='tmpdir'), call(device='/dev/volume_group/myvol', mountpoint='tmpdir//data'), call(device='/dev/volume_group/LVetc', mountpoint='tmpdir//etc'), call(device='/dev/volume_group/LVhome', mountpoint='tmpdir//home'), ] assert mock_command.call_args_list == [ call( ['lvcreate'] + self.volume_manager.lvm_tool_options + ['-Zn', '-L', '100', '-n', 'LVSwap', 'volume_group'] ), call( ['vgscan'] + self.volume_manager.lvm_tool_options + ['--mknodes'] ), call( ['lvcreate'] + self.volume_manager.lvm_tool_options + [ '-Zn', '-L', format(root_size), '-n', 'LVRoot', 'volume_group', ] ), call( ['vgscan'] + self.volume_manager.lvm_tool_options + ['--mknodes'] ), call( ['lvcreate'] + self.volume_manager.lvm_tool_options + [ '-Zn', '-L', format(myvol_size), '-n', 'myvol', 'volume_group', ] ), call( ['vgscan'] + self.volume_manager.lvm_tool_options + ['--mknodes'] ), call( ['lvcreate'] + self.volume_manager.lvm_tool_options + ['-Zn', '-L', format(etc_size), '-n', 'LVetc', 'volume_group'] ), call( ['vgscan'] + self.volume_manager.lvm_tool_options + ['--mknodes'] ), call( ['lvcreate'] + self.volume_manager.lvm_tool_options + ['-Zn', '-l', '+100%FREE', '-n', 'LVhome', 'volume_group'] ), call( ['vgscan'] + self.volume_manager.lvm_tool_options + ['--mknodes'] ), ] assert mock_fs.call_args_list == [ call( custom_args={'create_options': [], 'mount_options': ['a,b,c']}, device_provider='mapped_device', name='ext3', ), call( custom_args={'create_options': [], 'mount_options': ['a,b,c']}, device_provider='mapped_device', name='ext3', ), call( custom_args={'create_options': [], 'mount_options': ['a,b,c']}, device_provider='mapped_device', name='ext3', ), call( custom_args={'create_options': [], 'mount_options': ['a,b,c']}, device_provider='mapped_device', name='ext3', ), ] assert filesystem.create_on_device.call_args_list == [ call(label='ROOT'), call(label=None), call(label='etc'), call(label=None), ] assert mock_create.call_args_list == [ call('root_dir/etc'), call('root_dir/data'), call('root_dir/home'), ] self.volume_manager.volume_group = None @patch('kiwi.volume_manager.lvm.Path') def test_mount_volumes(self, mock_path): volume_mount = Mock() volume_mount.mountpoint = 'volume_mount_point' self.volume_manager.mount_list = [volume_mount] self.volume_manager.mount_volumes() mock_path.create.assert_called_once_with(volume_mount.mountpoint) volume_mount.mount.assert_called_once_with(options=['a,b,c']) @patch('kiwi.filesystem.base.RuntimeConfig') @patch('kiwi.volume_manager.lvm.Path') def test_mount_volumes_sparse_sync(self, mock_path, mock_RuntimeConfig): mock_RuntimeConfig.return_value.get_sync_sparse.return_value = True volume_mount = Mock() volume_mount.mountpoint = 'volume_mount_point' self.volume_manager.mount_list = [volume_mount] self.volume_manager.filesystem_name = 'xfs' self.volume_manager.mount_volumes() volume_mount.mount.assert_called_once_with( options=['a,b,c,allocsize=4k'] ) # the install time option is not part of the data the # fstab of the image is built from assert self.volume_manager.mount_options == 'a,b,c' @patch('kiwi.filesystem.base.RuntimeConfig') @patch('kiwi.volume_manager.lvm.Path') def test_mount_volumes_sparse_sync_no_declaration( self, mock_path, mock_RuntimeConfig ): mock_RuntimeConfig.return_value.get_sync_sparse.return_value = True volume_mount = Mock() volume_mount.mountpoint = 'volume_mount_point' self.volume_manager.mount_list = [volume_mount] self.volume_manager.filesystem_name = 'ext3' self.volume_manager.mount_volumes() volume_mount.mount.assert_called_once_with(options=['a,b,c']) def test_umount_volumes(self): volume_mount = Mock() volume_mount.mountpoint = 'volume_mount_point' self.volume_manager.mount_list = [volume_mount] self.volume_manager.umount_volumes() volume_mount.umount.assert_called_once_with() def test_get_volumes(self): volume_mount = Mock() volume_mount.mountpoint = ( '/var/tmp/kiwi_volumes.f2qx_d3y/boot/grub2/x86_64-efi' ) volume_mount.device = '/dev/mapper/vg1-LVRoot' self.volume_manager.mount_list = [volume_mount] assert self.volume_manager.get_volumes() == { 'boot/grub2/x86_64-efi': { 'volume_options': 'a,b,c', 'volume_device': '/dev/mapper/vg1-LVRoot', } } def test_get_fstab(self): self.volume_manager.volume_group = 'vgroup' self.volume_manager._add_to_volume_map('device') volume_mount = Mock() volume_mount.mountpoint = '/var/tmp/kiwi_volumes.XXX/var/tmp' volume_mount.device = self.volume_manager.volume_map['device'] self.volume_manager.mount_list = [volume_mount] assert self.volume_manager.get_fstab(None, 'ext3') == [ '/dev/vgroup/device /var/tmp ext3 a,b,c 0 0' ] self.volumes.append( volume_type( name='device', parent='', size='freespace:100', realpath='/var/tmp', mountpoint=volume_mount.mountpoint, fullsize=False, label=None, attributes=['enable-for-filesystem-check'], is_root_volume=False, ) ) assert self.volume_manager.get_fstab(None, 'ext3') == [ '/dev/vgroup/device /var/tmp ext3 a,b,c 0 2' ] @patch('kiwi.volume_manager.lvm.Command.run') @patch('kiwi.volume_manager.lvm.VolumeManagerLVM.umount_volumes') @patch('os.path.exists') def test_context_manager_exit( self, mock_os_path_exists, mock_VolumeManagerLVM_umount_volumes, mock_Command_run, ): mock_os_path_exists.return_value = True mock_Command_run.side_effect = KiwiCommandError('error') with self._caplog.at_level(logging.ERROR): with VolumeManagerLVM( self.device_map, 'root_dir', self.volumes ) as volume_manager: volume_manager.volume_group = 'volume_group' mock_VolumeManagerLVM_umount_volumes.assert_called_once_with() mock_Command_run.assert_called_once_with( ['vgchange'] + self.volume_manager.lvm_tool_options + ['-an', 'volume_group'] ) def test_get_volume_name_from_volume_map_not_found(self): assert ( self.volume_manager._get_volume_name_from_volume_map('/dev/unknown') is None ) ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7719254 kiwi-11.1.8/test/unit/xml_description_test.py0000644000000000000000000003210015273675667016271 0ustar00import logging from unittest.mock import patch import unittest.mock as mock from builtins import bytes from lxml import etree from pytest import raises from collections import namedtuple from kiwi.utils.temporary import Temporary from pytest import fixture from kiwi.xml_description import XMLDescription from kiwi.exceptions import ( KiwiCommandError, KiwiSchemaImportError, KiwiValidationError, KiwiDescriptionInvalid, KiwiDataStructureError, KiwiCommandNotFound, KiwiExtensionError, ) class TestSchema: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): test_xml = bytes( b""" John Doe john@example.com say hello zypper 1.1.1 """ ) test_xml_extension = bytes( b""" John Doe john@example.com say hello zypper 1.1.1 """ ) test_xml_extension_not_unique = bytes( b""" John Doe john@example.com say hello zypper 1.1.1 """ ) test_xml_extension_invalid = bytes( b""" John Doe john@example.com say hello zypper 1.1.1 """ ) self.description_from_file = XMLDescription( description='../data/example_config.xml' ) test_xml_file = Temporary().new_file() with open(test_xml_file.name, 'wb') as description: description.write(test_xml) self.description_from_data = XMLDescription(test_xml_file.name) test_xml_extension_file = Temporary().new_file() with open(test_xml_extension_file.name, 'wb') as description: description.write(test_xml_extension) self.extension_description_from_data = XMLDescription( test_xml_extension_file.name ) test_xml_extension_not_unique_file = Temporary().new_file() with open(test_xml_extension_not_unique_file.name, 'wb') as description: description.write(test_xml_extension_not_unique) self.extension_multiple_toplevel_description_from_data = XMLDescription( test_xml_extension_not_unique_file.name ) test_xml_extension_invalid_file = Temporary().new_file() with open(test_xml_extension_invalid_file.name, 'wb') as description: description.write(test_xml_extension_invalid) self.extension_invalid_description_from_data = XMLDescription( test_xml_extension_invalid_file.name ) def setup_method(self, cls): self.setup() def test_load_schema_from_xml_content(self): schema = etree.parse('../../kiwi/schema/kiwi.rng') lookup = '{http://relaxng.org/ns/structure/1.0}attribute' for attribute in schema.iter(lookup): if attribute.get('name') == 'schemaversion': schemaversion = attribute.find( '{http://relaxng.org/ns/structure/1.0}value' ).text parsed = self.description_from_data.load() assert parsed.get_schemaversion() == schemaversion @patch('lxml.etree.RelaxNG') def test_load_schema_import_error(self, mock_relax): mock_relax.side_effect = KiwiSchemaImportError('ImportError') with raises(KiwiSchemaImportError): self.description_from_file.load() @patch('kiwi.xml_description.Defaults.get_schematron_module_name') def test_load_schema_from_xml_content_skipping_isoschematron( self, mock_get_schematron_module_name ): mock_get_schematron_module_name.return_value = 'bogus' with self._caplog.at_level(logging.WARNING): self.description_from_data.load() assert 'schematron validation skipped:' in self._caplog.text @patch('lxml.isoschematron.Schematron') @patch('lxml.etree.RelaxNG') @patch('lxml.etree.parse') def test_load_schema_validation_error_from_file( self, mock_parse, mock_relax, mock_schematron ): mock_validate = mock.Mock() mock_validate.validate.side_effect = KiwiValidationError( 'ValidationError' ) mock_relax.return_value = mock_validate mock_schematron.return_value = mock_validate with raises(KiwiValidationError): self.description_from_file.load() @patch('lxml.isoschematron.Schematron') @patch('lxml.etree.RelaxNG') @patch('lxml.etree.parse') @patch('kiwi.system.setup.Command.run') def test_load_schema_description_from_file_invalid( self, mock_command, mock_parse, mock_relax, mock_schematron ): mock_rng_validate = mock.Mock() mock_rng_validate.validate = mock.Mock(return_value=False) mock_sch_validate = mock.Mock() mock_sch_validate.validate = mock.Mock(return_value=False) validation_report = namedtuple('report', ['text']) name_spaces = namedtuple('nspaces', ['nsmap']) mock_validation_report = mock.Mock() mock_validation_report.getroot = mock.Mock( return_value=name_spaces(nsmap="") ) mock_validation_report.xpath = mock.Mock( return_value=[ validation_report(text='wrong attribute 1'), validation_report(text='wrong attribute 2'), ] ) mock_sch_validate.validation_report = mock_validation_report mock_relax.return_value = mock_rng_validate mock_schematron.return_value = mock_sch_validate mock_command.side_effect = KiwiCommandError('jing output') with raises(KiwiDescriptionInvalid): self.description_from_file.load() @patch('lxml.isoschematron.Schematron') @patch('lxml.etree.RelaxNG') @patch('lxml.etree.parse') @patch('kiwi.system.setup.Command.run') def test_load_schema_description_from_data_invalid( self, mock_command, mock_parse, mock_relax, mock_schematron ): mock_rng_validate = mock.Mock() mock_rng_validate.validate = mock.Mock(return_value=False) mock_sch_validate = mock.Mock() mock_sch_validate.validate = mock.Mock(return_value=False) validation_report = namedtuple('report', ['text']) name_spaces = namedtuple('nspaces', ['nsmap']) mock_validation_report = mock.Mock() mock_validation_report.getroot = mock.Mock( return_value=name_spaces(nsmap="") ) mock_validation_report.xpath = mock.Mock( return_value=[ validation_report(text='wrong attribute 1'), validation_report(text='wrong attribute 2'), ] ) mock_sch_validate.validation_report = mock_validation_report mock_relax.return_value = mock_rng_validate mock_schematron.return_value = mock_sch_validate command_run = namedtuple('command', ['output', 'error', 'returncode']) mock_command.return_value = command_run( output='jing output\n', error='', returncode=1 ) with raises(KiwiDescriptionInvalid): self.description_from_data.load() @patch('lxml.isoschematron.Schematron') @patch('lxml.etree.RelaxNG') @patch('lxml.etree.parse') @patch('kiwi.system.setup.Command.run') def test_load_schema_description_from_data_invalid_no_jing( self, mock_command, mock_parse, mock_relax, mock_schematron ): mock_rng_validate = mock.Mock() mock_rng_validate.validate = mock.Mock(return_value=False) mock_sch_validate = mock.Mock() mock_sch_validate.validate = mock.Mock(return_value=True) mock_relax.return_value = mock_rng_validate mock_schematron.return_value = mock_sch_validate mock_command.side_effect = KiwiCommandNotFound('No jing command') with raises(KiwiDescriptionInvalid): self.description_from_data.load() @patch('lxml.isoschematron.Schematron') @patch('lxml.etree.RelaxNG') @patch('lxml.etree.parse') @patch('kiwi.xml_parse.parse') def test_load_data_structure_error( self, mock_xml_parse, mock_etree_parse, mock_relax, mock_schematron ): mock_rng_validate = mock.Mock() mock_rng_validate.validate = mock.Mock(return_value=True) mock_sch_validate = mock.Mock() mock_sch_validate.validate = mock.Mock(return_value=True) mock_relax.return_value = mock_rng_validate mock_schematron.return_value = mock_sch_validate mock_xml_parse.side_effect = KiwiDataStructureError( 'DataStructureError' ) with raises(KiwiDataStructureError): self.description_from_file.load() @patch('kiwi.xml_description.Command.run') def test_load_extension(self, mock_command): command_output = mock.Mock() command_output.output = 'file://../data/my_plugin.rng' mock_command.return_value = command_output self.extension_description_from_data.load() mock_command.assert_called_once_with( ['xmlcatalog', '/etc/xml/catalog', 'http://www.my_plugin.com'] ) xml_data = self.extension_description_from_data.get_extension_xml_data( 'my_plugin' ) assert xml_data.getroot()[0].get('name') == 'cool stuff' def test_load_extension_multiple_toplevel_error(self): with raises(KiwiExtensionError): self.extension_multiple_toplevel_description_from_data.load() @patch('kiwi.xml_description.Command.run') def test_load_extension_schema_error(self, mock_command): mock_command.side_effect = Exception with raises(KiwiExtensionError): self.extension_description_from_data.load() @patch('kiwi.xml_description.Command.run') def test_load_extension_validation_error(self, mock_command): command_output = mock.Mock() command_output.output = 'file://../data/my_plugin.rng' mock_command.return_value = command_output with raises(KiwiExtensionError): self.extension_invalid_description_from_data.load() ././@PaxHeader0000000000000000000000000000003400000000000010212 xustar0028 mtime=1794079670.7719254 kiwi-11.1.8/test/unit/xml_state_test.py0000644000000000000000000017610715273675667015106 0ustar00import os import io import logging from collections import namedtuple from unittest.mock import patch, Mock, MagicMock from pytest import raises, fixture from kiwi.defaults import Defaults from kiwi.xml_state import XMLState from kiwi.storage.disk import ptable_entry_type from kiwi.xml_description import XMLDescription from kiwi.exceptions import ( KiwiTypeNotFound, KiwiDistributionNameError, KiwiProfileNotFound, KiwiFileAccessError, KiwiUriStyleUnknown, ) class TestXMLState: @fixture(autouse=True) def inject_fixtures(self, caplog): self._caplog = caplog def setup(self): self.volume_type = namedtuple( 'volume_type', [ 'name', 'parent', 'size', 'realpath', 'mountpoint', 'fullsize', 'label', 'attributes', 'is_root_volume', ], ) Defaults.set_platform_name('x86_64') self.description = XMLDescription('../data/example_config.xml') self.state = XMLState(self.description.load()) apt_description = XMLDescription('../data/example_apt_config.xml') self.apt_state = XMLState(apt_description.load()) boot_description = XMLDescription( '../data/isoboot/example-distribution/config.xml' ) self.boot_state = XMLState(boot_description.load()) no_image_packages_description = XMLDescription( '../data/example_no_image_packages_config.xml' ) self.no_image_packages_boot_state = XMLState( no_image_packages_description.load() ) self.bootloader = Mock() self.bootloader.get_video_mode.return_value = '800x600' self.bootloader.get_name.return_value = 'some-loader' self.bootloader.get_timeout.return_value = 'some-timeout' self.bootloader.get_timeout_style.return_value = 'some-style' self.bootloader.get_targettype.return_value = 'some-target' self.bootloader.get_bls.return_value = False self.bootloader.get_output_console.return_value = 'some-console' self.bootloader.get_input_console.return_value = None self.bootloader.get_serial_line.return_value = 'some-serial' self.bootloader.get_use_disk_password.return_value = True def setup_method(self, cls): self.setup() def test_get_description_section(self): description = self.state.get_description_section() assert description.author == 'Marcus' assert description.contact == 'ms@suse.com' assert ( description.specification == 'Testing various configuration states' ) def test_get_preferences_by_architecture(self): Defaults.set_platform_name('aarch64') state = XMLState(self.description.load()) preferences = state.get_preferences_sections() Defaults.set_platform_name('x86_64') assert len(preferences) == 3 assert preferences[2].get_arch() == 'aarch64' assert state.get_build_type_name() == 'iso' def test_build_type_primary_selected(self): assert self.state.get_build_type_name() == 'oem' def test_build_type_first_selected(self): self.state.xml_data.get_preferences()[2].get_type()[0].set_primary( False ) assert self.state.get_build_type_name() == 'oem' @patch('kiwi.xml_state.XMLState.get_preferences_sections') def test_get_rpm_excludedocs_without_entry(self, mock_preferences): mock_preferences.return_value = [] assert self.state.get_rpm_excludedocs() is False def test_get_rpm_excludedocs(self): assert self.state.get_rpm_excludedocs() is True @patch('kiwi.xml_state.XMLState.get_preferences_sections') def test_get_rpm_check_signatures_without_entry(self, mock_preferences): mock_preferences.return_value = [] assert self.state.get_rpm_check_signatures() is False def test_get_rpm_check_signatures(self): assert self.state.get_rpm_check_signatures() is True def test_get_package_manager(self): assert self.state.get_package_manager() == 'zypper' def get_release_version(self): assert self.state.get_release_version() == '15.3' @patch('kiwi.xml_state.XMLState.get_preferences_sections') def test_get_default_package_manager(self, mock_preferences): mock_preferences.return_value = [] assert self.state.get_package_manager() == 'dnf4' def test_get_image_version(self): assert self.state.get_image_version() == '1.13.2' def test_get_bootstrap_packages(self): assert self.state.get_bootstrap_packages() == ['filesystem', 'zypper'] assert self.state.get_bootstrap_packages(plus_packages=['vim']) == [ 'filesystem', 'vim', 'zypper', ] assert self.no_image_packages_boot_state.get_bootstrap_packages() == [ 'patterns-openSUSE-base' ] self.state.get_package_manager = Mock(return_value="dnf4") assert self.state.get_bootstrap_packages() == [ 'dnf', 'filesystem', ] self.state.get_package_manager = Mock(return_value="apk") assert self.state.get_bootstrap_packages() == [ 'apk-tools', 'filesystem', ] def test_get_system_packages(self): assert self.state.get_system_packages() == [ 'gfxboot-branding-openSUSE', 'grub2-branding-openSUSE', 'ifplugd', 'iputils', 'kernel-default', 'openssh', 'plymouth-branding-openSUSE', 'vim', ] def test_get_system_packages_some_arch(self): Defaults.set_platform_name('s390') state = XMLState(self.description.load()) assert state.get_system_packages() == [ 'foo', 'gfxboot-branding-openSUSE', 'grub2-branding-openSUSE', 'ifplugd', 'iputils', 'kernel-default', 'openssh', 'plymouth-branding-openSUSE', 'vim', ] Defaults.set_platform_name('x86_64') def test_get_system_collections(self): assert self.state.get_system_collections() == ['base'] self.state.host_architecture = 'aarch64' assert self.state.get_system_collections() == ['base', 'base_for_arch'] def test_get_system_products(self): assert self.state.get_system_products() == ['openSUSE'] def test_get_system_files(self): assert self.state.get_system_files()['some'].target == '' assert ( self.state.get_system_files()['/absolute/path/to/some'].target == '' ) def test_get_bootstrap_files(self): assert self.state.get_bootstrap_files()['some'].target == '/some/target' def test_get_system_archives(self): assert self.state.get_system_archives() == [ '/absolute/path/to/image.tgz' ] def test_get_system_ignore_packages(self): assert self.state.get_system_ignore_packages() == ['bar', 'baz', 'foo'] self.state.host_architecture = 'aarch64' assert self.state.get_system_ignore_packages() == ['baz', 'foo'] self.state.host_architecture = 's390' assert self.state.get_system_ignore_packages() == ['baz'] def test_get_bootstrap_ignore_packages(self): assert self.state.get_bootstrap_ignore_packages() == ['some'] def test_get_system_collection_type(self): assert self.state.get_system_collection_type() == 'plusRecommended' def test_get_bootstrap_collections(self): assert self.state.get_bootstrap_collections() == [ 'bootstrap-collection' ] def test_get_bootstrap_products(self): assert self.state.get_bootstrap_products() == ['kiwi'] def test_get_bootstrap_archives(self): assert self.state.get_bootstrap_archives() == ['bootstrap.tgz'] def test_get_bootstrap_collection_type(self): assert self.state.get_bootstrap_collection_type() == 'onlyRequired' def test_set_repository(self): self.state.set_repository( 'repo', 'type', 'alias', 1, True, False, ['key_a', 'key_b'], 'main universe', 'jammy', False, 'metalink', ) assert ( self.state.xml_data.get_repository()[0].get_source().get_path() == 'repo' ) assert self.state.xml_data.get_repository()[0].get_type() == 'type' assert self.state.xml_data.get_repository()[0].get_alias() == 'alias' assert self.state.xml_data.get_repository()[0].get_priority() == 1 assert ( self.state.xml_data.get_repository()[0].get_imageinclude() is True ) assert ( self.state.xml_data.get_repository()[0].get_package_gpgcheck() is False ) assert ( self.state.xml_data.get_repository()[0] .get_source() .get_signing()[0] .get_key() == 'key_a' ) assert ( self.state.xml_data.get_repository()[0] .get_source() .get_signing()[1] .get_key() == 'key_b' ) assert ( self.state.xml_data.get_repository()[0].get_components() == 'main universe' ) assert ( self.state.xml_data.get_repository()[0].get_distribution() == 'jammy' ) assert ( self.state.xml_data.get_repository()[0].get_repository_gpgcheck() is False ) assert ( self.state.xml_data.get_repository()[0].get_sourcetype() == 'metalink' ) def test_add_repository(self): self.state.add_repository( 'repo', 'type', 'alias', 1, True, None, ['key_a', 'key_b'], 'main universe', 'jammy', False, 'metalink', ) assert ( self.state.xml_data.get_repository()[3].get_source().get_path() == 'repo' ) assert self.state.xml_data.get_repository()[3].get_type() == 'type' assert self.state.xml_data.get_repository()[3].get_alias() == 'alias' assert self.state.xml_data.get_repository()[3].get_priority() == 1 assert ( self.state.xml_data.get_repository()[3].get_imageinclude() is True ) assert ( self.state.xml_data.get_repository()[3] .get_source() .get_signing()[0] .get_key() == 'key_a' ) assert ( self.state.xml_data.get_repository()[3] .get_source() .get_signing()[1] .get_key() == 'key_b' ) assert ( self.state.xml_data.get_repository()[3].get_components() == 'main universe' ) assert ( self.state.xml_data.get_repository()[3].get_distribution() == 'jammy' ) assert ( self.state.xml_data.get_repository()[3].get_repository_gpgcheck() is False ) assert ( self.state.xml_data.get_repository()[3].get_sourcetype() == 'metalink' ) def test_add_repository_with_empty_values(self): self.state.add_repository('repo', 'type', '', '', True) assert ( self.state.xml_data.get_repository()[3].get_source().get_path() == 'repo' ) assert self.state.xml_data.get_repository()[3].get_type() == 'type' assert self.state.xml_data.get_repository()[3].get_alias() == '' assert self.state.xml_data.get_repository()[3].get_priority() is None assert ( self.state.xml_data.get_repository()[3].get_imageinclude() is True ) assert self.state.xml_data.get_repository()[3].get_sourcetype() is None def test_get_to_become_deleted_packages(self): assert self.state.get_to_become_deleted_packages() == ['kernel-debug'] def test_get_system_files_ignore_packages(self): assert self.state.get_system_files_ignore_packages() == [ 'rpm', 'yast', 'zypp', ] def test_get_build_type_vagrant_config_section(self): vagrant_config = self.state.get_build_type_vagrant_config_section() assert vagrant_config.get_provider() == 'libvirt' assert self.boot_state.get_build_type_vagrant_config_section() is None def test_virtualbox_guest_additions_vagrant_config_section(self): assert not self.state.get_vagrant_config_virtualbox_guest_additions() def test_virtualbox_guest_additions_vagrant_config_section_missing(self): self.state.get_build_type_vagrant_config_section().virtualbox_guest_additions_present = ( True ) assert self.state.get_vagrant_config_virtualbox_guest_additions() def test_get_build_type_system_disk_section(self): assert ( self.state.get_build_type_system_disk_section().get_name() == 'mydisk' ) def test_get_build_type_vmdisk_section(self): assert self.state.get_build_type_vmdisk_section().get_id() == 0 assert self.boot_state.get_build_type_vmdisk_section() is None def test_get_build_type_vmnic_entries(self): assert ( self.state.get_build_type_vmnic_entries()[0].get_interface() == '' ) assert self.boot_state.get_build_type_vmnic_entries() == [] def test_get_build_type_vmdvd_section(self): assert self.state.get_build_type_vmdvd_section().get_id() == 0 assert self.boot_state.get_build_type_vmdvd_section() is None @patch('kiwi.xml_parse.type_.get_filesystem') def test_get_volume_management(self, mock_xml_parse_get_filesystem): mock_xml_parse_get_filesystem.return_value = 'lvm' assert self.state.get_volume_management() == 'lvm' def test_get_volume_management_none(self): assert self.boot_state.get_volume_management() is None def test_get_volume_management_btrfs(self): description = XMLDescription('../data/example_btrfs_config.xml') xml_data = description.load() state = XMLState(xml_data) assert state.get_volume_management() == 'btrfs' def test_get_volume_management_lvm_prefer(self): description = XMLDescription('../data/example_lvm_preferred_config.xml') xml_data = description.load() state = XMLState(xml_data) assert state.get_volume_management() == 'lvm' def test_get_volume_management_lvm_default(self): description = XMLDescription('../data/example_lvm_default_config.xml') xml_data = description.load() state = XMLState(xml_data) assert state.get_volume_management() == 'lvm' def test_build_type_explicitly_selected(self): xml_data = self.description.load() state = XMLState(xml_data, ['vmxFlavour'], 'oem') assert state.get_build_type_name() == 'oem' def test_build_type_not_found(self): xml_data = self.description.load() with raises(KiwiTypeNotFound): XMLState(xml_data, ['vmxFlavour'], 'foo') def test_build_type_not_found_no_default_type(self): description = XMLDescription('../data/example_no_default_type.xml') xml_data = description.load() with raises(KiwiTypeNotFound): XMLState(xml_data, ['minimal']) def test_profile_not_found(self): xml_data = self.description.load() with raises(KiwiProfileNotFound): XMLState(xml_data, ['foo']) def test_profile_requires(self): Defaults.set_platform_name('x86_64') xml_data = self.description.load() xml_state = XMLState(xml_data, ['composedProfile']) assert xml_state.profiles == [ 'composedProfile', 'vmxSimpleFlavour', 'xenDomUFlavour', ] Defaults.set_platform_name('aarch64') xml_data = self.description.load() xml_state = XMLState(xml_data, ['composedProfile']) assert xml_state.profiles == ['composedProfile', 'vmxSimpleFlavour'] def test_get_partitions(self): description = XMLDescription('../data/example_partitions_config.xml') xml_data = description.load() state = XMLState(xml_data) assert state.get_partitions() == { 'var': ptable_entry_type( mbsize=100, clone=0, partition_name='p.lxvar', partition_type='t.linux', partition_id=None, mountpoint='/var', filesystem='ext3', label='', ), # a custom partition number arrives from the parser as a # string and must reach the partitioner as an int 'home': ptable_entry_type( mbsize=200, clone=0, partition_name='p.lxhome', partition_type='t.linux', partition_id=3, mountpoint='/home', filesystem='ext3', label='', ), } @patch('kiwi.xml_state.Defaults.is_buildservice_worker') @patch('kiwi.xml_state.Command.run') def test_get_containers_in_buildservice( self, mock_Command_run, mock_Defaults_is_buildservice_worker ): mock_Defaults_is_buildservice_worker.return_value = True description = XMLDescription('../data/example_containers_config.xml') xml_data = description.load() state = XMLState(xml_data) containers = state.get_containers()[0] containers.fetch_command('root_dir') assert containers.name == 'tumbleweed_latest' assert containers.backend == 'podman' assert ( containers.container_file == '/var/tmp/kiwi_containers/tumbleweed_latest' ) assert containers.fetch_only is False assert containers.load_command == [ '/usr/bin/podman', 'load', '-i', '/var/tmp/kiwi_containers/tumbleweed_latest', ] mock_Command_run.assert_called_once_with( [ 'cp', '/usr/src/packages/SOURCES/containers/' '_obsrepositories/registry.opensuse.org/opensuse/' 'tumbleweed:latest.ociarchive', 'root_dir/var/tmp/kiwi_containers/tumbleweed_latest', ] ) @patch('kiwi.xml_state.Command.run') def test_get_containers(self, mock_Command_run): containers = self.state.get_containers() c1 = containers[0] c2 = containers[1] c3 = containers[2] c4 = containers[3] c1.fetch_command('root_dir') assert c1.name == 'rmtserver_latest' assert c1.backend == 'podman' assert c1.container_file == '/var/tmp/kiwi_containers/rmtserver_latest' assert c1.fetch_only is False assert c1.load_command == [ '/usr/bin/podman', 'load', '-i', '/var/tmp/kiwi_containers/rmtserver_latest', ] mock_Command_run.assert_called_once_with( [ 'chroot', 'root_dir', '/usr/bin/skopeo', 'copy', 'docker://registry.suse.com/home/mschaefer/' 'images_pubcloud/pct/rmtserver:latest', 'oci-archive:/var/tmp/kiwi_containers/' 'rmtserver_latest:registry.suse.com/home/mschaefer/' 'images_pubcloud/pct/rmtserver:latest', ] ) mock_Command_run.reset_mock() c2.fetch_command('root_dir') assert c2.name == 'some_latest' assert c2.backend == 'docker' assert c2.container_file == '/var/tmp/kiwi_containers/some_latest' assert c2.fetch_only is False assert c2.load_command == [ '/usr/bin/docker', 'load', '-i', '/var/tmp/kiwi_containers/some_latest', ] mock_Command_run.assert_called_once_with( [ 'chroot', 'root_dir', '/usr/bin/skopeo', 'copy', 'docker://registry.suse.com/some:latest', 'oci-archive:/var/tmp/kiwi_containers/' 'some_latest:registry.suse.com/some:latest', ] ) mock_Command_run.reset_mock() c3.fetch_command('root_dir') assert c3.name == 'foo_latest' assert c3.backend == 'podman' assert c3.container_file == '/var/tmp/kiwi_containers/foo_latest' assert c3.fetch_only is True assert c3.load_command == [] mock_Command_run.assert_called_once_with( [ 'chroot', 'root_dir', '/usr/bin/skopeo', 'copy', 'docker://docker.io/foo:latest', 'oci-archive:/var/tmp/kiwi_containers/' 'foo_latest:docker.io/foo:latest', ] ) mock_Command_run.reset_mock() c4.fetch_command('root_dir') assert c4.name == 'test-app_v1.0' assert c4.backend == 'container-snap' assert c4.container_file == '/var/tmp/kiwi_containers/test-app_v1.0' assert c4.fetch_only is False assert c4.load_command == [ '/usr/bin/container-snap', 'load', '-i', '/var/tmp/kiwi_containers/test-app_v1.0', ] mock_Command_run.assert_called_once_with( [ 'chroot', 'root_dir', '/usr/bin/skopeo', 'copy', 'docker://registry.example.com/test-app:v1.0', 'oci-archive:/var/tmp/kiwi_containers/' 'test-app_v1.0:registry.example.com/test-app:v1.0', ] ) def test_get_volumes_custom_root_volume_name(self): description = XMLDescription( '../data/example_lvm_custom_rootvol_config.xml' ) xml_data = description.load() state = XMLState(xml_data) volume_type = self.volume_type assert state.get_volumes() == [ volume_type( name='myroot', parent='', size='freespace:500', realpath='/', mountpoint=None, fullsize=False, label=None, attributes=[], is_root_volume=True, ) ] def test_get_volumes_btrfs_quota(self): description = XMLDescription('../data/example_btrfs_vol_config.xml') xml_data = description.load() state = XMLState(xml_data) volume_type = self.volume_type assert state.get_volumes() == [ volume_type( name='some', parent='', size='freespace:120', realpath='some', mountpoint='some', fullsize=False, label=None, attributes=['quota=500M'], is_root_volume=False, ), volume_type( name='', parent='', size=None, realpath='/', mountpoint=None, fullsize=True, label=None, attributes=[], is_root_volume=True, ), ] def test_get_volumes_for_arch(self): description = XMLDescription('../data/example_lvm_arch_config.xml') xml_data = description.load() state = XMLState(xml_data) state.host_architecture = 'aarch64' volume_type = self.volume_type assert state.get_volumes() == [ volume_type( name='usr_lib', parent='', size='freespace:30', realpath='usr/lib', mountpoint='usr/lib', fullsize=False, label=None, attributes=[], is_root_volume=False, ), volume_type( name='LVRoot', parent='', size=None, realpath='/', mountpoint=None, fullsize=True, label=None, attributes=[], is_root_volume=True, ), ] state.host_architecture = 'x86_64' assert state.get_volumes() == [ volume_type( name='LVRoot', parent='', size=None, realpath='/', mountpoint=None, fullsize=True, label=None, attributes=[], is_root_volume=True, ) ] def test_get_volumes(self): description = XMLDescription('../data/example_lvm_default_config.xml') xml_data = description.load() state = XMLState(xml_data) volume_type = self.volume_type assert state.get_volumes() == [ volume_type( name='usr_lib', parent='', size='size:1024', realpath='usr/lib', mountpoint='usr/lib', fullsize=False, label='library', attributes=[], is_root_volume=False, ), volume_type( name='LVRoot', parent='', size='freespace:500', realpath='/', mountpoint=None, fullsize=False, label=None, attributes=[], is_root_volume=True, ), volume_type( name='etc_volume', parent='', size='freespace:30', realpath='etc', mountpoint='etc', fullsize=False, label=None, attributes=['no-copy-on-write', 'enable-for-filesystem-check'], is_root_volume=False, ), volume_type( name='bin_volume', parent='', size=None, realpath='/usr/bin', mountpoint='/usr/bin', fullsize=True, label=None, attributes=[], is_root_volume=False, ), volume_type( name='LVSwap', parent='', size='size:128', realpath='swap', mountpoint=None, fullsize=False, label='SWAP', attributes=[], is_root_volume=False, ), ] def test_get_volumes_no_explicit_root_setup(self): description = XMLDescription('../data/example_lvm_no_root_config.xml') xml_data = description.load() state = XMLState(xml_data) volume_type = self.volume_type assert state.get_volumes() == [ volume_type( name='LVRoot', parent='', size=None, realpath='/', mountpoint=None, fullsize=True, label=None, attributes=[], is_root_volume=True, ), volume_type( name='LVSwap', parent='', size='size:128', realpath='swap', mountpoint=None, fullsize=False, label='SWAP', attributes=[], is_root_volume=False, ), ] def test_get_volumes_no_explicit_root_setup_other_fullsize_volume(self): description = XMLDescription( '../data/example_lvm_no_root_full_usr_config.xml' ) xml_data = description.load() state = XMLState(xml_data) volume_type = self.volume_type assert state.get_volumes() == [ volume_type( name='usr', parent='', size=None, realpath='usr', mountpoint='usr', fullsize=True, label=None, attributes=[], is_root_volume=False, ), volume_type( name='LVRoot', parent='', size='freespace:30', realpath='/', mountpoint=None, fullsize=False, label=None, attributes=[], is_root_volume=True, ), volume_type( name='LVSwap', parent='', size='size:128', realpath='swap', mountpoint=None, fullsize=False, label='SWAP', attributes=[], is_root_volume=False, ), ] @patch('kiwi.xml_state.XMLState.get_build_type_system_disk_section') def test_get_empty_volumes(self, mock_system_disk): mock_system_disk.return_value = None assert self.state.get_volumes() == [] def test_get_strip_files_to_delete(self): assert self.state.get_strip_files_to_delete() == ['del-a', 'del-b'] def test_get_strip_tools_to_keep(self): assert self.state.get_strip_tools_to_keep() == ['tool-a', 'tool-b'] def test_get_strip_libraries_to_keep(self): assert self.state.get_strip_libraries_to_keep() == ['lib-a', 'lib-b'] def test_get_build_type_machine_section(self): xml_data = self.description.load() state = XMLState(xml_data, ['vmxSimpleFlavour'], 'oem') assert state.get_build_type_machine_section().get_guestOS() == 'suse' def test_get_drivers_list(self): assert self.state.get_drivers_list() == [ 'crypto/*', 'drivers/acpi/*', 'bar', ] def test_get_build_type_oemconfig_section(self): xml_data = self.description.load() state = XMLState(xml_data, None, 'oem') assert ( state.get_build_type_oemconfig_section().get_oem_swap()[0] is True ) def test_get_oemconfig_oem_resize(self): xml_data = self.description.load() state = XMLState(xml_data, ['vmxFlavour'], 'oem') assert state.get_oemconfig_oem_resize() is True description = XMLDescription( '../data/example_multiple_users_config.xml' ) xml_data = description.load() state = XMLState(xml_data) assert state.get_oemconfig_oem_resize() is False def test_get_oemconfig_oem_systemsize(self): xml_data = self.description.load() state = XMLState(xml_data, ['vmxFlavour'], 'oem') assert state.get_oemconfig_oem_systemsize() == 2048 def test_get_oemconfig_oem_multipath_scan(self): xml_data = self.description.load() state = XMLState(xml_data, ['vmxFlavour'], 'oem') assert state.get_oemconfig_oem_multipath_scan() is False description = XMLDescription('../data/example_disk_config.xml') xml_data = description.load() state = XMLState(xml_data) assert state.get_oemconfig_oem_multipath_scan() is False def test_get_oemconfig_swap_mbytes(self): xml_data = self.description.load() state = XMLState(xml_data, ['containerFlavour'], 'docker') assert state.get_oemconfig_swap_mbytes() is None state = XMLState(xml_data, ['vmxFlavour'], 'oem') assert state.get_oemconfig_swap_mbytes() == 42 def test_get_oemconfig_swap_name(self): xml_data = self.description.load() state = XMLState(xml_data, ['containerFlavour'], 'docker') assert state.get_oemconfig_swap_name() == 'LVSwap' state = XMLState(xml_data, ['vmxFlavour'], 'oem') assert state.get_oemconfig_swap_name() == 'swap' def test_get_oemconfig_swap_mbytes_default(self): description = XMLDescription('../data/example_btrfs_config.xml') xml_data = description.load() state = XMLState(xml_data) assert state.get_oemconfig_swap_mbytes() == 128 def test_get_users_sections(self): assert ( self.state.get_users_sections()[0].get_user()[0].get_name() == 'root' ) def test_get_users(self): description = XMLDescription( '../data/example_multiple_users_config.xml' ) xml_data = description.load() state = XMLState(xml_data) users = state.get_users() assert len(users) == 3 assert any(u.get_name() == 'root' for u in users) assert any(u.get_name() == 'tux' for u in users) assert any(u.get_name() == 'kiwi' for u in users) def test_get_user_groups(self): description = XMLDescription( '../data/example_multiple_users_config.xml' ) xml_data = description.load() state = XMLState(xml_data) assert len(state.get_user_groups('root')) == 0 assert len(state.get_user_groups('tux')) == 1 assert any(grp == 'users' for grp in state.get_user_groups('tux')) assert len(state.get_user_groups('kiwi')) == 3 assert any(grp == 'users' for grp in state.get_user_groups('kiwi')) assert any(grp == 'kiwi' for grp in state.get_user_groups('kiwi')) assert any(grp == 'admin' for grp in state.get_user_groups('kiwi')) def test_copy_displayname(self): self.state.copy_displayname(self.boot_state) assert self.boot_state.xml_data.get_displayname() == 'Bob' def test_copy_drivers_sections(self): self.state.copy_drivers_sections(self.boot_state) assert 'bar' in self.boot_state.get_drivers_list() def test_copy_systemdisk_section(self): self.state.copy_systemdisk_section(self.boot_state) systemdisk = self.boot_state.get_build_type_system_disk_section() assert systemdisk.get_name() == 'mydisk' @patch('kiwi.xml_parse.type_.get_bootloader') def test_copy_bootloader_section(self, mock_bootloader): mock_bootloader.return_value = [self.bootloader] self.state.copy_bootloader_section(self.boot_state) assert ( self.boot_state.get_build_type_bootloader_section() == self.bootloader ) def test_copy_strip_sections(self): self.state.copy_strip_sections(self.boot_state) assert 'del-a' in self.boot_state.get_strip_files_to_delete() def test_copy_machine_section(self): self.state.copy_machine_section(self.boot_state) machine = self.boot_state.get_build_type_machine_section() assert machine.get_memory() == 512 def test_copy_oemconfig_section(self): self.state.copy_oemconfig_section(self.boot_state) oemconfig = self.boot_state.get_build_type_oemconfig_section() assert oemconfig.get_oem_systemsize()[0] == 2048 def test_copy_repository_sections(self): self.state.copy_repository_sections(self.boot_state, True) repository = self.boot_state.get_repository_sections()[0] assert repository.get_source().get_path() == 'iso:///image/CDs/dvd.iso' def test_copy_preferences_subsections(self): self.state.copy_preferences_subsections( ['bootsplash_theme'], self.boot_state ) preferences = self.boot_state.get_preferences_sections()[0] assert preferences.get_bootsplash_theme()[0] == 'openSUSE' def test_copy_build_type_attributes(self): self.state.copy_build_type_attributes(['firmware'], self.boot_state) assert self.boot_state.build_type.get_firmware() == 'efi' def test_copy_bootincluded_packages_with_no_image_packages(self): self.state.copy_bootincluded_packages(self.boot_state) bootstrap_packages = self.boot_state.get_bootstrap_packages() assert 'plymouth-branding-openSUSE' in bootstrap_packages assert 'grub2-branding-openSUSE' in bootstrap_packages assert 'gfxboot-branding-openSUSE' in bootstrap_packages to_delete_packages = self.boot_state.get_to_become_deleted_packages() assert 'gfxboot-branding-openSUSE' not in to_delete_packages def test_copy_bootincluded_packages_with_image_packages(self): boot_description = XMLDescription( '../data/isoboot/example-distribution/config.xml' ) boot_state = XMLState(boot_description.load(), ['std']) self.state.copy_bootincluded_packages(boot_state) image_packages = boot_state.get_image_packages_sections() bootstrap_packages = boot_state.get_bootstrap_packages() assert 'plymouth-branding-openSUSE' in bootstrap_packages assert 'grub2-branding-openSUSE' in bootstrap_packages assert 'gfxboot-branding-openSUSE' in bootstrap_packages assert 'plymouth-branding-openSUSE' not in image_packages assert 'grub2-branding-openSUSE' not in image_packages assert 'gfxboot-branding-openSUSE' not in image_packages to_delete_packages = boot_state.get_to_become_deleted_packages() assert 'gfxboot-branding-openSUSE' not in to_delete_packages def test_copy_bootincluded_archives(self): self.state.copy_bootincluded_archives(self.boot_state) bootstrap_archives = self.boot_state.get_bootstrap_archives() assert '/absolute/path/to/image.tgz' in bootstrap_archives def test_copy_bootdelete_packages(self): self.state.copy_bootdelete_packages(self.boot_state) to_delete_packages = self.boot_state.get_to_become_deleted_packages() assert 'vim' in to_delete_packages def test_copy_bootdelete_packages_no_delete_section_in_boot_descr(self): boot_description = XMLDescription( '../data/isoboot/example-distribution-no-delete-section/config.xml' ) boot_state = XMLState(boot_description.load()) self.state.copy_bootdelete_packages(boot_state) to_delete_packages = boot_state.get_to_become_deleted_packages() assert 'vim' in to_delete_packages def test_build_type_size(self): result = self.state.get_build_type_size() assert result.mbytes == 1024 assert result.additive def test_build_type_size_with_unpartitioned(self): state = XMLState(self.description.load(), ['vmxSimpleFlavour'], 'oem') result = state.get_build_type_size() assert result.mbytes == 3072 assert not result.additive result = state.get_build_type_size(include_unpartitioned=True) assert result.mbytes == 4096 assert not result.additive def test_get_build_type_unpartitioned_bytes(self): assert self.state.get_build_type_unpartitioned_bytes() == 0 state = XMLState(self.description.load(), ['vmxSimpleFlavour'], 'oem') assert state.get_build_type_unpartitioned_bytes() == 1073741824 state = XMLState(self.description.load(), ['vmxFlavour'], 'oem') assert state.get_build_type_unpartitioned_bytes() == 0 state = XMLState(self.description.load(), ['ec2Flavour'], 'oem') assert state.get_build_type_unpartitioned_bytes() == 0 def test_get_volume_group_name(self): assert self.state.get_volume_group_name() == 'mydisk' def test_get_volume_group_name_default(self): assert self.boot_state.get_volume_group_name() == 'systemVG' def test_get_distribution_name_from_boot_attribute(self): assert ( self.state.get_distribution_name_from_boot_attribute() == 'distribution' ) def test_get_fs_mount_option_list(self): assert self.state.get_fs_mount_option_list() == ['async'] def test_get_efi_mount_option_list(self): assert self.state.get_efi_mount_option_list() == [] @patch('kiwi.xml_parse.type_.get_efimountoptions') def test_get_efi_mount_option_list_custom(self, mock_get_efimountoptions): mock_get_efimountoptions.return_value = 'umask=0077,shortname=winnt' assert self.state.get_efi_mount_option_list() == [ 'umask=0077,shortname=winnt' ] def test_get_fs_create_option_list(self): assert self.state.get_fs_create_option_list() == ['-O', '^has_journal'] @patch('kiwi.xml_parse.type_.get_overlayroot_readonly_createoptions') def test_get_fs_readonly_create_option_list(self, mock_createopts): mock_createopts.return_value = '-C 1048576' assert self.state.get_fs_readonly_create_option_list() == [ '-C', '1048576', ] @patch('kiwi.xml_parse.type_.get_boot') def test_get_distribution_name_from_boot_attribute_no_boot(self, mock_boot): mock_boot.return_value = None with raises(KiwiDistributionNameError): self.state.get_distribution_name_from_boot_attribute() @patch('kiwi.xml_parse.type_.get_boot') def test_get_distribution_name_from_boot_attribute_invalid_boot( self, mock_boot ): mock_boot.return_value = 'invalid' with raises(KiwiDistributionNameError): self.state.get_distribution_name_from_boot_attribute() def test_delete_repository_sections(self): self.state.delete_repository_sections() assert self.state.get_repository_sections() == [] def test_delete_repository_sections_used_for_build(self): self.state.delete_repository_sections_used_for_build() assert self.state.get_repository_sections()[0].get_imageonly() def test_get_build_type_vmconfig_entries(self): assert self.state.get_build_type_vmconfig_entries() == [] def test_get_build_type_vmconfig_entries_for_simple_disk(self): xml_data = self.description.load() state = XMLState(xml_data, ['vmxSimpleFlavour'], 'oem') assert state.get_build_type_vmconfig_entries() == [ 'numvcpus = "4"', 'cpuid.coresPerSocket = "2"', ] def test_get_build_type_vmconfig_entries_no_machine_section(self): description = XMLDescription('../data/example_disk_config.xml') xml_data = description.load() state = XMLState(xml_data) assert state.get_build_type_vmconfig_entries() == [] def test_get_build_type_docker_containerconfig_section(self): xml_data = self.description.load() state = XMLState(xml_data, ['containerFlavour'], 'docker') containerconfig = state.get_build_type_containerconfig_section() assert containerconfig.get_name() == 'container_name' assert containerconfig.get_maintainer() == 'tux' assert containerconfig.get_workingdir() == '/root' def test_set_container_tag(self): xml_data = self.description.load() state = XMLState(xml_data, ['containerFlavour'], 'docker') state.set_container_config_tag('new_tag') config = state.get_container_config() assert config['container_tag'] == 'new_tag' def test_add_container_label(self): xml_data = self.description.load() state = XMLState(xml_data, ['containerFlavour'], 'docker') state.add_container_config_label('somelabel', 'overwrittenvalue') state.add_container_config_label('new_label', 'new value') config = state.get_container_config() assert config['labels'] == { 'somelabel': 'overwrittenvalue', 'someotherlabel': 'anotherlabelvalue', 'new_label': 'new value', } def test_add_container_label_without_contianerconfig(self): xml_data = self.description.load() state = XMLState(xml_data, ['xenDom0Flavour'], 'docker') state.add_container_config_label('somelabel', 'newlabelvalue') config = state.get_container_config() assert config['labels'] == {'somelabel': 'newlabelvalue'} def test_add_container_label_no_container_image_type(self): xml_data = self.description.load() state = XMLState(xml_data, ['vmxFlavour'], 'oem') state.add_container_config_label('somelabel', 'newlabelvalue') with self._caplog.at_level(logging.WARNING): config = state.get_container_config() assert config == { 'history': {'author': 'Marcus '}, 'maintainer': 'Marcus ', } def test_set_container_tag_not_applied(self): with self._caplog.at_level(logging.WARNING): self.state.set_container_config_tag('new_tag') def test_get_container_config(self): expected_config = { 'labels': { 'somelabel': 'labelvalue', 'someotherlabel': 'anotherlabelvalue', }, 'maintainer': 'tux', 'entry_subcommand': ['ls', '-l'], 'container_name': 'container_name', 'container_tag': 'container_tag', 'additional_names': ['current', 'foobar'], 'workingdir': '/root', 'environment': { 'PATH': '/bin:/usr/bin:/home/user/bin', 'SOMEVAR': 'somevalue', }, 'user': 'root', 'volumes': ['/tmp', '/var/log'], 'entry_command': ['/bin/bash', '-x'], 'expose_ports': ['80', '8080'], 'stopsignal': 'SIGINT', 'history': { 'author': 'history author', 'comment': 'This is a comment', 'created_by': 'created by text', 'application_id': '123', 'package_version': '2003.12.0.0', 'launcher': 'app', }, } xml_data = self.description.load() state = XMLState(xml_data, ['containerFlavour'], 'docker') assert state.get_container_config() == expected_config def test_get_container_config_clear_commands(self): expected_config = { 'maintainer': 'tux', 'entry_subcommand': [], 'container_name': 'container_name', 'container_tag': 'container_tag', 'workingdir': '/root', 'user': 'root', 'entry_command': [], 'history': {'author': 'Marcus '}, } xml_data = self.description.load() state = XMLState(xml_data, ['derivedContainer'], 'docker') assert state.get_container_config() == expected_config def test_get_spare_part(self): assert self.state.get_build_type_spare_part_size() == 200 assert self.state.get_build_type_spare_part_fs_attributes() == [ 'no-copy-on-write' ] def test_get_build_type_format_options(self): assert self.state.get_build_type_format_options() == { 'super': 'man', 'force_size': None, } def test_get_derived_from_image_uri(self): xml_data = self.description.load() state = XMLState(xml_data, ['derivedContainer'], 'docker') assert ( state.get_derived_from_image_uri()[0].uri == 'obs://project/repo/image#mytag' ) def test_set_derived_from_image_uri(self): xml_data = self.description.load() state = XMLState(xml_data, ['derivedContainer'], 'docker') state.set_derived_from_image_uri('file:///new_uri') assert state.get_derived_from_image_uri()[0].translate() == '/new_uri' def test_set_derived_from_image_uri_not_applied(self): with self._caplog.at_level(logging.WARNING): self.state.set_derived_from_image_uri('file:///new_uri') def test_is_xen_server(self): assert self.state.is_xen_server() is True def test_is_xen_guest_by_machine_setup(self): assert self.state.is_xen_guest() is True def test_is_xen_guest_no_xen_guest_setup(self): assert self.boot_state.is_xen_guest() is False def test_is_xen_guest_by_firmware_setup(self): xml_data = self.description.load() state = XMLState(xml_data, ['ec2Flavour'], 'oem') assert state.is_xen_guest() is True def test_is_xen_guest_by_architecture(self): Defaults.set_platform_name('unsupported') xml_data = self.description.load() state = XMLState(xml_data, ['ec2Flavour'], 'oem') assert state.is_xen_guest() is False Defaults.set_platform_name('x86_64') def test_get_initrd_system(self): xml_data = self.description.load() state = XMLState(xml_data, ['vmxFlavour'], 'oem') assert state.get_initrd_system() == 'dracut' state = XMLState(xml_data, ['vmxSimpleFlavour'], 'iso') assert state.get_initrd_system() == 'dracut' state = XMLState(xml_data, ['containerFlavour'], 'docker') assert state.get_initrd_system() == 'none' state = XMLState(xml_data, [], 'oem') assert state.get_initrd_system() == 'dracut' def test_get_rpm_locale_filtering(self): assert self.state.get_rpm_locale_filtering() is True assert self.boot_state.get_rpm_locale_filtering() is False def test_get_locale(self): assert self.state.get_locale() == ['en_US', 'de_DE'] assert self.boot_state.get_locale() is None def test_get_rpm_locale(self): assert self.state.get_rpm_locale() == [ 'POSIX', 'C', 'C.UTF-8', 'en_US', 'de_DE', ] assert self.boot_state.get_rpm_locale() is None def test_set_root_partition_uuid(self): assert self.state.get_root_partition_uuid() is None self.state.set_root_partition_uuid('some-id') assert self.state.get_root_partition_uuid() == 'some-id' def test_set_root_filesystem_uuid(self): assert self.state.get_root_filesystem_uuid() is None self.state.set_root_filesystem_uuid('some-id') assert self.state.get_root_filesystem_uuid() == 'some-id' @patch('kiwi.xml_parse.type_.get_bootloader') def test_get_build_type_bootloader_name(self, mock_bootloader): mock_bootloader.return_value = [None] assert self.state.get_build_type_bootloader_name() == 'grub2' mock_bootloader.return_value = [self.bootloader] assert self.state.get_build_type_bootloader_name() == 'some-loader' @patch('kiwi.xml_parse.type_.get_bootloader') def test_get_build_type_bootloader_use_disk_password(self, mock_bootloader): mock_bootloader.return_value = [None] assert self.state.get_build_type_bootloader_use_disk_password() is False mock_bootloader.return_value = [self.bootloader] assert self.state.get_build_type_bootloader_use_disk_password() is True @patch('kiwi.xml_parse.type_.get_bootloader') def test_get_build_type_bootloader_bls(self, mock_bootloader): mock_bootloader.return_value = [self.bootloader] self.bootloader.get_bls.return_value = False assert self.state.get_build_type_bootloader_bls() is False self.bootloader.get_bls.return_value = True assert self.state.get_build_type_bootloader_bls() is True # The behavior for this is different on some distributions # because of the different default state. See # kiwi-revert-bls-default-for-suse.patch # As long as we cary this patch the following test is disabled # self.bootloader.get_bls.return_value = None # assert self.state.get_build_type_bootloader_bls() is True @patch('kiwi.xml_parse.type_.get_bootloader') def test_get_build_type_bootloader_console(self, mock_bootloader): mock_bootloader.return_value = [self.bootloader] assert self.state.get_build_type_bootloader_console() == [ 'some-console', 'some-console', ] @patch('kiwi.xml_parse.type_.get_bootloader') def test_get_build_type_bootloader_serial_line_setup(self, mock_bootloader): mock_bootloader.return_value = [self.bootloader] assert ( self.state.get_build_type_bootloader_serial_line_setup() == 'some-serial' ) mock_bootloader.return_value = [None] assert self.state.get_build_type_bootloader_serial_line_setup() is None @patch('kiwi.xml_parse.type_.get_bootloader') def test_get_build_type_bootloader_video_mode(self, mock_bootloader): mock_bootloader.return_value = [self.bootloader] assert self.state.get_build_type_bootloader_video_mode() == '800x600' self.bootloader.get_video_mode.return_value = None assert self.state.get_build_type_bootloader_video_mode() == 'auto' mock_bootloader.return_value = [None] assert self.state.get_build_type_bootloader_video_mode() == 'auto' @patch('kiwi.xml_parse.type_.get_bootloader') def test_get_build_type_bootloader_timeout(self, mock_bootloader): mock_bootloader.return_value = [self.bootloader] assert self.state.get_build_type_bootloader_timeout() == 'some-timeout' @patch('kiwi.xml_parse.type_.get_bootloader') def test_get_build_type_bootloader_timeout_style(self, mock_bootloader): mock_bootloader.return_value = [self.bootloader] assert ( self.state.get_build_type_bootloader_timeout_style() == 'some-style' ) mock_bootloader.return_value = [None] assert self.state.get_build_type_bootloader_timeout_style() is None @patch('kiwi.xml_parse.type_.get_bootloader') def test_get_build_type_bootloader_kernel_flavors(self, mock_bootloader): mock_bootloader.return_value = [self.bootloader] self.bootloader.get_kernel_flavor.return_value = 'rt,,default,rt' assert self.state.get_build_type_bootloader_kernel_flavors() == [ 'rt', 'default', ] self.bootloader.get_kernel_flavor.return_value = None assert self.state.get_build_type_bootloader_kernel_flavors() == [] mock_bootloader.return_value = [None] assert self.state.get_build_type_bootloader_kernel_flavors() == [] def test_get_build_type_bootloader_kernel_flavors_from_description(self): description = XMLDescription('../data/example_kernel_flavor_config.xml') xml_data = description.load() state = XMLState(xml_data, ['flavor']) assert state.get_build_type_bootloader_kernel_flavors() == [ 'rt', 'default', ] state = XMLState(xml_data, ['noFlavor']) assert state.get_build_type_bootloader_kernel_flavors() == [] @patch('kiwi.xml_parse.type_.get_bootloader') def test_get_build_type_bootloader_targettype(self, mock_bootloader): mock_bootloader.return_value = [self.bootloader] assert ( self.state.get_build_type_bootloader_targettype() == 'some-target' ) def test_get_installintrd_modules(self): assert self.state.get_installmedia_initrd_modules('add') == [ 'network-legacy' ] assert self.state.get_installmedia_initrd_modules('set') == [] assert self.state.get_installmedia_initrd_modules('omit') == [] xml_data = self.description.load() state = XMLState(xml_data, ['vmxSimpleFlavour'], 'oem') assert state.get_installmedia_initrd_modules('add') == [] def test_get_installintrd_driver(self): assert self.state.get_installmedia_initrd_drivers('add') == ['erofs'] assert self.state.get_installmedia_initrd_drivers('omit') == [] xml_data = self.description.load() state = XMLState(xml_data, ['vmxSimpleFlavour'], 'oem') assert state.get_installmedia_initrd_drivers('add') == [] def test_get_dracut_config(self): assert self.state.get_dracut_config('setup').uefi is False xml_data = self.description.load() state = XMLState(xml_data, ['vmxSimpleFlavour'], 'oem') assert state.get_dracut_config('setup').uefi is True assert state.get_dracut_config('add').modules == ['some'] assert state.get_dracut_config('add').drivers == ['driver'] @patch('kiwi.system.uri.os.path.abspath') def test_get_repositories_signing_keys(self, mock_root_path): mock_root_path.side_effect = lambda x: f'(mock_abspath){x}' # os.path.abspath is mocked, realpath can't be used here description_dir = os.path.normpath( os.sep.join([os.getcwd(), '../data']) ) assert self.state.get_repositories_signing_keys() == [ f'(mock_abspath){description_dir}/key_a', '(mock_abspath)/usr/share/distribution-gpg-keys/' 'fedora/RPM-GPG-KEY-fedora-15.3-primary', f'(mock_abspath){description_dir}/key_b', ] @patch('kiwi.system.uri.os.path.abspath') def test_get_repository_signing_keys(self, mock_root_path): mock_root_path.side_effect = lambda x: f'(mock_abspath){x}' description_dir = os.path.normpath( os.sep.join([os.getcwd(), '../data']) ) repositories = self.state.get_repository_sections() # both $releasever variants resolve to the same key assert self.state.get_repository_signing_keys(repositories[0]) == [ f'(mock_abspath){description_dir}/key_a', '(mock_abspath)/usr/share/distribution-gpg-keys/' 'fedora/RPM-GPG-KEY-fedora-15.3-primary', ] assert self.state.get_repository_signing_keys(repositories[1]) == [] assert self.state.get_repository_signing_keys(repositories[2]) == [ f'(mock_abspath){description_dir}/key_b' ] def test_get_repositories_signing_keys_absolute_file_uri(self): signing = ( self.state.get_repository_sections()[0].get_source().get_signing() ) for key_url in [ 'file:/path/to/key', 'file:///path/to/key', 'file://localhost/path/to/key', ]: signing[0].set_key(key_url) assert ( self.state.get_repositories_signing_keys()[0] == '/path/to/key' ) def test_get_repositories_signing_keys_invalid_file_uri(self): signing = ( self.state.get_repository_sections()[0].get_source().get_signing() ) for key_url in ['file:relative/key', 'file://relative/key']: signing[0].set_key(key_url) with raises(KiwiUriStyleUnknown): self.state.get_repositories_signing_keys() def test_this_path_resolver(self): description = XMLDescription('../data/example_this_path_config.xml') xml_data = description.load() state = XMLState(xml_data) description_dir = os.path.realpath('../data') repo_source = state.xml_data.get_repository()[0].get_source() assert repo_source.get_path() == f'dir://{description_dir}/my_repo' signing_keys = [ signing.get_key() for signing in repo_source.get_signing() ] assert signing_keys == [ f'file://{description_dir}/keys/my_repo.key', 'file:///usr/share/keys/my_repo.key', ] assert state.get_repositories_signing_keys() == [ f'{description_dir}/keys/my_repo.key', '/usr/share/keys/my_repo.key', ] def test_get_collection_modules(self): assert self.state.get_collection_modules() == { 'disable': ['mod_c'], 'enable': ['mod_a:stream', 'mod_b'], } @patch('kiwi.xml_parse.type_.get_luks') def test_get_luks_credentials(self, mock_get_luks): mock_get_luks.return_value = 'data' assert self.state.get_luks_credentials() == 'data' mock_get_luks.return_value = 'file:///some/data-file' with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.read.return_value = b'data' assert self.state.get_luks_credentials() == b'data' with patch('builtins.open', create=True) as mock_open: mock_open.return_value = MagicMock(spec=io.IOBase) file_handle = mock_open.return_value.__enter__.return_value file_handle.read.side_effect = Exception with raises(KiwiFileAccessError): self.state.get_luks_credentials() def test_get_luks_format_options(self): assert self.state.get_luks_format_options() == [ '--type', 'luks2', '--cipher', 'aes-gcm-random', '--integrity', 'aead', '--pbkdf', 'pbkdf2', ] def test_get_bootstrap_package_name(self): assert self.apt_state.get_bootstrap_package_name() == 'bootstrap-me' def test_get_bootloader_options(self): xml_data = self.description.load() state = XMLState(xml_data, ['vmxSimpleFlavour'], 'oem') assert state.get_bootloader_shim_options() == [ '--foo', 'bar', '--suse-we-adapt-you-succeed', ] assert state.get_bootloader_install_options() == ['--A', '123', 'B'] assert state.get_bootloader_config_options() == ['--joe', '-x'] def test_bootloader_environment_variables(self): xml_data = self.description.load() state = XMLState(xml_data, ['vmxSimpleFlavour'], 'oem') assert state.get_build_type_bootloader_environment_variables() == [ 'menu_auto_hide=1' ] def test_get_host_key_certificates(self): description = XMLDescription('../data/example_hkd_config.xml') xml_data = description.load() state = XMLState(xml_data) assert state.get_host_key_certificates() == [ { 'hkd_cert': ['some1-host.crt', 'some2-host.crt'], 'hkd_revocation_list': ['some1-revocation.crl'], 'hkd_ca_cert': 'some-ca.crt', 'hkd_sign_cert': 'some1-signing.crt', }, { 'hkd_cert': ['some3-host.crt'], 'hkd_revocation_list': ['some2-revocation.crl'], 'hkd_ca_cert': 'some-ca.crt', 'hkd_sign_cert': 'some2-signing.crt', }, ] def test_get_btrfs_root_is_subvolume(self): assert self.state.build_type.get_btrfs_root_is_subvolume() is None @patch('kiwi.xml_parse.type_.get_btrfs_set_default_volume') def test_btrfs_default_volume_requested( self, mock_get_btrfs_set_default_volume ): mock_get_btrfs_set_default_volume.return_value = True assert self.state.btrfs_default_volume_requested() is True mock_get_btrfs_set_default_volume.return_value = False assert self.state.btrfs_default_volume_requested() is False mock_get_btrfs_set_default_volume.return_value = None assert self.state.btrfs_default_volume_requested() is True def test_get_certificates(self): assert self.state.get_certificates() == ['/some/ca/filename'] assert self.state.get_certificates_target_distribution() == 'suse' self.state.add_certificate('/new/file', 'rhel') assert self.state.get_certificates() == [ '/new/file', '/some/ca/filename', ] assert self.state.get_certificates_target_distribution() == 'rhel' self.state.add_certificate('/new/file', 'rhel') assert self.state.get_certificates() == [ '/new/file', '/some/ca/filename', ] assert self.apt_state.get_certificates() == [] assert self.apt_state.get_certificates_target_distribution() == '' self.apt_state.add_certificate('/new/file', 'debian') assert self.apt_state.get_certificates() == ['/new/file'] assert self.apt_state.get_certificates_target_distribution() == 'debian' kiwi-11.1.8/PKG-INFO0000644000000000000000000000750700000000000010542 0ustar00Metadata-Version: 2.1 Name: kiwi Version: 11.1.8 Summary: KIWI - Appliance Builder Home-page: https://osinside.github.io/kiwi/ License: GPL-3.0-or-later Author: Marcus Schäfer Author-email: marcus.schaefer@suse.com Maintainer: Marcus Schäfer Maintainer-email: marcus.schaefer@suse.com Requires-Python: >=3.9,<4.0 Classifier: Development Status :: 5 - Production/Stable Classifier: Intended Audience :: Developers Classifier: License :: OSI Approved :: GNU General Public License v3 or later (GPLv3+) Classifier: Operating System :: POSIX :: Linux Classifier: Programming Language :: Python :: 3 Classifier: Programming Language :: Python :: 3.9 Classifier: Programming Language :: Python :: 3.10 Classifier: Programming Language :: Python :: 3.11 Classifier: Programming Language :: Python :: 3.12 Classifier: Topic :: System :: Operating System Provides-Extra: integration-tests Provides-Extra: libsolv Provides-Extra: markup Requires-Dist: Cerberus (>=1.3.0) Requires-Dist: PyYAML (>=5.4.0) Requires-Dist: anymarkup-core (>=0.8.0) ; extra == "markup" Requires-Dist: lxml (>=4.6.0) Requires-Dist: progressbar2 (>=3.53) Requires-Dist: requests (>=2.25.0) Requires-Dist: simplejson (>=3.17.0) Requires-Dist: solv ; extra == "libsolv" Requires-Dist: toml ; extra == "markup" Requires-Dist: typer (>=0.19.0) Requires-Dist: xmltodict (>=0.12.0) ; extra == "markup" Project-URL: Bug Tracker, https://github.com/OSInside/kiwi/issues Project-URL: Documentation, https://osinside.github.io/kiwi/ Project-URL: Repository, https://github.com/OSInside/kiwi Description-Content-Type: text/x-rst KIWI - Next Generation ====================== .. |GitHub Action Code Style| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-code-style.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |GitHub Action Config Functions| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-config-functions.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |GitHub Action Documentation| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-documentation.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |GitHub Action Publish Pages| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-publish-pages.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |GitHub Action Publish PyPi| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-publish-to-pypi.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |GitHub Action Unit Types| image:: https://github.com/OSInside/kiwi/actions/workflows/ci-units-types.yml/badge.svg :target: https://github.com/OSInside/kiwi/actions .. |Health| image:: https://app.codacy.com/project/badge/Grade/228f7e8cd15d448688a590c272ec3789 :target: https://www.codacy.com/gh/OSInside/kiwi/dashboard?utm_source=github.com&utm_medium=referral&utm_content=OSInside/kiwi&utm_campaign=Badge_Grade .. |Doc| replace:: `Documentation `__ .. |Installation| replace:: `Installation `__ .. |Contributing| replace:: `Contributing `__ .. |IntegrationTesting| replace:: `Integration Testing `__ .. |Donate| image:: https://www.paypalobjects.com/en_US/i/btn/btn_donateCC_LG.gif :target: https://www.paypal.com/donate/?hosted_button_id=CYZY57A7Q4TCC |GitHub Action Code Style| |GitHub Action Config Functions| |GitHub Action Documentation| |GitHub Action Publish Pages| |GitHub Action Publish PyPi| |GitHub Action Unit Types| |Health| **KIWI, the OS image and appliance builder.** * |Installation| * |IntegrationTesting| * |Contributing| * |Doc| KIWI has helped you in your work ? Even the smallest gift is a way to help that we don't run out of coffee :) |Donate|