mirror of
https://github.com/ansible-collections/community.general.git
synced 2025-04-25 11:51:26 -07:00
* [WIP] become plugins Move from hardcoded method to plugins for ease of use, expansion and overrides - load into connection as it is going to be the main consumer - play_context will also use to keep backwards compat API - ensure shell is used to construct commands when needed - migrate settings remove from base config in favor of plugin specific configs - cleanup ansible-doc - add become plugin docs - remove deprecated sudo/su code and keywords - adjust become options for cli - set plugin options from context - ensure config defs are avaialbe before instance - refactored getting the shell plugin, fixed tests - changed into regex as they were string matching, which does not work with random string generation - explicitly set flags for play context tests - moved plugin loading up front - now loads for basedir also - allow pyc/o for non m modules - fixes to tests and some plugins - migrate to play objects fro play_context - simiplify gathering - added utf8 headers - moved option setting - add fail msg to dzdo - use tuple for multiple options on fail/missing - fix relative plugin paths - shift from play context to play - all tasks already inherit this from play directly - remove obsolete 'set play' - correct environment handling - add wrap_exe option to pfexec - fix runas to noop - fixed setting play context - added password configs - removed required false - remove from doc building till they are ready future development: - deal with 'enable' and 'runas' which are not 'command wrappers' but 'state flags' and currently hardcoded in diff subsystems * cleanup remove callers to removed func removed --sudo cli doc refs remove runas become_exe ensure keyerorr on plugin also fix backwards compat, missing method is attributeerror, not ansible error get remote_user consistently ignore missing system_tmpdirs on plugin load correct config precedence add deprecation fix networking imports backwards compat for plugins using BECOME_METHODS * Port become_plugins to context.CLIARGS This is a work in progress: * Stop passing options around everywhere as we can use context.CLIARGS instead * Refactor make_become_commands as asked for by alikins * Typo in comment fix * Stop loading values from the cli in more than one place Both play and play_context were saving default values from the cli arguments directly. This changes things so that the default values are loaded into the play and then play_context takes them from there. * Rename BECOME_PLUGIN_PATH to DEFAULT_BECOME_PLUGIN_PATH As alikins said, all other plugin paths are named DEFAULT_plugintype_PLUGIN_PATH. If we're going to rename these, that should be done all at one time rather than piecemeal. * One to throw away This is a set of hacks to get setting FieldAttribute defaults to command line args to work. It's not fully done yet. After talking it over with sivel and jimi-c this should be done by fixing FieldAttributeBase and _get_parent_attribute() calls to do the right thing when there is a non-None default. What we want to be able to do ideally is something like this: class Base(FieldAttributeBase): _check_mode = FieldAttribute([..] default=lambda: context.CLIARGS['check']) class Play(Base): # lambda so that we have a chance to parse the command line args # before we get here. In the future we might be able to restructure # this so that the cli parsing code runs before these classes are # defined. class Task(Base): pass And still have a playbook like this function: --- - hosts: tasks: - command: whoami check_mode: True (The check_mode test that is added as a separate commit in this PR will let you test variations on this case). There's a few separate reasons that the code doesn't let us do this or a non-ugly workaround for this as written right now. The fix that jimi-c, sivel, and I talked about may let us do this or it may still require a workaround (but less ugly) (having one class that has the FieldAttributes with default values and one class that inherits from that but just overrides the FieldAttributes which now have defaults) * Revert "One to throw away" This reverts commit 23aa883cbed11429ef1be2a2d0ed18f83a3b8064. * Set FieldAttr defaults directly from CLIARGS * Remove dead code * Move timeout directly to PlayContext, it's never needed on Play * just for backwards compat, add a static version of BECOME_METHODS to constants * Make the become attr on the connection public, since it's used outside of the connection * Logic fix * Nuke connection testing if it supports specific become methods * Remove unused vars * Address rebase issues * Fix path encoding issue * Remove unused import * Various cleanups * Restore network_cli check in _low_level_execute_command * type improvements for cliargs_deferred_get and swap shallowcopy to default to False * minor cleanups * Allow the su plugin to work, since it doesn't define a prompt the same way * Fix up ksu become plugin * Only set prompt if build_become_command was called * Add helper to assist connection plugins in knowing they need to wait for a prompt * Fix tests and code expectations * Doc updates * Various additional minor cleanups * Make doas functional * Don't change connection signature, load become plugin from TaskExecutor * Remove unused imports * Add comment about setting the become plugin on the playcontext * Fix up tests for recent changes * Support 'Password:' natively for the doas plugin * Make default prompts raw * wording cleanups. ci_complete * Remove unrelated changes * Address spelling mistake * Restore removed test, and udpate to use new functionality * Add changelog fragment * Don't hard fail in set_attributes_from_cli on missing CLI keys * Remove unrelated change to loader * Remove internal deprecated FieldAttributes now * Emit deprecation warnings now
229 lines
8 KiB
Python
229 lines
8 KiB
Python
# (c) 2015, Joerg Thalheim <joerg@higgsboson.tk>
|
|
# Copyright (c) 2017 Ansible Project
|
|
# GNU General Public License v3.0+ (see COPYING or https://www.gnu.org/licenses/gpl-3.0.txt)
|
|
|
|
from __future__ import (absolute_import, division, print_function)
|
|
__metaclass__ = type
|
|
|
|
DOCUMENTATION = """
|
|
author: Joerg Thalheim <joerg@higgsboson.tk>
|
|
connection: lxc
|
|
short_description: Run tasks in lxc containers via lxc python library
|
|
description:
|
|
- Run commands or put/fetch files to an existing lxc container using lxc python library
|
|
version_added: "2.0"
|
|
options:
|
|
remote_addr:
|
|
description:
|
|
- Container identifier
|
|
default: inventory_hostname
|
|
vars:
|
|
- name: ansible_host
|
|
- name: ansible_lxc_host
|
|
executable:
|
|
default: /bin/sh
|
|
description:
|
|
- Shell executable
|
|
vars:
|
|
- name: ansible_executable
|
|
- name: ansible_lxc_executable
|
|
"""
|
|
|
|
import os
|
|
import shutil
|
|
import traceback
|
|
import select
|
|
import fcntl
|
|
import errno
|
|
|
|
HAS_LIBLXC = False
|
|
try:
|
|
import lxc as _lxc
|
|
HAS_LIBLXC = True
|
|
except ImportError:
|
|
pass
|
|
|
|
from ansible import constants as C
|
|
from ansible import errors
|
|
from ansible.module_utils._text import to_bytes, to_native
|
|
from ansible.plugins.connection import ConnectionBase
|
|
|
|
|
|
class Connection(ConnectionBase):
|
|
''' Local lxc based connections '''
|
|
|
|
transport = 'lxc'
|
|
has_pipelining = True
|
|
default_user = 'root'
|
|
|
|
def __init__(self, play_context, new_stdin, *args, **kwargs):
|
|
super(Connection, self).__init__(play_context, new_stdin, *args, **kwargs)
|
|
|
|
self.container_name = self._play_context.remote_addr
|
|
self.container = None
|
|
|
|
def _connect(self):
|
|
''' connect to the lxc; nothing to do here '''
|
|
super(Connection, self)._connect()
|
|
|
|
if not HAS_LIBLXC:
|
|
msg = "lxc bindings for python2 are not installed"
|
|
raise errors.AnsibleError(msg)
|
|
|
|
if self.container:
|
|
return
|
|
|
|
self._display.vvv("THIS IS A LOCAL LXC DIR", host=self.container_name)
|
|
self.container = _lxc.Container(self.container_name)
|
|
if self.container.state == "STOPPED":
|
|
raise errors.AnsibleError("%s is not running" % self.container_name)
|
|
|
|
def _communicate(self, pid, in_data, stdin, stdout, stderr):
|
|
buf = {stdout: [], stderr: []}
|
|
read_fds = [stdout, stderr]
|
|
if in_data:
|
|
write_fds = [stdin]
|
|
else:
|
|
write_fds = []
|
|
while len(read_fds) > 0 or len(write_fds) > 0:
|
|
try:
|
|
ready_reads, ready_writes, _ = select.select(read_fds, write_fds, [])
|
|
except select.error as e:
|
|
if e.args[0] == errno.EINTR:
|
|
continue
|
|
raise
|
|
for fd in ready_writes:
|
|
in_data = in_data[os.write(fd, in_data):]
|
|
if len(in_data) == 0:
|
|
write_fds.remove(fd)
|
|
for fd in ready_reads:
|
|
data = os.read(fd, 32768)
|
|
if not data:
|
|
read_fds.remove(fd)
|
|
buf[fd].append(data)
|
|
|
|
(pid, returncode) = os.waitpid(pid, 0)
|
|
|
|
return returncode, b"".join(buf[stdout]), b"".join(buf[stderr])
|
|
|
|
def _set_nonblocking(self, fd):
|
|
flags = fcntl.fcntl(fd, fcntl.F_GETFL) | os.O_NONBLOCK
|
|
fcntl.fcntl(fd, fcntl.F_SETFL, flags)
|
|
return fd
|
|
|
|
def exec_command(self, cmd, in_data=None, sudoable=False):
|
|
''' run a command on the chroot '''
|
|
super(Connection, self).exec_command(cmd, in_data=in_data, sudoable=sudoable)
|
|
|
|
# python2-lxc needs bytes. python3-lxc needs text.
|
|
executable = to_native(self._play_context.executable, errors='surrogate_or_strict')
|
|
local_cmd = [executable, '-c', to_native(cmd, errors='surrogate_or_strict')]
|
|
|
|
read_stdout, write_stdout = None, None
|
|
read_stderr, write_stderr = None, None
|
|
read_stdin, write_stdin = None, None
|
|
|
|
try:
|
|
read_stdout, write_stdout = os.pipe()
|
|
read_stderr, write_stderr = os.pipe()
|
|
|
|
kwargs = {
|
|
'stdout': self._set_nonblocking(write_stdout),
|
|
'stderr': self._set_nonblocking(write_stderr),
|
|
'env_policy': _lxc.LXC_ATTACH_CLEAR_ENV
|
|
}
|
|
|
|
if in_data:
|
|
read_stdin, write_stdin = os.pipe()
|
|
kwargs['stdin'] = self._set_nonblocking(read_stdin)
|
|
|
|
self._display.vvv("EXEC %s" % (local_cmd), host=self.container_name)
|
|
pid = self.container.attach(_lxc.attach_run_command, local_cmd, **kwargs)
|
|
if pid == -1:
|
|
msg = "failed to attach to container %s" % self.container_name
|
|
raise errors.AnsibleError(msg)
|
|
|
|
write_stdout = os.close(write_stdout)
|
|
write_stderr = os.close(write_stderr)
|
|
if read_stdin:
|
|
read_stdin = os.close(read_stdin)
|
|
|
|
return self._communicate(pid,
|
|
in_data,
|
|
write_stdin,
|
|
read_stdout,
|
|
read_stderr)
|
|
finally:
|
|
fds = [read_stdout,
|
|
write_stdout,
|
|
read_stderr,
|
|
write_stderr,
|
|
read_stdin,
|
|
write_stdin]
|
|
for fd in fds:
|
|
if fd:
|
|
os.close(fd)
|
|
|
|
def put_file(self, in_path, out_path):
|
|
''' transfer a file from local to lxc '''
|
|
super(Connection, self).put_file(in_path, out_path)
|
|
self._display.vvv("PUT %s TO %s" % (in_path, out_path), host=self.container_name)
|
|
in_path = to_bytes(in_path, errors='surrogate_or_strict')
|
|
out_path = to_bytes(out_path, errors='surrogate_or_strict')
|
|
|
|
if not os.path.exists(in_path):
|
|
msg = "file or module does not exist: %s" % in_path
|
|
raise errors.AnsibleFileNotFound(msg)
|
|
try:
|
|
src_file = open(in_path, "rb")
|
|
except IOError:
|
|
traceback.print_exc()
|
|
raise errors.AnsibleError("failed to open input file to %s" % in_path)
|
|
try:
|
|
def write_file(args):
|
|
with open(out_path, 'wb+') as dst_file:
|
|
shutil.copyfileobj(src_file, dst_file)
|
|
try:
|
|
self.container.attach_wait(write_file, None)
|
|
except IOError:
|
|
traceback.print_exc()
|
|
msg = "failed to transfer file to %s" % out_path
|
|
raise errors.AnsibleError(msg)
|
|
finally:
|
|
src_file.close()
|
|
|
|
def fetch_file(self, in_path, out_path):
|
|
''' fetch a file from lxc to local '''
|
|
super(Connection, self).fetch_file(in_path, out_path)
|
|
self._display.vvv("FETCH %s TO %s" % (in_path, out_path), host=self.container_name)
|
|
in_path = to_bytes(in_path, errors='surrogate_or_strict')
|
|
out_path = to_bytes(out_path, errors='surrogate_or_strict')
|
|
|
|
try:
|
|
dst_file = open(out_path, "wb")
|
|
except IOError:
|
|
traceback.print_exc()
|
|
msg = "failed to open output file %s" % out_path
|
|
raise errors.AnsibleError(msg)
|
|
try:
|
|
def write_file(args):
|
|
try:
|
|
with open(in_path, 'rb') as src_file:
|
|
shutil.copyfileobj(src_file, dst_file)
|
|
finally:
|
|
# this is needed in the lxc child process
|
|
# to flush internal python buffers
|
|
dst_file.close()
|
|
try:
|
|
self.container.attach_wait(write_file, None)
|
|
except IOError:
|
|
traceback.print_exc()
|
|
msg = "failed to transfer file from %s to %s" % (in_path, out_path)
|
|
raise errors.AnsibleError(msg)
|
|
finally:
|
|
dst_file.close()
|
|
|
|
def close(self):
|
|
''' terminate the connection; nothing to do here '''
|
|
super(Connection, self).close()
|
|
self._connected = False
|