写点什么

Shardingsphere 整合 Narayana 对 XA 分布式事务的支持(4)

  • 2020-12-03
  • 本文字数:17688 字

    阅读完需:约 58 分钟

Apache ShardingSphere 是一套开源的分布式数据库中间件解决方案组成的生态圈,它由 JDBC、Proxy 和 Sidecar(规划中)这 3 款相互独立,却又能够混合部署配合使用的产品组成。它们均提供标准化的数据分片、分布式事务和数据库治理功能,可适用于如 Java 同构、异构语言、云原生等各种多样化的应用场景。

ShardingSphere 已于 2020 年 4 月 16 日成为 Apache 软件基金会的顶级项目。

Narayana 简单介绍

Narayana(https://narayana.io/),是由 Jboss 团队提供的 XA 分布式事务的解决方案。

它具有以下特点:

  • 标准的基于 JTA 实现。

  • TransactionManager(TM) 完全去中心化设计,与业务耦合,无需单独部署。

  • 事务日志支持数据库存储,支持集群模式下的事务恢复。

ShardingTransactionManager 初始化 XATransactionDataSource 流程

ShardingSphere 对 XA 的支持提供一整套的 SPI 接口,在初始化话的时候,根据事务类型,先进行 TransactionManager 的初始化。我们先进入org.apache.shardingsphere.transaction.xa.XAShardingTransactionManager。代码如下:

 private final Map<String, XATransactionDataSource> cachedDataSources = new HashMap<>();    private final XATransactionManager xaTransactionManager = XATransactionManagerLoader.getInstance().getTransactionManager();    @Override    public void init(final DatabaseType databaseType, final Collection<ResourceDataSource> resourceDataSources) {        for (ResourceDataSource each : resourceDataSources) {            cachedDataSources.put(each.getOriginalName(), new XATransactionDataSource(databaseType, each.getUniqueResourceName(), each.getDataSource(), xaTransactionManager));        }      // Narayana的初始化        xaTransactionManager.init();    }
复制代码

  • 首先会根据配置的 datasource 将其转换成 XATransactionDataSource,具体代码在new XATransactionDataSource(databaseType, each.getUniqueResourceName(), each.getDataSource(), xaTransactionManager))。我们跟进去,代码如下:

public XATransactionDataSource(final DatabaseType databaseType, final String resourceName, final DataSource dataSource, final XATransactionManager xaTransactionManager) {        this.databaseType = databaseType;        this.resourceName = resourceName;        this.dataSource = dataSource;        if (!CONTAINER_DATASOURCE_NAMES.contains(dataSource.getClass().getSimpleName())) {            // 重点关注 1 ,返回了xaDatasource            xaDataSource = XADataSourceFactory.build(databaseType, dataSource);            this.xaTransactionManager = xaTransactionManager;            // 重点关注2 注册资源            xaTransactionManager.registerRecoveryResource(resourceName, xaDataSource);        }    }
复制代码

  • 我们重点来关注 XADataSourceFactory.build(databaseType, dataSource),从名字我们就可以看出,这应该是返回JTA规范里面的XADataSource,在 ShardingSphere 里面很多的功能,可以从代码风格的命名上就能猜出来,这就是优雅代码(吹一波)。不多逼逼,我们进入该方法。

public final class XADataSourceFactory {    public static XADataSource build(final DatabaseType databaseType, final DataSource dataSource) {        return new DataSourceSwapper(XADataSourceDefinitionFactory.getXADataSourceDefinition(databaseType)).swap(dataSource);    }}
复制代码

  • 首先又是一个 SPI 定义的 XADataSourceDefinitionFactory,它根据不同的数据库类型,来加载不同的方言。然后我们进入 swap方法。

 public XADataSource swap(final DataSource dataSource) {        XADataSource result = createXADataSource();        setProperties(result, getDatabaseAccessConfiguration(dataSource));        return result;    }
复制代码

  • 很简明,第一步创建,XADataSource,第二步给它设置属性(包含数据的连接,用户名密码等),然后返回。

Narayana 初始化过程详解

我们首先进入org.apache.shardingsphere.transaction.xa.narayana.manager.NarayanaXATransactionManager

public final class NarayanaXATransactionManager implements XATransactionManager {    //加载transactionManger    private final TransactionManager transactionManager = jtaPropertyManager.getJTAEnvironmentBean().getTransactionManager();//获取事务恢复模块    private final XARecoveryModule xaRecoveryModule = XARecoveryModule.getRegisteredXARecoveryModule();    private final RecoveryManagerService recoveryManagerService = new RecoveryManagerService();    @Override    public void init() {        RecoveryManager.delayRecoveryManagerThread();        recoveryManagerService.create();//开启事务恢复        recoveryManagerService.start();    }    @Override    public void registerRecoveryResource(final String dataSourceName, final XADataSource xaDataSource) {        xaRecoveryModule.addXAResourceRecoveryHelper(new DataSourceXAResourceRecoveryHelper(xaDataSource));    }    @Override    public void removeRecoveryResource(final String dataSourceName, final XADataSource xaDataSource) {        xaRecoveryModule.removeXAResourceRecoveryHelper(new DataSourceXAResourceRecoveryHelper(xaDataSource));    }    @SneakyThrows({SystemException.class, RollbackException.class})    @Override    public void enlistResource(final SingleXAResource singleXAResource) {        transactionManager.getTransaction().enlistResource(singleXAResource.getDelegate());    }    @Override    public TransactionManager getTransactionManager() {        return transactionManager;    }    @Override    public void close() throws Exception {        recoveryManagerService.stop();        recoveryManagerService.destroy();    }}
复制代码

  • 首先我们关注jtaPropertyManager.getJTAEnvironmentBean().getTransactionManager()获取 TransactionManager,这是整个 Narayana 初始化的核心。进入代码 com.arjuna.common.internal.util.propertyservice.BeanPopulator.getNamedInstance()。

private static <T> T getNamedInstance(Class<T> beanClass, String name, Properties properties) throws RuntimeException {        StringBuilder sb = new StringBuilder().append(beanClass.getName());        if (name != null)           sb.append(":").append(name);        String key = sb.toString();        // we don't mind sometimes instantiating the bean multiple times,        // as long as the duplicates never escape into the outside world.        if(!beanInstances.containsKey(key)) {            T bean = null;            try {               // 初始化 JTAEnvironmentBean 这个类                bean = beanClass.newInstance();                if (properties != null) {                    configureFromProperties(bean, name, properties);                } else {                    //初始化属性配置                    Properties defaultProperties = PropertiesFactory.getDefaultProperties();                    configureFromProperties(bean, name, defaultProperties);                }            } catch (Throwable e) {                throw new RuntimeException(e);            }            beanInstances.putIfAbsent(key, bean);        }        return (T) beanInstances.get(key);    }
复制代码

  • 我们重点关注 Properties defaultProperties = PropertiesFactory.getDefaultProperties(); 。最后会进入com.arjuna.common.util.propertyservice.AbstractPropertiesFactory.getPropertiesFromFile()。

 public Properties getPropertiesFromFile(String propertyFileName, ClassLoader classLoader) {        String propertiesSourceUri = null;        try        {            // 文件名称为:jbossts-properties.xml 加载顺序为:This is the point where the search path is applied - user.dir (pwd), user.home, java.home, classpath            propertiesSourceUri = com.arjuna.common.util.propertyservice.FileLocator.locateFile(propertyFileName, classLoader);        }        catch(FileNotFoundException fileNotFoundException)        {            // try falling back to a default file built into the .jar            // Note the default- prefix on the name, to avoid finding it from the .jar at the previous stage            // in cases where the .jar comes before the etc dir on the classpath.            URL url = AbstractPropertiesFactory.class.getResource("/default-"+propertyFileName);            if(url == null) {            commonLogger.i18NLogger.warn_could_not_find_config_file(url);            } else {                propertiesSourceUri = url.toString();            }        }        catch (IOException e)        {            throw new RuntimeException("invalid property file "+propertiesSourceUri, e);        }        Properties properties = null;        try {            if (propertiesSourceUri != null) {               //加载配置文件                properties = loadFromFile(propertiesSourceUri);            }            // 叠加系统配置属性            properties = applySystemProperties(properties);        } catch(Exception e) {            throw new RuntimeException("unable to load properties from "+propertiesSourceUri, e);        }        return properties;    }
复制代码

  • 加载文件名称为 jbossts-properties.xml, 加载路径优先级别为 :user.dir > user.home >java.home >classpath。最后再叠加上系统属性,然后返回。

我们再来看一下 jbossts-properties.xml 的参考格式如下:

<properties>    <entry key="CoordinatorEnvironmentBean.commitOnePhase">YES</entry>    <entry key="ObjectStoreEnvironmentBean.objectStoreType">com.arjuna.ats.internal.arjuna.objectstore.jdbc.JDBCStore</entry>    <entry key="ObjectStoreEnvironmentBean.jdbcAccess">com.arjuna.ats.internal.arjuna.objectstore.jdbc.accessors.DynamicDataSourceJDBCAccess;ClassName=com.mysql.jdbc.jdbc2.optional.MysqlDataSource;DatabaseName=jbossts;ServerName=172.25.4.62;PortNumber=3306;User=j_jbossts;Password=9MfNHoRncCi8</entry>    <entry key="ObjectStoreEnvironmentBean.tablePrefix">Action</entry>    <entry key="ObjectStoreEnvironmentBean.dropTable">true</entry>    <entry key="ObjectStoreEnvironmentBean.stateStore.objectStoreType">com.arjuna.ats.internal.arjuna.objectstore.jdbc.JDBCStore</entry>    <entry key="ObjectStoreEnvironmentBean.stateStore.jdbcAccess">com.arjuna.ats.internal.arjuna.objectstore.jdbc.accessors.DynamicDataSourceJDBCAccess;ClassName=com.mysql.jdbc.jdbc2.optional.MysqlDataSource;DatabaseName=jbossts;ServerName=172.25.4.62;PortNumber=3306;User=j_jbossts;Password=9MfNHoRncCi8</entry>    <entry key="ObjectStoreEnvironmentBean.stateStore.tablePrefix">stateStore</entry>    <entry key="ObjectStoreEnvironmentBean.stateStore.dropTable">true</entry>    <entry key="ObjectStoreEnvironmentBean.communicationStore.objectStoreType">com.arjuna.ats.internal.arjuna.objectstore.jdbc.JDBCStore</entry>    <entry key="ObjectStoreEnvironmentBean.communicationStore.jdbcAccess">com.arjuna.ats.internal.arjuna.objectstore.jdbc.accessors.DynamicDataSourceJDBCAccess;ClassName=com.mysql.jdbc.jdbc2.optional.MysqlDataSource;DatabaseName=jbossts;ServerName=172.25.4.62;PortNumber=3306;User=j_jbossts;Password=9MfNHoRncCi8</entry>    <entry key="ObjectStoreEnvironmentBean.communicationStore.tablePrefix">Communication</entry>    <entry key="ObjectStoreEnvironmentBean.communicationStore.dropTable">true</entry>    <entry key="ObjectStoreEnvironmentBean.transactionSync">ON</entry>    <entry key="CoreEnvironmentBean.nodeIdentifier">1</entry>    <entry key="JTAEnvironmentBean.xaRecoveryNodes">1</entry>    <entry key="JTAEnvironmentBean.xaResourceOrphanFilterClassNames">        com.arjuna.ats.internal.jta.recovery.arjunacore.JTATransactionLogXAResourceOrphanFilter        com.arjuna.ats.internal.jta.recovery.arjunacore.JTANodeNameXAResourceOrphanFilter        com.arjuna.ats.internal.jta.recovery.arjunacore.JTAActionStatusServiceXAResourceOrphanFilter    </entry>    <entry key="CoreEnvironmentBean.socketProcessIdPort">0</entry>    <entry key="RecoveryEnvironmentBean.recoveryModuleClassNames">        com.arjuna.ats.internal.arjuna.recovery.AtomicActionRecoveryModule        com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule    </entry>    <entry key="RecoveryEnvironmentBean.expiryScannerClassNames">        com.arjuna.ats.internal.arjuna.recovery.ExpiredTransactionStatusManagerScanner    </entry>    <entry key="RecoveryEnvironmentBean.recoveryPort">4712</entry>    <entry key="RecoveryEnvironmentBean.recoveryAddress"></entry>    <entry key="RecoveryEnvironmentBean.transactionStatusManagerPort">0</entry>    <entry key="RecoveryEnvironmentBean.transactionStatusManagerAddress"></entry>    <entry key="RecoveryEnvironmentBean.recoveryListener">NO</entry>    <entry key="RecoveryEnvironmentBean.recoveryBackoffPeriod">1</entry></properties>
复制代码

它被视为标准 java.util.Properties 文件的 XML 格式并按需加载。entry 名称的形式为:类名.属性名。提供的配置类都在com.arjuna.ats.arjuna.common包下,以 bean 结尾的实体类。

  • 文件加载后,它会被缓存,直到 JVM 重新启动才重新读取。对属性文件的更改需要重新启动才能生效

  • 在属性加载之后,将检查 EnvironmentBean,对于每个字段,如果属性在搜索顺序中包含如下匹配的键,则使用属性的值调用该字段的 setter 方法,或者使用不同的系统属性调用该字段的 setter 方法。

  • 然后将 bean 返回给调用者,调用者可以通过调用 setter 方法进一步覆盖值。

我们返回主线:现在已经加载了配置。接下来就是执行configureFromProperties(bean, name, defaultProperties); 。就是利用反射机制初始化对象,以及给对象的属性赋值。代码如下:

public static void configureFromProperties(Object bean, String instanceName, Properties properties) throws Exception {       for(Field field : bean.getClass().getDeclaredFields()) {            Class type = field.getType();            String setterMethodName = "set"+capitalizeFirstLetter(field.getName());            Method setter;            try {                setter = bean.getClass().getMethod(setterMethodName, new Class[] {field.getType()});            } catch(NoSuchMethodException e) {                continue; // emma code coverage tool adds fields to instrumented classes - ignore them.            }            String getterMethodName;            Method getter = null;            if(field.getType().equals(Boolean.TYPE)) {                getterMethodName = "is"+capitalizeFirstLetter(field.getName());                try {                    getter = bean.getClass().getMethod(getterMethodName, new Class[] {});                } catch (NoSuchMethodException e) {}            }            if(getter == null) {                getterMethodName = "get"+capitalizeFirstLetter(field.getName());                getter = bean.getClass().getMethod(getterMethodName, new Class[] {});            }            if(field.isAnnotationPresent(ConcatenationPrefix.class) || field.getType().getName().startsWith("java.util")) {                handleGroupProperty(bean, instanceName, properties, field, setter, getter);            } else {                handleSimpleProperty(bean, instanceName, properties, field, setter, getter);            }        }    }
复制代码

我们在回到 NarayanaXATransactionManager,分析 XARecoveryModule.getRegisteredXARecoveryModule();代码如下 :

    public static XARecoveryModule getRegisteredXARecoveryModule () {         if (registeredXARecoveryModule == null) {//获取事务恢复manager            RecoveryManager recMan = RecoveryManager.manager();            Vector recoveryModules = recMan.getModules();            if (recoveryModules != null) {                Enumeration modules = recoveryModules.elements();                while (modules.hasMoreElements()) {                    RecoveryModule m = (RecoveryModule) modules.nextElement();                    if (m instanceof XARecoveryModule) {                        registeredXARecoveryModule = (XARecoveryModule) m;                        break;                    }                }            }        }        return registeredXARecoveryModule;    }
复制代码

  • 重点关注获取RecoveryManager.manager();, 最后会进入com.arjuna.ats.internal.arjuna.recovery.RecoveryManagerImple的构造方法,代码如下:

       //省略了相关无用代码      // start the activator recovery loader 加载事务恢复        _recActivatorLoader = new RecActivatorLoader();        _recActivatorLoader.startRecoveryActivators();        // start the periodic recovery thread        // (don't start this until just about to go on to the other stuff)         //进行初始化        _periodicRecovery = new PeriodicRecovery(threaded, useListener);        /*         * Start the expiry scanner         *         * This has to happen after initiating periodic recovery, because periodic recovery registers record types used         * by the expiry scanner         */        ExpiredEntryMonitor.startUp();
复制代码

  • 重点关注 new PeriodicRecovery(threaded, useListener);,会进行恢复模块的加载,最后会进入com.arjuna.ats.internal.arjuna.recovery.AtomicActionRecoveryModule 的构造方法。

 public AtomicActionRecoveryModule()   {       if (tsLogger.logger.isDebugEnabled()) {           tsLogger.logger.debug("AtomicActionRecoveryModule created");       }      if (_recoveryStore == null)      {         _recoveryStore = StoreManager.getRecoveryStore();      }      _transactionStatusConnectionMgr = new TransactionStatusConnectionManager() ;   }
复制代码

  • StoreManager.getRecoveryStore(); ,最后会进入com.arjuna.ats.arjuna.objectstore.StoreManager.initStore(),进入事务日志的初始化。代码如下:

private static final ObjectStoreAPI initStore(String name)    {        ObjectStoreEnvironmentBean storeEnvBean = BeanPopulator.getNamedInstance(ObjectStoreEnvironmentBean.class, name);//获取事务存储类型,支持的类名,默认使用 ShadowNoFileLockStore 来存储      String storeType = storeEnvBean.getObjectStoreType();        ObjectStoreAPI store;        try        {//进行SPI初始化加载            store = ClassloadingUtility.loadAndInstantiateClass(ObjectStoreAPI.class, storeType, name);        }        catch (final Throwable ex)        {            throw new FatalError(tsLogger.i18NLogger.get_StoreManager_invalidtype() + " " + storeType, ex);        }        //进行初始化        store.start();        return store;    }
复制代码

  • 整个方法是比较清楚的,首先获取事务日志存储的类型(默认使用 file 模式),然后进行 SPI 初始化加载,最后再初始化。

  • storeType 这里如果配置的是 com.arjuna.ats.internal.arjuna.objectstore.jdbc.JDBCStore,那么就会进入这个类的构造方法,来进行初始化。代码如下:

//省略无关代码 try {                StringTokenizer stringTokenizer = new StringTokenizer(connectionDetails, ";");     //初始化jdbcAccess ,用来初始化                JDBCAccess jdbcAccess = (JDBCAccess) Class.forName(stringTokenizer.nextToken()).newInstance();//进行jdbc连接,datasource的初始化                jdbcAccess.initialise(stringTokenizer);                _storeName = jdbcAccess.getClass().getName() + ":" + tableName;                Connection connection = jdbcAccess.getConnection();                String name;                int major;                int minor;                try {                    DatabaseMetaData md = connection.getMetaData();                    name = md.getDriverName();                    major = md.getDriverMajorVersion();                    minor = md.getDriverMinorVersion();                } finally {                    connection.close();                }                /*                 * Check for spaces in the name - our implementation classes are                 * always just the first part of such names.                 */                int index = name.indexOf(' ');                if (index != -1)                    name = name.substring(0, index);                name = name.replaceAll("-", "_");                name = name.toLowerCase();                final String packagePrefix = JDBCStore.class.getName().substring(0, JDBCStore.class.getName().lastIndexOf('.')) + ".drivers.";                Class jdbcImpleClass = null;                try {                    jdbcImpleClass = Class.forName(packagePrefix + name + "_" + major + "_" + minor + "_driver");                } catch (final ClassNotFoundException cnfe) {                    try {                        jdbcImpleClass = Class.forName(packagePrefix + name + "_" + major + "_driver");                    } catch (final ClassNotFoundException cnfe2) {                        jdbcImpleClass = Class.forName(packagePrefix + name + "_driver");                    }                }                _theImple = (com.arjuna.ats.internal.arjuna.objectstore.jdbc.JDBCImple_driver) jdbcImpleClass.newInstance();                //使用不同的数据库类型来初始化                _theImple.initialise(jdbcAccess, tableName, jdbcStoreEnvironmentBean);                imples.put(key, _theImple);                storeNames.put(key, _storeName);            } catch (Exception e) {                tsLogger.i18NLogger.fatal_objectstore_JDBCStore_2(_storeName, e);                throw new ObjectStoreException(e);            }        }
复制代码

  • 这个方法还是比较清晰的,根据我们的 jdbc 的配置,首先初始化连接信息。然后获取连接,然后根据不同的数据库类型,来进行初始化。我们来关心下_theImple.initialise(jdbcAccess, tableName, jdbcStoreEnvironmentBean);。代码如下:

public void initialise(final JDBCAccess jdbcAccess, String tableName,            ObjectStoreEnvironmentBean jdbcStoreEnvironmentBean)            throws SQLException, NamingException {        this.jdbcAccess = jdbcAccess;        try (Connection connection = jdbcAccess.getConnection()) {            try (Statement stmt = connection.createStatement()) {                 // table [type, object UID, format, blob]  //初始化是否是否需要删除表                   if (jdbcStoreEnvironmentBean.getDropTable()) {                    try {                        stmt.executeUpdate("DROP TABLE " + tableName);                    } catch (SQLException ex) {                        checkDropTableException(connection, ex);                    }                }        //是否需要创建表                if (jdbcStoreEnvironmentBean.getCreateTable()) {                    try {                        createTable(stmt, tableName);                    } catch (SQLException ex) {                        checkCreateTableError(ex);                    }                }                // This can be the case when triggering via EmptyObjectStore                if (!connection.getAutoCommit()) {                    connection.commit();                }            }        }        this.tableName = tableName;    }
复制代码

  • 框架会自动的创建事务日志表来进行存储,所以我们不需要手动创建,也不要惊讶这个表是从哪里来的。创建的表的代码如下:

protected void createTable(Statement stmt, String tableName)            throws SQLException {        String statement = "CREATE TABLE "                + tableName                + " (StateType INTEGER NOT NULL, Hidden INTEGER NOT NULL, "                + "TypeName VARCHAR(255) NOT NULL, UidString VARCHAR(255) NOT NULL, ObjectState "                + getObjectStateSQLType()                + ", PRIMARY KEY(UidString, TypeName, StateType))";        stmt.executeUpdate(statement);    }
复制代码

  • 我们在回到主线 PeriodicRecovery,这个类是继承 Thread,调用 start 就会执行 run 方法,他会对控制需要进行恢复的事务线程,真的当前的事务状态进行处理,到底是阻塞,还是唤醒。

  • 初始化流程中,还有一步是进行事务恢复的,这个我们在后续的章节,单独拿出来进行讲解。

NarayanaXA 分布式事务 begin 流程

我们知道,本地的事务,都会有一个 trainsaction.begin, 对应 XA 分布式事务来说也不另外,我们再把思路切换回XAShardingTransactionManager.begin(), 会调用com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.begin() 方法。代码如下:

        //检查事务状态        checkTransactionState();        //获取超时配置,超时很重要        Iteger value = _timeouts.get();        int v = 0; // if not set then assume 0. What else can we do?        if (value != null)        {            v = value.intValue();        }        else            v = TxControl.getDefaultTimeout();        // TODO set default timeout                //初始化事务实现        TransactionImple.putTransaction(new TransactionImple(v));
复制代码

  • 初始化流程主要就是检查事务状态,获取超时时间,最后也是最重要的创建事务实现。new TransactionImple(v)。我们进入该类的构造方法,代码如下:

public TransactionImple(int timeout)    {//创建事务执行action        _theTransaction = new AtomicAction();//开启事务        _theTransaction.begin(timeout);        _resources = new Hashtable();        _duplicateResources = new Hashtable();        _suspendCount = 0;        _xaTransactionTimeoutEnabled = getXATransactionTimeoutEnabled();        _txLocalResources = Collections.synchronizedMap(new HashMap());    }
复制代码

  • 这里面最重要是 2 步,第一步是初始化 AtomicAction,第二步是 AtomicAction.begin()。我们先来看 new AtomicAction。会对相关的父类,进行初始化。AtomicAction 的继承体系图为:

  • 我们接下来看com.arjuna.ats.arjuna.AtomicAction.begin()。代码如下:

public int begin (int timeout)    {               //进行start,最关键        int status = super.start();        if (status == ActionStatus.RUNNING)        {            /*             * Now do thread/action tracking.             *///放入threadlocal里面            ThreadActionData.pushAction(this);            _timeout = timeout;            if (_timeout == 0)                _timeout = TxControl.getDefaultTimeout();            if (_timeout > 0)        //设置事务超时控制,很重要                TransactionReaper.transactionReaper().insert(this, _timeout);        }        return status;    }
复制代码

  • 我们先来分析super.start()。最后会进入com.arjuna.ats.arjuna.coordinator.BasicAction.begin()。代码如下:

  //省略很多代码//进行action的一些初始化工作  actionInitialise(parentAct);
复制代码

XATransactionDataSource getConnection() 流程

我们都知道想要执行 SQL 语句,必须要获取到数据库的 connection。让我们再回到 XAShardingTransactionManager.getConnection() 最后会调用到org.apache.shardingsphere.transaction.xa.jta.datasourceXATransactionDataSource.getConnection()。流程图如下:

代码 :

 public Connection getConnection() throws SQLException, SystemException, RollbackException {      //先检查是否已经有存在的connection,这一步很关心,也是XA的关键,因为XA事务,必须在同一个connection        if (CONTAINER_DATASOURCE_NAMES.contains(dataSource.getClass().getSimpleName())) {            return dataSource.getConnection();        }      //获取数据库连接        Connection result = dataSource.getConnection();      //转成XAConnection,其实是同一个连接        XAConnection xaConnection = XAConnectionFactory.createXAConnection(databaseType, xaDataSource, result);      //获取JTA事务定义接口        Transaction transaction = xaTransactionManager.getTransactionManager().getTransaction();        if (!enlistedTransactions.get().contains(transaction)) {      //进行资源注册            transaction.enlistResource(new SingleXAResource(resourceName, xaConnection.getXAResource()));            transaction.registerSynchronization(new Synchronization() {                @Override                public void beforeCompletion() {                    enlistedTransactions.get().remove(transaction);                }                @Override                public void afterCompletion(final int status) {                    enlistedTransactions.get().clear();                }            });            enlistedTransactions.get().add(transaction);        }        return result;    }
复制代码

  • 首先第一步很关心,尤其是对 shardingsphere 来说,因为在一个事务里面,会有多个 SQL 语句,打到相同的数据库,所以对相同的数据库,必须获取同一个 XAConnection,这样才能进行 XA 事务的提交与回滚。

  • 我们接下来关心 transaction.enlistResource(new SingleXAResource(resourceName, xaConnection.getXAResource()));, 会进入com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImp.enlistResource(), 代码太长,截取一部分。

 // Pay attention now, this bit is hairy. We need to add a new AbstractRecord (XAResourceRecord)                        // to the BasicAction, which will thereafter drive its completion. However, the transaction                        // core is not directly XA aware, so it's our job to start the XAResource. Problem is, if                        // adding the record fails, BasicAction will never end the resource via the XAResourceRecord,                        // so we must do so directly.  start may fail due to dupl xid or other reason, and transactions                        // may rollback async, for which reasons we can't call add before start.                        // The xid will change on each pass of the loop, so we need to create a new record on each pass.                        // The add will fail in the case of multiple last resources being disallowed                        // see JBTM-362 and JBTM-363                        AbstractRecord abstractRecord = createRecord(xaRes, params, xid);                        if(abstractRecord != null) {                            xaRes.start(xid, xaStartNormal);                            if(_theTransaction.add(abstractRecord) == AddOutcome.AR_ADDED) {                                _resources.put(xaRes, new TxInfo(xid));                                return true; // dive out, no need to set associatedWork = true;                            } else {                                // we called start on the resource, but _theTransaction did not accept it.                                // we therefore have a mess which we must now clean up by ensuring the start is undone:                                abstractRecord.topLevelAbort();                            }                        }
复制代码

  • 哦多尅,看见了吗,各位,看见了 xaRes.start(xid, xaStartNormal); 了吗????,我们进去,假设我们使用的 Mysql 数据库:

 public void start(Xid xid, int flags) throws XAException {        StringBuilder commandBuf = new StringBuilder(300);        commandBuf.append("XA START ");        appendXid(commandBuf, xid);        switch(flags) {        case 0:            break;        case 2097152:            commandBuf.append(" JOIN");            break;        case 134217728:            commandBuf.append(" RESUME");            break;        default:            throw new XAException(-5);        }        this.dispatchCommand(commandBuf.toString());        this.underlyingConnection.setInGlobalTx(true);    }
复制代码

  • 组装XA start Xid SQL 语句,进行执行。

到这里,我们总结下,在获取数据库连接的时候,我们执行了 XA 协议接口中的 XA start xid

Narayana commit 流程源码分析

我们进入com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit() 方法,代码如下:

//获取当前事务    TransactionImple theTransaction = TransactionImple.getTransaction();        if (theTransaction == null)            throw new IllegalStateException(                    "BaseTransaction.commit - "                            + jtaLogger.i18NLogger.get_transaction_arjunacore_notx());                 //进行事务提交        theTransaction.commitAndDisassociate();
复制代码

  • 我们重点来关注theTransaction.commitAndDisassociate();,最后进入com.arjuna.ats.arjuna.AtomicAction.commit()代码如下:

public int commit (boolean report_heuristics)    {                 //进行事务提交        int status = super.end(report_heuristics);        /*         * Now remove this thread from the action state.         */               //清空数据        ThreadActionData.popAction();        TransactionReaper.transactionReaper().remove(this);        return status;    }
复制代码

  • 最后我们会进入com.arjuna.ats.arjuna.coordinator.BasicAction.End()方法,会首先判断是否能优化成一阶段提交,否则进行二阶段提交(二阶段提交还可以使用异步线程池方式)。代码如下:

 if (doOnePhase())            {                onePhaseCommit(reportHeuristics);                ActionManager.manager().remove(get_uid());            }            else            {                int prepareStatus = prepare(reportHeuristics);                if (prepareStatus == TwoPhaseOutcome.PREPARE_NOTOK                        || prepareStatus == TwoPhaseOutcome.ONE_PHASE_ERROR) {                    tsLogger.i18NLogger.warn_coordinator_BasicAction_36(get_uid());                    if (heuristicDecision != TwoPhaseOutcome.PREPARE_OK) {                        tsLogger.i18NLogger.warn_coordinator_BasicAction_37(TwoPhaseOutcome.stringForm(heuristicDecision));                    }                    tsLogger.i18NLogger.warn_coordinator_BasicAction_38();                    if (!reportHeuristics && TxControl.asyncCommit                            && (parentAction == null)) {                        TwoPhaseCommitThreadPool.submitJob(new AsyncCommit(this, false));                    } else                        phase2Abort(reportHeuristics); /* first phase failed */                }                else                {                    if (!reportHeuristics && TxControl.asyncCommit                            && (parentAction == null))                    {                        TwoPhaseCommitThreadPool.submitJob(new AsyncCommit(this, true));                    }                    else                        phase2Commit(reportHeuristics); /* first phase succeeded */                }            }        }
复制代码

一阶段提交

进入方法 onePhaseCommit, 最后会调用com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelOnePhaseCommit()。该方法首先会发起 XA end 语句,然后再执行 XA commit 语句。代码如下:

//省略相关代码//执行XA end语句 endAssociation(XAResource.TMSUCCESS, TxInfo.NOT_ASSOCIATED);//执行XA commit _theXAResource.commit(_tranID, true);
复制代码

二阶段提交

  • 首先会进行进入 prepare(reportHeuristics);, 最后会调用com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelPrepare()该方法首先会执行 XA end 语句,然后执行 XA prepare 语句。代码如下:

//省略相关代码//执行XA end语句 endAssociation(XAResource.TMSUCCESS, TxInfo.NOT_ASSOCIATED);//执行XA prepare theXAResource.prepare(_tranID)
复制代码

  • 接下来进行提交,进入方法 phase2Commit, 最后会调用com.arjuna.ats.internal.jta.resources.arjunacore.XAResourceRecord.topLevelCommit()。该方法会执行 XA commit 语句。代码如下:

//省略相关代码//执行XA commit _theXAResource.commit(_tranID, fase);
复制代码

Narayana 回滚流程

首先我们先切换回org.apache.shardingsphere.transaction.xa.XAShardingTransactionManager.rollback() 方法,然后会进入 com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.rollback() 方法,代码如下:

public void rollback() throws java.lang.IllegalStateException,            java.lang.SecurityException, javax.transaction.SystemException    {        if (jtaLogger.logger.isTraceEnabled()) {            jtaLogger.logger.trace("BaseTransaction.rollback");        }        TransactionImple theTransaction = TransactionImple.getTransaction();        if (theTransaction == null)            throw new IllegalStateException(                    "BaseTransaction.rollback - "                            + jtaLogger.i18NLogger.get_transaction_arjunacore_notx());        theTransaction.rollbackAndDisassociate();    }
复制代码

  • 代码最后后进入com.arjuna.ats.arjuna.coordinator.BasicAction.topLevelAbort()。代码如下:

//省略代码//先执行XA end 语句endAssociation(XAResource.TMFAIL, TxInfo.FAILED);//然后执行XA rollback_theXAResource.rollback(_tranID);
复制代码

  • 接下来就是清除换成,清除事务日志。代码如下:

       ActionManager.manager().remove(get_uid());        actionStatus = ActionStatus.ABORTED;        if (TxStats.enabled()) {            TxStats.getInstance().incrementAbortedTransactions();            if (applicationAbort)                TxStats.getInstance().incrementApplicationRollbacks();        }
复制代码

总结 :可以看到回滚流程会稍微毕竟简单。先执行 XA end 语句,然后执行 XA rollback 语句。

文章到此,已经写的很长很多了,我们分析了 ShardingSphere 对于 XA 方案,提供了一套 SPI 解决方案,对 Narayana 进行了整合,也分析了 Narayana 初始化流程,开始事务流程,获取连接流程,提交事务流程,回滚事务流程。下一篇文章,我们来详解 narayana 的事务恢复流程。

作者介绍:

肖宇,Apache ShardingSphere Committer,开源 hmily 分布式事务框架作者,开源 soul 网关作者,热爱开源,追求写优雅代码。目前就职于京东数科,参与 ShardingSphere 的开源建设,以及分布式数据库的研发工作。

本文转载自公众号 ShardingSphere 官微(ID:Sharding-Sphere)。

原文链接:

Shardingsphere整合Narayana对XA分布式事务的支持(4)