亚洲乱码中文字幕综合,中国熟女仑乱hd,亚洲精品乱拍国产一区二区三区,一本大道卡一卡二卡三乱码全集资源,又粗又黄又硬又爽的免费视频

PowerJob的AbstractScriptProcessor實(shí)現(xiàn)類工作流程源碼解讀

 更新時間:2024年01月04日 09:39:51   作者:codecraft  
這篇文章主要為大家介紹了PowerJob的AbstractScriptProcessor源碼流程解讀,有需要的朋友可以借鑒參考下,希望能夠有所幫助,祝大家多多進(jìn)步,早日升職加薪

本文主要研究一下PowerJob的AbstractScriptProcessor

AbstractScriptProcessor

tech/powerjob/official/processors/impl/script/AbstractScriptProcessor.java

@Slf4j
public abstract class AbstractScriptProcessor extends CommonBasicProcessor {
    private static final ForkJoinPool POOL = new ForkJoinPool(4 * Runtime.getRuntime().availableProcessors());
    private static final Set<String> DOWNLOAD_PROTOCOL = Sets.newHashSet("http", "https", "ftp");
    protected static final String SH_SHELL = "/bin/sh";
    protected static final String CMD_SHELL = "cmd.exe";
    private static final String WORKER_DIR = PowerFileUtils.workspace() + "/official_script_processor/";
    @Override
    protected ProcessResult process0(TaskContext context) throws Exception {
        OmsLogger omsLogger = context.getOmsLogger();
        String scriptParams = CommonUtils.parseParams(context);
        omsLogger.info("[SYSTEM] ScriptProcessor start to process, params: {}", scriptParams);
        if (scriptParams == null) {
            String message = "[SYSTEM] ScriptParams is null, please check jobParam configuration.";
            omsLogger.warn(message);
            return new ProcessResult(false, message);
        }
        String scriptPath = prepareScriptFile(context.getInstanceId(), scriptParams);
        omsLogger.info("[SYSTEM] Generate executable file successfully, path: {}", scriptPath);
        if (SystemUtils.IS_OS_WINDOWS) {
            if (StringUtils.equals(getRunCommand(), SH_SHELL)) {
                String message = String.format("[SYSTEM] Current OS is %s where shell scripts cannot run.", SystemUtils.OS_NAME);
                omsLogger.warn(message);
                return new ProcessResult(false, message);
            }
        }
        // 授權(quán)
        if  ( !SystemUtils.IS_OS_WINDOWS) {
            ProcessBuilder chmodPb = new ProcessBuilder("/bin/chmod", "755", scriptPath);
            // 等待返回,這里不可能導(dǎo)致死鎖(shell產(chǎn)生大量數(shù)據(jù)可能導(dǎo)致死鎖)
            chmodPb.start().waitFor();
            omsLogger.info("[SYSTEM] chmod 755 authorization complete, ready to start execution~");
        }
        // 2. 執(zhí)行目標(biāo)腳本
        ProcessBuilder pb = StringUtils.equals(getRunCommand(), CMD_SHELL) ?
                new ProcessBuilder(getRunCommand(), "/c", scriptPath)
                : new ProcessBuilder(getRunCommand(), scriptPath);
        Process process = pb.start();
        StringBuilder inputBuilder = new StringBuilder();
        StringBuilder errorBuilder = new StringBuilder();
        boolean success = true;
        String result;
        final Charset charset = getCharset();
        try (InputStream is = process.getInputStream(); InputStream es = process.getErrorStream()) {
            POOL.execute(() -> copyStream(is, inputBuilder, omsLogger, charset));
            POOL.execute(() -> copyStream(es, errorBuilder, omsLogger, charset));
            success = process.waitFor() == 0;
        } catch (InterruptedException ie) {
            omsLogger.info("[SYSTEM] ScriptProcessor has been interrupted");
        } finally {
            result = String.format("[INPUT]: %s;[ERROR]: %s", inputBuilder.toString(), errorBuilder.toString());
        }
        return new ProcessResult(success, result);
    }
    /**
     * 生成腳本名稱
     * @param instanceId id of instance
     * @return 文件名稱
     */
    protected abstract String getScriptName(Long instanceId);
    /**
     * 獲取運(yùn)行命令(eg,shell返回 /bin/sh)
     * @return 執(zhí)行腳本的命令
     */
    protected abstract String getRunCommand();
    //......
}
AbstractScriptProcessor繼承了CommonBasicProcessor,它定義了一個parallelism為4*Runtime.getRuntime().availableProcessors()的ForkJoinPool;其process0方法先讀取scriptParams,然后執(zhí)行prepareScriptFile獲取scriptPath,接著使用chmod變更script權(quán)限為755,然后通過getRunCommand獲取命令,接著往pool提交copyStream,等待process返回

prepareScriptFile

private String prepareScriptFile(Long instanceId, String processorInfo) throws IOException {
        String scriptPath = WORKER_DIR + getScriptName(instanceId);
        File script = new File(scriptPath);
        if (script.exists()) {
            return scriptPath;
        }
        File dir = new File(script.getParent());
        boolean success = dir.mkdirs();
        success = script.createNewFile();
        if (!success) {
            throw new RuntimeException("create script file failed");
        }

        // 如果是下載鏈接,則從網(wǎng)絡(luò)獲取
        for (String protocol : DOWNLOAD_PROTOCOL) {
            if (processorInfo.startsWith(protocol)) {
                FileUtils.copyURLToFile(new URL(processorInfo), script, 5000, 300000);
                return scriptPath;
            }
        }

        final Charset charset = getCharset();

        if(charset != null)
        {
            try (Writer fstream = new OutputStreamWriter(Files.newOutputStream(script.toPath()), charset); BufferedWriter out = new BufferedWriter(fstream)) {
                out.write(processorInfo);
                out.flush();
            }
        }
        else {
            try (FileWriter fw = new FileWriter(script); BufferedWriter bw = new BufferedWriter(fw)) {
                bw.write(processorInfo);
                bw.flush();
            }
        }
        return scriptPath;
    }
prepareScriptFile先通過getScriptName獲取scriptPath,如果是http、https、ftp鏈接則通過FileUtils.copyURLToFile下載,否則把scriptParams寫入到scriptPath

copyStream

private static void copyStream(InputStream is, StringBuilder sb, OmsLogger omsLogger, Charset charset) {
        String line;
        try (BufferedReader br = new BufferedReader(new InputStreamReader(is, charset))) {
            while ((line = br.readLine()) != null) {
                sb.append(line);
                // 同步到在線日志
                omsLogger.info(line);
            }
        } catch (Exception e) {
            log.warn("[ScriptProcessor] copyStream failed.", e);
            omsLogger.warn("[SYSTEM] copyStream failed.", e);

            sb.append("Exception: ").append(e);
        }
    }
copyStream會讀取InputStream到StringBuilder,同時打印到omsLogger

ShellProcessor

tech/powerjob/official/processors/impl/script/ShellProcessor.java

public class ShellProcessor extends AbstractScriptProcessor {
    @Override
    protected String getScriptName(Long instanceId) {
        return String.format("shell_%d.sh", instanceId);
    }
    @Override
    protected String getRunCommand() {
        return SH_SHELL;
    }
}
ShellProcessor的getScriptName是基于shell_%d.sh和instanceId生成的;其getRunCommand為/bin/sh

CMDProcessor

tech/powerjob/official/processors/impl/script/CMDProcessor.java

public class CMDProcessor extends AbstractScriptProcessor {
    @Override
    protected String getScriptName(Long instanceId) {
        return String.format("cmd_%d.bat", instanceId);
    }
    @Override
    protected String getRunCommand() {
        return "cmd.exe";
    }
    @Override
    protected Charset getCharset() {
        return Charset.defaultCharset();
    }
}
CMDProcessor的getScriptName是基于cmd_%d.bat和instanceId生成,其getRunCommand為`cmd.exe

PowerShellProcessor

tech/powerjob/official/processors/impl/script/PowerShellProcessor.java

public class PowerShellProcessor extends AbstractScriptProcessor {

    @Override
    protected String getScriptName(Long instanceId) {
        return String.format("powershell_%d.ps1", instanceId);
    }

    @Override
    protected String getRunCommand() {
        return "powershell.exe";
    }

    @Override
    protected Charset getCharset() {
        return Charset.defaultCharset();
    }
}
PowerShellProcessor的getScriptName是基于powershell_%d.ps1"和instanceId生成,其getRunCommand為powershell.exe

PythonProcessor

tech/powerjob/official/processors/impl/script/PythonProcessor.java

public class PythonProcessor extends AbstractScriptProcessor {

    @Override
    protected String getScriptName(Long instanceId) {
        return String.format("python_%d.py", instanceId);
    }

    @Override
    protected String getRunCommand() {
        return "python";
    }
}
PythonProcessor的getScriptName是基于python_%d.py和instanceId生成,其getRunCommand為python

小結(jié)

AbstractScriptProcessor繼承了CommonBasicProcessor,它有四個實(shí)現(xiàn)類分別是ShellProcessor、CMDProcessor、PowerShellProcessor、PythonProcessor;它定義了getScriptName、getRunCommand抽象方法;其process0方法主要是把scriptParams寫入到本地文件(scriptParams是http、https、ftp的則根據(jù)url進(jìn)行下載),然后修改權(quán)限為755,然后執(zhí)行pb.start(),再將input及errorStream收集到StringBuilder并打印到omsLogger,最后process.waitFor()等待處理完成。

以上就是PowerJob的AbstractScriptProcessor方法工作流程源碼解讀的詳細(xì)內(nèi)容,更多關(guān)于PowerJob AbstractScriptProcessor的資料請關(guān)注腳本之家其它相關(guān)文章!

相關(guān)文章

最新評論