Articles

The latest in Cleareye.ai news and industry updates.

Building the team for your next AI initiative

The time to invest on a AL/ML initiative is now. Recent surveys indicate the pandemic has caused companies to invest in new AI initiatives. On the other hand studies indicates many enterprises still struggle to operationalize the AI initiatives they have started. Other than the data quality challenges, the one major reason for this struggle is most companies don’t have the right team composition or the right objectives set for the teams to take the models to production.

Planning upfront for the right team composition with complementing skills and setting the objectives are critical for a successful rollout of an AI initiative and better ROI

As a new AI initiative is kicked off, the first resources to come on board will be your data scientists / ML engineers along with the business teams to explain the data and the context. Most initiatives start small. The initial objective of this team will be to prove a hypothesis with a limited set of data to explore and build the initial models.

The first challenge the team will face after the hypothesis validation is on how to train on a massive production data set. Now the data is no longer a CSV export, to which feature engineering can be applied, and models can be fit in a single machine.

Data pipeline architectures to be defined for data delivery, and greater scalability. The infrastructure required for optimal extraction, transformation, and loading of data to be defined. Data pipelines ensure the right data is made available to the models. Parallel data processing and distributed training need to be addressed. You need the Data Engineer in your team to do the heavy lifting.

Bring your Data Engineers to the team right from the beginning. Data engineering skills can effectively utilize the network, storage, and compute resources.

Loosely Coupled Architecture lets the team work independently and deliver value. Solution Architects should ensure modularity in the ML systems. Solution architects work at the intersection of multiple disciplines and they have to be great communicators and with people skills.

For ML engagements along with your CodeData and Model need to be versioned, monitored, reproducibility to be ensured, and ML-workflow steps are automated.

Onboard MLOps engineer from get go to set the principles of operations.

Data versioning includes your Data preparation pipelines, Features store, Datasets, Metadata. Model Versioning includes ML model training pipeline, ML model (object), Hyperparameters, Experiment tracking. Reproducibility to be ensured by MLOps team that the same ‘hyper tuning’ parameters are applied to your production models. Plan for the new monitoring needs. There will be data distribution changes (training vs. serving data), measuring the model drifting, computational performance of the model.

ML initiatives involve a lot of experimentation and development. Plan for tracking, automating, and monitoring your experiments well ahead. Invest time on Governance and Security early in cycle

As stated from ML-Ops.org, make sure to set your guidelines around tests for features and datatests for model development, and tests for ML infrastructure.

QA Engineers doesn’t need to be experts in algorithms. But it is important to understand feature importance and correlation of features in the business context. Create test scenarios to measure the inference score while adding new features or dropping new features. Model metrics like RMSE are important, but QA Engineers plan to correlate with business metrics on the impact of a prediction, like % reduction in false positives, etc. Automated testing for end to end ML Pipeline to be planned as part of quality assurance.

Learn More

About the Author

Chandrasekhar Somasekhar is the Chief Architect at Cleareye.ai. He is responsible for product development, strategic technology direction, implementing and governing solution architecture methodologies at Cleareye.ai. Chandra defines and governs the enterprise solution architecture strategy. Additionally, he provides architectural direction. He is passionate about developing, mentoring, and motivating a high-performance team.

More Articles

Hi Mariya, welcome to this chat! Tell us about your journey through the years…we’d love to hear about the story behind Cleareye.ai… I was born into a business family in the southern tip of India – Kerala, which is also…

The time to invest on a AL/ML initiative is now. Recent surveys indicate the pandemic has caused companies to invest in new AI initiatives. On the other hand studies indicates many enterprises still struggle to operationalize the AI initiatives they…

Tell us a little about yourself Sarath…we’d love to hear about your role, a typical day at work? Well, let me start by saying that I’m an entrepreneur first then a COO. Being an entrepreneur can give you joy and stress and…

Around The Coin: Interview with Mariya George, Co-founder & President of Cleareye.ai In this episode, Faisal Khan sits down with Mariya George, the Co-founder and President at Cleareye.ai, a leading fintech platform transforming banks into hyper-agile organizations using advanced AI…

When’s the last time you visited a bank? Financial transactions used to take place on premise. From deposits and withdrawals to thousands of other mundane and complex financial transactions the average person makes, it either happened in person or it…

Fraud and money laundering is an ongoing problem in the United States, and it is getting worse as the years go on. A report released by the US Government Accountability Office (GAO) suggests that tougher regulations in the financial sector…

2020 was a challenging year, and it wreaked havoc on the state of trade finance. The COVID pandemic, fraud scandals, and allegations were just part of what put the market in such dire straits. But 2021 is providing a new…

“If lenders don’t invest in robust technology solutions for managing the coming onslaught of loan applications, they risk, at best, falling behind other lenders and, at worst, mismanaging loans and applications when they do come in.” Much needed relief is…

Trading of goods in international market is complex and fraught with risks and uncertainties. Transactions are made between entities in distant countries and there is often a trust deficit between sellers and buyers. And this is why risk-mitigating trade finance products…

For the past few months, America has been waiting for a new COVID relief package. On Dec. 20, negotiators finally agreed upon a $900 billion package with $320 billion going towards the PPP (Paycheck Protection Program) for small business. The…

In The News

The very latest in Cleareye.ai news.