Change has accelerated in the past decade. Earlier, systems were deployed with the expectation that they would last forever. They were not designed to look at each other’s data, and were fairly limiting. Open source was a new idea in the early 2000s. People began to adopt Lucene, a software I had written. There was no institutional backing or publicity. Open source emerged as a tool for development.
A Distributing Computing Platform
Nutch started in 2003. Around 2005, Google published a paper on how they build search engines. They had a paper talking about how they had automated things. We started working on reworking Nutch in 2004. The tale of debugging is much longer. In 2006, I joined yahoo! I developed Hadoop. Hadoop was named after my son’s toy elephant. It was a distributing computing platform, based on Google’s ideas.
A group of people believed that Hadoop could be used much further. Together, they formed Cloudera. I joined Cloudera in 2009. Stepping back from my lesson in Hadoop, if you can increase the scale and focus on flexibility, you can permit them to store more data in raw form and experiment. They can innovate more quickly. The waterfall method inhibited process through data. This gave us a much more appropriate platform. Most of the past data was relational.
New sources of data are events, things recorded from sensors, etc. We need a different class of tools. Companies can run petabytes of data easily today. Software is also eating the world. In every industry, everywhere, the advances being made are predominantly using software. A company’s growth is fuelled more by data, today. The use of data is no longer isolated. It has emerged everywhere.
Challenges
この記事は DataQuest の November 2019 版に掲載されています。
7 日間の Magzter GOLD 無料トライアルを開始して、何千もの厳選されたプレミアム ストーリー、9,000 以上の雑誌や新聞にアクセスしてください。
すでに購読者です ? サインイン
この記事は DataQuest の November 2019 版に掲載されています。
7 日間の Magzter GOLD 無料トライアルを開始して、何千もの厳選されたプレミアム ストーリー、9,000 以上の雑誌や新聞にアクセスしてください。
すでに購読者です? サインイン
Cold-Pressed AI Juice - Is That Bottle Here? Is It Worth It?
Compressing AI models has been both an adventure and a formidable next-inflection-point in the many curves of AI innovation. Can we look for options better than, and beyond, erstwhile approaches like pruning and SLMs?
Indian Research: Far from a bouquet of ORCIDS yet. Why?
Indian brains are universally, and globally, applauded for their 'horse sense' - whether we look at our laser-sharp unicorns and wide-bracket start-ups or pride in the unshakeable global confidence placed for many decades in our IT industry. And yet, when it comes to top-drawer academic research, we are still considered by many as either a 'one horse town' or a 'one-trick pony'. Why this ever-widening gap against our global counterparts?
Accountability in the Age of AI
In this interview, Aayush Ghosh Choudhury, Co-Founder & CEO OF Scrut Automation shares insights on why clear accountability is essential when working with AI, how AI is transforming GRC practices, and the key risks organizations need to navigate. We also explore the advancements expected in the coming years and how organizations can strike a balance between AI adoption and compliance, ensuring responsible and ethical use of these powerful technologies.
Live On the Edge
How can companies leverage the combination of edge computing & AI to foster sustainability?
Technology and Fashion - The Vanilla Girl, without being Cheugy
Moving the needle in fashion- now that can go either way- between being too soft to being too flashy. Especially when it's about AI's copyright issues, personalisation, VR in design, Counterfeits, Quiet Fashion, Image recognition and carbon impact. Can an elastic CRM-fabric and data's new look help in threading the technology needle?
AI does not facilitate financial crime, it helps to fight it.
Why and where do AI models, SLMs, synthetic data and recommendation engines work as angels in areas when the devil is always in the details?
Multi-million and multi-year deals are back-both for first-timers and mature outsourcers
With IT budgets tightening and global uncertainties rising, multi-million, multi-year outsourcing deals are making a comeback.
The Big Five in a Technology Safari
Mobile banking, Blockchain, AI, IT Modernisation and? Wait, is Physical Banking the 5th one? Africa has, for long and quite-deservedly, been brave about exploring the wild forests of banking innovations and on-ground solutions that fit the region's limitations and untapped opportunities to the T. How do you make sure you stay gutsy, relevant and on the right track in such a region? How do you make IT your navigator when you want to be the top pan-African bank? Johnson Idesoh, Group Chief Information and Technology Officer at Absa Group takes us around and gives a peek on what customers here are actually hunting for.
India's Quantum Bet - the Dark Horse Who Eats Dark Chocolate
Or the Dark Matter? It's about the Quantum Race's Winning Gap. India could be the unexpected winner in quantum research, innovation and markets as long as we look beyond the QuBit game and fix real issues that still slow down the last lap. The action is happening, albeit invisible, till we see it shine in full glory.
Quantum Leap or Quantum Leap of Faith? Indian Industries Dive into Infinite Possibilities!
India is on the brink of a quantum leap, as industries from finance to healthcare begin to explore the transformative power of quantum computing. With the capability to perform calculations at speeds unimaginable with classical computers, quantum technology is not just a futuristic concept-it's becoming a practical tool for solving today's most pressing challenges and unlocking new opportunities for growth.
