Connect with us

Technology

VMware demos ‘bare-metal’ performance from virtualized GPUs • The Register

The future of high-performance computing will be virtualized, VMware’s Uday Kurkure has told The Register.

Kurkure, the lead engineer for VMware’s performance engineering team, has spent the past five years working on ways to virtualize machine-learning workloads running on accelerators. Earlier this month his team reported “near or better than bare-metal performance” for Bidirectional Encoder Representations from Transformers (BERT) and Mask R-CNN — two popular machine-learning workloads — running on virtualized GPUs (vGPU) connected using Nvidia’s NVLink interconnect.

NVLink enables compute and memory resources to be shared across up to four GPUs over a high-bandwidth mesh fabric operating at 6.25GB/s per lane compared to PCIe 4.0’s 2.5GB/s. The interconnect enabled Kurkure’s team to pool 160GB of GPU memory from the Dell PowerEdge system’s four 40GB Nvidia A100 SXM GPUs.

“As the machine learning models get bigger and bigger, they don’t fit into the graphics memory of a single chip, so you need to use multiple GPUs,” he explained.

Support for NVLink in VMware’s vSphere is a relatively new addition. By toggling NVLink on and off in vSphere between tests, Kurkure was able to determine how large of an impact the interconnect had on performance.

And in what should be a surprise to no one, the large ML workloads ran faster, scaling linearly with additional GPUs, when NVLink was enabled.

Testing showed Mask R-CNN training running 15 percent faster in a twin GPU, NVLink configuration, and 18 percent faster when using all four A100s. The performance delta was even greater in the BERT natural language processing model, where the NVLink-enabled system performed 243 percent faster when running on all four GPUs.

What’s more, Kurkure says the virtualized GPUs were able to achieve the same or better performance compared to running the same workloads on bare metal.

“Now with NVLink being supported in vSphere, customers have the flexibility where they can combine multiple GPUs on the same host using NVLink so they can support bigger models, without a significant communication overhead,” Kurkure said.

HPC, enterprise implications

Based on the results of these tests, Kurkure expects most HPC workloads will be virtualized moving forward. The HPC community is always running into performance bottlenecks that leaves systems underutilized, he added, arguing that virtualization enables users to make much more efficient use of their systems.

Kurkure’s team was able to achieve performance comparable to bare metal while using just a fraction of the dual-socket system’s CPU resources.

“We were only using 16 logical cores out of 128 available,” he said. “You could use that CPU resources for other jobs without affecting your machine-learning intensive graphics modules. This is going to improve your utilization, and bring down the cost of your datacenter.”

A road leading up to a question mark in a cloud

Broadcom to buy VMware ‘on Thursday for $60 billion’

READ MORE

By toggling on and off NVLink between GPUs, additional platform flexibility can be achieved by enabling multiple isolated AI/ML workloads to be spread across the GPUs simultaneously.

“One of the key takeaways of this testing was that because of the improved utilization offered by vGPUs connected over a NVLink mesh network, VMware was able to achieve bare-metal-like performance while freeing idle resources for other workloads,” Kurkure said.

VMWare expects these results to improve resource utilization in several applications, including investment banking, pharmaceutical research, 3D CAD, and auto manufacturing. 3D CAD is a particularly high-demand area for HPC virtualization, according to Kurkure, who cited several customers looking to implement machine learning to assist with the design process.

And while it’s possible to run many of these workloads on GPUs in the cloud, he argued that cost and/or intellectual property rules may prevent them from doing so.

vGPU vs MIG

An important note is VMware’s tests were conducted using Nvidia’s vGPU Manager in vSphere as opposed to the hardware-level partitioning offered by multi-instance GPU (MIG) on the A100. MIG essentially allows the A100 to behave like up to seven less-powerful GPUs.

By comparison, vGPUs are defined in the hypervisor and are time-sliced. You can think of this as multitasking where the GPU rapidly cycles through each vGPU workload until they’re completed.

The benefit of vGPUs is users can scale well beyond seven GPU instances at the cost of potential overheads associated with rapid context switching, Kurkure explained. However, at least in his testing, the use of vGPUs didn’t appear to have a negative impact on performance compared to running on bare metal with the GPUs passed through to the VM.

Whether MIG would change this dynamic remains to be seen and is the subject of another ongoing investigation by Kurkure’s team. “It’s not clear when you should be using vGPU and when we should be running in MIG mode,” he said.

More to come

With vGPU with NVLink validated for scale-up workloads, VMware is now exploring options such as how these workloads scale across multiple systems and racks over RDMA over converged Ethernet (RoCE). Here, he says, networking becomes a major consideration.

“The natural extension of this is scale out,” he said. “So, we’ll have a number of hosted connected by RoCE.”

VMware is also investing how virtualized GPUs perform with even larger AI/ML models,

Kurkure’s team is also investigating how these architectures scale with even larger AI/ML, like GPT-3, as well as how they can be applied to telco workloads running at the edge. ®

Source link

Culture

Top 10 Florida Cities Dominate The Business Startup Landscape In The U.S.

Top 10 Florida Cities And Business Startup Landscape In The U.S.

The Voice Of EU | Florida emerges as a hub for entrepreneurial endeavors, with its vibrant business landscape and conducive environment for startups. Renowned for its low corporate tax rates and a high concentration of investors, the Sunshine State beckons aspiring entrepreneurs seeking fertile grounds to launch and grow their businesses.

In a recent report by WalletHub, Florida cities dominate the list of the top 10 best destinations for business startups, showcasing their resilience and economic vitality amidst challenging times.

From Orlando’s thriving market to Miami’s dynamic ecosystem, each city offers unique advantages and opportunities for entrepreneurial success. Let’s delve into the chronologically listed cities that exemplify Florida’s prominence in the business startup arena.

1. Orlando Leads the Way: Orlando emerges as the most attractive market in the U.S. for business startups, with a remarkable surge in small business establishments. WalletHub’s latest report highlights Orlando’s robust ecosystem, fostering the survival and growth of startups, buoyed by a high concentration of investors per capita.

2. Tampa Takes Second Place: Securing the second spot among large cities for business startups, Tampa boasts a favorable business environment attributed to its low corporate tax rates. The city’s ample investor presence further fortifies startups, providing essential resources for navigating the initial years of business operations.

3. Charlotte’s Diverse Industries: Claiming the third position, Charlotte stands out for its diverse industrial landscape and exceptionally low corporate taxes, enticing companies to reinvest capital. This conducive environment propels entrepreneurial endeavors, contributing to sustained economic growth.

4. Jacksonville’s Rising Profile: Jacksonville emerges as a promising destination for startups, bolstered by its favorable business climate. The city’s strategic positioning fosters entrepreneurial ventures, attracting aspiring business owners seeking growth opportunities.

5. Miami’s Entrepreneurial Hub: Miami solidifies its position as a thriving entrepreneurial hub, attracting businesses with its dynamic ecosystem and strategic location. The city’s vibrant startup culture and supportive infrastructure make it an appealing destination for ventures of all sizes.

6. Atlanta’s Economic Momentum: Atlanta’s ascent in the business startup landscape underscores its economic momentum and favorable business conditions. The city’s strategic advantages and conducive policies provide a fertile ground for entrepreneurial ventures to flourish.

7. Fort Worth’s Business-Friendly Environment: Fort Worth emerges as a prime destination for startups, offering a business-friendly environment characterized by low corporate taxes. The city’s supportive ecosystem and strategic initiatives facilitate the growth and success of new ventures.

8. Austin’s Innovation Hub: Austin cements its status as an innovation hub, attracting startups with its vibrant entrepreneurial community and progressive policies. The city’s robust infrastructure and access to capital foster a conducive environment for business growth and innovation.

9. Durham’s Emerging Entrepreneurship Scene: Durham’s burgeoning entrepreneurship scene positions it as a promising destination for startups, fueled by its supportive ecosystem and strategic initiatives. The city’s collaborative culture and access to resources contribute to the success of new ventures.

10. St. Petersburg’s Thriving Business Community: St. Petersburg rounds off the top 10 with its thriving business community and supportive ecosystem for startups. The city’s strategic advantages and favorable business climate make it an attractive destination for entrepreneurial endeavors.

Despite unprecedented challenges posed by the COVID-19 pandemic, the Great Resignation, and high inflation, these top Florida cities remain resilient and well-equipped to overcome obstacles, offering promising opportunities for business owners and entrepreneurs alike.


Continue Reading

Culture

European Startup Ecosystems Awash With Gulf Investment – Here Are Some Of The Top Investors

European Startup Ecosystem Getting Flooded With Gulf Investments

The Voice Of EU | In recent years, European entrepreneurs seeking capital infusion have widened their horizons beyond the traditional American investors, increasingly turning their gaze towards the lucrative investment landscape of the Gulf region. With substantial capital reservoirs nestled within sovereign wealth funds and corporate venture capital entities, Gulf nations have emerged as compelling investors for European startups and scaleups.

According to comprehensive data from Dealroom, the influx of investment from Gulf countries into European startups soared to a staggering $3 billion in 2023, marking a remarkable 5x surge from the $627 million recorded in 2018.

This substantial injection of capital, accounting for approximately 5% of the total funding raised in the region, underscores the growing prominence of Gulf investors in European markets.

Particularly noteworthy is the significant support extended to growth-stage companies, with over two-thirds of Gulf investments in 2023 being directed towards funding rounds exceeding $100 million. This influx of capital provides a welcome boost to European companies grappling with the challenge of securing well-capitalized investors locally.

Delving deeper into the landscape, Sifted has identified the most active Gulf investors in European startups over the past two years.

Leading the pack is Aramco Ventures, headquartered in Dhahran, Saudi Arabia. Bolstered by a substantial commitment, Aramco Ventures boasts a $1.5 billion sustainability fund, alongside an additional $4 billion allocated to its venture capital arm, positioning it as a formidable player with a total investment capacity of $7 billion by 2027. With a notable presence in 17 funding rounds, Aramco Ventures has strategically invested in ventures such as Carbon Clean Solutions and ANYbotics, aligning with its focus on businesses that offer strategic value.

Following closely is Mubadala Capital, headquartered in Abu Dhabi, UAE, with an impressive tally of 13 investments in European startups over the past two years. Backed by the sovereign wealth fund Mubadala Investment Company, Mubadala Capital’s diverse investment portfolio spans private equity, venture capital, and alternative solutions. Notable investments include Klarna, TIER, and Juni, reflecting its global investment strategy across various sectors.

Ventura Capital, based in Dubai, UAE, secured its position as a key player with nine investments in European startups. With a presence in Dubai, London, and Tokyo, Ventura Capital boasts an international network of limited partners and a sector-agnostic investment approach, contributing to its noteworthy investments in companies such as Coursera and Spotify.

Qatar Investment Authority, headquartered in Doha, Qatar, has made significant inroads into the European startup ecosystem with six notable investments. As the sovereign wealth fund of Qatar, QIA’s diversified portfolio spans private and public equity, infrastructure, and real estate, with strategic investments in tech startups across healthcare, consumer, and industrial sectors.

MetaVision Dubai, a newcomer to the scene, has swiftly garnered attention with six investments in European startups. Focusing on seed to Series A startups in the metaverse and Web3 space, MetaVision raised an undisclosed fund in 2022, affirming its commitment to emerging technologies and innovative ventures.

Investcorp, headquartered in Manama, Bahrain, has solidified its presence with six investments in European startups. With a focus on mid-sized B2B businesses, Investcorp’s diverse investment strategies encompass private equity, real estate, infrastructure, and credit management, contributing to its notable investments in companies such as Terra Quantum and TruKKer.

Chimera Capital, based in Abu Dhabi, UAE, rounds off the list with four strategic investments in European startups. As part of a prominent business conglomerate, Chimera Capital leverages its global reach and sector-agnostic approach to drive investments in ventures such as CMR Surgical and Neat Burger.

In conclusion, the burgeoning influx of capital from Gulf investors into European startups underscores the region’s growing appeal as a vibrant hub for innovation and entrepreneurship. With key players such as Aramco Ventures, Mubadala Capital, and Ventura Capital leading the charge, European startups are poised to benefit from the strategic investments and partnerships forged with Gulf investors, propelling them towards sustained growth and success in the global market landscape.


We Can’t Thank You Enough For Your Support!

— By Darren Wilson, Team VoiceOfEU.com

— Contact us: info@VoiceOfEU.com

— Anonymous submissions: press@VoiceOfEU.com

Continue Reading

Current

China Reveals Lunar Mission: Sending ‘Taikonauts’ To The Moon From 2030 Onwards

China Reveals Lunar Mission

The Voice Of EU | In a bold stride towards lunar exploration, the Chinese Space Agency has unveiled its ambitious plans for a moon landing set to unfold in the 2030s. While exact timelines remain uncertain, this endeavor signals a potential resurgence of the historic space race reminiscent of the 1960s rivalry between the United States and the USSR.

China’s recent strides in lunar exploration include the deployment of three devices on the moon’s surface, coupled with the successful launch of the Queqiao-2 satellite. This satellite serves as a crucial communication link, bolstering connectivity between Earth and forthcoming missions to the moon’s far side and south pole.

Unlike the secretive approach of the Soviet Union in the past, China’s strategy leans towards transparency, albeit with a hint of mystery surrounding the finer details. Recent revelations showcase the naming and models of lunar spacecraft, steeped in cultural significance. The Mengzhou, translating to “dream ship,” will ferry three astronauts to and from the moon, while the Lanyue, meaning “embrace the moon,” will descend to the lunar surface.

Drawing inspiration from both Russian and American precedents, China’s lunar endeavor presents a novel approach. Unlike its predecessors, China will employ separate launches for the manned module and lunar lander due to the absence of colossal space shuttles. This modular approach bears semblance to SpaceX’s Falcon Heavy, reflecting a contemporary adaptation of past achievements.

Upon reaching lunar orbit, astronauts, known as “taikonauts” in Chinese, will rendezvous with the lunar lander, reminiscent of the Apollo program’s maneuvers. However, distinct engineering choices mark China’s departure from traditional lunar landing methods.

The Chinese lunar lander, while reminiscent of the Apollo Lunar Module, introduces novel features such as a single set of engines and potential reusability and advance technology. Unlike past missions where lunar modules were discarded, China’s design hints at the possibility of refueling and reuse, opening avenues for sustained lunar exploration.

China Reveals Lunar Mission: Sending 'Taikonauts' To The Moon From 2030 Onwards
A re-creation of the two Chinese spacecraft that will put ‘taikonauts’ on the moon.CSM

Despite these advancements, experts have flagged potential weaknesses, particularly regarding engine protection during landing. Nevertheless, China’s lunar aspirations remain steadfast, with plans for extensive testing and site selection underway.

Beyond planting flags and collecting rocks, China envisions establishing a permanent lunar base, the International Lunar Research Station (ILRS), ushering in a new era of international collaboration in space exploration.

While the Artemis agreements spearheaded by NASA have garnered global support, China’s lunar ambitions stand as a formidable contender in shaping the future of space exploration. In conclusion, China’s unveiling of its lunar ambitions not only marks a significant milestone in space exploration but also sets the stage for a new chapter in the ongoing saga of humanity’s quest for the cosmos. As nations vie for supremacy in space, collaboration and innovation emerge as the cornerstones of future lunar endeavors.


Continue Reading

Trending

Subscribe To Our Newsletter

Join our mailing list to receive the latest news and updates 
directly on your inbox.

You have Successfully Subscribed!