Archive for the 'HDMI' Category

At home, most of us nowadays have multiple devices, like a DVD player, digital TV and satellite box that can be hooked up with HDMI. You may have noticed that it can take several seconds to switch from one device to another.  Aptly titled,“Fast Switching”,  solves the delay problem when switching between various HDMI enabled devices.  One of our early experiements to prove out our fast switching technology used two BluRay players from Sony and Philips running a video at 1080p, 12 bit deep-color and we reduced the switching time to a fraction of a second. An exciting demo that this post cannot do justice is on youtube:

http://www.youtube.com/watch?v=dXZxchcxptY&feature=youtu.be

This shows how we can switch from one HDMI source device to another HDMI source device in under one second with the Synopsys DesignWare HDMI RX solution. The solution consists of 4 inputs that can simultaneously be connected to 4 source devices.

Synopsys' HDMI fast switching demo

As we’re devloping HDMI IP, one of the interesting topics in the HDMI community is NG STBs (Next Generation Set Top Boxes) will become dominant in the market in next couple of years. What’s new is that the STB acts simultaneously as a HDMI Sink, an HDMI Source and a HDMI Repeater.  The first application for this new STB being deployed today will provide SKYPE video phone features at the television through the STB, but other applications are planned and coming. The Skype applications requires the STB to overlay both video and sound on top of the external media stream coming in on the HDMI-input from the other HDMI sources in the HDMI cluster.

With over 1150 adopters and an install base of ~2Billion devices, HDMI has achieved an overwhelming success in the world of consumer electronics. Since its premiere at CES in 2003, HDMI has rapidly evolved and penetrated into applications that can be broadly classified into 3 segments: digital home, mobile multimedia and PC. HDMI is now also found in many niche applications like 2Dà3D converter boxes, wireless hubs, automobiles (Honda Odyssey), NAS boxes etc. Given its broad and deep penetration into the world of consumer electronics, HDMI.org made the right decision to open up the standard body and form an entity called HDMI Forum for new companies willing to participate and define the future of HDMI. Synopsys is now a part of the HDMI forum and is looking forward to influence and make positive contributions to the HDMI specification for next generation consumer electronic applications. Being the largest provider of connectivity IPs, we can capture a very broad view of the semiconductor market and overall consumer electronic industry trends. We have collected feedback from over 125 companies that are integrating HDMI connectivity into their SOCs. We constantly meet with consumer electronic giants to discuss their requirements for next generation platforms. This puts us in a very unique position to translate the end customer requirements into HDMI specification.  

Next generation HDMI: Synopsys believes that for its continued success, HDMI should evolve to address the specific needs of each of the three broad segments discussed above.

1. Digital Home – HDMI dominates this market segment with close to 100% penetration in applications like DTVs, Blu Ray Players, AVRs, and Game Consoles. Hence HDMI should continue to future-proof itself, further enhance the user experience, and integrate some of the digital home connectivity standards. Some specific ideas include:
   1. Increasing bandwidth from 10.2Gbps Ă  ~18Gbps to support deep-color 4K resolution mode
   2. Offer cinema video formats (21:9 aspect ratio as defined in CEA-861-F  specification)
   3. Offer a transparent remote control with the goal to control the source remotely
2. Mobile Multimedia (battery powered applications) – HDMI has experienced a rapid penetration in the mobile multimedia applications. The top 7 tablets in the world are now supporting HDMI connectivity (either directly or through a dongle). HDMI competes with MHL in mobile applications and should offer the following enhancements to succeed in this segment:
   1. Power consumption is a key factor in mobile applications. Hence HDMI should target to reduce the overall power consumption by Muxing some of the TMDS channels, offering reduced range differential amplitude and low resolution video modes. HDMI should also eliminate some of the legacy requirements such as 5V protection to save area, pin count and power.
   2. Battery charging capability is also extremely important to penetrate into mobile market. HDMI should offer battery charging functionality (just like USB) by using its HPD (hot plug detect) and NC (no connect) pins.
3. PC Applications – HDMI clearly competes with Displayport in this segment and should offer PC-specific features to penetrate into this eco-system. Some specific ideas to successfully compete with Displayport are:
   1. Increasing bandwidth from 10.2Gbps Ă  ~18Gbps to support resolution up to WQXGA (2560×1600) at 120Hz frame rate. This would require using the TMDS clock lane as a 4th TMDS data channel + embedded clock.
   2. Transporting up to 4 video frames to support daisy chaining for multi-display mode.
   3. Transport USB2.0 traffic within the HDMI cable (similar to HEAC) by mapping D+ and D- from USB2.0 into HDMI NC and HPD pins. Extent CEC to declare USB traffic.

While we are recommending all these new features, Synopsys is mindful that one of the underlying requirements is backwards compatibility to previous generations of the specification. We will always take this into account as we work with other forum members to define the future of HDMI. 

Finally, Synopsys is glad to be a part of the HDMI forum and given our deep understanding of connectivity IPs, we will help enhance HDMI specification and enable it to successfully compete with other standards like DisplayPort, MHL and V-by-One.

Tomorrow I’ll be presenting at TSMC’s OIP (Open Innovation Program) on a topic regarding high performance analog and interface IP that is used in the latest smart phones, tablets and also the data centers. The idea of the talk was triggered by an article that I read about how the theoretical limit of Shannon’s Law is being reached and that Moore’s Law can be used to extend this bandwidth limit. What I’m presenting is that using the latest 28 nm and 20 nm technologies high performance analog and interface IP can be developed that can extend Shannon’s theoretical limit. If you cannot attend the talk, here’s the summary.

Extending Shannon's Limit?

What’s causing this bandwidth limit?

Mobile multimedia products such as smartphones and tablets are driving huge bandwidth requirements into the data centers. A rough order magnitude states that one server in the data center is needed to handle the traffic from every 600 smartphones or 122 tablets. By 2015, it is projected that 7.1 billion phones and tablets, will be sending 75 exabytes (one billion gigabytes) of internet traffic. To address these bandwidth limits, Moore’s Law is driving innovation at the system-on-chip (SoC) level with quad-core CPU’s running in excess of 1.5 GHz in 28 nm. In order to get data on and off the SoC, from the application processor to the base-band chip, high performance interfaces are used. Since the design and implementation challenges are significantly greater at 28 nm and below, SoC development teams are looking for ways to meet aggressive product cycles by implementing third party intellectual property (IP) for these interfaces. 

28-nm, 20-nm technology and IP

Being a consumer driven market, cost is a major factor for mobile multimedia products and SoC companies are using economies of scale afforded by 28 nm integration levels to build media processors to fit multiple personal computer and consumer electronic platforms. The interface IP needs include multi-port USB 2.0, USB 3.0, HSIC (high-speed inter-chip) which is derived from the USB protocol, PCI Express Gen. 1, SATA, HDMI Tx (to connect to high definition displays), MIPI CSI/DSI for camera and displays interfaces, Gigabit Ethernet and SD 4.0. Also, smartphone storage will exceed 100 GB in 2012 and this will require both throughput and capacity: USB “sync-n-go”, micro-USB, potentially UFS (universal flash storage) are likely candidates for this type of interface IP. The DRAM bandwidth is growing faster than any market segment: mDDR (mobile DDR) is being replaced by LPDDR2 this year. Audio codec’s and general purpose data converter IPs are also required. The low power variant of 28 nm technology (the POLYSION based LP, or the HKMG HPL) is the preferred choice with a 1.8 V gate oxide. Other important requirements include special power down modes.

On the other end, data centers or cloud computing is driving high-end IP requirements in 28HPM or 28HP processes. The data center backbone will use the 8 Gb/s PCIe 3.0 switches and these are used to connect to multi-channel 10 Gb Ethernet HBA (host bus adapters). The high-speed DDR3 memory interfaces are expected to operate at 2133 Mb/s supporting both RDIMM and LRDIMM – and these will eventually move to DDR4 2013.

How does TSMC’s OIP help in all of this?

TSMC’s Open Innovation Program (OIP) is an integral part of the collaboration between Synopsys and TSMC. For analog/mixed-signal IP this means access to early versions of design kits help reduce the adoption barrier for customers implementing next-generation SoC designs in the advanced process technologies.  By providing IP that meets the rigorous TSMC9000 certification standards, Synopsys and TSMC are enabling our mutual customers to reduce integration risk and system cost, while quickly ramping up into volume production

Participating in the CEDIA (Custom Home Theater Installation Contractors) workshop is a classic example of how we approach each standard from grass roots level.

This was the first ever HDMI installer workshop with the goal of providing better insight into HDMI protocol and equipment connection sequences. We gained familiarity was various test instruments. We also learnt that most common problems in HDMI installations happen when an HDMI device (HDMI AVRs, HDMI switches, HDMI splitters, HDMI Cat6 Extenders etc) is inserted between 2 existing HDMI devices (set top box and digital TV). The device in the middle manipulates DTV’s EDID in various ways to reflect its limitations or improvements over DTV’s capabilities. Such daisy chaining does not work very well and troubleshooting the faulty component can be a night mare. We also saw some failures related to HDCP over poor quality cables. The bit errors during HDCP authentication corrupt the DDC channel and cause the authentication to fail.

Lessons learnt in such events are invaluable and our customers (and end consumers) reap the benefits of a robust interface that is a true “plug and play”.

Following on from last week’s posting on driving the HDMI ecosystem http://synopsysoc.org/theeyeshaveit/2010/10/hdmi-driving-an-ecosystem/ , this week I’m writing about an IP vendor’s perspective and the HDMI community:

1. HDMI is one of the key connectivity requirements in an SoC, the others include USB, DDR, PCI Express, SATA and MIPI
2. Complex multimedia SoCs require ~4 connectivity IPs. HDMI is a key component of multimedia ASICs along with other IPs like USB, DDR, and SATA etc.
3. Synopsys continues to see an increase in chip design starts requiring HDMI connectivity. This is consistent with the growing number of HDMI adopters (1000+) and HDMI enabled devices (1.5 Billion+). 
4. The range of applications is beyond traditional home theatre components like DTV, STB etc.
5. Mobile multimedia and home entertainment SOCs are primary markets for advanced nodes like 28 nm. HDMI is a key title required in these applications.
6. “Megatrends” like 3D will greatly enhance the demand for HDMI. Most multimedia SOCs designed in 2010 are incorporating this feature.
7. Other trends like home connectivity may continue to evolve HDMI in years to come.

Next week I will post the final installment on the HDMI ecosystem, by participating in workshops. A classic example of how we approach each standard (HDMI, USB, PCI Express) from the grass roots level is the Custom Home Theater Installation Contractors workshop.

Last week at the HDMI road show/developers conference in Sunnyvale, we showed the HDMI community how an IP provider can significantly impact and grow their eco-system.

 Back in 2002, there was a definitive need for digital connectivity for audio/video content. HDMI was there at the right place at the right time. As a result it has experienced a robust growth since its inception. With over 1.5 billion devices, it has definitely achieved “critical mass” and will continue to dominate over other competing standards. Since HDMI has achieved critical mass, by providing HDMI IP, Synopsys is playing a key role in ensuring that this protocol continues to flourish by enabling semiconductor companies aspiring to integrate HDMI connectivity into the latest generation of  40 nm and 32/28 nm SOCs. 

The end applications of these SOCs range from digital TVs, Blu Ray Players to very unique and un-tapped markets like 2D to 3D Boxes, 3D with glasses to 3D without glasses, 1080p to 4K resolution boxes, NAS systems etc. Boosted by the simplicity, reliability and performance of HDMI, these unique applications are sprawling all over the map to service this eco-system.

In my next posting I will show our opinions shared with the HDMI community from an IP vendors perspective.

Ralph Morgan, Our VP Engineering For HDMI Controllers

In earlier postings I’d commented on the penetration of HDMI as the high definition multimedia interface of choice for various consumer devices. Many of these devices are now adopting 3D such as TVs, Blu-Ray players, broadcasting equipment, game consoles, cameras and camcorders. This was evidenced by the recent “plugfest” event in Milpitas, California. Plugfest is one of those behind the scenes but critical events where the connectivity ecosystem, in this case HDMI, gets together. Literally.  Meaning: chip, plug, board, system, test and cable companies connect up there equipment to see if they can reliably pass HDMI content. There were almost 50% more attendees at this plugfest event compared to the last event in October.

The key highlight of the event was the rapid appearance of 3D equipment only months after the Consumer Electronics Show in Las Vegas (CES).  At CES, LG, Samsung, Toshiba and Panasonic all presented their 3D TV line-up, with Samsung and Toshiba also indicating that some select 3D TVs will also incorporate real-time 2D to 3D conversion processors. 

To ensure that our HDMI 1.4a IP core interoperated with the latest 3D equipment, our engineering team made the trek from Portugal to Milpitas and using the HAPS platform, we tested the 3D modes with key RX platforms from various vendors. Our TX solution was flexible enough to provide the experience of 3D movies with RX platforms in less than 30 minute de-bug sessions. This is pretty amazing! In fact we tested our TX core with 28 RX cores during the 5 days of plugfest.

Here’s some background. There are a total of 68 video modes which can be used in 2D or in 8 different 3D formats. However, most televisions today only support about 10 out of the 68 video modes and 3 out of 8 3D formats. Half side-by-side seems to be the most popular 3D format since it requires the same bandwidth as the 2D format (with 50% compression). The 720p and 1080i HD formats continue to be the most popular in North America.

If you’ve been following HDMI you may remember the Ethernet over HDMI hype. This feature did not even show up in any of the multimedia devices at this plugfest. It seems the market is still questioning the real world use cases and feasibility of Ethernet over HDMI.

 

3D HD broadcasting with Direct TV to your home

The HDMI 1.4 specification was announced in June 2009 and contained many important capabilities that have further revolutionized multimedia devices. While HDMI 1.3 made significant improvements by doubling the data rate, providing up to 2.8 trillion colors, lossless audio formats, 120 Hz frame rates and 1440p resolution modes, HDMI 1.4 has further added some subtle but highly innovative features that reinforced consumers’ perception that HDMI equates to simplicity, reliability and performance.  The key features added in HDMI 1.4 included: 1) HEAC, 2) 3D modes, 3) 4K resolution, 4) real time content recognition & 5) additional color space for digital still cameras. Synopsys is one of the very few companies to support ALL of the HDMI 1.4 features including the HDMI Ethernet and Audio Return Channel (HEAC). 

If you talk to analysts they will say that 3D TV is the next big wave in consumer electronic market. CES 2010 was dominated by 3D TVs. Sony, Toshiba and Hitachi will be releasing their 1^st models of 3D TVs later this year. Likewise content providers have begun talking about 3D content for kids. Next generation game consoles will definitely incorporate 3D capabilities. Synopsys’ announcement of HDMI 1.4 cores will help expedite the adoption of the 3D into the digital home theatre appliances.

HDMI will enjoy a 33% CAGR in the portable multimedia (camcorders, still cameras, PMPs) devices. Low power is the key to succeed in this market. Our HDMI 1.4 TX PHY core features sub 50mW power for such applications. Furthermore our HDMI IP comes with ATC reports, test results from plug fest events and with complete system validation on a HAPS-51 based platform.

There are conflicting opinions in the market about how far can HDMI evolve. Has it reached its saturation in terms of bandwidth, color formats & other features? Is law of diminishing returns kicking in? Most customers are still trying to get a good handle on the HEAC feature. Regardless, 3 out 4 customers in the digital home arena are seriously looking into incorporating 1.4 features into their next generation SOCs/systems.

Synopsys’ HDMI 1.4 cores will incorporate HEAC block to support bi-direction transfer of IP packets and audio packets, hence simplifying the home theatre system by eliminating additional connectors, wires and dongle cards on each appliance to connect to Ethernet/802.11. The SoC designer will be responsible for providing their own 100BASE-TX and S/PDIF blocks that will seamlessly connect with the Synopsys’ HDMI HEAC block. The SoC designer will need to incorporate higher layers of 100BASE-TX only if IP packets need to be processed in the end application. Likewise 100BASE-TX IOs are optional depending on whether the end application needs to connect to external router to obtain IP packets. A simplified block diagram of sink and source SoCs with HDMI HEAC block is shown below.

As an IP provider, Synopsys will play an important role in the commercialization of HDMI. The consumer electronic giants we have been working with have appreciated the reduction in their development costs and shortened time-to-market. Also we have applied all the valuable lessons learnt from the plugfest events and HDMI ATCs to reduce the interoperability problems recently seen in the HDMI appliances. For this reason, we believe that a growing number of SoC and system designers will choose to keep their development schedules and budgets on track and lower integration risk by buying their HDMI IP from us.