-
Sun Microsystems 10GBE XFP - page 1
Sun Microsystems, Inc. www .sun.com Submit comments about this document at: http://www.sun.com/hwdocs/feedback Sun ™ Dual 10GbE XFP PCI Express Card User’ s Guide P ar t No . 820-0184-13 January 2009, Revision A ...
-
Sun Microsystems 10GBE XFP - page 2
Please Recycle Copyright 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. Sun Microsystems, Inc. has intellectual pr operty rights relating to technology embodied in the product that is described in this document. In particular , and without limitation, these intellectual property rights m ...
-
Sun Microsystems 10GBE XFP - page 3
iii Contents Preface xiii 1. Product Overview 1 Components 1 Product Description 1 Hardware and Software Requirements 2 Features 3 2. Installing and Setting Up the Driver 5 Downloading and Installing the Driver on a Solaris SPARC or x86 Platform 5 ▼ T o Download the Driver on a Solaris Platform 5 ▼ T o Remove the Driver from a Solaris Platform ...
-
Sun Microsystems 10GBE XFP - page 4
iv Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ▼ T o V erify the Hardware Installation 18 Rebooting the System 20 4. Network Conf iguration 21 Configuring the Network Host Files 21 Setting Up a 10-Gigabit Ethernet Network on a Diskless Client System 23 ▼ T o Set Up a 10-Gigabit Ethernet Port on a Diskless Client 24 Insta ...
-
Sun Microsystems 10GBE XFP - page 5
Contents v ▼ T o Set Parameters Using the ethtool Utility 44 ▼ T o Set Parameters Using the Bundled configtool Utility 48 T uning for Maximum Performance on a Linux Platform 49 6. Conf iguring the Jumbo Frames Feature 51 Jumbo Frames Overview 51 Checking Jumbo Frames Configurations 51 ▼ T o Show the Driver Statistics in a Solaris Environment ...
-
Sun Microsystems 10GBE XFP - page 6
vi Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 A. Specif ications 71 Connectors 71 Performance Specifications 72 Physical Characteristics 73 Power Requirements 73 B. Diagnostic Software 75 SunVTS Diagnostic Software 75 Updating SunVTS to Recognize the Adapter 76 ▼ T o Update SunVTS to Recognize the Adapter 76 Using the Sun ...
-
Sun Microsystems 10GBE XFP - page 7
vii T ables T ABLE 1-1 Hardware and Software Requirements for Sun SPARC and X64 Servers 2 T ABLE A-1 XFP Connector Characteristics 72 T ABLE A-2 Performance Specifications 72 T ABLE A-3 Physical Characteristics 73 T ABLE A-4 Low-Profile Power Requirements 73 T ABLE B-1 SunVTS Documentation 76 ...
-
Sun Microsystems 10GBE XFP - page 8
viii Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ...
-
Sun Microsystems 10GBE XFP - page 9
ix Figur es FIGURE 1-1 Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter 2 FIGURE 8-1 Example of Servers Supporting Multiple VLANs With Tagging Adapters 68 FIGURE 8-2 Ethernet Tag Header Format 70 FIGURE A-1 Sun x8 Express Dual 10 Gigabit Ethernet XFP Low Profile Adapter Connectors 73 ...
-
Sun Microsystems 10GBE XFP - page 10
x Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ...
-
Sun Microsystems 10GBE XFP - page 11
xi Declaration of Conformity EMC USA—FCC Class A This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: 1. This equipment may not cause harmful interference. 2. This equipment must accept any interference that may cause undesired operation. European Union This equipment complies with the follo ...
-
Sun Microsystems 10GBE XFP - page 12
xii Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ...
-
Sun Microsystems 10GBE XFP - page 13
xiii Pr eface This guide provides instructions for installing both the hardwar e and software for the Sun Dual 10GbE XFP PCI Express car d. This manual also describes how to configur e the nxge driver , which controls the card. These instructions are designed for enterprise system administrators with experience installing network hardware and softw ...
-
Sun Microsystems 10GBE XFP - page 14
xiv Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 Chapter 6 describes how to configure the Jumbo Frame featur e. Chapter 7 describes how to configure link aggr egation. Chapter 8 explains V irtual Local Area Networks (VLANs) in detail and provides configuration instructions and examples. Appendix A lists the specif ications fo ...
-
Sun Microsystems 10GBE XFP - page 15
Preface xv Shell Pr ompts T ypographic Conventions Shell Prompt C shell machine-name % C shell superuser machine-name # Bourne shell and Korn shell $ Bourne shell and Korn shell superuser # T ypeface * * The settings on your browser might differ from these settings. Meaning Examples AaBbCc123 The names of commands, files, and directories; on-scr ee ...
-
Sun Microsystems 10GBE XFP - page 16
xvi Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 Related Documentation The documents listed as online are available at: http://www.sun.com/documentation/ Documentation, Support, and T raining Thir d-Party W eb Sites Sun is not responsible for the availability of third-party web sites mentioned in this document. Sun does not e ...
-
Sun Microsystems 10GBE XFP - page 17
Preface xvii Sun W elcomes Y our Comments Sun is interested in impr oving its documentation and welcomes your comments and suggestions. Y ou can submit your comments by going to: http://www.sun.com/hwdocs/feedback Please include the title and part number of your document with your feedback: Sun Dual 10GbE XFP PCI Express Card User ’ s Guide , par ...
-
Sun Microsystems 10GBE XFP - page 18
xviii Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ...
-
Sun Microsystems 10GBE XFP - page 19
1 CHAPTER 1 Pr oduct Overview This chapter provides an overview of the Sun x8 Expr ess Dual 10 Gigabit Ethernet Fiber XFP Low Prof ile Adapter, including: ■ “Components” on page 1 ■ “Product Description” on page 1 ■ “Hardwar e and Software Requir ements” on page 2 ■ “Features” on page 3 Components The carton in which your Su ...
-
Sun Microsystems 10GBE XFP - page 20
2 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 FIGURE 1-1 Sun x8 Expr ess Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter Har dware and Softwar e Requir ements Before installing the adapter , make sure your system meets the hardware and software r equirements. T ABLE 1- 1 lists the supported hardwar e and software. T A ...
-
Sun Microsystems 10GBE XFP - page 21
Chapter 1 Product Overview 3 Featur es The Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Pr ofile Adapter provides the following features: ■ T wo full-duplex 10 gigabit Ethernet interface that use a 10 gigabit Ethernet small form factor pluggable (XFP), optical transceiver with duplex LC fiber connector ■ IEEE 802.3ae 2002 compliant ■ ...
-
Sun Microsystems 10GBE XFP - page 22
4 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ...
-
Sun Microsystems 10GBE XFP - page 23
5 CHAPTER 2 Installing and Setting Up the Driver This chapter explains how to download and install the nxge driver . The nxge gigabit Ethernet driver ( nxge (7D)) is a multi-threaded, loadable, clonable, GLD-based STREAMS driver . The nxge driver is managed by the dladm (1M) command line utility , which allows VLANs to be defined on top of nxge ins ...
-
Sun Microsystems 10GBE XFP - page 24
6 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 2. Uncompress the gzipped tar f ile: 3. Unpack the tar f ile: a. For SP ARC systems, change to the following directory: b. For x86 systems: 4. For SP ARC systems, determine which architecture your system is running: a. For sun4v systems, install the software packages by typing th ...
-
Sun Microsystems 10GBE XFP - page 25
Chapter 2 Installing and Setting Up the Driver 7 5. For x86 systems, install the software packages by typing the following at the command line: A menu similar to the following displays: 6. Select the packages you want to install: ■ Press Return or type all to accept the default and install all packages. ■ T ype the specific numbers, separated b ...
-
Sun Microsystems 10GBE XFP - page 26
8 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 7. V erify that the nxge driver is installed on the system: ▼ T o Remove the Driver fr om a Solaris Platform 1. T o discover the driver packages run the pkginfo command: 2. T o remove the driver packages run the pkgrm command: Sun PCI-E 10G/1G Ethernet Adapter Driver(i386) 1.0, ...
-
Sun Microsystems 10GBE XFP - page 27
Chapter 2 Installing and Setting Up the Driver 9 Downloading and Installing the Driver on a Linux Platform 1. Login to your system. 2. Download the driver RPM for your operating system: http://www.sun.com/download/products.xml?id=44eb1efd For example: 3. Discover the network interfaces before adding the package by using the ifconfig -a command: 4. ...
-
Sun Microsystems 10GBE XFP - page 28
10 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 Note – In RHEL5.0 and later releases, the driver is packaged in the kmod driver binary package format. This packaging allows forward and backward driver binary compatibility within the same flavors of RHEL5 r eleases. Driver packages nxge version 2.0.0 and later are not compat ...
-
Sun Microsystems 10GBE XFP - page 29
Chapter 2 Installing and Setting Up the Driver 11 7. Use the ethtool command to check the parameter conf igurations that apply to the nxge driver . ▼ T o Remove the Driver Fr om a Linux Platform ● T o remove the driver packages from a Linux Platform use the rpm -e command: (For 10G) # ethtool -i eth4 driver: nxge version: 2.0.1 firmware-version ...
-
Sun Microsystems 10GBE XFP - page 30
12 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ...
-
Sun Microsystems 10GBE XFP - page 31
13 CHAPTER 3 Installing the Adapter This chapter describes how to install the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Prof ile Adapter in your system and verify that it has been installed correctly . This chapter contains the following section: ■ “Installing the Adapter” on page 13 ■ “Installing an Optical T ransceiver” on ...
-
Sun Microsystems 10GBE XFP - page 32
14 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 Adapter in slot-2 of a Sun Fire T2000 system. The SA T A cables from the adjacent card slot pr event the proper installation of an Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Prof ile Adapter in this slot. (Note that this issue does not exist for Sun Fire T2000 that is ...
-
Sun Microsystems 10GBE XFP - page 33
Chapter 3 Installing the Adapter 15 Note – These illustrations show the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Prof ile Adapter being installed into a Sun Fire T2000, which requir es a standard height bracket for the low prof ile adapter . 6. Open the retaining clip at the edge of the PCI-E opening. 7. Holding the adapter by the ed ...
-
Sun Microsystems 10GBE XFP - page 34
16 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 9. Secure the retaining clip Caution – Do not use excessive force when installing the adapter into the PCI-E slot. Y ou might damage the adapter ’s PCI connector . If the adapter does not seat properly when you apply even pr essure, remove the adapter and car efully reinstal ...
-
Sun Microsystems 10GBE XFP - page 35
Chapter 3 Installing the Adapter 17 1 1. Install the optical transceivers. Note – Illustrations for installing the adapter and installing the optical transceiver show differ ent systems. This differ ence in systems provides the maximum clarity for installing the optical tranceiver and shows the most complicated adapter installation. Installing an ...
-
Sun Microsystems 10GBE XFP - page 36
18 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ▼ T o Install an Optical T ransceiver 1. Pull the white locking handle into the full horizontal position. Y ou will feel the handle click into position when it is fully opened. Note – If you are installing an optical transceiver in a SunFire T1000, ensur e that the label and ...
-
Sun Microsystems 10GBE XFP - page 37
Chapter 3 Installing the Adapter 19 4. Push the handle closed to lock the optical transceiver in place. 5. Repeat Step 1 through Step 4 to install the second optical transceiver 6. Detach the wrist strap. Caution – If you pull the locking handle down when the optical transceiver is installed, remove the optical transceiver entirely and r einstall ...
-
Sun Microsystems 10GBE XFP - page 38
20 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 7. Connect the Ethernet cables. V erifying the Har dware Installation After you have installed the Sun 10-Gigabit Ethernet adapter , but before you boot your system, perform the following tasks to verify the installation. Refer to the your Solaris documentation for the detailed ...
-
Sun Microsystems 10GBE XFP - page 39
Chapter 3 Installing the Adapter 21 3. V iew the device that you installed. Using the previous example, type: 4. Use the .properties command to display a list of device properties. The . properties command displays the specific information about the device. If you are using the Sun x8 Expr ess Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter, ...
-
Sun Microsystems 10GBE XFP - page 40
22 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 5. T ype the following when you f inish looking at the .properties values: Rebooting the System After verifying the adapter installation, use the boot -r command to perform a reconf iguration boot on your system. ok device-end ok boot -r ...
-
Sun Microsystems 10GBE XFP - page 41
23 CHAPTER 4 Network Conf iguration This chapter describes how to edit the network host files after the adapter has been installed on your system. This chapter contains the following sections: ■ “Configuring the Network Host Files” on page 23 ■ “Setting Up a 10-Gigabit Ethernet Network on a Diskless Client System” on page 25 ■ “Inst ...
-
Sun Microsystems 10GBE XFP - page 42
24 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 1. At the command line, use the grep command to search the /etc/path_to_inst f ile for nxge interfaces. In this example, the device instance is from a Sun x8 Expr ess Dual 10 Gigabit Ethernet Fiber XFP Low Prof ile Adapter installed in slot 1. Be sure to write down your device p ...
-
Sun Microsystems 10GBE XFP - page 43
Chapter 4 Network Configuration 25 ■ The host name must be differ ent from any other host name of any other interface, for example: /etc/hostname.nxge0 and /etc/hostname.nxge1 cannot share the same host name. The following example shows the /etc/hostname.nxge number file r equired for a system called zardoz that has a Sun x4 PCI-Express Gigabit E ...
-
Sun Microsystems 10GBE XFP - page 44
26 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ▼ T o Set Up a 10-Gigabit Ethernet Port on a Diskless Client 1. Locate the root directory of the diskless client on the host server . The root dir ectory of diskless client system is commonly installed in the host server ’s /export/root/ client-name directory , where client_ ...
-
Sun Microsystems 10GBE XFP - page 45
Chapter 4 Network Configuration 27 Installing the Solaris Operating System Over a 10-Gigabit Ethernet Network The Solaris Advanced Installation Guide describes the full procedure for installing the Solaris Operating System over the network. The following procedure assumes that you have created an install server , which contains the image of the Sol ...
-
Sun Microsystems 10GBE XFP - page 46
28 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 2. Find the root directory of the client system. The client system’s root dir ectory can be found in the install server ’s /etc/bootparams file. Use the grep command to sear ch this file for the r oot directory . In this example, the root directory for the Solaris 10 client ...
-
Sun Microsystems 10GBE XFP - page 47
Chapter 4 Network Configuration 29 5. Shut down and halt the client system. Use the shutdown command to go to the OpenBoot ( ok ) prompt. 6. At the ok prompt, use the show-nets command to f ind the device path of the 10- Gigabit Ethernet device. The show-nets command lists the system devices. Y ou should see the full paths and names of the network ...
-
Sun Microsystems 10GBE XFP - page 48
30 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 9. After installing the Solaris Operating System, install the Sun x8 Dual 10 Gigabit Ethernet software on the client system. The software installed in Step 4 is requir ed to boot the client system over the 10- Gigabit Ethernet interface. Y ou now need to install the software in ...
-
Sun Microsystems 10GBE XFP - page 49
Chapter 4 Network Configuration 31 Booting Over the 10-Gigabit Ethernet Network for Solaris x86 and Linux Systems ▼ T o Boot Over the Network on Solaris x86 and Linux Systems 1. Obtain the MAC address from the target Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Prof ile Adapter. 2. Set up the PXE boot server with the MAC addresses . 3. C ...
-
Sun Microsystems 10GBE XFP - page 50
32 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 9. Press the F10 key to save the boot conf iguration changes and exit. System should reboot after saving the boot configuration. ...
-
Sun Microsystems 10GBE XFP - page 51
Chapter 4 Network Configuration 33 10. Press the F12 key to install the OS from the network. If the cable is connected to the right port, you should see the MAC address that you assigned to your PXE server displayed by BIOS. 1 1. Y ou can now install the nxge driver and conf igure the adapter . image : pxe-mac-addr PXE-E61: Media test failure, chec ...
-
Sun Microsystems 10GBE XFP - page 52
34 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ...
-
Sun Microsystems 10GBE XFP - page 53
35 CHAPTER 5 Conf iguring the nxge Device Driver Parameters The nxge device driver controls the Sun x8 Express Dual 10 Gigabit Ethernet interfaces. Y ou can manually set the nxge driver parameters to customize each device in your system. This chapter lists the available device driver parameters and describes how you can set these parameters. ■ ? ...
-
Sun Microsystems 10GBE XFP - page 54
36 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 processing. The Sun 10-Gigabit Ethernet Adapter utilizes Sun’s own innovative MAC Controller to map the 10-Gigabit XAUI interface onto the PCI Express form factor . It supports 10 Gb/sec bandwidth using eight transmit and eight r eceive lanes. Setting nxge Driver Parameters on ...
-
Sun Microsystems 10GBE XFP - page 55
Chapter 5 Configuring the nxge Device Driver P arameters 37 ▼ T o Specify Device Instances for the ndd Utility Before you use the ndd utility to get or set a parameter for a nxge device, you must specify the device instance for the utility . 1. Check the /etc/path_to_inst f ile to identify the instance associated with a particular device. ▼ T o ...
-
Sun Microsystems 10GBE XFP - page 56
38 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 After you enter the parameter name, the ndd utility prompts you for the parameter value. 2. T o list all the parameters supported by the nxge driver , type ? . Setting Parameters Using the nxge.conf File Specify the driver parameter properties for each device by creating a nxge. ...
-
Sun Microsystems 10GBE XFP - page 57
Chapter 5 Configuring the nxge Device Driver P arameters 39 ▼ T o Set Driver Parameters Using an nxge.conf File 1. Obtain the hardware path names for the nxge devices in the device tree. a. Check the /etc/driver_aliases f ile to identify the name associated with a particular device: b. Locate the path names and the associated instance numbers in ...
-
Sun Microsystems 10GBE XFP - page 58
40 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 # apply only to 10gigabit ports. # Half duplex is not supported on any NIU card. # # adv-autoneg-cap # Advertise auto-negotiation capability. # default is 1 # adv-autoneg-cap = 1; # # adv_10gfdx_cap # Advertise 10gbps Full duplex capability. # default is 1 # adv_10gfdx_cap = 1; ...
-
Sun Microsystems 10GBE XFP - page 59
Chapter 5 Configuring the nxge Device Driver P arameters 41 # #------- Receive DMA Configuration ---------------------------- # # rxdma-intr-time # Interrupts after this number of NIU hardware ticks have # elapsed since the last packet was received. # A value of zero means no time blanking (Default = 8). # # rxdma-intr-pkts # Interrupt after this n ...
-
Sun Microsystems 10GBE XFP - page 60
42 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 b. The following parameters operate on a per port basis and can be set using the /platform/sun4u/kernel/drv/nxge.conf f ile. c. In the following example, the ports of all the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Prof ile Adapter are being set for load balancing ...
-
Sun Microsystems 10GBE XFP - page 61
Chapter 5 Configuring the nxge Device Driver P arameters 43 d. The following example shows ports on two different cards being set. Only one node needs to be specif ied. 3. Save the nxge.conf f ile. T uning for Maximum Performance on a Solaris Platform T uning for maximum performance in a Solaris platform depends on whether you are using an UltraSP ...
-
Sun Microsystems 10GBE XFP - page 62
44 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 3. Add the following to a startup script, or use ndd before plumbing the interface: Utilizing more soft-rings provided by the Solaris TCP/IP stack signif icantly improves bulk thr oughput for Rx. The default number of soft-rings is 2, but changing it to 8 improves performance. ( ...
-
Sun Microsystems 10GBE XFP - page 63
Chapter 5 Configuring the nxge Device Driver P arameters 45 ▼ T o Obtain Higher Thr oughput Using the Generic T unables for the Solaris TCP/IP Stack ● T o obtain higher throughput, add the following to a startup script: ndd -set /dev/tcp tcp_conn_req_max_q 8192 ndd -set /dev/tcp tcp_conn_req_max_q0 8192 ndd -set /dev/tcp tcp_max_buf 4194304 ndd ...
-
Sun Microsystems 10GBE XFP - page 64
46 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 Setting Parameters on a Linux Platform ▼ T o Set Parameters Using the ethtool Utility 1. Determine which parameters are available using the ethtool utility: # ethtool -help eth4 ethtool version 1.8 Usage: ethtool DEVNAME ethtool -a DEVNAME ethtool -A DEVNAME [ autoneg on|off ...
-
Sun Microsystems 10GBE XFP - page 65
Chapter 5 Configuring the nxge Device Driver P arameters 47 ethtool -G DEVNAME [ rx N ] [ rx-mini N ] [ rx-jumbo N ] [ tx N ] ethtool -i DEVNAME ethtool -d DEVNAME ethtool -e DEVNAME [ raw on|off ] [ offset N ] [ length N ] ethtool -E DEVNAME [ magic N ] [ offset N ] [ value N ] ethtool -k DEVNAME ethtool -K DEVNAME [ rx on|of ...
-
Sun Microsystems 10GBE XFP - page 66
48 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 Following are some common parameters that can be changed: rx-usecs and rx-frames control the RX interrupt rate per RX DMA channel. RX interrupt will be generated after rx-frames have been received or after rx-usecs time interval if fewer than rx-frames have been r eceived within ...
-
Sun Microsystems 10GBE XFP - page 67
Chapter 5 Configuring the nxge Device Driver P arameters 49 2. T o change RX interrupt Coalesce parameters use the ethtool -C command: 3. T o get status of L4 HW checksumming, use the ethtool -k command: # ethtool -C eth4 rx-usecs 20 # ethtool -c eth4 Coalesce parameters for eth4: Adaptive RX: off TX: off stats-block-usecs: 0 sample-interval: 0 pkt ...
-
Sun Microsystems 10GBE XFP - page 68
50 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ▼ T o Set Parameters Using the Bundled configtool Utility 1. T o get a list of tunable parameters, use the nxge_config if_name get command: These classification variables def ine how each IP class is configur ed. This parameter also controls how the f low template is construct ...
-
Sun Microsystems 10GBE XFP - page 69
Chapter 5 Configuring the nxge Device Driver P arameters 51 3. T o set a particular variable, use the /usr/local/bin/nxge_config if_name set param_name value : T uning for Maximum Performance on a Linux Platform The following tunings will improve the performance of the Sun x8 Express Dual 10 Gigabit Ethernet device driver on a system running the Li ...
-
Sun Microsystems 10GBE XFP - page 70
52 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 2. Set up the sysctl utility . # sysctl -p /etc/sysctl_nxge.conf ...
-
Sun Microsystems 10GBE XFP - page 71
53 CHAPTER 6 Conf iguring the Jumbo Frames Featur e This chapter describes how to configure the Jumbo Frames featur e. It contains the following sections: ■ “Jumbo Frames Overview” on page 53 ■ “Checking Jumbo Frames Configurations” on page 53 ■ “Enabling Jumbo Frames in a Solaris Environment” on page 55 ■ “Enabling Jumbo Fram ...
-
Sun Microsystems 10GBE XFP - page 72
54 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ▼ T o Show the Driver Statistics in a Solaris Envir onment 1. Use the kstat command to display driver statistics, for example: The previous example diplays the receive packet counts on all of the eight Receive DMA channels on interface 1. Using the kstat nxge:1 shows all the s ...
-
Sun Microsystems 10GBE XFP - page 73
Chapter 6 Configuring the Jumbo F rames Feature 55 2. Use the kstat command to display driver statistics of a VLAN interface, for example:. Enabling Jumbo Frames in a Solaris Envir onment This section describes how to enable jumbo frames in both a SP ARC and an x86 environment. # kstat nxge:38001 module: nxge instance: 38001 name: nxge38001 class: ...
-
Sun Microsystems 10GBE XFP - page 74
56 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ▼ T o Enable Jumbo Frames in a Solaris Envir onment Using nxge.conf 1. Enable Jumbo Frames for a port using the nxge.conf f ile. For example, 2. Reboot the system: 3. Set the maximum MTU for maximum performance: ▼ T o Check Layer 2 Conf iguration ● V iew the maximum transm ...
-
Sun Microsystems 10GBE XFP - page 75
Chapter 6 Configuring the Jumbo F rames Feature 57 ▼ T o Check Layer 3 Conf iguration ● Check the Layer 3 conf iguration by using the dladm command with the show-link option, as shown in the following example: Enabling Jumbo Frames in a Linux Envir onment This section describes how to enable jumbo frames in a Linux environment. ▼ T o Enable J ...
-
Sun Microsystems 10GBE XFP - page 76
58 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 3. Set the MTU for maximum performance: Where x is the instance number of the interface you want to configur e jumbo frames on. ▼ T o Show the Driver Statistics in a Linux Envir onment 1. Use the ifconfig utility to display driver statistics, for example: 2. Use the ethtool ut ...
-
Sun Microsystems 10GBE XFP - page 77
Chapter 6 Configuring the Jumbo F rames Feature 59 3. T o get more specif ic statitics, use the grep command on the output of ethtool -S: # ethtool -S eth9 |grep tx_pac tx_packets: 8645339 tx_packets: 3418334 tx_packets: 26 tx_packets: 0 tx_packets: 22 tx_packets: 401791 tx_packets: 1466540 tx_packets: 0 tx_packets: 21 tx_packets: 725 tx_packets: 3 ...
-
Sun Microsystems 10GBE XFP - page 78
60 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ...
-
Sun Microsystems 10GBE XFP - page 79
61 CHAPTER 7 Conf iguring Link Aggregation This chapter describes how to configure link aggr egation. It contains the following sections: ■ “Overview of Link Aggregation” on page 61 ■ “Configuring Link Aggregation in a Linux Environment” on page 64 Overview of Link Aggr egation Link Aggregation allows one or more network links to be agg ...
-
Sun Microsystems 10GBE XFP - page 80
62 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ▼ T o Conf igure Link Aggr egation in a Solaris Envir onment 1. Aggregate nxge0 and nxge1 to form an aggregation and a random number 33 as key . a. Unplumb the interfaces to be aggregated: b. Create a link-aggregation group with key 33 without specifying mode: As the command r ...
-
Sun Microsystems 10GBE XFP - page 81
Chapter 7 Configuring Link Aggregation 63 2. Plumb up the interface aggr key , which is aggr33 is this case: 3. Show link-aggregation status again, and now the state should become attached: 4. Use the dladm show-aggr -s command to display statistics: # ifconfig aggr33 plumb # ifconfig aggr33 aggr33: flags=1000842<BROADCAST,RUNNING,MULTICAST,IPv4 ...
-
Sun Microsystems 10GBE XFP - page 82
64 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 5. Use the dladm show-aggr -L command to display LACP specif ic information: For more information r efer to the man pages for dladm , man dladm . Conf iguring Link Aggregation in a Linux Envir onment This section explains how to configure link aggr egation in a Linux environment ...
-
Sun Microsystems 10GBE XFP - page 83
Chapter 7 Configuring Link Aggregation 65 3. Conf igure bond0 interface. In this example, bond0 is the master of the two interfaces eth4 and eth5. # ip addr add 192.12.38.64/24 brd + dev bond0 # ip link set dev bond0 up # ifenslave bond0 eth4 eth5 ...
-
Sun Microsystems 10GBE XFP - page 84
66 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ...
-
Sun Microsystems 10GBE XFP - page 85
67 CHAPTER 8 Conf iguring VLANs This chapter explains V irtual Local Area Networks (VLANs) in detail and pr ovides configuration instructions and examples. It contains the following sections: ■ “Overview of VLANs” on page 67 ■ “Configuring VLANs in a Solaris Environment” on page 69 ■ “Configuring VLANs in a Linux Environment” on p ...
-
Sun Microsystems 10GBE XFP - page 86
68 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 FIGURE 8-1 Example of Servers Supporting Multiple VLANs W ith T agging Adapters The example network has the following features: The physical LAN network consists of a switch, two servers, and five clients. The LAN is logically organized into thr ee differ ent VLANs, each represe ...
-
Sun Microsystems 10GBE XFP - page 87
Chapter 8 Configuring VLANs 69 The Main Server is a heavily used server that needs to be accessed from all VLANs and IP subnets. The server has a Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Prof ile Adapter installed. All three IP subnets are accessed by means of the single physical adapter interface. The server is attached to one of the ...
-
Sun Microsystems 10GBE XFP - page 88
70 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 T agging an Ethernet frame requires the addition of a tag header to the frame. The header is inserted immediately following the destination MAC address and the Source MAC addr ess. The tag header consists of two bytes of Ethernet T ag Protocol identifier (TPID, 0x8100) and two b ...
-
Sun Microsystems 10GBE XFP - page 89
Chapter 8 Configuring VLANs 71 2. Use the ifconfig(1M) to conf igure a VLAN virtual device, for example: The output of ifconfig -a on a system having VLAN devices nxge123000 and nxge224000 : 3. On the switch, set VLAN tagging and set VLAN ports to coincide with the VLANs you’ve set up on the server . Using the examples in Step 2 , you would set u ...
-
Sun Microsystems 10GBE XFP - page 90
72 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 2. Plumb the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Prof ile Adapter interface: where xxx.xxx.xx.xxx = the IP addr ess of the interface. 3. Insert the VLAN module: 4. Add the VLAN instance (VID): 5. Conf igure the nxge VLAN ( eth2 in this example): where xxx.xxx.x ...
-
Sun Microsystems 10GBE XFP - page 91
73 APPENDIX A Specif ications This appendix lists the specif ications for the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Prof ile Adapter. It contains the following sections: ■ “Connectors” on page 73 ■ “Performance Specifications” on page 74 ■ “Physical Characteristics” on page 75 ■ “Power Requirements” on page 7 ...
-
Sun Microsystems 10GBE XFP - page 92
74 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 T ABLE A-1 lists the characteristics of the f iber connectors used by the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Prof ile Adapter. Performance Specif ications T ABLE A-1 XFP Connector Characteristics Parameter Description Connector type LC Distance 10GBase-SR: Dep ...
-
Sun Microsystems 10GBE XFP - page 93
Appendix A Specifications 75 Physical Characteristics Power Requir ements T ABLE A-3 Physical Characteristics Dimension Measurement Length 167.65 mm (6.6 inches) W idth 68.90 mm (2.713 inches) Height Component side = 14.48 mm (0.57 inches) maximum Solder side = 2.67 mm (0.105 inches) maximum T ABLE A-4 Low-Prof ile Power Requirements Specification ...
-
Sun Microsystems 10GBE XFP - page 94
76 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ...
-
Sun Microsystems 10GBE XFP - page 95
77 APPENDIX B Diagnostic Softwar e This appendix provides an overview of the SunVTS diagnostic application and instructions for updating the SunVTS software to r ecognize the adapter . This appendix contains the following sections: ■ “SunVTS Diagnostic Software” on page 77 ■ “Updating SunVTS to Recognize the Adapter” on page 78 ■ “U ...
-
Sun Microsystems 10GBE XFP - page 96
78 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 http://www.sun.com/products-n-solutions/hardware/docs/Software /system_administration/tools/testing_valid/sunvts/index.html Select the document for the Solaris release on your system. Updating SunVTS to Recognize the Adapter Use SunVTS 6.3 or later . Y ou will need to update the ...
-
Sun Microsystems 10GBE XFP - page 97
Appendix B Diagnostic Software 79 Using the SunVTS netlbtest Y ou must have the Ethernet card and the device driver installed, a loopback connector in place, and Intervention mode enabled before running netlbtest . netlbtest cannot run if the network interface is connected to a live network, and requir es that the Ethernet device be configur ed off ...
-
Sun Microsystems 10GBE XFP - page 98
80 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009 ...
-
Sun Microsystems 10GBE XFP - page 99
81 Index Symbols /etc/hostname.nxge number f ile ,2 4 A assigning an IP address, 24 C configuring the network host files, 23 configuring VLANs, 69 D diskless clients, 25 documentation SunVTS, 78 E editing the network host files, xiii, 23 H hardwar e components, 1 requir ements, 2 I ifconfig -a, 71 ifconfig command, 24 installing the adapter w ...
-
Sun Microsystems 10GBE XFP - page 100
82 Sun Dual 10GbE XFP PCI Express Card User’ s Guide • J anuar y 2009 ...
Do you have a question concerning Sun Microsystems 10GBE XFP?
Use the form below
If you did not solve your problem by using a manual Sun Microsystems 10GBE XFP, ask a question using the form below. If a user had a similar problem with Sun Microsystems 10GBE XFP it is likely that he will want to share the way to solve it.